Lead Data Engineer
Scott Logic4 months ago
Bristol, United KingdomStaff+
Responsibilities
- Build data platforms, pipelines, data lakes, warehouses, and integrated data models.
- Extract or access operational data and transform it into analytical datasets for reporting, business insight, data science, and ML model training.
- Design and build well-structured, maintainable systems using a strong software engineering approach.
- Advise clients, solve complex engineering challenges, and potentially lead teams or set technical direction.
- Work on-site with clients in the London area on an ad-hoc basis.
Requirements
- Good experience with modern data engineering and reporting, including data storage, ingestion and transformation pipelines, and analytical querying and reporting.
- Experience with technologies such as Python, Spark, SQL, PySpark, and Power BI.
- A software engineering background, including experience with frontend technologies such as JavaScript.
- Understanding of how to design and build well-structured, maintainable systems.
- Strong communication skills and a collaborative approach.
- Eligibility for SC clearance.
- Preferred experience with AWS, Azure, or GCP cloud services.
- Preferred experience with Snowflake, Databricks, and CI/CD tooling.
- Experience working in an Agile environment is desirable.
Benefits
- 25 days of annual leave, rising to 30 days with each year of service.
- Generous family leave policies.
- Employer pension scheme, private medical services, and Group Life Assurance.
- Optional benefits including discounted gym membership and a cycle-to-work scheme.
- Remote-working flexibility alongside office and client collaboration.
- Employee-led clubs and events, free games, books, and refreshments in the offices.
Tech Stack
Categories
Data Engineering
About Scott Logic
Scott Logic is a UK software consultancy that designs and builds bespoke applications, data platforms, and UX for enterprise clients in capital markets, commodities, and the public sector. The privately held firm, founded in 2005 and headquartered in Newcastle upon Tyne, delivers services spanning architecture, testing, data engineering, and AI. Its business model is project-based consulting and managed delivery for complex, large-scale systems across regulated industries.