Senior Data Engineer
Solirius Reply6 months ago
London, United KingdomSenior
Responsibilities
- Develop data engineering solutions for client projects.
- Design and build data models and schemas to support business requirements.
- Develop and maintain data ingestion and processing systems using SQL, NoSQL, ETL tools, Luigi, Airflow, and Argo.
- Implement relational, non-relational, and cloud-based data storage solutions.
- Collaborate with clients and cross-functional teams to identify and address data-related issues and opportunities.
- Define processes for operational excellence and ensure data quality across projects and clients.
- Define and manage SLAs for production data sets and processes.
- Lead the design, build, and launch of new data models and pipelines.
- Prepare data for predictive and prescriptive modelling and support data acquisition and dataset development.
- Provide line or team management and technical leadership.
Requirements
- Experience working independently and as part of data engineering teams.
- Line or team management and leadership experience.
- Experience with cloud infrastructure; Azure or AWS required, with GCP beneficial.
- Experience with SQL and relational databases such as MS SQL, Azure SQL, or PostgreSQL.
- Framework experience with Flask, Tornado, or Django, plus Docker experience.
- Experience with ETL pipelines using tools such as Luigi, Airflow, or Argo is desirable.
- Experience with big data technologies such as Apache Spark, Hadoop, or Kafka.
- Hands-on coding experience, such as Python.
- Experience with reporting tools such as Tableau, Power BI, or Qlik.
- Data architecture experience and experience improving data quality.
- GDPR and Government Service Standard experience is desirable.
- Experience working in an Agile development environment.
- Strong communication, analytical, collaborative, consultative, and client-engagement skills.
Benefits
- Hybrid and flexible working.
- Full-time employment.
- Competitive salary and bonus scheme.
- Private healthcare insurance.
- 25 days of annual leave plus bank holidays.
- Up to 10 days of development training per year.
- Enhanced parental leave and five days of paid fertility leave.
- Contributory pension and EAP with Help@Hand.
- Gym membership benefits and flexible benefits allowance.
- Cycle to Work and Electric Vehicle schemes.
- Annual away days and company socials.
Tech Stack
Apache AirflowApache HadoopApache KafkaApache SparkArgo CDAWSAzureDjangoDockerFlaskGoogle Cloud PlatformPostgreSQLPythonSQL
Categories
Data Engineering
About Solirius Reply
Solirius Reply is a London-headquartered technology consultancy and digital transformation partner that delivers strategy, design, engineering, and delivery services for public, private, and third-sector organisations. Founded in 2007 and now part of Reply Group, it focuses on user-centred design, AI and data transformation, and technology and business consulting. The firm builds and modernises digital services, from discovery through implementation and support.