Data Engineer
Solirius Reply7 months ago
London, United KingdomMid Level
Responsibilities
- Develop data engineering solutions for client projects.
- Design and build data models and schemas supporting business requirements.
- Develop and maintain data ingestion and processing systems using SQL, NoSQL, ETL tools, Luigi, Airflow, and Argo.
- Implement relational, non-relational, and cloud-based data storage solutions.
- Collaborate with clients and cross-functional teams to identify and address data-related issues and opportunities.
- Acquire data, develop datasets, improve data quality, and prepare data for predictive and prescriptive modelling.
- Work with reporting tools and stay current with modern data stack, big data, and cloud computing developments.
Requirements
- Experience working independently and as part of data engineering teams.
- Experience with cloud infrastructure, including Azure or AWS; GCP experience is beneficial.
- Experience with SQL and relational databases such as MS SQL, Azure SQL, and PostgreSQL.
- Experience with Flask, Tornado, or Django and Docker.
- Desirable experience with ETL pipelines and tools such as Luigi, Airflow, or Argo.
- Experience with big data technologies such as Apache Spark, Hadoop, and Kafka.
- Experience with reporting tools such as Tableau, Power BI, or Qlik.
- Desirable knowledge of GDPR and the Government Service Standard.
- Experience working in an Agile development environment, with strong communication, collaboration, and consultative skills.
Benefits
- Hybrid, flexible working arrangement in a full-time London role.
- Competitive salary and bonus scheme.
- Private healthcare insurance, contributory pension, EAP with Help@Hand, and gym membership benefits.
- 25 days of annual leave plus bank holidays.
- Up to 10 days of development training per year.
- Enhanced parental leave and five days of paid fertility leave.
- Flexible benefits allowance, Cycle to Work and Electric Vehicle schemes, and annual away days or company socials.
Tech Stack
Apache AirflowApache HadoopApache KafkaApache SparkArgo CDAWSAzureDjangoDockerFlaskGoogle Cloud PlatformPostgreSQLSQL
Categories
Data Engineering
About Solirius Reply
Solirius Reply is a London-headquartered technology consultancy and digital transformation partner that delivers strategy, design, engineering, and delivery services for public, private, and third-sector organisations. Founded in 2007 and now part of Reply Group, it focuses on user-centred design, AI and data transformation, and technology and business consulting. The firm builds and modernises digital services, from discovery through implementation and support.