Data Engineering
SLR Consulting2 months ago
London, United KingdomSenior
Responsibilities
- Design, build, maintain, and improve production data pipelines for large-scale financial, climate, and ESG datasets.
- Ensure data pipelines are efficient, reliable, and capable of processing terabytes of data.
- Integrate advanced economic models into production environments with the Climate Risk modeling team.
- Use automation and deployment tools to support rapid iteration and reliable delivery.
- Apply coding, testing, documentation, code review, version control, build, and deployment best practices.
- Collaborate with data scientists, analysts, and other stakeholders on cross-functional initiatives.
Requirements
- Degree in computer science, engineering, mathematics, quantitative methods, or a related field.
- Substantial experience developing and maintaining production-level data pipelines.
- Strong Python programming skills and experience writing clean, efficient, production-ready code.
- Strong SQL expertise and experience with relational databases such as PostgreSQL or Snowflake.
- Substantial experience with AWS products including EC2, ECS, Lambda, and RDS.
- Familiarity with Dagster or willingness to learn data orchestration technologies.
- Familiarity with DBT or similar data transformation tools, or willingness to learn.
- Experience with containerization such as Docker, shell scripting, and continuous integration and continuous deployment pipelines.
- Knowledge of software engineering best practices across the development lifecycle.
- Excellent written and verbal communication skills and a commitment to creating positive environmental value.
Benefits
- Collaborative and supportive environment focused on professional development.
- Inclusive equal-opportunity workplace with employee networks and regional and global inclusion initiatives.
- Work with a global sustainability consultancy serving clients across more than 125 countries.
Tech Stack
Categories
Data Engineering