Senior Data Engineer
Simple Machines6 months ago
London, United KingdomSenior
Responsibilities
- Own the end-to-end architecture and technical direction of modern, cloud-native data platforms.
- Design data mesh architectures, data products, data contracts, and scalable data ecosystems.
- Build and operate greenfield batch, real-time, streaming, and event-driven data pipelines.
- Develop and optimize large-scale data processing, storage, and access patterns for production systems.
- Implement secure, compliant, governed data solutions with strong operational and data-quality practices.
- Work directly with clients to translate business needs into pragmatic engineering solutions.
- Set engineering standards, review designs and code, mentor engineers, and influence technical culture.
Requirements
- Strong Python and SQL skills.
- Deep experience with Spark and modern data platforms such as Databricks and Snowflake.
- Solid experience with cloud data services on AWS or GCP.
- Demonstrated ownership of large-scale data-platform architectures and production data pipelines.
- Strong data modeling, architectural judgment, and ability to balance performance, cost, and complexity.
- Experience with multiple storage technologies and data formats.
- Infrastructure-as-code experience with Terraform or Pulumi.
- Experience building CI/CD pipelines using tools such as GitHub Actions or ArgoCD.
- Experience with data testing and quality frameworks such as dbt, Great Expectations, or Soda.
- Consulting or professional-services experience, with the ability to advise clients, challenge assumptions, and mentor senior engineers.
Benefits
- Work on interesting, high-impact data and technology problems.
- Build modern platforms rather than maintaining legacy systems.
- Collaborate with experienced senior engineers and have autonomy, influence, and room to grow.
- Hybrid workplace in London, United Kingdom.
Tech Stack
Apache AirflowApache CassandraApache FlinkApache KafkaApache SparkAWSDatabricksdbtGitHub ActionsGoogle BigQueryGoogle Cloud PlatformMongoDBPostgreSQLPythonSnowflakeSQLTerraform
Categories
Data Engineering
About Simple Machines
Simple Machines is a privately held consulting and engineering firm that designs and builds data platforms, machine-learning/AI systems, and bespoke software for enterprises and public-sector clients. The company provides architecture, data engineering, and scalable distributed systems expertise across AWS, GCP, Azure, Databricks, Snowflake, and Confluent. Founded in 2008 and headquartered in Sydney, it operates globally with teams in Australia, the UK, Europe, and New Zealand.