7 months ago
London, United KingdomSenior
Responsibilities
- Build, operate, and scale distributed analytics platforms across on-premises and AWS environments.
- Design and implement platform features that improve usability, scalability, and developer experience.
- Collaborate with research, data, and engineering teams to accelerate time-to-insight through modern analytics solutions.
- Improve automation, observability, resilience, security, and performance across analytics services.
- Evaluate and adopt emerging technologies including AI assistants, data mesh, and cloud-native analytics solutions.
- Define SLAs, KPIs, and monitoring strategies for reliability and service excellence.
- Participate in the out-of-hours rota to support critical systems.
Requirements
- Experience running distributed data and analytics systems at scale using Spark, Kafka, Trino, or Airflow.
- Strong Linux skills and proficiency in Python for automation and integration.
- Familiarity with infrastructure as code using Terraform or Ansible.
- Deep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue, and MWAA.
- Experience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana, and OpenTelemetry.
- Strong problem-solving skills and a systematic approach to diagnosing and resolving issues.
- Experience with Flink, Kafka Streams, and Kafka Connect is highly desirable.
- Knowledge of Delta Lake, Iceberg, and Glue Data Catalog is highly desirable.
- Exposure to DataOps practices and collaboration with Data Engineering teams is highly desirable.
- Familiarity with GPU-accelerated analytics using Spark with GPUs or RAPIDS is highly desirable.
- Programming experience with Java, Scala, C#, Python, or Go is desirable.
Benefits
- Highly competitive compensation plus an annual discretionary bonus.
- Lunch provided via Just Eat for Business and a dedicated barista bar.
- 35 days' annual leave.
- 9% company pension contributions.
- Informal dress code and excellent work/life balance.
- Comprehensive healthcare and life assurance.
- Cycle-to-work scheme.
- Monthly company events.
- The role is based from the London headquarters and includes an out-of-hours support rota.
Tech Stack
Amazon RedshiftAnsibleApache AirflowApache FlinkApache KafkaApache SparkAWSC#ClickHouseGoGrafanaJavaJenkinsLinuxPrometheusPythonScalaTerraform
Categories
Data EngineeringDevOps
