11 hours ago
London, United KingdomSenior
Responsibilities
- Design, build, and evolve scalable data pipeline and orchestration infrastructure for autonomous driving data platforms.
- Revamp the existing Harness system and develop a new DAG-based workflow platform.
- Build tooling and libraries for reliable data ingestion, processing, inference, and evaluation workflows.
- Enable hundreds of parallel pipeline steps with correct outputs, conflict prevention, and effective resource prioritization.
- Support batch inference and performance optimization workflows at scale.
- Improve platform reliability, quality, usability, and incident response workflows aligned with business-defined SLOs.
- Collaborate with partner teams to provide infrastructure that supports their pipeline requirements.
Requirements
- 7+ years of professional experience in software engineering or a related technical field.
- Strong software engineering fundamentals and experience designing, building, and maintaining production-grade systems.
- Solid Python programming skills.
- Understanding of unit testing, integration testing, test-driven development, and data-driven development.
- Experience with distributed systems, large data volumes, or high-throughput processing.
- Familiarity with distributed event streaming platforms such as Apache Kafka.
- Understanding of database principles, consistency models, and distributed data systems.
- Familiarity with traditional databases or data warehouses such as Postgres and ClickHouse.
- Preferred experience in data engineering, data platforms, workflow orchestration, pipeline infrastructure, machine learning infrastructure, inference systems, batch processing, compute scheduling, resource prioritization, shared libraries, developer tooling, or internal platforms.
- Preferred experience with Ray, Flyte, or Spark.
Benefits
- Inclusive interview accommodations and adjustments are available upon request.
- The role is based in London.
Tech Stack
Categories
Data EngineeringDevOps
About Wayve
Wayve builds end-to-end autonomous driving software—the vehicle-agnostic Wayve AI Driver—that runs on onboard compute and native sensors, licensed to automakers and fleet operators. Its platform spans ADAS and higher autonomy (L2+/L3 to robotaxi) and is designed to generalize across vehicle types and geographies. Founded in 2017 and headquartered in London, it tests its models across Europe, North America, and Japan, with a U.S. base in Sunnyvale, CA.