1 day ago
Responsibilities
- Design and evolve high-performance training platform components for orchestration, scheduling, training abstractions, control planes, observability, and performance tuning.
- Deliver end-to-end ML model pipelines covering log processing, feature extraction, dataset schema design and storage, model configuration, training, and profiling or acceleration workflows.
- Analyze infrastructure performance and resolve bottlenecks across the technology stack.
- Optimize distributed training throughput using topology-aware frameworks and hardware technologies such as InfiniBand, NVLink, and NCCL.
- Develop abstractions and tooling that help machine learning engineers iterate rapidly and independently profile and optimize workflows.
- Provide long-term technical direction across ML Platform, Infrastructure, Autonomy, and Safety Evaluation teams.
- Set and promote a culture of engineering excellence.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 8+ years of experience with ML platforms and building ML-based applications; modeling experience is a bonus.
- Proven experience optimizing training with state-of-the-art distributed training paradigms.
- Experience productionizing large-scale data pipelines and data loaders for resource utilization and compute throughput.
- Strong programming skills in Python and experience with Lance, PyTorch, Ray, Spark, or equivalent technologies.
- Demonstrated ability to build scalable, reliable infrastructure and collaborate with MLEs across multiple modeling teams.
- Strong understanding of design tradeoffs and ability to align cross-functional teams.
- Strong analytical, problem-solving, verbal communication, and written communication skills.
- Autonomous vehicle experience is a bonus.
Tech Stack
Categories
About Stack AV
Stack AV builds autonomous driving software and integrated systems for commercial trucking, combining AI perception, planning, robotics, and cloud-based fleet operations. The company works with freight carriers and logistics operators to pilot and deploy autonomy-enabled trucking solutions and supporting services. Founded in 2023 and headquartered in Pittsburgh, PA, it is a privately held firm focused on long-haul and hub-to-hub routes.