6 hours ago
Base Salary
$240k - $270k/yr
Responsibilities
- Design, build, and improve Ray Data systems with a focus on performance, scalability, and reliability.
- Design and optimize distributed execution across data-pipeline stages and heterogeneous environments.
- Build data loading and processing solutions for production training and inference workloads.
- Solve problems involving scheduling, resource management, data partitioning, fault tolerance, distributed execution, and performance optimization.
- Make system-level architectural decisions involving resource allocation, execution models, batch versus streaming workloads, and consistency versus availability.
- Work with customers and AI-native companies to address challenges in scaling AI workloads.
Requirements
- At least 6 years of experience building production-grade software, infrastructure, or developer-facing systems, with strong Python engineering experience.
- At least 6 years of personally owning core architectural decisions within a distributed data or compute engine.
- Deep experience with distributed-systems internals, including scheduling, fault tolerance, data partitioning, distributed execution, performance optimization, or database and query-engine internals.
- Demonstrated ability to reason through and defend system-level tradeoffs such as batch versus streaming and static versus dynamic resource allocation.
- Passion for solving large-scale AI infrastructure problems and building systems for next-generation AI applications.
Benefits
- Competitive salary and equity.
- Health, dental, and vision coverage, with many plans up to 99% employer-covered.
- Flexible time off, paid parental leave, and mental health support.
About Anyscale
Anyscale builds a cloud platform and tools to run Ray, the open-source framework for distributed Python and AI/ML workloads, enabling teams to scale data prep, training, and inference. It monetizes through a managed service, enterprise features, and support for Ray deployments. Founded in 2019 and headquartered in San Francisco, this privately held company is the commercial steward of Ray, widely used to power production AI systems.