3 months ago
Bengaluru, IndiaMid Level
H1B Sponsor
Responsibilities
- Design, build, and scale services that orchestrate Ray clusters across cloud and on-premises environments, including VM-based and Kubernetes-based deployments.
- Optimize control-plane components for large-scale distributed AI and machine learning workloads.
- Build intelligent scheduling and resource management systems for heterogeneous compute clusters.
- Improve the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads.
- Support and optimize accelerator integration, including GPUs and TPUs.
- Handle container image management and dependency resolution for distributed workloads.
- Participate in code reviews and design and architecture discussions.
- Provide on-call support and collaborate with customer and field teams to troubleshoot infrastructure issues.
- Collaborate with distributed systems and machine learning experts on AI infrastructure.
Requirements
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
- 3+ years of experience writing high-quality production code.
- Hands-on experience building and maintaining highly available, scalable, and performant distributed systems.
- Expertise in AWS, Azure, GCP, and Kubernetes-based deployments.
- Deep understanding of networking, security, and authentication mechanisms in cloud environments.
- Familiarity with observability stacks such as Prometheus and Grafana.
- Proficiency in Go and Python.
- Knowledge of low-level operating system foundations, including the Linux kernel, file systems, and containers.
Tech Stack
About Anyscale
Anyscale enables Python developers to build and run all their AI—from data prep to training and inference—at any scale. Anyscale is trusted by leading AI teams at Canva, TripAdvisor, Physical Intelligence, Coinbase and more.