Responsibilities
- Design and operate scalable production cloud infrastructure for ML workloads across AWS and GCP, including GPU- and TPU-based training and inference environments.
- Architect and improve CI/CD systems for ML models and platform services.
- Own and evolve low-latency infrastructure for real-time model inference, including KV stores and vector databases.
- Define observability standards covering model performance, drift detection, capacity planning, and pipeline health.
- Participate in on-call rotation and lead incident response and root-cause analysis for critical ML infrastructure.
- Partner with data scientists and ML engineers to improve platform usability and accelerate model iteration.
- Drive automation, resilience engineering, disaster recovery planning, and continuous improvement across ML infrastructure.
Requirements
- BS or MS in Computer Science, Engineering, or a related quantitative field.
- 8+ years of experience in DevOps, SRE, or ML infrastructure, including 4+ years supporting large-scale ML or AI systems.
- Strong programming skills in Python and/or Scala or Java.
- Deep experience with Kubernetes and container orchestration on GCP using GKE and/or AWS using EKS.
- Expertise with NoSQL or low-latency data stores such as Aerospike or similar technologies.
- Hands-on experience with Apache Spark, Apache Flink, Apache Airflow, and Kafka.
- Experience building and maintaining CI/CD systems using Jenkins or GitLab Runner.
- Familiarity with Chronon and MLflow.
- Strong infrastructure-as-code experience with Terraform or similar tooling.
- Experience with Prometheus, Grafana, and Datadog.
- Excellent communication and cross-functional collaboration skills.
Benefits
- Hybrid schedule with office work Monday through Thursday and flexible remote work on Fridays, subject to role and office policy.
- Healthcare options may include medical, dental, and vision coverage, plus life, accident, disability, commuter, and retirement benefits such as 401(k) or pension.
- Global mental health and financial wellness support and resources.
- Paid time off in accordance with local leave policies and personal needs.
Tech Stack
Categories
About Roku
With the #1 platform for streaming television in the U.S., Roku wants to revolutionize the way the world watches TV. Our Roku-branded TVs, Roku TV models, Smart Home system, streaming players, audio equipment, and the purpose-built operating system that powers it all can turn any home into a home theater, with seamless integration of hardware and software. Our commitment to our users extends to our brand studio, which creates innovative Roku Originals exclusively for The Roku Channel, a free channel that reaches approximately 80 million households in the U.S. and Mexico. Join us and you'll have the chance to delight millions of TV streamers around the world while gaining meaningful experience across a variety of disciplines. Be a part of shaping the future of streaming at weareroku.com.