Base Salary
$141k - $361k/yr
Responsibilities
- Design and develop automated test frameworks for APIs and data pipelines.
- Containerize automated quality checks for complex orchestrated services.
- Use agentic AI workflows to author and maintain integration tests, triage failures, and debug production issues.
- Build retrieval and context pipelines grounded in code, schemas, telemetry, and business logic.
- Implement tool-calling and MCP-style integrations with test runners, CI, ticketing, logs, and data services.
- Build and maintain CI/CD workflows and infrastructure as code using Terraform or CloudFormation.
- Establish evaluation, observability, and monitoring for test reliability, flake rate, triage time, agent success rate, latency, and cost.
- Build controlled rollouts, drift detection, and safeguards for production agent workflows.
- Create reusable testing templates and paved-path patterns in partnership with development, data engineering, and product teams.
Requirements
- At least 5 years of experience in software testing and automation, software engineering, or adjacent domains.
- Strong software engineering fundamentals and the ability to build production-grade systems.
- Expertise in Python or Java and familiarity with the other; C/C++ or another systems language is a plus.
- Experience designing test plans, test cases, and automated frameworks for APIs, services, and data pipelines.
- Hands-on experience with LLM-based systems, prompt design, retrieval, tool use, memory handling, and agent orchestration.
- Experience building retrieval and context pipelines, agent frameworks, and MCP servers or equivalent function-calling architectures.
- Experience with CI/CD tooling such as GitLab runners, GitHub Actions, Jenkins, or Travis CI.
- Experience with AWS, GCP, or Azure; Docker and Kubernetes; and REST APIs.
- Experience with Terraform or CloudFormation for infrastructure as code.
- Working knowledge of Linux and Bash scripting.
- Experience with observability, evaluation, experimentation, feedback loops, and monitoring for AI systems in production.
- Bachelor's or master's degree in a listed technical field or equivalent engineering experience.
- Strong analytical, problem-solving, communication, collaboration, independence, and engineering judgment skills.
Benefits
- Estimated California annual base salary of $141,300–$360,700.
- Health insurance, healthcare options including medical, dental, and vision, life insurance, disability benefits, parental leave, wellness benefits, mental health and financial wellness resources, commuter benefits, retirement options, and paid time off.
- Hybrid work generally involves working in the office Monday through Thursday, with Fridays generally flexible for remote work.
- Additional local statutory and voluntary benefits may vary by location and role.
Tech Stack
Categories
About Roku
With the #1 platform for streaming television in the U.S., Roku wants to revolutionize the way the world watches TV. Our Roku-branded TVs, Roku TV models, Smart Home system, streaming players, audio equipment, and the purpose-built operating system that powers it all can turn any home into a home theater, with seamless integration of hardware and software. Our commitment to our users extends to our brand studio, which creates innovative Roku Originals exclusively for The Roku Channel, a free channel that reaches approximately 80 million households in the U.S. and Mexico. Join us and you'll have the chance to delight millions of TV streamers around the world while gaining meaningful experience across a variety of disciplines. Be a part of shaping the future of streaming at weareroku.com.