Senior Software Development Engineer In Test, ML/AI

about 2 hours ago

San Mateo, CA, USASenior

Base Salary

$183k - $275k/yr

Responsibilities

Define and complete quality strategies, test plans, and automation coverage for ML-powered services.
Use LLMs and AI-assisted techniques to generate and maintain high-value test cases.
Design scenario-based test suites for AI features, including edge cases and ambiguous inputs.
Lead QE efforts for multi-functional projects, managing risk and release readiness.
Design, develop, and maintain scalable automation frameworks using Python and/or Java.
Build automated validation for ML and LLM outputs, including quality and behavior assessments.
Debug test failures and service anomalies to identify root causes.
Perform various testing types for distributed systems, including functional and performance testing.
Improve automation reliability and optimize execution efficiency.
Collaborate with engineering and ML teams to integrate automated testing into CI/CD pipelines.

Bachelor’s degree in Computer Science or equivalent.
5+ years of experience as an SDET or QE engineer focused on backend and distributed systems.
Experience using LLMs to generate and prioritize test cases for AI-powered experiences.
Strong experience testing RESTful APIs, microservices, and distributed architectures.
Proficiency in Python, Java, JS or similar languages for automation development.
Hands-on experience with automation frameworks such as pytest, JUnit, or Selenium.
Experience with CI/CD systems and test pipelines like Jenkins or GitHub Actions.
Experience with cloud and container technologies such as AWS or Docker.
Strong understanding of SDLC, Agile methodologies, and release processes.
Excellent problem-solving, debugging, and communication skills.