Software Development Engineer in Test, ML/AI
PlayStation Globalabout 2 hours ago
San Mateo, CA, USAMid Level / Senior
Base Salary
$141k - $211k/yr
Responsibilities
- Define and complete quality strategies, test plans, and automation coverage for ML-powered services.
- Use LLMs and AI-assisted techniques to generate and maintain high-value test cases.
- Design scenario-based test suites for AI features, including edge cases and ambiguous inputs.
- Lead QE efforts for multi-functional projects, managing risk and release readiness.
- Develop and maintain scalable automation frameworks for backend services and ML inference systems.
- Build automated validation for ML outputs, including ranking behavior and prompt quality.
- Debug test failures and service anomalies to identify root causes.
- Perform various testing types for distributed systems.
- Improve automation reliability and optimize execution efficiency.
- Integrate automated testing into CI/CD pipelines and release workflows.
- Establish scalable quality standards and guidelines across teams.
Requirements
- Bachelor’s degree in Computer Science or equivalent experience.
- 3+ years of experience as an SDET or QE engineer focused on backend systems.
- Experience using LLMs for test case generation for AI-powered experiences.
- Familiarity with AI evaluation tooling and model monitoring.
- Strong experience testing RESTful APIs and distributed architectures.
- Proficiency in Python, Java, or similar languages for automation.
- Hands-on experience with automation frameworks like pytest or Selenium.
- Experience with CI/CD systems and test pipelines.
- Familiarity with cloud and container technologies like AWS or Docker.
- Strong understanding of SDLC and Agile methodologies.
- Excellent problem-solving and communication skills.
Benefits
- Top-tier benefits package including medical, dental, and vision.
- Matching 401(k) plan.
- Paid time off and wellness program.
- Employee discounts for Sony products.
- Potential eligibility for a bonus package.
Tech Stack
AppiumAWSCypressDatabricksDockerGitHub ActionsGoogle Cloud PlatformJavaJavaScriptJenkinsJUnitKubernetesNode.jspytestPythonReactSelenium