Senior Software Development Engineer in Test, ML

9 days ago

Madison, WI, USASenior

H1B sponsor

Base Salary

$152k - $190k/yr

Responsibilities

Drive architecture-level automation solutions and scalable quality engineering practices across multiple teams and product areas.
Design, develop, and maintain automated test frameworks and scripts for ML inference services and ML platform components.
Create representative test accounts and datasets to evaluate model behavior across scenarios.
Validate score distributions, ranking behavior, output quality, and other model signals before release.
Perform functional, integration, regression, API, performance, and load testing for distributed inference services.
Ensure features and bug fixes include automated test coverage in partnership with ML engineering and operations teams.
Debug test failures and model anomalies, report defects, and improve test-environment performance.
Establish scalable, maintainable test-automation practices and quality strategies.

Bachelor’s degree in Computer Science or a related field.
At least 5 years of experience as an SDET with strong backend-system testing experience.
Proficiency in Python, Java, Scala, or Go for test automation.
Hands-on experience with API testing tools such as Postman and with automated test frameworks such as pytest, JUnit, or TestNG.
Experience with databases, cloud and container technologies, monitoring and observability tools, and Jenkins or comparable environments.
Preferred experience testing recommendation systems, search-ranking systems, or other probabilistic ML applications.
Preferred experience creating synthetic or seeded test data and evaluating model outputs with statistical or distribution-based techniques.
Knowledge of data pipelines, feature stores, inference systems, model-serving infrastructure, Databricks, performance testing, and CI/CD quality gates is preferred.
Strong problem-solving, communication, software development lifecycle, and agile-methodology knowledge.

Medical, dental, and vision coverage.
Matching 401(k), paid time off, wellness program, and employee discounts on Sony products.
The role may be eligible for a bonus package.
The role is located in Madison, Wisconsin or Waterloo, Ontario, with base pay varying according to Sony’s hybrid working policy and location.
Sony conducts background checks at the offer stage for new employees.

AWSDatabricksDatadogDockerGitHub ActionsGo Google Cloud PlatformGrafanaJavaJenkinsJUnitKubernetesPostmanPrometheuspytestPythonScalaTestNG