Staff Software Engineer in Test (Modeling and Simulation)
Code Metal3 days ago
Base Salary
$145k - $185k/yr
Responsibilities
- Translate Quality Engineering strategy into risk-based validation across unit, integration, contract, end-to-end, performance, resilience, and security-critical workflows.
- Build test infrastructure with deterministic fixtures, isolated test data, service and event-contract tests, integration harnesses, versioned reference scenarios, deterministic replay, and browser automation.
- Improve CI feedback through test partitioning, parallel execution, caching, failure attribution, and flaky-test control.
- Write behavior-focused tests for planning, sensing, simulation, authorization, state-transition, and recovery workflows.
- Create reusable reference scenarios, regression baselines, characterization or differential tests, and reproducible quality evidence with simulation and model owners.
- Define validation and release criteria for simulation and AI-assisted workflows using deterministic checks, statistical or model-based evaluation, failure-recovery testing, and human oversight.
- Establish measurable performance and reliability validation and release evidence.
- Participate in design and code reviews, identify testability risks, mentor engineers, and lead multi-team quality initiatives through influence.
- Turn Modeling & Simulation lessons into reusable quality standards, reporting practices, quality bars, and validation infrastructure.
Requirements
- Significant experience as an SDET, test-infrastructure engineer, quality architect, or software engineer responsible for automated production-system validation.
- Strong production programming skills in Python.
- Deep experience building Python test infrastructure with pytest or comparable frameworks, including asynchronous testing, fixtures and factories, parallel execution, and CI integration.
- Experience designing risk-based test strategies across multiple layers of distributed systems.
- Experience validating partially nondeterministic systems such as simulations, statistical models, ML, or AI-assisted workflows.
- Hands-on experience testing Docker-based or comparable containerized multi-service applications involving APIs, databases, messaging, authentication, authorization, and data isolation.
- Experience improving CI workflows with GitHub Actions or a comparable platform, including test isolation, failure diagnosis, and flaky-test control.
- Ability to set technical direction, write design documents, mentor engineers, and lead multi-team initiatives through influence.
- Preferred: experience validating simulation, geospatial, event-driven, or stateful systems; testing or debugging C++ simulation or systems code; and testing TypeScript and React applications with Playwright or equivalent tools.
- Preferred: experience with performance testing, generated test data, API or schema validation, cloud-based containerized systems, logs, metrics, traces, and retained test artifacts.
- Preferred: familiarity with constructive simulation, distributed simulation standards, mission-analysis software, AI-assisted or agentic systems, AI coding assistants, regulated or mission-critical domains, and eligibility to obtain and maintain a U.S. Secret security clearance.
Benefits
- Health care plan with 100% premium coverage, including medical, dental, and vision.
- 401k with 5% matching.
- Uncapped vacation, sick leave, and public holidays.
- Flexible hybrid or remote work arrangement.
- Relocation assistance for qualifying employees.
About Code Metal
Code Metal builds an AI-assisted code transpilation and verification platform that translates algorithms into optimized implementations for heterogeneous hardware (GPUs, FPGAs, ASICs, and edge SoCs). It serves defense, automotive, aerospace, and semiconductor teams deploying DSP, RF, communications, and embedded signal-processing workloads to constrained devices. Privately held and founded in 2023, the company is headquartered in Boston, MA.