SDET Contractor

1 day ago

Aliso Viejo, CA, USAMid Level

H1B sponsor

Responsibilities

Develop and execute quality engineering strategies and test plans for Agentic AI systems, backend services, APIs, and service integrations.
Design and maintain scalable automated frameworks for API, functional, integration, contract, regression, and end-to-end testing.
Develop evaluation approaches for non-deterministic AI behavior and assess accuracy, relevance, groundedness, consistency, guardrails, and failure handling.
Test multi-step AI workflows, tool selection and invocation, task completion, memory or state management, APIs, data sources, downstream services, and prompt-based attacks.
Integrate automated testing into CI/CD pipelines and establish quality gates, metrics, coverage, reliability, defect, and release-readiness reporting.
Investigate distributed-system failures, analyze defects and production issues, perform root-cause analysis, and participate in triage, regression testing, and release activities.
Partner with software engineers, product managers, and quality engineering teams to improve testability, observability, and product quality.

Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
4+ years of experience in SDET, Quality Engineering, Software Engineering, or a related discipline.
Strong experience testing REST APIs, backend services, microservices, distributed systems, service integrations, JSON, schemas, authentication, and error handling.
Hands-on automated test development using Python, Java, JavaScript, TypeScript, or a similar programming language.
Experience with functional, integration, regression, contract, and end-to-end testing and integrating tests into CI/CD pipelines.
Experience testing Generative AI, LLM-powered applications, or Agentic AI systems, including non-deterministic behavior and evaluation beyond exact-match assertions.
Experience with Git, automated test frameworks, risk-based testing, software testing methodologies, and cross-functional engineering collaboration.
Preferred experience includes Agentic AI workflows, AI evaluation techniques, LangSmith, DeepEval, Ragas, Arize Phoenix, Promptfoo, RAG systems, Pact, OpenAPI/Swagger, event-driven architectures, Kafka, Docker, Kubernetes, AWS, and performance, scalability, reliability, or resiliency testing.

Medical, dental, and vision benefit offerings are available.
The role is a contractor position with an hourly base pay range of $58—$72 USD.
Sony Interactive Entertainment conducts background checks at the offer stage for all new employees.