1 day ago
San Diego, CA, USAMid Level
H1B sponsor

Responsibilities

  • Develop and execute quality engineering strategies and test plans for Agentic AI systems, backend services, APIs, and integrations.
  • Design and maintain automated frameworks for API, functional, integration, contract, regression, and end-to-end testing.
  • Develop evaluation approaches for non-deterministic AI behavior and assess accuracy, relevance, groundedness, consistency, and expected behavior.
  • Test AI workflows, guardrails, tool invocation, failure handling, prompt-based attacks, APIs, data sources, and downstream services.
  • Integrate automated testing into CI/CD pipelines and establish quality gates, metrics, and release-readiness visibility.
  • Investigate distributed-system failures, analyze defects and production issues, and identify root causes and testing gaps.
  • Collaborate with software engineers, product managers, and quality engineering teams to improve testability, observability, and product quality.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
  • 4+ years of experience in SDET, Quality Engineering, Software Engineering, or a related discipline.
  • Strong experience testing REST APIs, backend services, microservices, distributed systems, and service-to-service integrations.
  • Hands-on experience developing automated tests with Python, Java, JavaScript, TypeScript, or a similar programming language.
  • Experience with functional, integration, regression, contract, and end-to-end testing and automated test framework development.
  • Experience integrating automated tests into CI/CD pipelines and using Git-based development workflows.
  • Hands-on experience testing Generative AI, LLM-powered applications, or Agentic AI systems, including non-deterministic behavior.
  • Strong analytical, debugging, root-cause-analysis, software testing methodology, and risk-based testing skills.
  • Preferred experience includes Agentic AI workflows, AI evaluation techniques and tools, RAG systems, Pact, OpenAPI/Swagger, event-driven architectures, Kafka, Docker, Kubernetes, AWS, and performance, scalability, reliability, or resiliency testing.

Benefits

  • Medical, dental, and vision benefit offerings are available.
  • The role is a contractor position and is paid hourly at an estimated base rate of $58–$72 per hour.
  • Sony Interactive Entertainment conducts background checks at the offer stage for new employees.
Contact me