3 days ago
Base Salary
$138k - $191k/yr
Responsibilities
- Own the end-to-end quality strategy for a GenAI product area from development and model evaluation through launch and product improvements.
- Perform hands-on testing of consumer-facing and business-facing applications, APIs, AI models, backend systems, and infrastructure.
- Design and maintain AI model evaluation processes using representative datasets, weighted scoring, automated evaluations, human review, and regression coverage.
- Establish product-specific standards for model correctness, relevance, safety, and robustness.
- Plan and execute functional, integration, end-to-end, performance, stress, and cross-platform testing.
- Build reusable test automation and evaluation tooling and integrate quality checks into development workflows.
- Define quality metrics, analyze failures and coverage gaps, and drive improvements in testing effectiveness and product quality.
- Lead cross-team quality projects, advise on release readiness, investigate root causes, and prevent recurring defects.
- Mentor QA engineers in test design, automation, and AI evaluation.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience; the degree must be completed before joining Meta.
- At least 7 years of experience in quality assurance and test engineering for software products or services.
- At least 2 years of experience in AI model testing or evaluation, including developing evaluation methods and defining model quality standards.
- Experience independently leading quality engineering for a complex product or system and delivering measurable improvements.
- Experience developing test automation or evaluation tooling in Python, PHP, Java, C/C++, or an equivalent programming language.
- Hands-on experience testing and debugging web or mobile applications, APIs, backend services, and AI models.
- Experience with test planning, test design and execution, performance and stress testing, and client and server test automation.
- Experience using metrics and failure analysis to prioritize improvements and inform release decisions.
- Experience coordinating work across engineering and cross-functional partners, communicating technical risks and trade-offs, and mentoring engineers.
- Preferred experience includes building reusable testing or evaluation frameworks, responsible AI practices, human and automated model evaluation, frontier model evaluation, multimodal model testing, prompt/context engineering, agent orchestration, and partnering with AI research teams.
Benefits
- $138,000/year to $191,000/year plus bonus, equity, and benefits.
About Meta
Meta builds social platforms and communication apps—including Facebook, Instagram, WhatsApp, and Messenger—and develops AR/VR hardware and software such as Quest to power immersive computing. It monetizes primarily through advertising tools for businesses, with additional revenue from devices and services, and operates a massive global infrastructure. Founded in 2004 and headquartered in Menlo Park, California, Meta Platforms, Inc. is a public company traded on Nasdaq under the ticker META.