1 day ago
Base Salary
$154k - $217k/yr
Responsibilities
- Design, create, and quality-review expert multimedia tasks and reference outputs for model training and evaluation.
- Define task guidelines, rubrics, and quality criteria, and calibrate reviewers for consistent application.
- Build and harden evaluations, reliable graders, and workflows that distinguish model failures from instrumentation failures.
- Reproduce and debug quality issues, analyze model-output failure modes, and propose new task types or data to close gaps.
- Design and build agentic, human-in-the-loop, and expert-in-the-loop workflows and pipelines for scalable data production.
- Mentor engineers, contribute to hiring and onboarding, and improve evaluation and quality practices.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience.
- 8+ years of software engineering experience, or a PhD plus 5 years, including significant depth in video, image, audio, speech, or music.
- Demonstrated experience designing and building multimedia pipelines, workflows, or tooling.
- Working understanding of model training and evaluation and how data quality and coverage affect model behavior.
- Experience owning software components or systems end to end and driving work with cross-functional partners.
- Preferred experience evaluating or red-teaming multimodal models and creating data used to improve them.
- Preferred experience designing model-capability benchmarks and evaluations with reliable grading, reproducibility, and label quality.
- Preferred knowledge of video, audio, and streaming standards, including H.265, MPEG-DASH, and WebRTC.
- Preferred fluency with professional media tools such as Premiere, After Effects, Blender, and Pro Tools.
- Preferred experience building media data pipelines with versioning, lineage, and provenance.
- Preferred experience with AI agents, orchestration, human-in-the-loop systems, research collaboration, responsible AI, zero-to-one team formation, and workflow optimization using AI tools.
Benefits
- Base salary of $154,003/year to $217,000/year, plus bonus, equity, and benefits.
Categories
Data Engineering
About Meta
Meta builds social platforms and communication apps—including Facebook, Instagram, WhatsApp, and Messenger—and develops AR/VR hardware and software such as Quest to power immersive computing. It monetizes primarily through advertising tools for businesses, with additional revenue from devices and services, and operates a massive global infrastructure. Founded in 2004 and headquartered in Menlo Park, California, Meta Platforms, Inc. is a public company traded on Nasdaq under the ticker META.