3 months ago
Palo Alto, CA, USAMid Level
H1B sponsor
Base Salary
$144k - $270k/yr
Responsibilities
- Partner with model and engineering teams to define high-value data projects and evaluation strategies.
- Own end-to-end delivery of data and evaluation projects supporting model development.
- Build tools and systems to measure data yield, evaluation lift, usage, and data effectiveness.
- Run evaluations and maintain validation processes for data quality, factual accuracy, integrity, and truthfulness.
- Research and implement data collection, annotation, generation, and multimodal integration techniques.
- Design and improve annotation workflows, labeling interfaces, and related data-quality tools.
- Coordinate with engineering, technical staff, Human Data Operations, and tutoring teams to share knowledge and align delivery.
- Support project scaling and demand forecasting while reporting status, insights, and blockers.
Requirements
- Bachelor’s degree in engineering, computer science, or a related STEM discipline, or 4+ years of experience in lieu of a degree.
- Experience collaborating across engineering, research, product, annotation, or operations teams.
- Experience analyzing datasets to identify trends, anomalies, quality issues, or integrity problems.
- Master’s degree or higher in a relevant technical field is preferred.
- Experience curating, evaluating, or improving training or evaluation datasets for large language models or other AI/ML systems is preferred.
- Experience designing, supporting, or optimizing annotation tools, labeling interfaces, or data workflows is preferred.
- Familiarity with multimodal or domain-specific data is preferred.
- Experience conducting model or dataset evaluations for quality, truthfulness, or product alignment is preferred.
- Experience with a scripting language such as Python is preferred.
- Experience with SQL or other data analysis tools is preferred.
Benefits
- Base salary of $144,000–$270,000 USD, with equity and additional total-rewards benefits.
- Comprehensive medical, vision, and dental coverage.
- 401(k) retirement plan, short- and long-term disability insurance, life insurance, discounts, and other perks.
- Weekend work may be required.
- Travel to other SpaceXAI sites may be required.
About xAI
Understand the Universe. We are a team of AI technologists and business leaders on a mission to build AI systems that can help humanity understand the world better. https://x.ai/careers