3 hours ago
Responsibilities
- Build tools for browsing environments, inspecting trajectories, reviewing task quality, and understanding model behavior.
- Develop partner workflows for creating, submitting, testing, and iterating on environments and training data.
- Create dashboards and observability tools for environment quality, evaluation results, data collection progress, and pipeline health.
- Design backend services and APIs connecting task authoring, data collection, evaluation, quality review, and training systems.
- Collaborate with research, operations, and go-to-market teams to ship useful systems amid evolving requirements.
Requirements
- At least 3 years of full-stack software engineering experience building and shipping production systems.
- Proficiency in Python and a modern web stack such as React, TypeScript, or Next.js.
- Experience owning user-facing or internal products from design through deployment.
- Experience building data inspection, review, quality assessment, dashboard, or observability tools.
- Experience with backend services, APIs, databases, cloud infrastructure, Docker, CI/CD, and production debugging.
- Experience with data collection, labeling, evaluation, developer tools, or partner-facing workflows is valuable.
- AWS, Kubernetes, Terraform, and Grafana experience is useful.
- Clear communication skills and initiative to identify needs and improve products independently.
Benefits
- Visa sponsorship and relocation support are available for strong full-time candidates relocating to the United States or Singapore.
- The position is on-site in San Francisco, California, with an additional team office in Singapore.