3 hours ago
Singapore, SingaporeMid Level / Senior
Base Salary
$150k - $250k/yr
Responsibilities
- Build pipelines that transform domain-specific workflows into realistic, structured synthetic training tasks.
- Collaborate with subject-matter experts to create tasks across professional and technical domains.
- Design tools and methods to generate, mutate, validate, and improve synthetic tasks.
- Analyze model and agent performance to identify strengths, gaps, and failure modes.
- Develop metrics for task diversity, realism, learnability, and overall quality.
- Independently deliver technical projects in an unstructured environment.
Requirements
- Two to four years of relevant experience, including at least two years in software engineering, machine learning engineering, or AI research roles.
- Hands-on experience building end-to-end synthetic data generation pipelines for AI or machine learning applications.
- Proficiency in Python and experience working in Linux environments with Docker or similar containerization tools.
- Practical knowledge of synthetic data quality, evaluation metrics, and generated-data limitations.
- Experience building automated systems for generating, validating, mutating, or processing structured datasets at scale.
- Background in AI agent or language model evaluation, benchmarks, testing environments, or post-training workflows.
- Ability to reason carefully about edge cases and work effectively in an unstructured environment.
Benefits
- Annual salary of USD $150,000 to $250,000.
- Visa sponsorship is available.
- On-site work in Singapore, Singapore.