RL Environments
Bespoke Labs9 months ago
Mountain View, CA, USAEntry Level / Mid Level
H1B Sponsor
Responsibilities
- Develop systematic strategies for creating high-quality RL environments.
- Study agent failures across different tasks to inform better environment design.
- Create benchmark environments for testing specific agent capabilities.
- Verify environment quality through hands-on testing and analysis.
- Work with the environment creation pipeline to scale production.
- Analyze agent rollout data for insights on environment effectiveness.
- Collaborate with the team to integrate benchmarks into external dashboards.
- Establish quality standards and evaluation protocols for environment production.
Requirements
- Strong foundation in machine learning, preferably with a PhD/MS in ML, CS, or equivalent experience.
- Deep curiosity about agent behavior and ability to form and test hypotheses.
- Experience analyzing complex systems and extracting actionable insights.
- Proficiency in Python and ML frameworks like PyTorch or JAX.
- Familiarity with RL concepts and agent training.
- Ability to design experiments and interpret results.
- Comfortable working with cloud platforms like GCP or AWS.
- Experience building pipelines and automation for scaling research.
Benefits
- Health coverage.
- Flexible work arrangements.
- Opportunity to shape AI community standards for agent evaluation and training.