about 3 hours ago
New York, NY, USA or San Francisco, CA, USA
Mid Level / Senior
H1B Sponsor
Base Salary
$320k - $405k/yr
Responsibilities
- Build and operate data pipelines that extract data from research training runs and land it in storage systems that are easy and fast to query.
- Work closely with researchers to design and build APIs, libraries, and web interfaces that support data management, exploration, and analysis.
- Develop dataset management, data cataloging, and provenance tooling that researchers use in their day-to-day work.
- Embed with research teams to understand their workflows, identify high-leverage tooling opportunities, and ship solutions quickly.
- Collaborate with adjacent teams to build on existing systems rather than reinventing them.
Requirements
- Have significant software engineering experience, particularly building data-intensive applications or internal tooling.
- Enjoy working directly with users, gathering requirements iteratively, and shipping things that get adopted.
- Are results-oriented, with a bias towards flexibility and impact.
- Pick up slack, even if it goes outside your job description.
- Want to learn more about machine learning research.
- Care about the societal impacts of your work.
Benefits
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- A lovely office space for collaboration.
Tech Stack
Apache SparkGoogle BigQuery
Categories
AI & MLData EngineeringFull Stack