21 hours ago
San Francisco, CA, USAMid Level
Base Salary
$170k - $200k/yr
Responsibilities
- Build a reusable connector framework that makes integrations faster to configure for new customers.
- Develop a reliable AI-assisted process for creating connectors from vendor documentation.
- Create data access methods for systems without APIs, including collectors running on farm servers.
- Design and maintain a canonical farm data model with mappings reviewed before implementation.
- Own data quality and evaluation tools for detecting and diagnosing failures.
- Build tools that enable agents to query data and prepare machine learning training sets.
- Occasionally work on-site to connect farm systems.
Requirements
- Two to four years of engineering experience building and operating production pipelines or integrations with messy data sources.
- Strong Python and SQL skills, with experience using PostgreSQL, a data warehouse such as BigQuery, and tools such as dbt.
- Experience designing schemas that other people and systems depend on and resolving production issues directly.
- Daily experience building with AI and a practical understanding of its limitations.
- Experience with data quality and evaluation frameworks.
- Helpful experience includes Airbyte, Fivetran or similar connector frameworks, document extraction or OCR, and data from ERP, IoT, agriculture, logistics, or food supply chain systems.
- Candidates must be authorized to work in the United States.
Benefits
- Base salary of $170,000 to $200,000 annually, plus 1% equity with four-year vesting and a one-year cliff.
- Healthcare, AI coding tools and model access, and necessary hardware are provided.
- On-site in San Francisco five days per week.
- Approximately one week per quarter visiting farms in Washington, Oregon, and California.
Tech Stack
Categories
Data Engineering
