3 months ago
Palo Alto, CA, USAStaff+
Base Salary
$225k - $300k/yr
Responsibilities
- Lead the development of DataHub's platform framework.
- Build scalable, fault-tolerant ingestion systems for enterprise-scale metadata.
- Create clean, intuitive APIs for the connector ecosystem.
- Design event-driven architectures for real-time metadata processing.
- Implement schema mapping between diverse systems and DataHub's unified model.
- Develop versioning systems for AI assets.
Requirements
- 8+ years of experience building production-grade distributed systems.
- Advanced expertise in Python and API design.
- Experience with high-scale data processing or integration frameworks.
- Strong systems knowledge and distributed architecture experience.
- Proven track record of solving complex technical challenges.
- Experience maintaining online applications serving live traffic at scale.
- Hands-on experience with LLMs and scalable LLM development.
Benefits
- Competitive compensation reflecting skills and experience.
- Equity for all team members.
- Remote work options with location flexibility.
- Comprehensive health coverage with 99% of premiums covered for employees.
- Flexible savings accounts for healthcare costs.
- Support for various paths to parenthood through fertility benefits.
- Unlimited PTO and sick leave policy for flexibility.