GrepJob
DataHub

Senior Platform Engineer

DataHub
Apply
4 months ago
Palo Alto, CA, USASenior / Mid Level

Base Salary

$225k - $300k/yr

Responsibilities

  • Lead the development of DataHub's ingestion framework.
  • Build scalable, fault-tolerant ingestion systems for enterprise-scale metadata.
  • Create clean, intuitive APIs for the connector ecosystem.
  • Implement event-driven architectures for real-time metadata processing.
  • Develop schema mapping between diverse systems and DataHub's unified model.
  • Establish versioning systems for AI assets.

Requirements

  • 4+ years of experience building production-grade distributed systems.
  • Advanced Python expertise with a focus on API design.
  • Experience with high-scale data processing or integration frameworks.
  • Strong systems knowledge and distributed architecture experience.
  • A proven track record of solving complex technical challenges.

Benefits

  • Competitive compensation reflecting skills and experience.
  • Equity for all team members, providing ownership in the company.
  • Remote work options available for all roles.
  • Location flexibility with a monthly coworking stipend.
  • Comprehensive health coverage with 99% of premiums covered for employees.
  • Flexible savings accounts for healthcare costs.
  • Inclusive fertility benefits and family-forming support.
  • Unlimited PTO and sick leave policy for flexibility.

Tech Stack

AirbyteApache AirflowdbtPython

Categories

AI & MLBackendData Engineering