about 4 hours ago
Remote, United StatesSenior / Mid Level
H1B Sponsor
Base Salary
$131k - $220k/yr
Responsibilities
- Design, build, and operate high-scale data ingestion and replication systems.
- Maintain reliable, scalable data platform infrastructure for petabytes of data.
- Improve the reliability and observability of the Spark and Databricks-based data processing platform.
- Develop internal libraries, APIs, and tooling in languages like Go and Python.
- Work on foundational data lake technologies and orchestration systems.
- Collaborate with various teams to understand platform needs and deliver solutions.
- Stay updated on modern data platform technologies and shape the data infrastructure roadmap.
Requirements
- 4+ years of professional software engineering experience in production environments.
- 4+ years of experience with large-scale production data infrastructure.
- Strong experience with Apache Spark or similar distributed data processing systems.
- Experience operating production infrastructure in AWS.
- Proficiency in at least one production programming language such as Go, Python, Scala, or Java.
- Ability to collaborate effectively with cross-functional partners.
Benefits
- Flexible, employee-led remote working model.
- Professional development stipend.
- Comprehensive health and parental leave plans.
- Above-market total compensation including base salary, performance-based bonuses, and equity.
Tech Stack
Categories
AI & MLData Engineering