about 6 hours ago
Base Salary
$190k - $250k/yr
Responsibilities
- Build and scale the datalake and its feeding pipelines.
- Develop high-throughput data-movement and ingestion services.
- Own streaming and batch ingestion pipelines for large data volumes.
- Build new query and analytics capabilities on the datalake.
- Operate a low-latency serving layer for real-time data access.
- Collaborate with infrastructure and product teams for platform provisioning and security.
Requirements
- 5+ years of experience in software engineering with expertise in data infrastructure.
- Proficiency in Python and familiarity with Go.
- Hands-on experience with big-data or streaming technologies like Spark and Kafka.
- Experience building scalable data pipelines for structured and unstructured data.
- Track record of leading complex infrastructure projects and making architecture decisions.
- Strong fundamentals in distributed systems and performance optimization.
- Excellent communication and collaboration skills.
Benefits
- Medical, dental, and vision insurance for US-based employees.
- 3% 401(k) contribution and unlimited PTO.
- Quarterly mental health days and family planning benefits.
- Professional development stipend and wellness benefits.
- Private medical insurance and a 6% employer pension contribution for UK employees.
- Monthly wellness stipend and co-working stipend for UK employees.
Tech Stack
Categories
Data Engineering