about 3 hours ago
Remote, United States
Senior / Staff+
Base Salary
$254k - $321k/yr
Responsibilities
- Define and drive the technical vision and roadmap for Instacart's core data platform.
- Lead platform strategy, including build vs. buy decisions and risk analysis for major investments.
- Own the architecture and delivery of the open lakehouse, ensuring reliable scaling.
- Drive the architecture for streaming data and real-time serving for critical use cases.
- Lead the adoption of AI tools across the data platform lifecycle.
- Serve as a senior technical voice, mentoring engineers and contributing to hiring.
- Collaborate with stakeholders to translate needs into reliable, self-serve infrastructure.
Requirements
- 10+ years of software engineering experience focused on data infrastructure or distributed systems.
- Expertise in modern data lakehouse architectures and distributed query/compute systems.
- Proven track record of executing major infrastructure platform transitions.
- Experience building business cases for infrastructure investments.
- Exceptional technical communication skills for architecture documents and strategy memos.
Benefits
- Flexible work arrangements allowing employees to choose their work environment.
- Eligibility for new hire equity grants and annual refresh grants.
- Highly market-competitive compensation and benefits.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkAWSClickHouseDatabricksdbtPostgreSQLPythonScalaSnowflake
Categories
AI & MLData EngineeringData Science