about 3 hours ago
Remote, Canada
Senior / Staff+
Responsibilities
- Define and drive the technical vision and roadmap for Instacart's core data platform.
- Architect the ownership strategy for the data platform, evaluating build vs. buy decisions.
- Drive the architecture and delivery of the open lakehouse, ensuring reliable scaling.
- Own the architecture for streaming data and real-time serving for critical use cases.
- Lead the adoption of AI tools across the data platform lifecycle.
- Set standards for system design and reliability while mentoring engineers.
- Collaborate with stakeholders to translate needs into reliable infrastructure.
Requirements
- 10+ years of software engineering experience focused on data infrastructure or distributed systems.
- Expertise in modern data lakehouse architectures and distributed query systems.
- Proven track record of executing major infrastructure platform transitions.
- Experience in building business cases for infrastructure investments.
- Exceptional technical communication skills for architecture documents and strategy memos.
Benefits
- Flexible work arrangements allowing employees to choose their work environment.
- Highly market-competitive compensation and benefits.
- Eligibility for new hire equity grants and annual refresh grants.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkAWSClickHouseDatabricksdbtPostgreSQLPythonScalaSnowflake
Categories
AI & MLData EngineeringData Science