about 3 hours ago
Base Salary
$221k - $280k/yr
Responsibilities
- Translate Instacart’s data strategy into a multi-year architecture roadmap.
- Own the open lakehouse foundation and define unified table formats.
- Drive real-time and streaming infrastructure for critical use cases.
- Pioneer AI-native data infrastructure engineering using LLM/AI tools.
- Lead architecture reviews and mentor senior engineers.
Requirements
- 10+ years of software engineering experience in data infrastructure.
- Hands-on expertise with modern data lakehouse architectures.
- Experience with event-driven and streaming infrastructure.
- Proven ownership of major platform transitions delivered to production.
- Ability to build cost/benefit models for infrastructure investments.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkAWSClickHouseDatabricksdbtPostgreSQLPythonScalaSnowflake
Categories
AI & MLData Engineering