2 months ago
Base Salary
$221k - $280k/yr
Responsibilities
- Translate data strategy into a multi-year architecture roadmap aligned with leadership and focused on scale, maturity, and cost efficiency.
- Own the open lakehouse foundation, including unified table formats, storage governance, and a portable multi-engine compute portfolio for interactive, batch, and streaming workloads.
- Drive real-time and streaming infrastructure for critical Ads, Fraud, and ML use cases, including deployment patterns, SLAs, and operational practices.
- Apply LLM and AI tools to platform development, automation, observability, and cost optimization, and partner on AI-powered platform capabilities.
- Lead architecture reviews, mentor senior and staff engineers, influence hiring, and communicate complex trade-offs across technical and executive audiences.
Requirements
- 10+ years of software engineering experience building and operating production-scale data infrastructure or distributed systems.
- Hands-on expertise with modern data lakehouse architectures, open table formats, and distributed query or compute engines, including performance tuning and production reliability.
- Experience with event-driven and streaming infrastructure for real-time pipelines and serving systems.
- Proven ownership of major platform transitions or migrations delivered to production.
- Ability to build infrastructure cost-benefit and total-cost-of-ownership models and drive alignment through architecture documentation and strategy memos.
- Experience designing platform-level governance controls and familiarity with compliance frameworks such as SOX, CPRA, and GDPR.
- FinOps experience optimizing data platform spending, including managing large infrastructure budgets and negotiating vendor contracts.
- Deep SQL proficiency and strong Python or Scala skills for systems-level development.
- Experience with orchestration and data transformation pipelines in large-scale production environments.
- Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience.
Benefits
- Flex First remote work arrangement with flexibility to work from home, an office, or another preferred location.
- Regular in-person events to build connection and community.
- Eligible for a new hire equity grant and annual refresh grants.
- Benefits and compensation vary by permanent work location.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkAWSClickHouseDatabricksdbtPostgreSQLPythonScalaSnowflakeSQL
Categories
BackendData Engineering
About Instacart
Instacart builds a grocery technology platform used by retailers and consumers for online shopping, delivery, and pickup. Its business spans a consumer marketplace, enterprise e-commerce and fulfillment software, and a retail media ads network, generating revenue from fees, subscriptions, software, and advertising. Founded in 2012 and headquartered in San Francisco, the company is publicly traded on Nasdaq and operates across the U.S. and Canada.