5 days ago
New York, NY, USA or Remote, United States
Staff+
H1B Sponsor
Base Salary
$180k - $275k/yr
Responsibilities
- Design and ship platform services for ingestion, transformation, orchestration, and metadata.
- Build execution and scheduling capabilities for Spark/SQL jobs focusing on throughput and developer experience.
- Implement lakehouse features such as schema evolution and ACID guarantees.
- Optimize Snowflake and other data warehouses for cost and performance.
- Deliver SDKs, CLIs, and templates to standardize data product development.
- Work across AWS services with Infrastructure as Code and strong observability.
Requirements
- 8+ years of experience in backend/platform software development using Python, Scala, or Java.
- Strong SQL skills and a proven track record in designing distributed systems.
- Deep experience with Spark and AWS data services.
- Hands-on experience with data warehouse optimization, preferably Snowflake.
- Experience building platform APIs/SDKs and strong collaboration skills.
Benefits
- Flexible, hybrid work environment at a convenient Soho location.
- Unlimited vacation policy.
- 100% paid employee health benefits including medical, dental, and vision.
- Commuter benefits and a 401(k) with employer match.
- Corporate wellness program and sabbatical leave for long-term employees.
- Catered lunch daily along with beverages and snacks.
Tech Stack
Apache AirflowApache SparkAWSDatabricksDatadogJavaPythonScalaSnowflakeSQLTerraform
Categories
BackendData Engineering