Senior Data Platform Engineer
Komodo Health7 hours ago
Base Salary
$170k - $230k/yr
Responsibilities
- Build, operate, and optimize large-scale batch pipelines using Python, SQL, Spark, Airflow, and AWS.
- Make data storage and layout decisions involving table formats, partitioning, file sizing, and compaction.
- Ingest data from external sources and maintain pipeline correctness through frequent schema changes.
- Transform healthcare claims, EHR, and reference data into trusted, serving-ready data products.
- Improve data quality, validation, lineage, observability, alerting, reliability, performance, and cost efficiency.
- Debug complex data, system, and performance issues across compute-heavy workflows.
- Contribute to system design, code quality, testing, documentation, CI/CD, and rotational production support.
- Partner with Data Product and Engineering teams and provide mentorship through design reviews and engineering best practices.
- Use AI-assisted engineering tools for coding, debugging, documentation, test creation, technical exploration, and architectural analysis.
Requirements
- Strong hands-on experience building, owning, and debugging production data pipelines at multi-terabyte scale.
- Advanced Python skills, including performant and memory-efficient large-scale data processing, and strong SQL skills.
- Deep production experience operating and scaling Airflow, not only writing DAGs.
- Understanding of physical data storage, including columnar and row formats and open table formats such as Iceberg, Delta Lake, or Hudi.
- Experience with Spark or a comparable distributed processing framework.
- Proven experience designing and operating data systems in AWS.
- Strong data correctness, root-cause analysis, and production troubleshooting skills.
- Ability to communicate technical trade-offs with engineering, product, and data partners.
- Preferred experience with Docker, Kubernetes, data governance, data lineage, external-facing data products, APIs, serving layers, customer access patterns, AI or agentic workflows, and high-growth or ambiguous environments.
- Healthcare experience is not required.
Benefits
- Annual base pay is $196,000–$230,000 in the San Francisco Bay Area and New York City, or $170,000–$200,000 in other US locations.
- Benefits include comprehensive health, dental, and vision insurance, flexible time off and holidays, 401(k) with company match, disability insurance, life insurance, and applicable leaves of absence.
- Open to US remote work or hybrid work in San Francisco or New York City; Komodo also has hubs in Chicago.
- The role may be eligible for performance-based bonuses and equity awards.
- Komodo uses a hybrid work model with intentional in-office rhythms for hub-based employees.
Tech Stack
Categories
Data Engineering
About Komodo Health
Komodo Health builds a healthcare data platform and analytics applications, anchored by its Healthcare Map of de-identified U.S. patient journeys. Life sciences companies, payers, providers, and public health teams use its SaaS tools and services to study treatment patterns, size markets, and identify gaps in care. Founded in 2014 and headquartered in New York, the company is privately held.