Lead Data Engineer - Healthcare Data & Audience Applications
Zeta Global3 months ago
Base Salary
$180k - $200k/yr
Responsibilities
- Define and maintain healthcare data architecture, interface contracts, ADRs, schemas, and staged delivery plans.
- Lead ingestion and transformation patterns across Snowflake, Athena/S3, MySQL, and approved healthcare data stores.
- Design healthcare base and vertical models, governed views, semantic cubes, domain APIs, data contracts, and identity-resolution services.
- Build applications and data products for HCP and DTC audience discovery, segmentation, activation, reporting, attribution, NPI onboarding, and patient/HCP intelligence.
- Set SLOs and operational-readiness criteria, ensuring dashboards, alerts, runbooks, rollback paths, and incident ownership are established before release.
- Partner with Data Cloud, Product, and Data teams on source certification, partner-feed contracts, identity validation, requirements, and data availability SLAs.
- Implement row/member-level controls, account scoping, masking, versioning, privacy-by-design, and approved healthcare-data joins under CERT/HIPAA rules.
- Lead design and code reviews, mentor the Senior Data Engineer, and coordinate dependencies across the pod.
- Support compliance evidence, annual audits, US data-residency controls, and Start/Stop/Requires CERT decisions.
- Drive engineering practices for testing, CI/CD, code quality, observability, scalability, and operational excellence.
Requirements
- 8+ years of data engineering experience with increasing technical ownership.
- Expert SQL and strong Python and Java skills, with experience in batch and streaming patterns, orchestration, testing, and schema evolution.
- Proven experience building and scaling data-intensive or distributed systems, including microservices and event-driven architectures.
- Strong understanding of data modeling, OLTP and OLAP storage systems, data-processing frameworks, performance optimization, and scalability trade-offs.
- Experience with streaming and batch technologies such as Kafka, Spark, or Flink and workflow orchestration tools such as Apache Airflow.
- Experience with data warehouses or lakehouse platforms such as Snowflake or Databricks and cloud platforms such as AWS, GCP, or Azure.
- Experience with API design using REST or gRPC, infrastructure as code, Docker, Kubernetes, and observability practices involving logging, metrics, and tracing.
- Experience working with HCP data, patient or DTC workflows, healthcare data ecosystems, identity graphs, data onboarding, reporting, or attribution systems.
- Strong understanding of HIPAA, PHI/PII, regulated data handling, lineage, data quality, access control, masking, retention, auditability, observability, and cost controls.
- Strong system design, architecture, collaboration, and technical leadership skills while remaining hands-on.
- Healthcare data-provider or identity-ecosystem experience, AdTech/MarTech or audience-platform experience, privacy-enhancing technology experience such as tokenization or clean rooms, and exposure to ML/AI-driven data products are preferred.
Benefits
- Unlimited PTO.
- Medical, dental, and vision coverage.
- Employee equity.
- Employee discounts, virtual wellness classes, and pet insurance.
Tech Stack
Apache AirflowApache FlinkApache KafkaApache SparkAWSAzureDatabricksDockerGoogle Cloud PlatformgRPCJavaKubernetesMySQLPythonRubySnowflakeSQL
Categories
BackendData Engineering
About Zeta Global
Zeta Global builds an AI-powered marketing cloud that unifies customer data, analytics, and omnichannel activation for enterprise brands and agencies. Its Zeta Marketing Platform combines martech and adtech—spanning CRM, email, display, and social—to acquire, grow, and retain customers on a subscription and media-buying model. Founded in 2007 and headquartered in New York City, Zeta is a public company trading on the NYSE under the ticker ZETA.