Sr. Data Engineer
Cohere Health5 months ago
Hyderābād, IndiaSenior
Responsibilities
- Build and maintain scalable, reusable, fault-tolerant ETL/ELT pipelines for batch and near-real-time processing.
- Develop dashboards, scorecards, KPI reporting, and automated reporting workflows aligned with business goals.
- Translate stakeholder data integration and reporting needs into scalable technical solutions and define KPIs and business rules.
- Implement data validation, reconciliation, lineage, metadata, governance, observability, security, and access controls.
- Provide technical guidance, conduct code reviews, establish best practices, and mentor junior team members.
- Monitor production pipelines, investigate incidents, perform root cause analysis, and implement preventive fixes.
- Improve platform reliability, performance, scalability, monitoring, and cost efficiency.
Requirements
- 5+ years of data engineering experience designing scalable data platforms, ETL/ELT pipelines, cloud solutions, and reliable data systems.
- 5+ years of experience developing automated ingestion pipelines integrating multiple data streams through cleansing, transformation, validation, and batch or near-real-time workflows.
- Strong proficiency writing and tuning advanced SQL queries, views, and data models, including indexing, partitioning, query plans, and database resource utilization.
- 5+ years of experience in cloud-based distributed environments using technologies such as AWS, EMR, Glue, Iceberg, dbt, Lambda, and Athena.
- Experience designing and managing secure client integrations involving file exchanges, SFTP, APIs, and end-to-end data delivery.
- Knowledge of medallion and lakehouse architecture, schema evolution, streaming ingestion, and batch orchestration.
- Familiarity with AWS QuickSight or Tableau for reporting and dashboarding.
- Experience building low-latency, highly available pipelines and triaging production data incidents while meeting SLAs.
- Experience implementing data governance, observability, quality controls, schema validation, lineage tracking, alerting, reconciliation, and policy-based access management.
- Knowledge of CI/CD, version control, and DevOps practices using GitHub and AWS CodePipeline.
- Bachelor’s or master’s degree in computer science, engineering, or a related discipline.
Benefits
- Preferred location is Hyderabad, Telangana, with reliable commuting or relocation before starting.
- The company describes an empathetic, inclusive, supportive, and growth-oriented work environment.
About Cohere Health
Cohere Health builds a clinical intelligence and operations platform used by U.S. health plans and provider organizations to streamline prior authorization and align care with evidence-based policies. Its SaaS products connect payers and providers across utilization management, policy management, and payment accuracy workflows, reducing administrative burden and speeding decisions. Founded in 2019, the privately held company is headquartered remotely and sells enterprise contracts to national and regional health plans.