Senior Data Engineer
Cohere Health2 months ago
Hyderābād, IndiaSenior
Responsibilities
- Deliver complex data engineering projects from design through production deployment.
- Design and implement scalable batch and near-real-time data pipelines.
- Build reusable ingestion, transformation, validation, and publishing frameworks.
- Contribute to Apache Iceberg implementation, schema evolution, partitioning, compaction, and metadata management.
- Implement data quality, validation, observability, monitoring, and reliability practices.
- Support modernization of legacy workloads and participate in architecture, design discussions, and code reviews.
- Mentor junior engineers and share engineering best practices.
- Manage ISMS documentation, conduct risk assessments, and implement risk treatment plans.
- Monitor and report ISMS performance and implement information security policies and procedures.
- Conduct business continuity and information security continuity tests with the CISO.
Requirements
- 5+ years of data engineering experience.
- Experience contributing to enterprise-scale data initiatives.
- Experience with AWS S3, AWS Glue, Athena, Lake Formation, IAM, and security controls.
- Experience with Apache Iceberg; Delta Lake or Hudi experience is relevant.
- Experience with dbt and Airflow or Step Functions.
- Proficiency in Python, SQL, and PySpark or Spark.
- Good knowledge of information security and ISMS processes.
Benefits
- Preferred ability to reliably commute to or relocate before starting work in Hyderabad, Telangana.
- Interview process includes Talent Acquisition, hiring manager, behavioral, case study, and senior leadership interviews.
Tech Stack
Categories
Data Engineering
About Cohere Health
Cohere Health builds a clinical intelligence and operations platform used by U.S. health plans and provider organizations to streamline prior authorization and align care with evidence-based policies. Its SaaS products connect payers and providers across utilization management, policy management, and payment accuracy workflows, reducing administrative burden and speeding decisions. Founded in 2019, the privately held company is headquartered remotely and sells enterprise contracts to national and regional health plans.