Senior - Data Engineer
HCA Healthcare India1 month ago
Hyderābād, IndiaSenior
Responsibilities
- Design, develop, maintain, and support ETL/ELT data pipelines for the HIM GCP Datamart.
- Extract, transform, and load data from Teradata, SQL Server, GCP Datamarts, file-based sources, and other enterprise systems.
- Develop, schedule, monitor, and troubleshoot Airflow DAGs using Python, PowerShell, SSIS, SQL, Dataproc, and related tools.
- Create SQL queries, stored procedures, views, functions, and transformation logic across SQL Server, Teradata, PostgreSQL, BigQuery, and other relational platforms.
- Support on-premises-to-GCP integrations and large-scale data processing using Google Cloud Dataproc and related GCP services.
- Monitor and troubleshoot pipeline failures, delays, schema changes, data quality issues, missing data, transformation errors, and performance bottlenecks.
- Perform root-cause analysis and implement fixes to improve pipeline reliability, scalability, and operational stability.
- Implement data validation, reconciliation, quality checks, monitoring, alerting, logging, and operational dashboards.
- Collaborate with HIM Operations, source-system owners, technical teams, reporting teams, and business stakeholders.
- Maintain data flow diagrams, source-to-target mappings, job schedules, support procedures, operational runbooks, and other documentation.
- Participate in release management, change control, defect resolution, incident response, enhancement delivery, and production support.
- Modernize legacy ETL processes and ensure solutions meet enterprise security, privacy, compliance, governance, and production-readiness standards.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, Engineering, Healthcare Informatics, or a related field is required.
- Five or more years of experience in data engineering, ETL/ELT development, data warehousing, data integration, or enterprise data platform support is required.
- Hands-on experience designing, developing, maintaining, and troubleshooting production data pipelines with SQL, Python, PowerShell, SSIS, Apache Airflow, and DAGs.
- Strong SQL experience with SQL Server, Teradata, PostgreSQL, BigQuery, or similar platforms, including performance tuning and source-to-target validation.
- Experience integrating Teradata, SQL Server, file-based sources, GCP Datamarts, and other enterprise sources into GCP-based platforms.
- Experience with Google Cloud Platform services including Dataproc, Cloud Composer, Cloud Storage, BigQuery, Cloud SQL, Cloud Logging, and Cloud Monitoring.
- Experience with batch processing, scheduling, dependency management, error handling, logging, alerting, validation, reconciliation, data quality, and production support.
- Experience handling CSV, fixed-width files, Excel, JSON, XML, Parquet, Avro, and delimited file formats.
- Experience with GitHub, Azure DevOps, Git, YAML pipelines, CI/CD, or similar source-control and delivery tools.
- Experience with Spark, PySpark, Hadoop, or distributed data processing frameworks.
- Experience with Teradata SQL, BTEQ, FastExport, TPT, scalable ingestion frameworks, incremental loads, CDC, SCD handling, partitioning, and archival strategies.
- Experience with secure file transfers, file watchers, landing zones, staging tables, data lake patterns, dimensional modeling, star schemas, snowflake schemas, BI/reporting platforms, and downstream analytics dependencies.
- Experience with healthcare data, HIM operations, revenue cycle, coding, clinical documentation, billing, or Parallon operational data is strongly preferred.
- Experience with HIPAA, PHI, role-based access, encryption, audit logging, data privacy, and healthcare compliance is preferred.
- Strong analytical, troubleshooting, problem-solving, written communication, and verbal communication skills, with the ability to work independently and collaboratively.
- Experience working in Agile/Scrum or Lean delivery environments is preferred.
Tech Stack
Apache AirflowApache HadoopApache SparkGitGoogle BigQueryGoogle Cloud PlatformMicrosoft SQL ServerPostgreSQLPython
Categories
Data Engineering
About HCA Healthcare India
HCA Healthcare India is the technology and analytics arm of HCA Healthcare, Inc., the U.S.-based hospital operator headquartered in Nashville. Teams in India build cloud data platforms, pipelines, and software that support clinical, operational, and revenue workflows across HCA’s hospitals and clinics, and provide DevOps, BI, and testing services. HCA Healthcare was founded in 1968 and runs a broad network of hospitals and outpatient facilities in the United States.