Consultant - Data Architect
HCA Healthcare India3 months ago
India (city not specified)Staff+
Responsibilities
- Design and own data architecture patterns for a defined GCP Lakehouse platform or data domain.
- Personally build production-quality reference implementations, ingestion frameworks, transformation pipelines, platform tooling, APIs, and reusable libraries.
- Benchmark architectural alternatives and optimize data platforms for cost, throughput, latency, scalability, and operational performance.
- Design and build Lakehouse environments using BigQuery, Apache Iceberg, Delta Lake, and Google Cloud Storage.
- Develop batch, streaming, multimodal, and AI-assisted ingestion pipelines for structured, semi-structured, and unstructured data.
- Implement vector storage and retrieval, semantic chunking, embedding generation, metadata extraction, classification, enrichment, and RAG patterns with AI/ML teams.
- Design REST and event-driven APIs with OpenAPI specifications, versioning, governance, security, and backward compatibility.
- Build monitoring, observability, testing, CI/CD, and infrastructure-as-code capabilities for data platforms.
- Apply data governance, privacy, security, retention, lineage, access control, auditability, HIPAA, and GDPR requirements.
- Modernize legacy pipelines, lead migrations through direct technical contribution, and resolve production issues alongside engineers.
- Collaborate with business, clinical, analytics, and engineering stakeholders to translate requirements into scalable solutions.
- Mentor Staff and Senior Data Engineers through code reviews, pairing, design coaching, and community leadership.
Requirements
- Bachelor’s degree in computer science or a related technical field, or equivalent experience.
- At least 8 years of experience in information technology.
- At least 7 years of experience in data engineering, data architecture, or equivalent hands-on data platform development.
- At least 2 years of experience in a cloud data or information architect capacity.
- Production-depth Python and SQL skills plus JVM-based language experience with Java or Scala.
- Hands-on experience designing and building enterprise data solutions on Google Cloud Platform or another major cloud provider.
- Experience with BigQuery, Cloud Storage, Dataflow, Dataproc, Cloud Composer, Pub/Sub, Kafka, Spark Streaming, Cloud Run, GKE, and Cloud Functions.
- Experience with Lakehouse formats and data formats including Iceberg, Delta Lake, Parquet, Avro, and JSON.
- Experience with source control, CI/CD automation, test-driven development, and production data platform engineering.
- Experience processing, enriching, and indexing documents and other unstructured data.
- Practical experience integrating LLMs and AI frameworks into production data pipelines.
- Strong understanding of cloud data security, privacy, HIPAA, GDPR, and regulatory requirements.
- Ability to communicate complex architectures to technical and non-technical audiences and work independently with sound judgment.
- Preferred qualifications include a master’s degree, at least 3 years of healthcare experience, Terraform, Docker, Kubernetes, Dynatrace, Bigtable, Cloud SQL, Cloud Spanner, Vertex AI, LangChain, embeddings, RAG patterns, and GCP Professional Data Engineer or GCP Professional Cloud Architect certification.
Tech Stack
Apache KafkaDockerGitGoogle BigQueryGoogle CloudGoogle Cloud PlatformJavaKubernetesPythonScalaSQLTerraform
Categories
BackendData Engineering
About HCA Healthcare India
HCA Healthcare India is the technology and analytics arm of HCA Healthcare, Inc., the U.S.-based hospital operator headquartered in Nashville. Teams in India build cloud data platforms, pipelines, and software that support clinical, operational, and revenue workflows across HCA’s hospitals and clinics, and provide DevOps, BI, and testing services. HCA Healthcare was founded in 1968 and runs a broad network of hospitals and outpatient facilities in the United States.