Consultant - Data Engineer

3 months ago

Hyderābād, IndiaStaff+

Responsibilities

Design, build, test, implement, document, and maintain GCP-based enterprise data solutions.
Build scalable batch and real-time data pipelines for structured, semi-structured, and unstructured data.
Implement automated workflows, define data delivery SLAs, and reduce manual and operational costs.
Enable self-service data architecture for query exploration, dashboards, data catalogs, and data discovery.
Analyze requirements and design AI/ML-based solutions for customer environments.
Produce modular, reusable, high-quality code and establish data engineering best practices and standards.
Implement unit, integration, performance, continuous integration, and automated deployment practices.
Monitor data platforms and pipelines and create analytical tools to improve operational efficiency.
Promote data security practices aligned with industry standards and regulatory and legal requirements.
Mentor and coach junior engineers, lead complex data projects, and contribute to the HCA data engineering community.
Work independently and collaboratively in a changing, matrixed environment while meeting deadlines and supporting after-hours needs.

Bachelor's degree in computer science, a related technical field, or equivalent experience is required.
At least 5 years of experience in data engineering is required.
At least 7 years of experience in information technology is required.
At least 3 years of hands-on experience with the GCP platform and multiple GCP data and cloud components.
At least 4 years of hands-on experience with technologies such as Spark Streaming, Kafka, SQL, JSON, Avro, Parquet, Java, Python, or Scala.
Strong knowledge of GCP data process design, public cloud best practices, data pipelines, analytical data warehouses, SQL, source control, and CI/CD automation tools.
Experience designing and implementing scalable data platforms, automated processes, pipeline monitoring, and complex data solutions.
Strong problem-solving, analytical, communication, presentation, facilitation, and technical decision-making skills.
Ability to work independently and collaboratively, prioritize workloads, and operate with minimal supervision.
Experience coaching and mentoring junior team members and contributing to team capability growth.
A master's degree in computer science or a related field is preferred.
At least 1 year of healthcare experience is preferred.
GCP Cloud Professional Data Engineer certification is a plus.

The role is based in a computer workstation environment requiring prolonged sitting or standing and use of a mouse, keyboard, and monitor.
After-hours support is required.
The position requires travel.
The role offers opportunities to mentor others, lead technical direction, and contribute to the organization's data engineering community.

1,001-5,000 employees