2 months ago
Gurgaon, IndiaSenior
Responsibilities
- Design scalable and efficient data models for OLAP and OLTP use cases.
- Build automated, scalable, and reliable ETL/ELT pipelines using Python, Scala, or Cloud Data Fusion.
- Use GCP data services including BigQuery, Dataproc, Airflow, Dataflow, and Pub/Sub for warehousing, orchestration, batch processing, streaming, and event ingestion.
- Develop custom data solutions using Python, SQL, Java or Scala, and GCP APIs and SDKs.
- Deploy data pipelines using GCP infrastructure, Kubernetes, and containerization.
- Set up CI/CD workflows using Cloud Build, GitHub Actions, or comparable tools.
- Monitor and troubleshoot production workflows using Cloud Monitoring and Cloud Logging.
- Collaborate with data analysts and business stakeholders and communicate technical concepts to non-technical audiences.
- Prototype and experiment with GCP tools and third-party integrations to solve complex data challenges.
Requirements
- A graduate degree or qualification in Computer Science or a related field.
- 6+ years of experience in data engineering or a related field.
- Strong coding skills in Python and SQL, with Java or Scala as optional programming languages.
- Expertise building automated, scalable, and reliable data pipelines.
- Experience or knowledge designing data models for OLAP and OLTP use cases.
- Familiarity with GCP APIs and SDKs, cloud infrastructure, Kubernetes/GKE, and containerization.
- Experience setting up CI/CD pipelines using Cloud Build, GitHub Actions, or similar tools.
- Familiarity with GCP monitoring and logging tools such as Cloud Monitoring and Cloud Logging.
- Strong analytical, problem-solving, communication, collaboration, and continuous-learning skills.
Tech Stack
Apache AirflowApache HadoopApache SparkGitHub ActionsGoogle BigQueryGoogle Cloud PlatformJavaKubernetesPythonScalaSQL
Categories
Data Engineering
About EXL
EXL provides data analytics, AI, and digital operations services for enterprises in insurance, healthcare, banking, and other regulated industries. It delivers consulting, managed services, and technology platforms to improve decision-making, risk management, and operational efficiency. Founded in 1999 and headquartered in New York, EXL is a public company listed on the NASDAQ (ticker: EXLS).