Lead Senior Associate | Google Cloud Platform Data Engineering | Chennai | Engineering as a Service/
Deloitte Advisory30 days ago
Chennai, IndiaStaff+
Responsibilities
- Build and optimize large-scale ETL/ELT data pipelines on GCP.
- Develop data processing and scripting solutions using SQL, Python, Java, Scala, Spark, and PySpark.
- Design analytical data models, schemas, partitioning strategies, and cloud data architectures.
- Work with BigQuery, Dataflow/Apache Beam, Pub/Sub, Cloud Storage, Cloud Composer/Airflow, and Cloud Functions.
- Implement streaming data architectures and optimize query performance, scalability, and reliability.
- Lead complex projects end-to-end and mentor, document, and share knowledge with the team.
- Support data privacy, compliance, and security for data at rest and in transit.
- Collaborate with stakeholders and work independently on technical initiatives.
Requirements
- Bachelor's or master's degree in Computer Science, Engineering, Information Systems, or a related field.
- At least 5 years of experience in data engineering, including at least 3 years working extensively with GCP.
- Strong proficiency with SQL, Python, and/or Java or Scala for data processing and scripting.
- Proven experience with BigQuery, Dataflow/Apache Beam, Pub/Sub, Cloud Storage, Cloud Composer/Airflow, and Cloud Functions.
- Experience building large-scale ETL/ELT pipelines and optimizing cloud query performance.
- Strong understanding of data modeling, partitioning, and schema design for analytical workloads.
- Familiarity with Terraform, version control such as Git, and CI/CD practices.
- Preferred qualifications include a GCP Professional Data Engineer Certification or equivalent.
- Preferred experience includes Looker, dbt, Kafka, Spark Streaming, Flink, Kubernetes, Cloud Run, data privacy, and GDPR/CCPA compliance.
- Strong analytical, problem-solving, communication, stakeholder engagement, collaboration, and project leadership skills.
Tech Stack
Apache AirflowApache BeamApache FlinkApache HiveApache KafkaApache SparkdbtGitGoogle BigQueryGoogle Cloud PlatformJavaKubernetesPythonScalaSQLTerraform
Categories
Data Engineering
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.