Lead Senior Associate | Google Cloud Platform Data Engineering | Bengaluru | Engineering as a Servic
Deloitte Advisory30 days ago
Bengaluru, IndiaSenior
Responsibilities
- Build and optimize large-scale ETL/ELT data pipelines on Google Cloud Platform.
- Design analytical data models, partitioning strategies, and schemas, and optimize query performance.
- Develop data processing and scripting solutions using SQL, Python, Java, Scala, PySpark, and Spark.
- Work with GCP services including BigQuery, Dataflow/Apache Beam, Pub/Sub, Cloud Storage, Cloud Composer/Airflow, and Cloud Functions.
- Support streaming data architectures using technologies such as Kafka, Spark Streaming, or Flink.
- Apply CI/CD, Terraform, version control, data privacy, compliance, and data security practices.
- Lead complex projects end to end, engage stakeholders, mentor colleagues, and document and share knowledge.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
- 5+ years of experience in data engineering, including at least 3+ years working extensively on GCP.
- Strong proficiency with SQL, Python, and/or Java or Scala for data processing and scripting.
- Proven experience with BigQuery, Dataflow/Apache Beam, Pub/Sub, Cloud Storage, Cloud Composer/Airflow, and Cloud Functions.
- Experience building large-scale ETL/ELT pipelines and optimizing analytical query performance on cloud platforms.
- Solid understanding of data modeling, partitioning, and schema design for analytical workloads.
- Familiarity with CI/CD practices, Terraform, and version control such as Git.
- GCP Professional Data Engineer Certification or equivalent is preferred.
- Experience with Looker, dbt, streaming data technologies, data privacy, GDPR/CCPA compliance, data security, DevOps, and container orchestration tools such as Kubernetes or Cloud Run is preferred.
- Strong analytical, problem-solving, communication, stakeholder engagement, collaboration, project leadership, mentoring, and documentation skills.
Tech Stack
Apache AirflowApache BeamApache FlinkApache HiveApache KafkaApache SparkdbtGitGoogle BigQueryGoogle Cloud PlatformJavaKubernetesPythonScalaSQLTerraform
Categories
Data Engineering
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.