26 days ago
Pune, IndiaStaff+
Responsibilities
- Architect, design, and build cloud solutions using Google Cloud Platform.
- Develop modular, object-oriented Python applications for data ingestion and transformation.
- Build and maintain ETL/ELT pipelines using BigQuery, Cloud Functions, Cloud Run, Cloud Composer, and Dataform.
- Integrate external APIs to extract and load data into BigQuery.
- Develop event-driven architectures using Pub/Sub and Eventarc for workflow triggering and real-time data streams.
- Automate deployment and testing workflows using Cloud Build and CI/CD pipelines.
- Optimize the performance and cost of data processing and storage across GCP services.
- Translate business requirements into scalable data solutions with cross-functional teams.
- Ensure data security, governance, and compliance across pipelines and storage layers.
- Oversee other architects and shepherd solution delivery through relevant governance processes.
Requirements
- At least 10 years of data engineering experience, including 4 or more years using Google Cloud Platform.
- Strong Python proficiency, including object-oriented programming, modular design, clean coding standards, design patterns, and SOLID principles.
- Hands-on experience with BigQuery, Cloud Functions, Cloud Run, Cloud Build, Dataform, Pub/Sub, Eventarc, Cloud Storage, and Cloud Composer.
- Solid understanding of SQL, data modeling, and data warehousing concepts.
- Familiarity with Git-based workflows and CI/CD pipelines.
- Experience with UNIX shell scripting, Snowflake, Redshift, MongoDB or other NoSQL technologies is preferred.
- Experience with AWS or Azure is preferred.
- Client-facing skills, technical team management, requirement gathering, and ETL tool experience are preferred.
- Strong problem-solving skills and the ability to work independently in a fast-paced environment.
Benefits
- Full-time permanent position.
- On-site location: DGS India, Pune, Indiqube Orchid.
Categories
Data Engineering
About Dentsu
Dentsu is a global advertising and marketing services group that plans and buys media, develops creative campaigns, and builds data- and technology-led customer experiences for brands. It earns revenue from agency fees and media services across a network that includes Carat, iProspect, and Merkle. Founded in 1901 and headquartered in Tokyo, Dentsu is publicly traded in Japan and serves clients across many sectors worldwide.