GCP Engineer
Fractal Analytics3 years ago
Bengaluru, IndiaSenior
Responsibilities
- Understand business requirements and contribute to large-scale client business development and delivery engagements.
- Engineer real-time streaming and batch ingestion and processing pipelines on GCP.
- Use Dataflow, Apache Beam, Python libraries, Java, BigQuery, and Composer to develop data solutions.
- Automate repeatable tasks into reusable project frameworks.
- Handle data quality, governance, and reconciliation during development.
- Define, create, test, and execute operational procedures.
- Communicate with internal and external customers and contribute to delivery activities and agile ceremonies.
Requirements
- Bachelor’s degree in Computer Science or a related field.
- At least 5 years of software development experience.
- At least 3 years of experience in data engineering projects and GCP.
- At least 3 years of Python programming experience.
- At least 3 years of SQL/PL SQL scripting experience.
- At least 3 years of data warehouse or ETL experience.
- Ability to build streaming and batch solutions and understand real-time streaming concepts.
- Hands-on experience with Dataflow and Apache Beam custom templates, Composer, BigQuery, Pub/Sub, Python, and modular Java development using design patterns.
- Understanding of Kafka, RabbitMQ, Redis or Memorystore, Terraform, DevOps pipelines, identity and access management, authentication protocols, and Google Drive and OneDrive APIs.
- Experience with JIRA, Confluence, and Git is expected or beneficial.
- GCP Professional Data Engineer certification is an added advantage.
- Strong problem-solving, analytical, and communication skills.
Tech Stack
Categories
Data Engineering