about 3 hours ago
Bengaluru, India
Mid Level / Senior
H1B Sponsor
Responsibilities
- Own on-call rotations and investigate pipeline failures with end-to-end accountability.
- Maintain SLO/SLA compliance and author incident documentation.
- Build automation tools and integrate data quality checks into CI/CD pipelines.
- Manage and optimize ETL/ELT workflows across various data streams.
- Provision and configure Google Cloud Composer environments.
- Conduct capacity planning reviews for the data warehouse.
- Instrument SLO boards and support data architecture goals.
- Serve as a communication bridge between technical failures and business stakeholders.
Requirements
- Proficiency in Python scripting and Linux.
- Expertise in SQL for complex queries and large-table transactions.
- Fluency in Git for version control in a fast-paced environment.
- Ability to perform root cause analysis across multiple systems.
- Minimum 3 years of experience in production systems.
- Hands-on experience with Google Cloud Composer and orchestration platforms.
- Mindset focused on CI/CD and automation.
Tech Stack
Amazon RedshiftApache AirflowGitHub ActionsGoogle BigQueryGoogle Cloud PlatformNext.jsPrometheusPythonReactSnowflakeSQL
Categories
AI & MLData EngineeringDevOps