Senior Airflow/ Cloud Engineer (Workload Automation)
D.B. Group5 days ago
Birmingham, United KingdomSenior
Responsibilities
- Develop solutions using Python, Kubernetes, Google Cloud services, and API integrations.
- Build and orchestrate REST APIs across Airflow, Google Cloud Platform, Control-M, and Automic.
- Automate infrastructure provisioning, configuration, and management using Infrastructure as Code.
- Deliver secure, scalable user interfaces, backend services, and REST APIs.
- Own features from design and coding through testing, deployment, and production monitoring.
- Integrate, configure, upgrade, and maintain workload automation platforms and independently deliver automation solutions.
- Support platform availability, latency, performance, efficiency, monitoring, emergency response, capacity planning, and change management.
Requirements
- Strong Python and full-stack development experience.
- Extensive experience with automation and delivery tools including Argos CD, GitHub Actions, GitLab, and Ansible.
- Hands-on experience with Google Cloud Platform and services including Terraform, Cloud Composer, BigQuery, Dataflow, Cloud Functions, Dataproc, Google Transfer Service, and Postgres.
- Understanding of Airflow REST services and Airflow integration within a platform ecosystem.
- Experience with API integration, orchestration, ServiceNow integration, and Ansible YAML development.
- Ability to use AI tools to improve productivity and workflows while applying responsible judgment to data and AI outputs.
Benefits
- Hybrid working with eligibility to work remotely for part of the working time.
- Competitive salary and non-contributory pension.
- 30 days of holiday plus bank holidays, with the option to purchase additional days.
- Life Assurance and private healthcare for the employee and family.
- Flexible benefits including retail discounts, Bike4Work, and gym benefits.
- Two days of volunteering leave per year and access to a corporate social responsibility programme.
- Training, development, coaching, expert support, and flexible working arrangements.
Tech Stack
AnsibleApache AirflowArgo CDGitHub ActionsGoogle BigQueryGoogle Cloud PlatformKubernetesPostgreSQLPythonTerraform