Senior Airflow Reliability Engineer
Astronomer
about 7 hours ago
Dublin, Ireland
Senior / Mid Level
H1B Sponsor
Responsibilities
- Become an expert in Apache Airflow and provide direct support to customers.
- Solve challenging Airflow problems, including configuration optimization and bug identification.
- Spend up to 25% of your time on side projects that contribute to Astronomer's success.
- Work directly with customers' data engineers and DevOps teams to prioritize and solve issues.
- Maintain 24x7 coverage through a specified pager period during your workday.
- Participate in a paid on-call rotation for weekend coverage.
Requirements
- Background in Data Engineering.
- 4 years of experience with Python.
- 1 year of experience with Kubernetes/Docker/Containers.
- Experience in Airflow administration and DAG creation.
- Experience with distributed systems on major cloud providers (AWS, GCP, Azure).
- Strong problem-solving and troubleshooting abilities.
- Ability to work autonomously and independently.
- Strong written and verbal communication skills.
Tech Stack
Amazon RedshiftApache AirflowAWSAzureDatabricksdbtDockerGoogle Cloud PlatformKubernetesPostgreSQLPythonSnowflakeSQL
Categories
Data EngineeringDevOps