2 days ago
Berlin, Germany
Senior / Staff+
H1B Sponsor
Responsibilities
- Take ownership of existing data processing pipelines and improve them.
- Design and implement new data processing pipelines.
- Collect and monitor performance metrics.
- Discuss and implement security best practices.
Requirements
- Good knowledge of at least one programming language (C++, Python, Scala, Java).
- Experience with AWS services (S3, EC2, IAM, EMR, Glue, Athena, Kinesis) or other cloud platforms.
- Comfortable with SQL and understanding of SQL engine basics.
- Proficient understanding of distributed computing principles.
- Experience with at least one workflow management tool (Airflow, Oozie, or Luigi).
- Strong analytical thinking and ability to justify technical decisions.
- Creative problem solver with good communication skills in English.
Benefits
- Supportive health care and parental leave.
- Flexibility for personal life events.
- Commitment to teaching and learning for employee success.
- Encouragement of a diverse team and inclusive work environment.
Tech Stack
Apache AirflowApache SparkAWSC++JavaPythonScalaSQL
Categories
AI & MLData EngineeringSecurity