2 days ago
Warsaw, Poland
Senior / Staff+
H1B Sponsor
Base Salary
$75k - $112k/yr
Responsibilities
- Take ownership, improve, scale, and iterate on existing data processing pipelines.
- Design and implement new data processing pipelines.
- Collect and monitor performance metrics.
- Discuss and implement security best practices.
Requirements
- Good knowledge of at least one programming language (C++, Python, Scala, or Java).
- Experience with AWS services (S3, EC2, IAM, EMR, Glue, Athena, Kinesis) or any other cloud platform.
- Comfortable with SQL and have a thorough understanding of SQL engine basics.
- Proficient understanding of distributed computing principles.
- Experience with at least one workflow management tool, such as Airflow, Oozie, or Luigi.
- Strong analytical thinking and the ability to justify technical decisions.
- Creative, resourceful, and innovative problem solver.
- Excellent communication skills in English, both written and spoken.
Benefits
- Supportive health care and parental leave.
- Flexibility for personal life events.
- Emphasis on teaching and learning for employee success.
- Commitment to growing a diverse team.
Tech Stack
Apache AirflowApache SparkAWSC++JavaPythonScalaSQL
Categories
AI & MLData EngineeringSecurity