about 1 month ago
Warsaw, PolandMid Level / Senior
Responsibilities
- Build a multitenant data platform for data ingestion and cataloguing.
- Lead best practices for managing the Data Platform on AWS.
- Collaborate with architects and business teams to gather requirements.
- Plan and deliver projects successfully with the team.
- Develop data ingestion pipelines in the cloud.
- Utilize Databricks features for data processing and streaming.
- Enhance team excellence and improve processes.
Requirements
- More than 3 years of experience in Python and software craftsmanship.
- Experience with microservices frameworks and event-driven architectures.
- Proficient in building scalable pipelines using Spark and PySpark.
- Experience with Spark Streaming for low latency pipelines.
- Familiarity with Delta format from the Delta Lake project.
- Experience with Kubernetes and MongoDB.
- Strong knowledge of AWS Cloud.
Benefits
- Sports card.
- Private life insurance.
- Private medical and dental care with vision allowance.
- Private pension scheme.
- Volunteer opportunities.
- Support for employee-led affinity groups.
- Business travel accident insurance.
- Employee assistance program.
- Educational assistance reimbursement.