(Senior) Data Engineer with Kafka
Aviva Investors5 days ago
Warsaw, PolandMid Level / Senior
Responsibilities
- Build and maintain scalable data pipelines using Kafka/MSK, AWS Glue, Python, and PySpark.
- Design and implement ingestion, transformation, validation, and publishing processes.
- Deliver end-to-end Operational Data Store data flows integrating APIs, event streams, and batch sources.
- Develop reusable frameworks, metadata-driven solutions, and domain onboarding patterns.
- Ensure data quality, integrity, traceability, and adherence to enterprise data models and standards.
- Write clean, testable, maintainable code and participate in code reviews and technical discussions.
- Support CI/CD pipelines, monitoring, logging, and operational excellence initiatives.
- Improve platform performance, scalability, and reliability while collaborating with product, architecture, domain, and engineering teams.
- Contribute to technical documentation, design artefacts, and domain onboarding activities.
Requirements
- More than three years of data engineering experience for the regular level or more than five years for the senior level.
- Experience with Kafka or event-driven architectures.
- Hands-on experience with AWS Glue, S3, ECS, MSK, and Aurora/PostgreSQL.
- Strong Python development skills and experience building ETL/ELT pipelines.
- Good understanding of data modelling concepts.
- Experience with JSON, Avro, and schema-based integrations.
- Familiarity with CI/CD and DevOps practices.
- Knowledge of data quality and data validation techniques.
- Desirable: experience with Apache Kafka/MSK, CDC technologies such as Debezium, metadata-driven data platforms, and financial services or insurance organisations.
Benefits
- Contract of employment and performance bonus.
- Private medical care through ENEL-MED and a cafeteria benefits system such as a MultiSport card.
- Additional parent privileges, including six weeks of leave for the second parent and shortened working time after parental leave.
- Employer-funded group insurance and an Employee Shares Plan.
- Extra day off for birthdays, paid volunteering time, and additional leave accrued over time.
- Two weeks of paid Wellbeing Leave after 10 years of service.
- Psychological support consultations and access to e-learning platforms.
- Internal employee referral program.
- Hybrid working model from Poland with a few days per month in the Warsaw office.
- Additional entitlements for people with disabilities and an inclusive, diversity-focused work environment.
Tech Stack
Categories
Data Engineering