Data Engineer (Spark, Airflow, Iceberg, AWS)
Convotis Iberia9 days ago
Málaga, SpainMid Level / Staff+
Responsibilities
- Build aggregation pipelines that move data from the Silver layer to the Gold layer.
- Generate scoring and awards datasets that support awards, operator claims, and coverage products.
- Perform large-scale data aggregation and collaborate with Data Science teams.
- Work on geospatial tile-based aggregation using the new location model, depending on profile.
- Integrate data from collaborative measurements and drive tests and reconcile operator models.
- Process terabytes of data per day on AWS using Spark, Airflow, Iceberg, and data modeling.
Requirements
- For aggregation and scoring roles, have SQL and Python experience with three or more years of Python experience.
- Have experience with Spark and Athena, Iceberg, or Redshift.
- Have experience orchestrating workflows with Dagster or Airflow.
- Have experience with large-scale data aggregation and collaboration with Data Science teams.
- For the senior big-data profile, have more than ten years of experience as a Data Engineer.
- For the senior big-data profile, have Python, Spark, Apache Airflow, AWS, Apache Iceberg, large-volume data, and data-modeling experience.
- Experience with Kimball-style data modeling is relevant for the senior big-data profile.
- Experience with Silver-to-Gold aggregation pipelines, scoring or awards datasets, geospatial aggregation with H3, Quadkey, or Apache Sedona, and multi-source data integration is a plus.
Benefits
- Flexible working hours with the ability to adjust and compensate schedules.
- Choice to work from the office or from home.
- Medical insurance and flexible compensation.
- Training, English classes, and certifications.
- Internal events, outdoor activities, leisure days, and padel matches.
- Vacation flexibility and a collaborative team environment.
Tech Stack
Categories
Data Engineering
About Convotis Iberia
Convotis Iberia is an IT services and consulting company that builds custom software, data/analytics solutions, and CRM/cloud integrations for enterprise clients. Founded in 2002 and headquartered in Elche (Alicante), it rebranded from Teralco Group in 2024. The firm delivers end-to-end projects—from greenfield development to legacy migrations—and supports clients with AI/ML, systems integration, and ongoing managed services.