
(Sr) Data Engineer Retail Media, Measure & Forecast
Advertima Vision AG2 months ago
Zürich, SwitzerlandSenior
Responsibilities
- Design, develop, and maintain scalable Spark and Python data pipelines for high-volume datasets.
- Implement and optimize Apache Iceberg, Avro, Hadoop, S3/GCS, and Trino-based storage and querying systems.
- Build, manage, and scale real-time ingestion pipelines using Kafka and MQTT.
- Create REST APIs, develop Apache Superset visualizations, and maintain internal and external data contracts.
- Collaborate with Data Scientists and Backend Engineers to transform raw data into features and integrate data products into core applications.
- Support systems combining real-time streaming, large-scale batch processing, lakehouse architectures, and cloud-based analytics.
Requirements
- BSc/MSc in Computer Science, Data Engineering, or a related field, or equivalent practical experience.
- At least 5 years of experience in data engineering or software development.
- Proficiency in Python, including a deep understanding of Spark internals and REST APIs.
- Strong SQL skills and hands-on experience with distributed querying using Trino.
- Experience with event-driven architectures using Kafka and MQTT.
- Experience with big data infrastructure such as Hadoop and Iceberg.
- Experience with containerized development workflows using Docker.
- Fluent written and spoken English.
- Rust, cloud infrastructure or managed data services, Terraform, Ansible, Prometheus, Grafana, OpenTelemetry, ELK, or Loki experience is advantageous.
Benefits
- Hybrid work environment with flexibility between remote and in-person work.
- Employee participation plan.
- Budget for professional development, learning, and growth.
- International startup environment with opportunities for future leadership and specialist roles.
- In-person collaboration at the office and team events.
Tech Stack
AnsibleApache HadoopApache KafkaApache SparkApache SupersetAWSAzureDockerGoogle CloudGoogle Cloud PlatformGrafanaPrometheusPythonRustSQLTerraform
Categories
Data Engineering