Data Engineer
Ernst and Young1 month ago
Milan, ItalyMid Level
Responsibilities
- Design and implement end-to-end batch and real-time data pipelines.
- Develop and optimize data lake, data warehouse, and lakehouse architectures in cloud and hybrid environments.
- Integrate heterogeneous data sources through APIs, messaging systems, databases, and enterprise applications.
- Define standards for data modeling, quality, cataloging, lineage, and observability.
- Ensure data platform performance, resilience, security, regulatory compliance, and cost sustainability.
- Implement DataOps, CI/CD, Infrastructure as Code, and process automation practices.
- Collaborate with Data Scientists and AI Engineers to provide reliable data for analytics, machine learning, and AI solutions.
- Evaluate technologies, frameworks, and cloud services and support architecture decisions.
- Conduct code reviews, define engineering best practices, and mentor Data Engineers.
- Ensure compliance with GDPR, INFOSEC requirements, and company data governance policies.
Requirements
- At least four years of experience in Data Engineering or comparable roles, including at least three years in senior or technical-responsibility positions.
- Proficiency in SQL and at least one of Python, Scala, or Java.
- Experience with distributed processing and streaming technologies such as Apache Spark and Kafka.
- Knowledge of data orchestration and transformation tools such as Airflow, Dagster, or dbt.
- Experience with enterprise cloud platforms including AWS, Azure, or GCP and their data services.
- Knowledge of data lake, data warehouse, and lakehouse architectures and platforms such as Databricks, Snowflake, BigQuery, Redshift, or Microsoft Fabric.
- Experience with data quality, metadata management, data lineage, monitoring, and troubleshooting.
- Knowledge of containerization, CI/CD, Infrastructure as Code, and version control systems.
- Ability to translate functional requirements into robust, maintainable technical solutions.
- Strong problem-solving, technical communication, collaboration, and mentoring skills.
Benefits
- Annual salary range of €35,000–€45,000 plus a bonus based on previously communicated and agreed objectives.
- Hybrid work without centrally predetermined office days.
- Ability to work remotely from abroad for up to 20 days when not traveling for work.
- More than 50 hours of technical and management training annually, along with future-focused development programs.
- International teams, a global professional network, and international mobility opportunities.
- Counselor support from the first day, welfare benefits, and leadership programs.
- Inclusive workplace and accessibility support aligned with Italian Law L.68/99.
Tech Stack
Amazon RedshiftApache AirflowApache KafkaApache SparkAWSAzureDatabricksdbtGoogle BigQueryGoogle Cloud PlatformJavaPythonScalaSnowflakeSQL
Categories
Data Engineering
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.