2 months ago
Brussels, BelgiumSenior
Responsibilities
- Capture, integrate, and process structured and unstructured data from internal and external sources.
- Design, develop, maintain, and optimize ETL/ELT pipelines.
- Structure, standardize, qualify, document, and map lineage for data sources.
- Monitor and improve data quality through validation, testing, cleansing, and duplicate-data removal.
- Ensure the quality and reliability of data entering the Data Lake.
- Contribute to data repositories, data governance, data management practices, and enterprise data architecture.
- Write technical specifications and design documentation and participate in architectural discussions.
- Develop and execute unit tests and deliver reliable development activities.
- Monitor production systems and data pipelines and perform maintenance, troubleshooting, and issue resolution.
- Collaborate with business stakeholders, architects, developers, Data Analysts, and Data Scientists.
Requirements
- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.
- Strong experience with Python for data processing, scripting, and ETL implementation.
- Advanced knowledge of SQL, relational databases, and data warehouse concepts.
- Experience designing and optimizing data models and database performance.
- Strong understanding of software development best practices.
- Proficiency with version control systems, particularly Git.
- Experience developing and maintaining ETL/ELT solutions.
- Preferred hands-on experience with Databricks, including ETL pipeline development, Spark cluster management, and SQL optimization and performance tuning.
- Experience with Apache Airflow and DAG development for workflow orchestration.
- Knowledge of Big Data ecosystems, Data Lake architectures, and IoT platforms.
- Familiarity with cloud-based data platforms and modern data engineering frameworks.
Tech Stack
Categories
Data Engineering
About Everience
Everience Italia provides IT managed services, including helpdesk support, break-fix dispatch, and technology consulting for SMEs and enterprises. Founded in 2012 and headquartered in Rho, Lombardy, it operates within an international group under the Everience brand and offers multilingual nearshore support from Timisoara, Romania. Revenue comes from managed service contracts and project-based support across Italy and abroad.