Senior Data Engineer - ODS
Banco Santander, S.A.4 months ago
Madrid, SpainSenior
Responsibilities
- Design, develop, and optimize large-scale data pipelines using Apache Spark, primarily with Scala and Spark.
- Build and maintain batch and near-real-time data processing solutions for high-volume environments.
- Create reliable, reusable datasets for Analytics, Data Science, Machine Learning, and business teams.
- Use cloud data platforms to process, transform, store, and expose data efficiently.
- Implement data quality, validation, monitoring, documentation, and performance optimization practices.
- Collaborate with Data Engineering, Data Science, Machine Learning, Architecture, and business teams to deliver data solutions.
- Contribute to code quality, testing, version control, CI/CD, and automation practices.
Requirements
- At least 5 years of experience in Data Engineering, Big Data Engineering, Software Engineering, or similar technical roles.
- Experience building production-grade data pipelines in large-scale or complex data environments.
- Hands-on experience with Apache Spark, preferably with Scala, and strong knowledge of PySpark, Spark SQL, or Spark-based distributed processing.
- Strong Python or Scala coding skills for data engineering use cases.
- Solid SQL knowledge and experience with relational and analytical databases.
- Experience designing and optimizing ETL/ELT processes.
- Experience with AWS or similar cloud ecosystems, ideally including S3, Glue, Athena, EMR, Redshift, IAM, or Lake Formation.
- Experience with Git and collaborative software development practices.
- Understanding of data quality, validation, monitoring, and performance optimization.
- Experience with CI/CD or DevOps tools such as Jenkins, Sonar, Nexus, Jira, or Splunk.
- Experience in banking, fintech, or regulated environments.
- Fluent Spanish and professional English are preferred.
- Preferred qualifications include Scala, Apache Flink, Spark Streaming, Apache Iceberg, Delta Lake, Airflow, or similar workflow orchestration tools.
- Strong problem-solving, ownership, communication, collaboration, autonomy, and willingness to learn are required.
Tech Stack
Categories
Data Engineering
About Banco Santander, S.A.
Banco Santander, S.A. is a global bank providing retail and commercial banking, corporate and investment banking, wealth management, insurance, and payments for individuals, SMEs, corporates, and public institutions. Founded in 1857 and headquartered in Boadilla del Monte (Madrid), it operates across Europe and the Americas through local subsidiaries and digital brands like Openbank, and is publicly traded, including on the New York Stock Exchange.