Responsibilities
- Design, develop, and maintain large-scale data pipelines using Scala, Spark, and cloud-native technologies.
- Design resilient distributed systems and optimize data processing workflows for performance, scalability, and reliability.
- Build and support production-grade data platforms and deliver high-quality, tested, documented code.
- Participate in code reviews, architecture discussions, and technical guidance for peers.
- Collaborate with engineers, product owners, and cross-functional stakeholders to deliver technical solutions.
- Support deployments, monitoring, alerting, release processes, and continuous reliability improvements.
- Improve the performance, cost efficiency, and scalability of data processing workloads.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- Solid experience in software or data engineering.
- Hands-on experience with cloud-native data platforms such as AWS, GCP, or Azure, including services such as S3, Glue, and Athena or equivalents.
- Strong understanding of distributed systems, resiliency patterns, data partitioning, and efficient data access strategies.
- Experience designing and operating highly parallelized data workloads.
- Proficiency with Git-based version control systems such as GitHub or Bitbucket.
- Familiarity with agile methodologies and collaborative multi-team development.
- Strong communication skills and the ability to contribute to technical discussions and support peer development.
- Advanced English proficiency and availability to travel to São Carlos/SP when needed.
- Experience with DBT or other data transformation frameworks is preferred.
- Knowledge of concurrent and parallel programming patterns is preferred.
- Expertise with Scala and Apache Spark for large-scale data pipelines is preferred.
- Experience with functional programming or languages such as Java, Python, or Rust is preferred.
- Familiarity with modern data platform architectures and large-scale data ecosystems is preferred.
Benefits
- Experian promotes inclusive recruitment, professional development, and affinity groups supporting underrepresented communities.
- The role requires availability to travel to São Carlos/SP when needed.
Tech Stack
Categories
About Experian
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, deliver digital marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them to save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agrifinance, insurance, and many more industry segments. We invest in talented people and new advanced technologies to unlock the power of data and innovate. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.