Responsibilities
- Design, develop, and maintain large-scale data pipelines using Scala, Apache Spark, and cloud-native technologies.
- Design resilient distributed systems and optimize data processing workflows for performance, scalability, reliability, and cost efficiency.
- Develop production-grade, tested, clean, and documented code and support end-to-end feature delivery.
- Participate in code reviews, architecture discussions, and efforts to improve engineering practices.
- Support deployments, monitoring, alerting, release processes, and continuous improvement of system reliability.
- Collaborate with engineers, product owners, and cross-functional global stakeholders in agile value stream teams.
- Provide technical guidance to peers and contribute to their development.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- Solid experience in software or data engineering.
- Strong expertise building and optimizing large-scale data pipelines with Scala and Apache Spark.
- Hands-on experience with cloud-native data platforms such as AWS, GCP, or Azure, including services such as S3, Glue, and Athena or equivalents.
- Strong understanding of distributed systems, resiliency patterns, data partitioning, efficient data access strategies, and highly parallelized data workloads.
- Proficiency with Git-based version control systems such as GitHub or Bitbucket.
- Familiarity with agile methodologies and collaborative multi-team development.
- Strong communication skills and ability to contribute to technical discussions and support peer development.
- Advanced English proficiency and availability to travel to São Carlos, São Paulo, when needed.
- Preferred experience with DBT or other data transformation frameworks, concurrent and parallel programming patterns, functional programming, and Java, Python, or Rust.
- Familiarity with modern data platform architectures and large-scale data ecosystems.
Benefits
- Experian promotes inclusive recruitment and professional development initiatives.
- Employees can participate in affinity groups including ExperianPride, Ubuntu, Women in Experian, Aspire, and Connecting Generations.
Tech Stack
Categories
About Experian
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, deliver digital marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them to save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agrifinance, insurance, and many more industry segments. We invest in talented people and new advanced technologies to unlock the power of data and innovate. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.