Responsibilities
- Design, implement, and evolve a petabyte-scale AWS data platform for performance, reliability, and scalability.
- Build and optimize scalable data pipelines using JVM languages, Apache Spark, Python, and cloud-native services.
- Lead architectural and design decisions for long-term platform evolution in collaboration with architects, product owners, and engineering leadership.
- Mentor engineers, conduct high-quality code reviews, and promote engineering best practices.
- Plan and deliver complex technical initiatives within agile value-stream teams.
- Support operational readiness through coding standards, testing practices, monitoring strategies, release procedures, and production deployments.
- Explore GraphQL integrations, vector databases, and AI/LLM-based techniques for data access, platform usability, and development efficiency.
Requirements
- Expert-level software and data engineering experience with large-scale data platforms.
- Deep experience building petabyte-scale systems using Java-based languages such as Scala and Apache Spark.
- Strong expertise with AWS data services, including Glue, S3, Athena, Managed Airflow, and Iceberg.
- Advanced understanding of distributed systems and highly parallelized workloads.
- Strong skills in query optimization, data partitioning, and efficient storage patterns.
- Mastery of AWS cloud ecosystems; Azure and GCP experience are advantageous.
- Experience influencing long-term architecture and platform design.
- Strong code review, mentorship, and technical leadership capabilities.
- Hands-on experience in agile environments and collaboration across multiple engineering teams.
- Strong version-control and multi-repository collaboration skills using Git, GitHub, and Bitbucket.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- Advanced English and availability to travel to São Carlos/SP when needed.
- Experience with dbt or modern transformation frameworks is preferred.
- Knowledge of concurrent and parallel programming is preferred.
- Familiarity with Python, Angular, and TypeScript is preferred.
- Experience with vector databases such as pgvector and Redis vector fields is preferred.
- Practical experience applying AI/LLM techniques to data platforms, data access, or software quality is preferred.
Benefits
- The company promotes inclusive recruitment and professional development initiatives.
- Employees can participate in affinity groups supporting LGBTQIAPN+ people, racial equity, gender equity, people with disabilities, and generational diversity.
- The role is Brazil-based and requires availability to travel to São Carlos/SP when needed.
Tech Stack
Categories
About Experian
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, deliver digital marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realise their financial goals and help them to save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agrifinance, insurance, and many more industry segments. We invest in talented people and new advanced technologies to unlock the power of data and innovate. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.