10 hours ago
Remote, BrazilStaff+
Responsibilities
- Design, implement, and evolve a petabyte-scale AWS data platform for performance, reliability, and scalability.
- Build and optimize scalable data pipelines using JVM languages, Apache Spark, Python, and cloud-native services.
- Lead architecture and design decisions with architects, product owners, and engineering leadership.
- Mentor engineers, conduct code reviews, and promote engineering best practices.
- Plan and deliver complex technical initiatives across agile value-stream teams.
- Support operational readiness, production deployments, monitoring, testing, and release procedures.
- Explore GraphQL integrations, vector databases, and AI/LLM-based techniques for data platforms and development efficiency.
Requirements
- Expert-level software and data engineering experience with large-scale data platforms.
- Deep experience building petabyte-scale systems using Java-based languages such as Scala and Apache Spark.
- Strong expertise with AWS data services including Glue, S3, Athena, Managed Airflow, and Iceberg.
- Advanced understanding of distributed systems, highly parallelized workloads, query optimization, data partitioning, and efficient storage patterns.
- AWS cloud expertise; Azure and GCP experience are pluses.
- Experience influencing long-term architecture and platform design.
- Strong code review, mentorship, technical leadership, version control, and multi-repository collaboration skills.
- Experience working in agile environments and across multiple engineering teams.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- Advanced English and availability to travel to São Carlos, São Paulo when needed.
- Experience with dbt or modern transformation frameworks is preferred.
- Knowledge of concurrent and parallel programming is preferred.
- Familiarity with Python, Angular, and TypeScript is preferred.
- Experience with vector databases such as pgvector and Redis vector fields is preferred.
- Practical experience applying AI/LLM techniques to data platforms, data access, or software quality is preferred.
Benefits
- Inclusive workplace initiatives and affinity groups supporting LGBTQIAPN+ people, racial equity, gender equity, people with disabilities, and multiple generations.
- Brazil-based role with availability to travel to São Carlos/SP when needed.
Tech Stack
Categories
Data Engineering
About Experian
Experian builds credit reporting, identity and fraud prevention, and data analytics software that help lenders, insurers, healthcare providers, and marketers make decisions; it also offers consumer credit monitoring and scores. The company earns via data licensing, decisioning software, and subscription services, operates in 30+ countries, is headquartered in Costa Mesa, California, and is a FTSE 100 public company listed on the London Stock Exchange (EXPN); it is one of the three major U.S. credit bureaus.