2 months ago
Remote, BrazilMid Level
Responsibilities
- Design, develop, and maintain large-scale data pipelines using Scala, Spark, and cloud-native technologies.
- Design resilient distributed systems and optimize data processing workflows for performance, scalability, and reliability.
- Build and support production-grade data platforms and deliver high-quality, tested, documented code.
- Participate in code reviews, architecture discussions, and technical guidance for peers.
- Collaborate with engineers, product owners, and cross-functional stakeholders to deliver technical solutions.
- Support deployments, monitoring, alerting, release processes, and continuous reliability improvements.
- Improve the performance, cost efficiency, and scalability of data processing workloads.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- Solid experience in software or data engineering.
- Hands-on experience with cloud-native data platforms such as AWS, GCP, or Azure, including services such as S3, Glue, and Athena or equivalents.
- Strong understanding of distributed systems, resiliency patterns, data partitioning, and efficient data access strategies.
- Experience designing and operating highly parallelized data workloads.
- Proficiency with Git-based version control systems such as GitHub or Bitbucket.
- Familiarity with agile methodologies and collaborative multi-team development.
- Strong communication skills and the ability to contribute to technical discussions and support peer development.
- Advanced English proficiency and availability to travel to São Carlos/SP when needed.
- Experience with DBT or other data transformation frameworks is preferred.
- Knowledge of concurrent and parallel programming patterns is preferred.
- Expertise with Scala and Apache Spark for large-scale data pipelines is preferred.
- Experience with functional programming or languages such as Java, Python, or Rust is preferred.
- Familiarity with modern data platform architectures and large-scale data ecosystems is preferred.
Benefits
- Experian promotes inclusive recruitment, professional development, and affinity groups supporting underrepresented communities.
- The role requires availability to travel to São Carlos/SP when needed.
Tech Stack
Categories
BackendData Engineering
About Experian
Experian builds credit reporting, identity and fraud prevention, and data analytics software that help lenders, insurers, healthcare providers, and marketers make decisions; it also offers consumer credit monitoring and scores. The company earns via data licensing, decisioning software, and subscription services, operates in 30+ countries, is headquartered in Costa Mesa, California, and is a FTSE 100 public company listed on the London Stock Exchange (EXPN); it is one of the three major U.S. credit bureaus.