Spark Developer Senior
Ernst and Young1 month ago
São Paulo, BrazilSenior
Responsibilities
- Design, develop, and maintain scalable data-processing applications using Apache Spark and Java on AWS.
- Collaborate with data engineers, data scientists, and business stakeholders to gather requirements and create technical specifications.
- Optimize Spark jobs for performance and efficiency while ensuring high-quality data processing.
- Implement data-engineering practices for data ingestion, transformation, and storage.
- Build and deploy data solutions using AWS EMR, S3, Glue, and Redshift.
- Conduct code reviews and mentor junior developers.
- Troubleshoot and resolve issues in existing data-processing applications to maintain performance and reliability.
- Stay current with relevant technologies and industry trends.
Requirements
- Bachelor's degree in Information Systems, Computer Science, Data Engineering, or a related field.
- Advanced or fluent English proficiency at C2 level.
- Software-development experience with a strong focus on Apache Spark, Java, and AWS.
- Proficiency with data-processing frameworks and tools, particularly Spark SQL and DataFrames.
- Strong knowledge of AWS services including EMR, S3, Glue, and Redshift.
- Excellent analytical and problem-solving skills.
Benefits
- Food allowance, meal allowance, transportation allowance, health insurance, and dental insurance.
- Corporate university and other educational benefits, Wellhub, profit-sharing, and additional benefits.
- On-site work model with flexibility for remote work at EY offices throughout Brazil.
Tech Stack
Categories
Data Engineering
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.