2 months ago
Remote, BrazilStaff+
Responsibilities
- Lead the technical design and implementation of large-scale data-processing and streaming applications.
- Define architecture standards and best practices for distributed data platforms.
- Design, develop, and optimize batch and real-time data pipelines using Apache Spark and Kafka.
- Build and maintain scalable APIs following OpenAPI specifications.
- Analyze systems, identify performance bottlenecks, and implement optimization strategies.
- Translate business and product requirements into technical solutions with cross-functional stakeholders.
- Provide technical direction through mentoring, code reviews, knowledge sharing, and engineering guidance.
- Ensure solutions are secure, scalable, maintainable, and aligned with enterprise standards.
- Drive continuous improvement across development processes, architecture, and platform reliability.
- Participate in technical decision-making and roadmap planning.
Requirements
- Strong experience developing Java applications in enterprise environments.
- Expertise with Apache Spark, including Spark SQL, Spark Structured Streaming, and distributed data processing.
- Hands-on experience with the Cloudera ecosystem, Apache Kafka, and Kafka Streams.
- Experience developing applications with Scala.
- Expertise designing and implementing RESTful APIs using OpenAPI specifications.
- Strong understanding of SQL databases and data modeling.
- Experience with cloud platforms, particularly AWS, and hands-on experience with Databricks.
- Strong systems analysis and troubleshooting capabilities.
- Experience leading technical teams and complex software projects, making architectural decisions, and providing technical direction.
- Experience mentoring developers and promoting engineering best practices.
- Preferred qualifications include cloud-native architecture, microservices, CI/CD and DevOps practices, Agile/Scrum environments, and data governance, monitoring, and observability frameworks.
- Strong stakeholder management, communication, and business-prioritization skills.
Benefits
- Permanent, full-time contract.
- Career development opportunities and training in finance, technology, and data management.
- Opportunity to work in a challenging, multicultural environment on international projects.
- Exposure to large-scale financial IT systems and cross-country operations.
- Commitment to non-discrimination and workplace equality.
Tech Stack
Categories
BackendData Engineering
