2 months ago
Remote, Colombia or Bogotá, ColombiaStaff+
Responsibilities
- Lead the technical design and implementation of large-scale data processing and streaming applications.
- Define architecture standards and best practices for distributed data platforms.
- Design, develop, and optimize batch and real-time data pipelines using Apache Spark and Kafka.
- Build and maintain scalable APIs following OpenAPI specifications.
- Analyze systems, identify performance bottlenecks, and implement optimization strategies.
- Translate business and product requirements into technical solutions with cross-functional stakeholders.
- Mentor development teams through code reviews, technical guidance, and knowledge sharing.
- Ensure solutions are secure, scalable, maintainable, and aligned with enterprise standards.
- Drive continuous improvement across development processes, architecture, and platform reliability.
- Participate in technical decision-making and roadmap planning.
Requirements
- Strong enterprise Java development experience.
- Expertise in Apache Spark, including Spark SQL, Spark Structured Streaming, and distributed data processing.
- Hands-on experience with the Cloudera ecosystem.
- Strong knowledge of Apache Kafka and Kafka Streams.
- Experience developing applications with Scala.
- Expertise designing and implementing RESTful APIs using OpenAPI specifications.
- Strong understanding of SQL databases and data modeling.
- Experience with cloud platforms, particularly AWS.
- Hands-on Databricks experience.
- Strong systems analysis and troubleshooting capabilities.
- Experience leading technical teams and complex software projects.
- Ability to make architectural decisions and provide technical direction.
- Experience mentoring developers and promoting engineering best practices.
- Preferred: experience with cloud-native architectures, microservices, CI/CD, DevOps, Agile/Scrum, data governance, monitoring, and observability frameworks.
Benefits
- Permanent, full-time contract.
- Career development and training opportunities in finance, technology, and data management.
- Opportunity to work in a multicultural environment on international projects.
- Exposure to large-scale financial IT systems and cross-country operations.
Tech Stack
Categories
BackendData Engineering
