5 months ago
Bengaluru, IndiaSenior
Responsibilities
- Lead the design, development, and implementation of complex features for the open-source data platform.
- Architect scalable, robust, high-performance, and reliable solutions.
- Mentor and guide junior software engineers.
- Drive technical discussions and advise on technology selection and engineering best practices.
- Contribute to the strategic direction of the Open Source Data Platform project.
- Perform code reviews focused on quality, maintainability, and standards.
- Work across bare-metal, virtual-machine, and Kubernetes environments.
- Debug threads, deadlocks, memory leaks, and performance bottlenecks in complex software systems.
Requirements
- At least 7 years of experience in distributed systems or data platform development.
- Proficiency with Linux, including automation, troubleshooting, and Linux shortcuts.
- Familiarity with Kubernetes, Docker, and cloud environments.
- Ability to manage threads and diagnose deadlocks and memory leaks.
- Strong understanding of garbage collection tuning and management.
- Advanced hands-on experience with Java, Scala, or Python.
- Experience developing project build models with Maven, Gradle, or SBT.
- Experience managing and using GitHub and Nexus.
- Strong understanding of software engineering, database concepts, virtualization, and architectural patterns.
- Significant contributions to prior projects and experience fixing bugs and developing features in complex software systems.
- Experience with big data stacks or ecosystem components and appropriate application-development frameworks.
- Experience mentoring junior engineers on critical issues or tasks.
- Fluent English communication and the ability to present technical accomplishments and strategic insights to senior leadership.
- Ability to collaborate with internal teams, external contributors, and the open-source community.
- Preferred experience contributing to or serving as a committer for Apache projects.
- Preferred experience identifying performance bottlenecks in big data applications and frameworks.
- Preferred experience migrating applications, Hadoop-based distributions, or data-streaming platforms.
- Preferred familiarity with distributed systems and architectures optimized for scalable data processing.
Benefits
- Full-time onsite position requiring five days per week in the Bangalore office.
- Opportunity to work on mission-critical data platforms operating at petabyte scale.
- Opportunity to contribute to open-source technologies and collaborate with open-source contributors.
Tech Stack
Apache HadoopApache HiveApache KafkaApache SparkDockerGradleJavaKubernetesLinuxMavenMLflowPythonScala
Categories
BackendData Engineering
