4 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Define and drive the long-term technical strategy and architecture for the Open Data Platform.
- Own the design of complex, high-impact systems and establish scalable architectural principles.
- Lead research and development initiatives involving emerging data-platform technologies.
- Drive Apache project contributions, represent Acceldata at conferences, and influence open-source project roadmaps.
- Collaborate with executive, engineering, product, customers, and partners to translate strategy and needs into technical execution.
- Influence engineering practices, tools, culture, and technical decisions across multiple teams.
- Mentor Staff and Senior Engineers and develop technical leadership capabilities.
- Resolve challenging architecture, performance, scalability, reliability, and distributed-systems problems.
- Work across bare-metal, VM, Kubernetes, multi-cloud, and hybrid enterprise architectures.
Requirements
- 15+ years of hands-on software development experience, including at least 8 years focused on distributed systems, big data platforms, or data infrastructure.
- Proven experience leading large-scale technical initiatives from conception through production across multiple teams.
- Expert proficiency in Java or Scala, with strong Python and systems-language skills.
- Deep expertise in distributed computing, including consensus protocols, distributed transactions, replication, partitioning, and modern table-format optimization.
- Production-scale experience architecting and scaling Hadoop, Spark, Hive, Trino, Kafka, Flink, and related systems across hundreds to thousands of nodes.
- Experience designing complex systems handling petabyte-scale data with high availability and performance requirements.
- Expert knowledge of cloud-native architectures, Kubernetes orchestration, and multi-cloud deployment patterns.
- Experience diagnosing distributed-system issues involving performance, resource management, and failure-mode analysis.
- Significant contributions to major open-source projects and experience with distributed global teams and open-source governance.
- Exceptional written and verbal communication, organizational influence, technical vision, and build-versus-buy decision-making.
- Preferred qualifications include Apache PMC or committer status, major conference speaking or published technical work, query-engine or execution-framework experience, lakehouse and table-format expertise, ML infrastructure or MLOps experience, and a Master's or PhD in Computer Science or a related field.
Tech Stack
Categories
BackendData Engineering
