5 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Define and drive the long-term technical strategy and architecture for the Open Data Platform.
- Own the design of complex, high-impact systems and establish scalable architectural principles.
- Lead research and development initiatives involving emerging data-platform technologies.
- Drive Apache project contributions, represent Acceldata at conferences, and influence open-source project roadmaps.
- Collaborate with executive, engineering, product, customers, and partners to translate strategy and needs into technical execution.
- Influence engineering practices, tools, culture, and technical decisions across multiple teams.
- Mentor Staff and Senior Engineers and develop technical leadership capabilities.
- Resolve challenging architecture, performance, scalability, reliability, and distributed-systems problems.
- Work across bare-metal, VM, Kubernetes, multi-cloud, and hybrid enterprise architectures.
Requirements
- 15+ years of hands-on software development experience, including at least 8 years focused on distributed systems, big data platforms, or data infrastructure.
- Proven experience leading large-scale technical initiatives from conception through production across multiple teams.
- Expert proficiency in Java or Scala, with strong Python and systems-language skills.
- Deep expertise in distributed computing, including consensus protocols, distributed transactions, replication, partitioning, and modern table-format optimization.
- Production-scale experience architecting and scaling Hadoop, Spark, Hive, Trino, Kafka, Flink, and related systems across hundreds to thousands of nodes.
- Experience designing complex systems handling petabyte-scale data with high availability and performance requirements.
- Expert knowledge of cloud-native architectures, Kubernetes orchestration, and multi-cloud deployment patterns.
- Experience diagnosing distributed-system issues involving performance, resource management, and failure-mode analysis.
- Significant contributions to major open-source projects and experience with distributed global teams and open-source governance.
- Exceptional written and verbal communication, organizational influence, technical vision, and build-versus-buy decision-making.
- Preferred qualifications include Apache PMC or committer status, major conference speaking or published technical work, query-engine or execution-framework experience, lakehouse and table-format expertise, ML infrastructure or MLOps experience, and a Master's or PhD in Computer Science or a related field.
Tech Stack
Categories
BackendData Engineering
About Acceldata
Acceldata builds an agentic data management and data observability platform for enterprises to monitor data pipelines, data quality, and compute performance, and deliver trusted data for AI and analytics. It sells enterprise software, delivered as a cloud service or on‑premises, with subscriptions and professional services for deployment and integration. Founded in 2018 and headquartered in Campbell, California, it serves global enterprises including Nestlé, Dun & Bradstreet, Hershey, PhonePe, and TPG Telecom, and raised a Series C in 2023.