8 months ago
Kitchener, CanadaStaff+
Responsibilities
- Define and drive the long-term technical strategy and architecture for the Open Data Platform.
- Own the design of complex, high-impact systems and establish scalable architectural principles across the organization.
- Lead research and development initiatives involving emerging technologies and data-platform innovation.
- Drive Apache project contributions, represent Acceldata at conferences, and influence open-source project roadmaps.
- Collaborate with the CTO, VP of Engineering, product leadership, customers, and partners on technical strategy and platform capabilities.
- Influence engineering practices, tools, culture, and technical decisions across multiple teams.
- Mentor Staff and Senior Engineers and develop technical leadership capabilities.
- Resolve challenging architecture, performance, scalability, reliability, resource-management, and failure-mode issues.
- Work across bare-metal, virtual-machine, Kubernetes, multi-cloud, and hybrid enterprise architectures.
Requirements
- At least 14 years of software development experience, including 8+ years focused on distributed systems, big data platforms, or data infrastructure.
- Proven experience leading large-scale technical initiatives from conception through production across multiple teams.
- Expert proficiency in Java or Scala, with strong Python and systems-language skills.
- Deep knowledge of distributed computing, consensus protocols, distributed transactions, replication, partitioning, and modern table-format optimization.
- Extensive production-scale experience with Hadoop, Spark, Hive, Trino, Kafka, Flink, and related technologies.
- Experience designing systems that process petabyte-scale data with high availability and performance requirements.
- Expertise in cloud-native architecture, Kubernetes orchestration, and multi-cloud deployment patterns.
- Significant contributions to major open-source projects and experience with distributed global teams and open-source governance.
- Exceptional written and verbal communication skills and the ability to influence technical direction across organizations and external stakeholders.
- Experience balancing long-term technical vision with near-term delivery and making build-versus-buy decisions.
- Preferred qualifications include Apache PMC or committer status, major conference speaking or published technical content, query-engine or execution-framework experience, lakehouse and data-mesh expertise, ML infrastructure or MLOps experience, and a Master’s or PhD in Computer Science.
Benefits
- Unlimited-negative-balance PTO plan.
- RRSP plan.
- Up to 100% employer-paid health, dental, and vision benefit options.
- Supplemental benefits.
- Apple Air Mac equipment.
- Office gym access with workout equipment, a basketball court, and showers.
- Opportunity to work with Apache members, committers, and distributed-systems industry veterans on open-source data-platform technology.
Tech Stack
Categories
BackendData Engineering
About Acceldata
Acceldata builds an agentic data management and data observability platform for enterprises to monitor data pipelines, data quality, and compute performance, and deliver trusted data for AI and analytics. It sells enterprise software, delivered as a cloud service or on‑premises, with subscriptions and professional services for deployment and integration. Founded in 2018 and headquartered in Campbell, California, it serves global enterprises including Nestlé, Dun & Bradstreet, Hershey, PhonePe, and TPG Telecom, and raised a Series C in 2023.