8 months ago
Kitchener, CanadaStaff+
Responsibilities
- Own the end-to-end architecture and design decisions for major platform components.
- Architect and implement distributed data storage, processing, and query-optimization systems.
- Define technical roadmaps and translate business requirements into scalable solutions.
- Lead contributions to Apache projects and open-source communities.
- Diagnose performance bottlenecks and optimize cost, latency, and throughput.
- Mentor Senior Software Engineers and promote technical excellence.
- Establish coding standards, conduct code reviews, and maintain architectural consistency.
- Evaluate emerging technologies, tools, and frameworks for platform use.
- Lead root-cause analysis of critical production issues and drive systemic improvements.
- Work across bare-metal, virtual-machine, Kubernetes, and multi-cloud environments.
Requirements
- At least 9 years of hands-on software development experience, including at least 5 years focused on distributed systems or big data platforms.
- Expert-level proficiency in Java or Scala and strong Python skills; systems-language experience is a plus.
- Deep knowledge of consensus algorithms, data partitioning, replication, fault tolerance, consistency models, and scalable distributed-system architecture.
- Hands-on experience with multiple big-data technologies such as Hadoop, Spark, Hive, Trino, Kafka, Flink, and NiFi.
- Expert Linux proficiency, including kernel tuning, performance analysis, and system-level debugging.
- Strong experience with Kubernetes, Docker, and AWS, GCP, or Azure.
- Expertise with Maven, Gradle, or SBT, along with CI/CD pipelines, GitHub, and Nexus artifact management.
- Ability to diagnose memory leaks, deadlocks, garbage-collection issues, and distributed-system failures.
- Strong written and verbal communication skills and the ability to explain complex technical concepts to varied audiences.
- Ability to collaborate with cross-functional teams, external contributors, and open-source communities.
- Preferred: significant Apache project contributions or committer status, including work with Spark, Kafka, Hive, Iceberg, or Flink.
- Preferred: experience with Apache Iceberg, Delta Lake, Hudi, data lake architectures, query engines, query planners, execution frameworks, data governance, security, lineage, compliance, platform migrations, technical publications, or open-source project leadership.
Tech Stack
Apache FlinkApache HadoopApache HiveApache KafkaApache SparkAWSAzureDockerGoogle Cloud PlatformGradleJavaKubernetesLinuxMavenPythonScala
Categories
BackendData Engineering
About Acceldata
Acceldata builds an agentic data management and data observability platform for enterprises to monitor data pipelines, data quality, and compute performance, and deliver trusted data for AI and analytics. It sells enterprise software, delivered as a cloud service or on‑premises, with subscriptions and professional services for deployment and integration. Founded in 2018 and headquartered in Campbell, California, it serves global enterprises including Nestlé, Dun & Bradstreet, Hershey, PhonePe, and TPG Telecom, and raised a Series C in 2023.