3 days ago
Base Salary
$295k - $345k/yr
Responsibilities
- Define and drive the architectural vision for core data platforms.
- Align technical roadmaps with business-critical metrics through cross-functional collaboration.
- Optimize performance of distributed engine internals and complex query planning.
- Integrate AI/ML capabilities within the core data platform for enhanced data discovery.
- Set standards for code quality and mentor engineers to foster technical rigor.
Requirements
- B.S. in Computer Science or equivalent experience.
- 8+ years of experience in building and maintaining large-scale distributed systems.
- Expertise in foundational data technologies like Kafka, Flink, and Spark.
- Proven track record of architecting and deploying core data platform code.
- Strong proficiency in Java, Go, or Scala for backend development.
- Experience managing complex data infrastructure on Kubernetes in AWS or GCP.
- Demonstrated ability to influence technical direction across large organizations.
- History of radical accountability and ownership in high-ambiguity environments.
Tech Stack
Apache AirflowApache FlinkApache HiveApache KafkaApache SparkAWSGoGoogle Cloud PlatformJavaKubernetesScala