1 day ago
Santa Clara, CA, USASenior / Staff+
H1B sponsor
Base Salary
$196k - $293k/yr
Responsibilities
- Architect how the data processing engine interfaces with open-source platforms and engines.
- Lead design of functional and performance enhancements to Apache Gluten, Velox, and their integrations.
- Design, implement, test, optimize, and maintain data processing engine components.
- Analyze technology roadmaps and identify opportunities to improve technology and product leadership.
- Collaborate with engineering, product management, open-source communities, and customer success teams.
- Promote best practices in design reviews, code reviews, testing, CI/CD, and issue resolution.
Requirements
- 12+ years of relevant experience.
- Bachelor’s degree in Computer Science or a related field, or a master’s degree in Computer Science.
- At least three years of deep technical experience developing core components of Apache Spark, Apache Flink, Apache Doris, Apache Gluten, Velox, Apache DataFusion, Apache DataFusion Comet, or equivalent large-scale data processing platforms.
- At least three years of experience instrumenting, analyzing, and optimizing data processing engine performance on benchmark and customer workloads.
- Knowledge of the architecture and internal operation of one or more of Apache Spark, Apache Flink, or Presto/Trino.
- Experience designing, developing, and successfully releasing high-performance data processing engines for large production deployments.
- Exceptional programming skills in C, C++, and Java.
- Extensive development experience in Linux environments.
- Strong analytical and problem-solving skills with a focus on performance optimization.
Benefits
- Comprehensive benefits package that may include health insurance, life insurance, retirement or pension plans, paid time off, various leave options, performance-based incentives, employee stock purchase plans, and restricted stock units, subject to regional variations and company policies.
Tech Stack
Categories
BackendData Engineering
About NetApp
NetApp builds data storage and data management software and hardware for enterprises, including ONTAP-powered all-flash arrays and hybrid cloud services that integrate with AWS, Azure, and Google Cloud. It sells systems and subscriptions that support backup, disaster recovery, databases, and container/Kubernetes workloads. Founded in 1992 and headquartered in San Jose, California, NetApp is a public company listed on NASDAQ.