1 day ago
Base Salary
$228k - $339k/yr
Responsibilities
- Architect how the DataPelago data processing engine interfaces with open-source platforms and engines.
- Lead the design of functional and performance enhancements for Apache Gluten, Velox, and their integration with the DataPelago engine.
- Design, implement, test, optimize, and maintain core data processing engine components.
- Analyze open-source technology roadmaps and identify opportunities for product and technology differentiation.
- Contribute downstream and upstream to open-source projects and engage with their communities.
- Collaborate with engineering, product management, open-source community, and customer success teams.
- Promote best practices in design reviews, code reviews, testing, CI/CD, and issue resolution.
Requirements
- 15+ years of relevant experience.
- A bachelor’s degree in Computer Science or a related field, or a master’s degree in Computer Science or a related field.
- At least 3 years of deep technical experience developing core components of Apache Spark, Apache Flink, Apache Doris, Apache Gluten, Velox, Apache DataFusion, Apache DataFusion Comet, or equivalent large-scale data processing platforms.
- At least 3 years of experience instrumenting, analyzing, and optimizing data processing engine performance on benchmark and customer workloads.
- Experience designing, developing, and successfully releasing high-performance data processing engines for large production deployments.
- Exceptional programming skills in C, C++, and Java.
- Extensive development experience in Linux environments.
- Strong analytical and problem-solving skills with a focus on performance optimization.
Benefits
- Comprehensive benefits package that may include health insurance, life insurance, retirement or pension plans, paid time off, leave options, performance-based incentives, employee stock purchase plans, and restricted stock units; offerings vary by country and region.
Tech Stack
Categories
BackendData Engineering
About NetApp
NetApp builds data storage and data management software and hardware for enterprises, including ONTAP-powered all-flash arrays and hybrid cloud services that integrate with AWS, Azure, and Google Cloud. It sells systems and subscriptions that support backup, disaster recovery, databases, and container/Kubernetes workloads. Founded in 1992 and headquartered in San Jose, California, NetApp is a public company listed on NASDAQ.