8 days ago
Santa Clara, CA, USAStaff+
Base Salary
$179k - $304k/yr
Responsibilities
- Design and optimize large-scale data processing, production, and loading pipelines for various data types.
- Build and maintain high-performance dataset management and loading frameworks.
- Develop and optimize distributed compute and inference systems.
- Collaborate with cross-functional teams to create production-ready infrastructure solutions.
- Monitor, profile, and eliminate bottlenecks across the AI data and compute stack.
Requirements
- Master’s degree in Computer Science, Software Engineering, or equivalent experience.
- 5+ years of experience in large-scale data processing or ML infrastructure.
- Proficient in Python with solid software engineering fundamentals.
- Hands-on experience with relational databases and NoSQL systems.
- Familiarity with Linux file systems and network I/O optimization.
- Strong communication skills and ability to work cross-functionally.
- Ability to learn quickly and adapt to new challenges.