over 1 year ago
San Jose, CA, USAEntry Level
Base Salary
$143k - $186k/yr
Responsibilities
- Research and apply cutting-edge techniques to optimize large language and multimodal models.
- Develop core algorithmic optimizations for efficient LLM inference on heterogeneous architectures.
- Optimize and deploy models across distributed and heterogeneous hardware environments, including vehicle digital cockpit and advanced-driving systems.
- Identify and address GPU/NPU architecture bottlenecks and optimize inference on resource-constrained edge devices.
- Contribute to research, development, testing, and hardware deployment while collaborating with cross-functional teams.
Requirements
- Currently pursuing or completed a PhD or master’s degree in computer science, computer engineering, applied mathematics, communications, electronics, or a related field, with relevant research projects and publications.
- Strong understanding of GPU/NPU architecture and optimization techniques.
- Proficiency with LLM and VLM architectures, transformer-based NLP, audio, and computer-vision algorithms and technologies.
- Proficiency in Python, C, and C++, with experience using AI training and inference tools such as PyTorch.
- Familiarity with at least one commonly used LLM inference engine and model-serving frameworks such as ONNX.
- Familiarity with debugging code in distributed computing environments.
- Preferred: PhD in computer science, artificial intelligence, or a related field, or a master’s degree plus three years of relevant industry experience.
- Preferred: experience optimizing deep-learning inference techniques or libraries on hardware architectures and familiarity with microkernels, the Linux kernel, hypervisors, middleware, and application frameworks.
- Strong publication records and high-impact innovative papers are preferred.
Benefits
- Full-time employees receive medical coverage through CIGNA EPO, HSA, and Kaiser HMO plans, with $0 employee-only coverage; dental and vision plans include options with $0 paycheck contribution for employees and eligible dependents.
- Company-paid HSA contributions are available with the high-deductible CIGNA plan, along with healthcare and dependent-care FSAs.
- Benefits include a 401(k) with BrokerageLink, company-paid life and disability insurance, an Employee Assistance Program, sick and vacation time, and 13 paid holidays.
- Employees receive paid parental leave and paid disability leave after 90 days of employment, plus voluntary life, AD&D, pet insurance, commuter, and mobile-phone benefits.
- Additional perks include a health benefits app, free lunch and snacks, an onsite gym, and employee discounts and perks.
Categories
