almost 2 years ago
San Jose, CA, USAIntern
Responsibilities
- Research and apply cutting-edge technologies to optimize large language models and multimodal models.
- Develop core algorithmic optimizations for efficient inference across heterogeneous architectures.
- Optimize model deployment for vehicle digital cockpit and advanced-driving applications.
- Collaborate with cross-functional teams to integrate optimized models into automotive applications.
- Contribute across research, development, testing, and deployment on GPUs and distributed hardware systems.
- Debug and improve model performance in distributed computing environments.
Requirements
- Currently pursuing or completed a Ph.D. or master’s degree in computer science, computer engineering, applied mathematics, communications, electronics, or a related field, with relevant research projects and publications.
- Strong understanding of GPU and NPU architecture and optimization techniques for identifying and resolving bottlenecks.
- Proficiency with LLM and VLM architectures, transformer-based NLP, audio, and computer-vision algorithms and technologies.
- Proficiency in Python and AI training and inference tools such as PyTorch.
- Proficiency in C/C++ and familiarity with at least one commonly used LLM inference engine.
- Hands-on experience with model-serving frameworks such as Open Neural Network Exchange (ONNX).
- Familiarity with debugging code in distributed computing environments.
- Experience optimizing LLM inference on resource-constrained edge devices is a plus.
- Preferred qualifications include a Ph.D. in computer science, artificial intelligence, or a related field, or a master’s degree plus three years of relevant industry experience.
- Experience optimizing deep-learning model inference techniques or libraries on hardware architectures is preferred.
- Familiarity with microkernel architecture, Linux kernel, hypervisor, middleware, and application frameworks is preferred.
- Strong publication records and high-impact innovative papers are preferred.
Benefits
- US base salary is $38.00-$46.00 per hour.
- Medical plans include CIGNA EPO, HSA, and Kaiser HMO options, with $0 employee-only coverage.
- Dental and vision plans include orthodontic coverage and options with $0 paycheck contribution for employees and eligible dependents.
- Company-paid HSA contribution is available with the high-deductible CIGNA medical plan.
- Healthcare and dependent-care flexible spending accounts are available.
- 401(k) plan includes a Brokerage Link option.
- Company-paid basic life, AD&D, short-term disability, and long-term disability insurance are provided.
- Employee Assistance Program, sick time, vacation time, and 13 paid holidays are provided.
- Paid parental leave and paid disability leave are available after 90 days of employment, subject to the stated eligibility terms.
- Voluntary benefits include life and AD&D coverage, pet insurance, commuter benefits, mobile phone credit, and the Healthjoy mobile benefits app.
- Free lunch and snacks, an onsite gym, and employee discounts and perks are provided.
Categories
