2 years ago
San Jose, CA, USAIntern
Responsibilities
- Research and apply cutting-edge technologies to optimize large language models and multimodal models.
- Develop core algorithmic optimizations for efficient inference across heterogeneous architectures.
- Optimize model deployment for vehicle digital cockpit and advanced-driving applications.
- Collaborate with cross-functional teams to integrate optimized models into automotive applications.
- Contribute across research, development, testing, and deployment on GPUs and distributed hardware systems.
- Debug and improve model performance in distributed computing environments.
Requirements
- Currently pursuing or completed a Ph.D. or master’s degree in computer science, computer engineering, applied mathematics, communications, electronics, or a related field, with relevant research projects and publications.
- Strong understanding of GPU and NPU architecture and optimization techniques for identifying and resolving bottlenecks.
- Proficiency with LLM and VLM architectures, transformer-based NLP, audio, and computer-vision algorithms and technologies.
- Proficiency in Python and AI training and inference tools such as PyTorch.
- Proficiency in C/C++ and familiarity with at least one commonly used LLM inference engine.
- Hands-on experience with model-serving frameworks such as Open Neural Network Exchange (ONNX).
- Familiarity with debugging code in distributed computing environments.
- Experience optimizing LLM inference on resource-constrained edge devices is a plus.
- Preferred qualifications include a Ph.D. in computer science, artificial intelligence, or a related field, or a master’s degree plus three years of relevant industry experience.
- Experience optimizing deep-learning model inference techniques or libraries on hardware architectures is preferred.
- Familiarity with microkernel architecture, Linux kernel, hypervisor, middleware, and application frameworks is preferred.
- Strong publication records and high-impact innovative papers are preferred.
Benefits
- US base salary is $38.00-$46.00 per hour.
- Medical plans include CIGNA EPO, HSA, and Kaiser HMO options, with $0 employee-only coverage.
- Dental and vision plans include orthodontic coverage and options with $0 paycheck contribution for employees and eligible dependents.
- Company-paid HSA contribution is available with the high-deductible CIGNA medical plan.
- Healthcare and dependent-care flexible spending accounts are available.
- 401(k) plan includes a Brokerage Link option.
- Company-paid basic life, AD&D, short-term disability, and long-term disability insurance are provided.
- Employee Assistance Program, sick time, vacation time, and 13 paid holidays are provided.
- Paid parental leave and paid disability leave are available after 90 days of employment, subject to the stated eligibility terms.
- Voluntary benefits include life and AD&D coverage, pet insurance, commuter benefits, mobile phone credit, and the Healthjoy mobile benefits app.
- Free lunch and snacks, an onsite gym, and employee discounts and perks are provided.
Categories
About NIO Inc.
NIO Inc. builds and sells premium smart electric vehicles, plus services such as Battery-as-a-Service and autonomous driving subscriptions. The public company, founded in 2014 and headquartered in Jiading, Shanghai, designs, develops, and jointly manufactures models like the ES8, ET5, and ET7, and operates in China and parts of Europe; its shares trade on the NYSE and Singapore Exchange.