almost 2 years ago
San Jose, CA, USAEntry Level
Base Salary
$143k - $186k/yr
Responsibilities
- Research and apply cutting-edge techniques to optimize large language and multimodal models.
- Develop core algorithmic optimizations for efficient LLM inference on heterogeneous architectures.
- Optimize and deploy models across distributed and heterogeneous hardware environments, including vehicle digital cockpit and advanced-driving systems.
- Identify and address GPU/NPU architecture bottlenecks and optimize inference on resource-constrained edge devices.
- Contribute to research, development, testing, and hardware deployment while collaborating with cross-functional teams.
Requirements
- Currently pursuing or completed a PhD or master’s degree in computer science, computer engineering, applied mathematics, communications, electronics, or a related field, with relevant research projects and publications.
- Strong understanding of GPU/NPU architecture and optimization techniques.
- Proficiency with LLM and VLM architectures, transformer-based NLP, audio, and computer-vision algorithms and technologies.
- Proficiency in Python, C, and C++, with experience using AI training and inference tools such as PyTorch.
- Familiarity with at least one commonly used LLM inference engine and model-serving frameworks such as ONNX.
- Familiarity with debugging code in distributed computing environments.
- Preferred: PhD in computer science, artificial intelligence, or a related field, or a master’s degree plus three years of relevant industry experience.
- Preferred: experience optimizing deep-learning inference techniques or libraries on hardware architectures and familiarity with microkernels, the Linux kernel, hypervisors, middleware, and application frameworks.
- Strong publication records and high-impact innovative papers are preferred.
Benefits
- Full-time employees receive medical coverage through CIGNA EPO, HSA, and Kaiser HMO plans, with $0 employee-only coverage; dental and vision plans include options with $0 paycheck contribution for employees and eligible dependents.
- Company-paid HSA contributions are available with the high-deductible CIGNA plan, along with healthcare and dependent-care FSAs.
- Benefits include a 401(k) with BrokerageLink, company-paid life and disability insurance, an Employee Assistance Program, sick and vacation time, and 13 paid holidays.
- Employees receive paid parental leave and paid disability leave after 90 days of employment, plus voluntary life, AD&D, pet insurance, commuter, and mobile-phone benefits.
- Additional perks include a health benefits app, free lunch and snacks, an onsite gym, and employee discounts and perks.
Categories
About NIO Inc.
NIO Inc. builds and sells premium smart electric vehicles, plus services such as Battery-as-a-Service and autonomous driving subscriptions. The public company, founded in 2014 and headquartered in Jiading, Shanghai, designs, develops, and jointly manufactures models like the ES8, ET5, and ET7, and operates in China and parts of Europe; its shares trade on the NYSE and Singapore Exchange.