1 day ago
Base Salary
$122k - $181k/yr
Responsibilities
- Provide technical leadership for collective communication library development on Meta’s large-scale GPU training infrastructure, with a focus on GenAI and LLM scaling.
- Develop customized features, software benchmarks, performance tuners, and software stacks around NCCL and PyTorch.
- Improve the reliability and performance of distributed ML training across trainer, GPU, and network communication layers.
- Lead cross-functional technical projects and communicate technical decisions to technical and non-technical stakeholders.
Requirements
- Proven programming skills in C/C++ and Python.
- A proven track record of leading successful projects and cross-functional technical initiatives.
- Specialized experience in one or more of distributed ML training, GPU architecture, ML systems, AI infrastructure, high-performance computing, performance optimization, or machine learning frameworks.
- A bachelor’s degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience; the degree must be completed before joining Meta.
- Preferred experience with NCCL, distributed GPU performance analysis on RoCE or InfiniBand, GPU architectures, and CUDA programming.
- Preferred experience with PyTorch, Caffe2, or TensorFlow and with AI framework or trainer development for large-scale distributed deep learning models.
- Preferred experience with data parallel and model parallel training, including Distributed Data Parallel, Fully Sharded Data Parallel, Tensor Parallel, and Pipeline Parallel.
- Preferred knowledge of machine learning, deep learning, LLMs, HPC, and parallel computing.
- Preferred experience with responsible and ethical AI practices, including risk assessment, bias mitigation, and quality and accuracy reviews.
- Preferred PhD in Computer Science, Computer Engineering, or a relevant technical field.
Benefits
- Annual base salary of $121,992/year to $181,000/year, plus bonus, equity, and benefits.
Categories
About Meta
Meta builds social platforms and communication apps—including Facebook, Instagram, WhatsApp, and Messenger—and develops AR/VR hardware and software such as Quest to power immersive computing. It monetizes primarily through advertising tools for businesses, with additional revenue from devices and services, and operates a massive global infrastructure. Founded in 2004 and headquartered in Menlo Park, California, Meta Platforms, Inc. is a public company traded on Nasdaq under the ticker META.