1 day ago
Base Salary
$184k - $257k/yr
Responsibilities
- Tech-lead collective communication library development on Meta’s large-scale GPU training infrastructure, with a focus on GenAI/LLM scaling.
- Build customized features, software benchmarks, performance tuners, and software stacks around NCCL and PyTorch.
- Improve distributed ML reliability and performance from model trainers through inter-GPU and network communication layers.
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience.
- Proven C/C++ and Python programming skills.
- Proven track record of leading successful projects and effective leadership and communication skills.
- Specialized experience in one or more of HPC, GPU architecture, ML systems, distributed ML training, AI infrastructure, performance optimization, or machine learning frameworks.
- Preferred experience with NCCL, RCCL, OneCCL, RDMA transports, RoCE, InfiniBand, HPC collective communication, parallel computing libraries, and distributed GPU performance analysis.
- Preferred knowledge of GPU architectures, CUDA programming, machine learning, deep learning, LLMs, and distributed training approaches including data parallel and model parallel training.
- Preferred experience with PyTorch, Caffe2, TensorFlow, AI framework development, and trainer development for large-scale distributed deep learning models.
- Preferred PhD in Computer Science, Computer Engineering, or a relevant technical field.
- Preferred experience integrating AI tools into workflows, implementing responsible and ethical AI practices, and developing skills in prompt/context engineering or agent orchestration.
Benefits
- Bonus, equity, and benefits are offered.
Categories
About Meta
Meta builds social platforms and communication apps—including Facebook, Instagram, WhatsApp, and Messenger—and develops AR/VR hardware and software such as Quest to power immersive computing. It monetizes primarily through advertising tools for businesses, with additional revenue from devices and services, and operates a massive global infrastructure. Founded in 2004 and headquartered in Menlo Park, California, Meta Platforms, Inc. is a public company traded on Nasdaq under the ticker META.