Senior AI Infra JD for Inference & Eval's

about 4 hours ago

Foster City, CA, USASenior / Mid Level

H1B Sponsor

Base Salary

$168k - $205k/yr

Responsibilities

Design, build, and maintain AI infrastructure for real-time computer vision and multimodal inference workloads.
Build scalable systems for running state-of-the-art models across large volumes of video and sensor data.
Optimize inference performance across latency, throughput, GPU utilization, reliability, and cost.
Develop robust evaluation harnesses and benchmarking systems to measure model quality and system performance.
Build infrastructure for continuous model evaluation, experimentation, and deployment.
Partner with research scientists to productionize advances in AI technologies.
Improve model-serving architecture, including batching, caching, and routing.
Develop data engines for collecting training data and evaluating model behavior.
Create observability, monitoring, and debugging tools for production AI systems.
Define best practices for deploying and operating AI systems in enterprise environments.

4+ years of industry experience in building infrastructure or production AI systems.
BS/MS in Computer Science or a related technical field, or equivalent practical experience.
Strong programming skills in Python with solid software engineering fundamentals.
Experience designing scalable machine learning infrastructure for training and inference.
Hands-on experience running deep learning models in production, including LLMs and vision-language models.
Strong understanding of inference optimization techniques.
Experience with model-serving frameworks like vLLM or Triton Inference Server.
Experience building evaluation frameworks and benchmarks.
Strong background in machine learning and deep learning; computer vision experience is a plus.
Familiarity with cloud infrastructure and distributed systems.