Concentrix

Senior AI/ML Engineer – SLM Optimization & Inference

Concentrix
Apply
2 days ago
Remote, United StatesSenior

Base Salary

$145k - $171k/yr

Responsibilities

  • Fine-tune and optimize Small Language Models, particularly Alibaba Qwen models, for domain-specific use cases.
  • Improve model accuracy, precision, recall, latency, and inference throughput.
  • Optimize model serving with vLLM, SGLang, or similar inference engines.
  • Implement GPU memory optimization, KV-cache management, quantization, and efficient batching.
  • Develop and optimize real-time audio intelligence pipelines for low-latency processing.
  • Benchmark, profile, debug, and tune models for production-scale deployment.
  • Collaborate with engineering and data teams to evaluate model behavior, identify bottlenecks, and improve end-to-end ML system performance.
  • Build reliable, scalable ML workflows for high-throughput, low-latency AI applications.
  • Balance model quality, infrastructure efficiency, and production performance requirements.

Requirements

  • Strong hands-on experience with PyTorch, Hugging Face Transformers, and LLM/SLM fine-tuning techniques including LoRA, QLoRA, and PEFT.
  • Practical experience using vLLM or SGLang for high-performance model inference.
  • Deep understanding of GPU utilization, CUDA fundamentals, KV caching, and memory optimization.
  • Experience evaluating and improving model precision, recall, latency, throughput, and inference performance.
  • Strong Python programming and ML engineering skills.
  • Proven ability to benchmark, debug, and optimize models for production environments.
  • Experience fine-tuning and deploying Alibaba Qwen models is preferred.
  • Experience with real-time audio AI, speech recognition, ASR, or audio classification is preferred.
  • Experience optimizing AI models for high-throughput, low-latency production environments is preferred.
  • Ability to work hands-on across SLM training or fine-tuning and GPU inference optimization.
  • Strong collaboration skills across engineering and data teams.

Benefits

  • Base salary is $ 144,964-$ 171,321 plus incentives aligned with individual and company performance.
  • Benefits may include medical, dental, and vision insurance, an employee assistance program, a 401(k) retirement plan, paid time off and holidays, and paid learning days.
  • This is a full-time, work-at-home position in the United States, with the employee required to reside in the United States or have a valid U.S. address.
  • The position is an existing immediate vacancy with an expected start as soon as possible; the application deadline is 11/04/2026.

Tech Stack

Hugging Face TransformersPythonPyTorch

Categories

Concentrix

About Concentrix

10,000+ employees

We’re Concentrix, a Fortune 500® technology and services leader, helping the world's best brands cut through AI hype and create intelligent operations that perform in the real world. We design, build, and run integrated human and AI solutions, harnessing the insight from billions of real-world interactions to help 2000+ of the world’s most complex organizations solve their toughest business challenges. Backed by 20+ years of operational experience and battle tested AI, we’re the Intelligent Transformation Partner that helps clients across every major vertical move from AI ambition to measurable, scalable performance.

Contact me