GrepJob
SambaNova Systems

ML Features Solutions Engineer

SambaNova Systems

Apply
about 4 hours ago
Austin, TX, USA
Senior
H1B Sponsor

Responsibilities

  • Design and implement core ML features including model optimization and inference enhancements.
  • Optimize model performance for latency, throughput, and memory efficiency on SambaNova hardware.
  • Develop and improve features such as Function Calling and JSON mode conformance.
  • Create end-to-end ML solutions that showcase platform capabilities.
  • Convert cutting-edge ML research into practical, deployable product features.
  • Establish benchmarks and quality standards for ML features in production environments.
  • Work with SDK team to ensure ML features are properly exposed and documented.
  • Support enterprise customers implementing advanced ML features.

Requirements

  • Master’s degree or higher in Computer Science, Machine Learning, Electrical Engineering, or related field.
  • 5+ years of industry experience in ML engineering or applied ML research.
  • 3+ years of hands-on experience with large language models and transformer architectures.
  • Expert proficiency in Python and deep learning frameworks: PyTorch, TensorFlow, or JAX.
  • Experience with model optimization techniques: quantization, pruning, distillation.
  • Strong understanding of LLM inference optimization: KV cache, batching strategies.
  • Experience deploying ML models to production at scale.
  • Track record of translating research concepts into production features.

Benefits

  • Work on cutting-edge ML features powering the fastest AI inference platform.
  • Direct impact on product capabilities used by enterprise customers globally.
  • Collaborate with world-class ML researchers and engineers.
  • Bay Area location enabling close collaboration with core ML teams.
  • Competitive compensation and benefits.
  • Opportunity to shape the future of enterprise AI.

Tech Stack

PythonPyTorchTensorFlow

Categories

AI & MLData Science