2 days ago
Tel Aviv-Yafo, IsraelSenior
Responsibilities
- Optimize multimodal LLM inference to support customer goals and business value.
- Support supervised and reinforcement-learning fine-tuning, including SFT and LoRA.
- Design and implement LLM-based solutions using Token Factory inference services.
- Build production-ready applications using serverless LLM APIs and multimodal or domain-specific models.
- Advise customers on prompt engineering, RAG architectures, model selection, and scaling from proof of concept to production.
- Build or support LLM evaluation benchmarks and offline and online evaluation pipelines.
- Collaborate with product and engineering teams to incorporate customer feedback into the platform roadmap.
- Guide customers on performance, reliability, and cost efficiency.
Requirements
- At least 5 years of experience in ML/AI systems, including at least 2 years focused on LLMs and generative AI.
- Deep knowledge of the LLM ecosystem, model architectures, and fine-tuning approaches.
- Hands-on experience running LLM inference workloads in production.
- Experience with LLM fine-tuning, including supervised fine-tuning, SFT, LoRA, and data preparation or curation; reinforcement-learning fine-tuning is a strong plus.
- Experience building task-specific benchmarks, offline and online evaluation pipelines, and LLM-as-a-judge systems.
- Experience with inference frameworks and libraries such as vLLM, SGLang, TensorRT-LLM, and Transformers.
- Experience deploying LLM-powered applications using OpenAI, Anthropic, or open-source model APIs.
- Strong Python programming skills and the ability to explain technical concepts to diverse audiences.
- Experience with multimodal AI models, DevOps tools such as Docker and Kubernetes, or open-source ML/AI contributions is a bonus.
Benefits
- Competitive compensation.
- Career growth and learning opportunities.
- Flexibility and ownership.
- Collaborative and innovative culture.
- Opportunity to work on impactful AI projects.
- International environment and talented teams.
- Work location: Tel Aviv, Israel.
- Applicants must be authorized to work in the country where they apply and must provide proof of employment eligibility.
Categories
Solutions Engineering
About Nebius
Nebius builds a full-stack AI cloud offering GPU compute, storage, and tools for training and deploying ML models for startups, enterprises, and research labs. It sells consumption-based cloud infrastructure (IaaS/PaaS) and managed services tailored to generative AI workloads, including large-scale model training and inference. The company is headquartered in Amsterdam and operates as an independent provider.