GrepJob
Clarity AI

Senior MLE Staff Engineer

Clarity AI
Apply
about 18 hours ago
Barcelona, SpainSenior / Staff+

Responsibilities

  • Design and develop the core platform for deploying and managing LLMs and multi-agent systems.
  • Build infrastructure to support long-running agentic workflows.
  • Scale inference for LLMs to optimize for latency, throughput, and cost.
  • Establish a self-service path for model deployment with automated evaluation frameworks.
  • Monitor the AI ecosystem and evolve the platform to maintain a competitive edge.
  • Implement deep observability for LLMs to track system health and performance.
  • Provide tools for Data Scientists to transition from tuned models to production services.

Requirements

  • Deep experience deploying Large Language Models and complex agentic architectures at scale.
  • Proven experience in implementing Prompt Lifecycle Management and LLM Abstraction Layer.
  • Expert-level experience building automated evaluation pipelines and frameworks.
  • A track record of building platforms or shared infrastructure with MLOps concepts.
  • 3+ years of experience in MLOps or high-scale Software Engineering focused on AI.
  • Expert-level Python skills and experience with container orchestration and cloud infrastructure.
  • Proficiency with orchestration libraries, vector databases, and inference engines.
  • Ability to learn and implement new technologies rapidly.
  • Strong fundamentals in API design, microservices, and automated security compliance.
  • Excellent communication skills in English, capable of articulating technical vision.

Benefits

  • Competitive compensation with equity plans.
  • Flexible working arrangements and location options.
  • Generous paid time off schemes including vacation and sabbaticals.
  • Meaningful benefits including private healthcare and wellness programs.
  • Professional development budget for training and certifications.
  • Collaborative environment with global team activities and events.

Tech Stack

AWSDockerGoogle Cloud PlatformKubernetesPython

Categories

AI & MLData ScienceDevOps