GrepJob
Octus

Senior AI Engineer

Octus
Apply
about 3 hours ago

Base Salary

$160k - $170k/yr

Responsibilities

  • Design and implement multi-agent orchestration frameworks using various agent SDKs.
  • Build and maintain MCP servers and integrations to enhance AI system capabilities.
  • Optimize RAG pipelines, including embedding strategies and retrieval quality tuning.
  • Integrate with managed LLM services for deployment and cost optimization.
  • Fine-tune and deploy open-source deep learning models for production use.
  • Apply systems thinking to optimize AI and LLM systems for quality and scalability.
  • Design automated evaluation frameworks to assess LLM system performance.
  • Utilize reinforcement learning techniques to improve model alignment.
  • Architect and manage high-throughput data pipelines using Kafka.
  • Deploy and scale production AI services on AWS using modern practices.
  • Implement observability frameworks to track system performance metrics.
  • Identify and resolve production bottlenecks in distributed systems.
  • Conduct code reviews and contribute to team standards.
  • Communicate progress and outcomes to stakeholders.
  • Continuously learn and adapt to advancements in NLP and Generative AI.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience as an AI Engineer or similar role.
  • Deep Python expertise with a track record of shipping production systems.
  • Experience designing and deploying LLM-driven applications.
  • Hands-on experience with automated evaluation frameworks for LLM systems.
  • Solid understanding of machine learning concepts and production systems.
  • Experience with GPUs for model training and inference.
  • Practical experience with cloud-based deployments and infrastructure tools.
  • Strong problem-solving and systems thinking skills.
  • Excellent communication and collaboration skills.
  • Strong ownership and initiative in driving projects.

Benefits

  • Competitive health benefits.
  • Matched 401k and pension plans.
  • Generous parental leave.
  • Gym subsidies.
  • Educational reimbursements for career development.
  • Recognition programs.
  • Pet-friendly offices (US only).

Tech Stack

Categories

AI & MLData EngineeringDevOps