Senior AI Engineer (LLMs & Agentic AI)
Applaudo Studios19 days ago
Remote, Colombia or Bogotá, ColombiaSenior
Responsibilities
- Build and maintain MCP servers, tool definitions, and context management capabilities.
- Design intent evaluation, classification, and routing workflows that orchestrate API and data-source calls across multiple sources.
- Integrate Anthropic and OpenAI models into production environments.
- Manage prompt versioning, fallback strategies, and LLM performance, cost, and latency optimization.
- Develop and maintain evaluation frameworks for model quality and production performance.
- Write SQL against model inputs and outputs to support evaluation and monitoring.
- Support the backend behavior of chat and MCP interfaces.
- Collaborate with software engineers and AI specialists to deliver production-ready AI solutions.
- Participate in architecture discussions and contribute to AI platform design.
- Continuously improve AI systems through experimentation and engineering best practices.
Requirements
- Bachelor's degree in Computer Science, Software Engineering, Artificial Intelligence, Data Science, or a related field is desired, or equivalent professional experience.
- Strong proficiency in Python and software engineering best practices.
- Strong SQL skills working with cloud data warehouses.
- Hands-on experience building production-grade LLM and agentic AI applications.
- Experience implementing tool calling, MCP servers, context management, and multi-step orchestration.
- Experience integrating hosted LLM APIs such as Anthropic and OpenAI into production environments.
- Experience with prompt engineering, prompt versioning, fallback strategies, and cost and latency optimization.
- Experience designing intent classification and routing solutions for natural-language applications.
- Experience building conversational AI solutions or multi-API orchestration workflows.
- Experience developing LLM evaluation methodologies and working in partially documented, brownfield codebases.
- Senior-level experience building production AI applications with Python and LLM technologies.
- Must have personally authored and built an MCP server, rather than only integrated or consumed one.
- Experience designing and deploying conversational AI or agentic AI solutions.
- Strong experience with prompt engineering, LLM integrations, and evaluation methodologies.
- Conversational and professional English proficiency.
- Preferred experience deploying, fine-tuning, and evaluating open-source models using Hugging Face.
- Preferred experience with GPU acceleration, inference optimization, MLOps practices, vector databases, Retrieval-Augmented Generation, applied NLP, and client-facing AI products.
Categories