Senior Software Engineer
Mercado Libre20 hours ago
Buenos Aires, ArgentinaSenior
Responsibilities
- Build and maintain a continuous evaluation pipeline that collects production conversations for scheduled evaluation against configurable rubrics.
- Evolve the evaluation platform to audit conversational agents and their assets across the complete lifecycle.
- Integrate the platform into continuous improvement processes for model selection and prompt tuning.
- Design evaluation strategies and rubrics for complex conversational agents in high-availability environments.
- Collaborate with product teams to translate use cases into measurable evaluation criteria.
Requirements
- Strong knowledge of Python or Go and RESTful API design.
- Familiarity with microservice architectures, distributed systems, and asynchronous processing.
- Knowledge of relational databases such as MySQL.
- Familiarity with LLMs, their APIs, and evaluation frameworks such as LLM-as-judge.
- Curiosity, autonomy, problem-solving ability, and teamwork.
Benefits
- Hybrid work arrangement at the Saavedra site in CABA.
Categories
About Mercado Libre
Mercado Libre builds an e-commerce marketplace and fintech infrastructure for consumers and merchants across Latin America. It monetizes through marketplace transaction fees, payment processing (Mercado Pago), logistics and fulfillment (Mercado Envíos), advertising, and credit products. Founded in 1999 and headquartered in Buenos Aires, it operates in 18 countries and is publicly traded on Nasdaq under the ticker MELI.