Lead AI Engineer – Quality Engineering
KMS Technology4 hours ago
Ho Chi Minh City, VietnamStaff+
Responsibilities
- Design and develop autonomous and multi-agent workflows for end-to-end software test automation.
- Build production AI agents for test generation, code creation, validation, debugging, failure triage, and self-healing.
- Develop application knowledge bases using embeddings, retrieval, and context strategies.
- Define agent instructions, guardrails, validation checkpoints, and human-in-the-loop review processes.
- Establish evaluation practices using golden datasets, regression evaluations, LLM-as-judge approaches, and reliability metrics.
- Instrument, monitor, and improve agent accuracy, reliability, latency, token cost, and maintainability in production.
- Integrate agents with UI, API, database, end-to-end testing, GitHub, Jenkins, and other engineering workflows.
- Set technical standards, lead design reviews, mentor engineers, and improve the team's AI engineering maturity.
Requirements
- At least 6 years of software engineering experience, including technical delivery leadership or engineering mentorship.
- At least 1.5 years of production experience building LLM-based or agentic systems beyond proof-of-concept work.
- Strong hands-on experience with LLM integration, prompt engineering, RAG, and AI-agent development.
- Proficiency in Python or TypeScript and solid experience building and consuming REST APIs.
- Hands-on experience with an agent orchestration framework such as LangGraph, OpenAI Agents SDK, CrewAI, AutoGen, or Semantic Kernel, including tool integration, structured outputs, and validation.
- Practical experience designing AI evaluations, measuring agent quality, and using tracing or observability tools such as LangSmith, Langfuse, or Arize Phoenix.
- Experience with vector databases, embeddings, and knowledge management for retrieval.
- Solid understanding of Git, CI/CD pipelines, and modern software development practices.
- Good English communication skills for distributed-team and stakeholder collaboration.
- Preferred experience with Playwright and TypeScript, UI/API/database/end-to-end test automation, Angular or React, MCP servers and clients, LLM cost and latency optimization, and Jenkins or comparable CI orchestration.
Benefits
- Attractive salary and benefits, annual performance appraisal, and performance bonus.
- Flexible working time and training in emerging technologies, best practices, and soft skills.
- Onsite short-term and long-term assignment opportunities in the United States, Canada, Europe, and Asia.
- Premium healthcare insurance for the employee and dependents.
- Company trips, annual year-end party, team-building activities, and fitness and sports activities.
- Community development opportunities, including charity, blood donation, and public seminars.
- Free in-house entertainment facilities, coffee, and snacks.
- Opportunity to work on large-scale global software products with distributed teams in Vietnam and other international locations.
Tech Stack
Categories
About KMS Technology
KMS Technology provides software product development, quality assurance/testing, and AI engineering services for independent software vendors and enterprises using offshore and nearshore teams. Its consulting-led model spans DevOps, mobile app development, and automated testing, delivered through global centers in Vietnam and Mexico. Founded in 2009 and headquartered in Atlanta, the privately held company focuses on helping North American clients scale product delivery.