Lead AI Engineer – Quality Engineering, based in Da Nang
KMS Technology4 hours ago
Đà Nẵng, VietnamStaff+
Responsibilities
- Design and develop autonomous and multi-agent workflows for end-to-end software test automation.
- Build LLM-powered agents for test generation, code creation, validation, debugging, failure triage, and self-healing.
- Maintain application knowledge bases using embeddings, retrieval, and context strategies.
- Define agent instructions, guardrails, validation checkpoints, and human-in-the-loop review processes.
- Establish evaluation practices using golden datasets, regression evaluations, LLM-as-judge methods, and reliability metrics.
- Instrument and monitor agents for accuracy, reliability, latency, token cost, and maintainability in production.
- Integrate agents with UI, API, database, end-to-end testing, GitHub, Jenkins, and other engineering tools.
- Set technical standards, lead design reviews, mentor engineers, and improve the team's AI engineering maturity.
Requirements
- 6+ years of software engineering experience, including experience leading technical delivery or mentoring engineers.
- At least 1.5 years of production experience building LLM-based or agentic systems beyond proof-of-concept work.
- Strong hands-on experience with LLM integration, prompt engineering, RAG, and AI-agent development.
- Proficiency in Python or TypeScript and solid experience building and consuming REST APIs.
- Experience with an agent orchestration framework such as LangGraph, OpenAI Agents SDK, CrewAI, AutoGen, or Semantic Kernel, including tool integration, structured outputs, and validation mechanisms.
- Practical experience designing AI evaluations, measuring agent quality, and using tracing or observability tools such as LangSmith, Langfuse, or Arize Phoenix.
- Experience with vector databases, embeddings, and knowledge management for retrieval.
- Understanding of Git, CI/CD pipelines, and modern software-development practices.
- Good English communication skills for collaboration with distributed teams and stakeholders.
- Preferred qualifications include Playwright with TypeScript, UI/API/database/end-to-end test automation, Angular or React, MCP servers and clients, LLM cost and latency optimization, and Jenkins or comparable CI orchestration at scale.
Benefits
- Attractive salary and benefits, annual performance appraisal, and performance bonus.
- Flexible working time and training in current technologies, best practices, and soft skills.
- Onsite short- and long-term assignment opportunities in the U.S., Canada, Europe, and Asia.
- Premium healthcare insurance for the employee and their loved ones.
- Company trips, annual year-end party, team building, fitness and sports activities, and community development activities.
- Free in-house entertainment facilities, coffee, and snacks.
- The role is based onsite in Da Nang, Vietnam.
Tech Stack
Categories
About KMS Technology
KMS Technology provides software product development, quality assurance/testing, and AI engineering services for independent software vendors and enterprises using offshore and nearshore teams. Its consulting-led model spans DevOps, mobile app development, and automated testing, delivered through global centers in Vietnam and Mexico. Founded in 2009 and headquartered in Atlanta, the privately held company focuses on helping North American clients scale product delivery.