Lead AI Engineer – Quality Engineering, based in Da Nang
KMS Technology12 hours ago
Đà Nẵng, VietnamStaff+
Responsibilities
- Design and develop autonomous and multi-agent workflows for end-to-end software test automation.
- Build AI agents for test generation, code creation, validation, debugging, failure triage, and self-healing.
- Maintain application knowledge bases using embeddings, retrieval, and context strategies.
- Define agent instructions, guardrails, validation checkpoints, and human-in-the-loop review processes.
- Establish evaluation practices using golden datasets, regression evaluations, LLM-as-judge methods, and reliability metrics.
- Instrument and monitor agents for accuracy, reliability, latency, token cost, and maintainability in production.
- Integrate agents with UI, API, database, end-to-end testing, GitHub, Jenkins, and other engineering workflows.
- Set technical standards and best practices for agentic development and AI-assisted testing.
- Mentor engineers, run design reviews, and raise the team’s AI engineering maturity.
Requirements
- 6+ years of software engineering experience, including experience leading technical delivery or mentoring engineers.
- 1.5+ years of production experience building LLM-based or agentic systems beyond proof-of-concept work.
- Strong hands-on experience with LLM integration, prompt engineering, RAG, and AI-agent development.
- Proficiency in Python or TypeScript and solid experience building and consuming APIs.
- Hands-on experience with an agent orchestration framework such as LangGraph, OpenAI Agents SDK, CrewAI, AutoGen, Semantic Kernel, or an equivalent.
- Experience with structured outputs, tool integration, validation mechanisms, AI evaluation, and observability.
- Experience designing evaluation datasets, measuring agent quality, and using tracing tools such as LangSmith, Langfuse, Arize Phoenix, or a custom harness.
- Experience with vector databases, embeddings, and knowledge management for retrieval.
- Understanding of Git, CI/CD pipelines, and modern software-development practices.
- Good English communication skills for collaboration with distributed teams and stakeholders.
- Working knowledge of Playwright with TypeScript is preferred.
- Background in UI, API, database, or end-to-end test automation is preferred.
- Familiarity with Angular, React, MCP servers and clients, Jenkins, or comparable CI orchestration is preferred.
- Experience optimizing LLM cost and latency through caching, model routing, or token budgeting is preferred.
Benefits
- Attractive salary and benefits, with an annual performance appraisal and performance bonus.
- Flexible working time.
- Onsite short-term and long-term assignment opportunities in North America, Europe, and Asia.
- Training in emerging technologies, best practices, and soft skills.
- Premium healthcare insurance for the employee and dependents.
- Company trips, annual year-end parties, team-building activities, and fitness and sports activities.
- Community development opportunities, including charity, blood donation, and public seminars.
- Free in-house entertainment facilities, coffee, and snacks.
- Opportunity to work on large-scale global software products with teams across Vietnam, the US, Mexico, and Poland.
Tech Stack
Categories
About KMS Technology
KMS Technology provides software product development, quality assurance/testing, and AI engineering services for independent software vendors and enterprises using offshore and nearshore teams. Its consulting-led model spans DevOps, mobile app development, and automated testing, delivered through global centers in Vietnam and Mexico. Founded in 2009 and headquartered in Atlanta, the privately held company focuses on helping North American clients scale product delivery.