Generative AI Automation Lead (Generative AI & AI Agents for Test Automation)

Company Description

KMS Technology is a strategic engineering company helping businesses turn bold ideas into high-impact solutions—faster. Founded in 2009 as a U.S.-based services company, we’ve grown into a global organization with locations in the US, Vietnam, Mexico and Poland. KMS is trusted globally for the quality of our engineering and consulting services. We bring deep expertise in product development and quality assurance, Data & AI-native engineering, and delivery excellence to every engagement. Our mission is to help customers build what’s next—accelerating innovation, crafting brilliant solutions, and creating  real-world impact. At KMS, we believe sustainable growth is built on the success of our clients and employees, and in making a lasting contribution to our communities.

More about KMS Technology:

• Website: https://kms-technology.com 
• Linkedin: https://www.linkedin.com/company/kms-technology 

Job Description

We are looking for a Lead Generative AI for Automation Test to design, build, and maintain intelligent agents that support and automate software testing activities.

You will own agentic workflows across test-case generation, automation-script creation, execution, validation, failure analysis, self-healing, and continuous test maintenance. The role integrates AI agents with application knowledge, automation tools, APIs, databases, and CI/CD pipelines to enable reliable end-to-end testing, and sets the technical direction for how agentic quality engineering is delivered across teams.

Key Responsibilities

• Design and develop autonomous and multi-agent workflows for test automation.
• Build AI agents using LLMs, prompt engineering, RAG, tool calling, and MCP-based integrations.
• Develop agents for test generation, code creation, validation, debugging, failure triage, and self-healing.
• Integrate agents with UI, API, database, and end-to-end testing workflows.
• Define agent instructions, guardrails, validation checkpoints, and human-in-the-loop review processes.
• Monitor and improve agent accuracy, reliability, performance, and maintainability.
• Maintain application knowledge bases and continuously improve agent decision-making.
• Integrate agentic solutions with GitHub, Jenkins, APIs, databases, and other engineering tools.
• Set technical standards and best practices, and mentor engineers on agentic development and AI-assisted testing.

Qualifications

• 6+ years of software development experience, including proven experience leading technical delivery or mentoring engineers.
• Strong hands-on experience in Generative AI, LLM integration, prompt engineering, RAG, and AI-agent development.
• Proficiency in Python or TypeScript, with solid experience working with REST APIs.
• Solid understanding of agent orchestration, tool integration, structured outputs, and validation mechanisms.
• Experience with vector databases, embeddings, knowledge management, and AI evaluation.
• Working knowledge of Playwright with TypeScript.
• Familiarity with Angular or React applications, and with UI, API, database, and end-to-end testing.
• Good understanding of Git, CI/CD pipelines, and modern software-development practices.
• Good English communication skills for collaborating with distributed teams and stakeholders.

Additional Information

Perks You'll Enjoy 

• Working in one of the Best Places to Work in Vietnam
• Building large-scale & global software products
• Working & growing with Passionate & Talented Team
• Diverse careers opportunities with Software Outsourcing, Software Product Development, IT Solutions & Consulting
• Attractive Salary and Benefits
• Performance appraisal once a year and performance bonus
• Onsite opportunities: short-term and long-term assignments in North American (U.S, Canada), Europe, Asia.
• Flexible working time
• Various training on hot-trend technologies, best practices and soft skills
• Premium healthcare insurance for you and your loved ones
• Company trip, big annual year-end party every year, team building, etc.
• Fitness & sport activities: football, tennis, table-tennis, badminton, yoga, swimming…
• Joining community development activities: 1% Pledge, charity every quarter, blood donation, public seminars, career orientation talks,…
• Free in-house entertainment facilities (foosball, ping pong, gym…), coffee, and snack (instant noodles, cookies, candies…)

And much more, join us and let yourself explore other fantastic things!