AI Engineer (Mid/Senior)
Data Wow Co., Ltd.
QA Automation Engineer (Senior)
About this role
- Build evaluation suites for LLM and ML features: curated test sets, scoring against reference answers, LLM-as-judge where it is justified, and human review where it is not.
- Define what "good enough" means with the delivery team before launch, in numbers a client can accept, and hold releases to it.
- Test retrieval pipelines end to end, covering chunking and indexing, retrieval quality, grounding of the final answer, and behaviour when the right document is simply not there.
- Write regression tests that tolerate non-deterministic output, using semantic similarity, structured-output validation, tolerance bands, and repeated sampling rather than exact string matching.
- Cover failure modes that matter to clients: hallucination, prompt injection through user or document content, leakage of data across tenants or sessions, refusal and over-refusal, and degradation on Thai-language input.
- Track cost and latency alongside accuracy, so that a quality improvement that triples token spend is visible before it ships.
- Detect drift after release by comparing production samples against the baseline, and raise it early rather than after the client does.
- Design and maintain automated test suites for APIs, services, data pipelines, and web applications built for client projects.
- Run tests in CI, keep them fast and stable, and treat a flaky suite as a defect in its own right.
- Set the test strategy at the start of an engagement: what gets automated, what stays manual, what the exit criteria are, and what evidence the client will receive.
- 4-5 years in test automation, QA engineering, or software engineering with substantial testing ownership.
- Strong programming ability in Python, or in TypeScript or Java with the willingness to work primarily in Python.
- Hands-on experience testing an LLM or ML-based product in production or close to it.
- Practical command of at least one automation framework such as Pytest, Playwright, Cypress, or RestAssured, and experience running suites in CI.
- Working knowledge of API and data testing, including SQL and validating data through a pipeline.
- The judgement to decide what deserves automation and what does not, and to say so when a suite is producing noise rather than signal.
- Clear written and spoken communication in Thai and English.
- Hybrid Working options with Flexible Working Hours.
- Your Choice of Gear: Mac or Windows? You pick your preferred work equipment.
- Comprehensive Group Health Insurance.
- Monthly Grab Transportation credits.
- Job-related training courses and certificate fee coverage.
- 10+ days of annual leave.
- Free snacks and drinks available at the office.
Frequently Asked Questions
Is the salary disclosed for the QA Automation Engineer (Senior) position at Data Wow Co., Ltd.?
The salary for this QA Automation Engineer (Senior) role at Data Wow Co., Ltd. is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the QA Automation Engineer (Senior) position at Data Wow Co., Ltd. located?
This QA Automation Engineer (Senior) role at Data Wow Co., Ltd. is based in Pathum Wan, Bangkok, Thailand. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
Is the QA Automation Engineer (Senior) role at Data Wow Co., Ltd. full-time or part-time?
This is listed as a Full time position. It is posted as a QA Automation Engineer (Senior) role at Data Wow Co., Ltd..
How do I apply for the QA Automation Engineer (Senior) position at Data Wow Co., Ltd.?
Click the "Apply Now" button on this page. You will be redirected to Data Wow Co., Ltd.'s official application portal hosted on workable where you can submit your application directly.
When was the QA Automation Engineer (Senior) job at Data Wow Co., Ltd. posted?
This QA Automation Engineer (Senior) position at Data Wow Co., Ltd. was posted on Oct 1, 2026. Apply as soon as possible — early applications are often reviewed first.
QA Automation Engineer (Senior)
Data Wow Co., Ltd.
You'll be redirected to Data Wow Co., Ltd.'s official application page on workable.