Microsoft 365 AI Consultant
madiffpl
AI Testing Specialist
About this role
We are looking for an AI Testing Specialist to support the validation and continuous improvement of AI/ML models used to detect events in football matches. The role focuses on preparing test datasets, comparing model outputs against annotated ground truth, and evaluating performance using precision, recall, and F1-score. The consultant will analyse errors, edge cases, outliers, and complex visual scenarios, document findings, and work closely with ML teams in an iterative feedback loop to improve model accuracy and reliability.
Responsibilities
- Test AI/ML models detecting football match events such as passes, fouls, shots and interceptions
- Prepare test datasets and compare AI results against manually annotated ground truth
- Analyse model performance using precision, recall and F1-score
- Identify errors, edge cases, outliers and unusual scenarios affecting model performance
- Analyse issues such as occlusions, camera angle changes and overlapping actions
- Document findings and provide recommendations to the ML team
- Support annotation and iterative model improvement
- Verify whether implemented changes improve model performance
Requirements
- Master's degree
- 3+ years of relevant experience
- Experience testing / validating AI or ML models
- Experience preparing test datasets
- Experience analysing large datasets for anomalies, outliers and rare scenarios
- Ability to document findings and provide actionable recommendations
- Experience working in an iterative feedback loop with ML/AI teams
Benefits
• Solid, competitive salary
• Work in a multinational environment on international projects
• Comprehensive healthcare
• Long-term B2B contract with a stable project pipeline
Frequently Asked Questions
Is the salary disclosed for the AI Testing Specialist position at madiffpl?
The salary for this AI Testing Specialist role at madiffpl is not publicly listed. Click "Apply Now" to learn more about the compensation package on their official careers page.
Where is the AI Testing Specialist position at madiffpl located?
This AI Testing Specialist role at madiffpl is based in Warsaw, Poland. The position is listed as on-site or hybrid. Check the full job description or apply directly to confirm the work arrangement.
Is the AI Testing Specialist role at madiffpl full-time or part-time?
This is listed as a Full time position. It is posted as a AI Testing Specialist role at madiffpl.
How do I apply for the AI Testing Specialist position at madiffpl?
Click the "Apply Now" button on this page. You will be redirected to madiffpl's official application portal hosted on zohorecruit where you can submit your application directly.
When was the AI Testing Specialist job at madiffpl posted?
This AI Testing Specialist position at madiffpl was posted on Sep 25, 2026. Apply as soon as possible — early applications are often reviewed first.
AI Testing Specialist
madiffpl
You'll be redirected to madiffpl's official application page on zohorecruit.