What an auditor, or Sekit's evidence engine, asks for.
AI testing and validation records
The proof that an AI system was tested before going live and that the results were used to decide: what was tested, with what data, what results it gave against the defined criteria, and who approved the release.
From the Sekit evidence catalog
In practice
Verification checks the AI system does what it was specified to do; validation checks it performs well and safely in the conditions it will genuinely meet. The AI testing and validation records show what was tested, with what data, against what criteria, and who approved the release. A common failure is testing that only covers functional correctness, does the button work, while skipping robustness or safety checks specific to AI, such as how the system behaves on edge-case or adversarial inputs. Auditors ask what happens when a test fails: is there a real gate, or does the release ship anyway.
Common gaps
Testing confirms the AI feature works functionally but never checks robustness against unexpected or adversarial inputs.
Test results are recorded but a failed test did not block the release it was meant to gate.
Validation criteria were defined for the initial launch but never reapplied after a vendor model update.
Questions your auditor will ask
What is tested before an AI system goes live?
Functional correctness against the specification, plus robustness and safety checks, recorded in the AI testing and validation records.
Who approves the release based on the test results?
A named approver reviews results against the acceptance criteria and signs off before deployment, on record.
What happens when a test fails?
The release is held until the failure is remediated and retested, tracked the same way as any other control testing finding.
Are vendor model updates re-tested, or only the initial launch?
Re-tested, since a model version change is treated as a material change requiring a fresh validation pass.
Where regulation demands it
GDPR Article 32.1.d requires regular testing of security measures, which for an AI system extends to robustness and validation before release.