Glossary
Benchmark contamination
Quick answer
When test examples leak into a model's training data, inflating its scores.
It is a common problem as public benchmarks spread online.
Private, never-published business data is valuable for evaluation partly because it is less likely to be contaminated.
Related terms
Related resources
- SolutionWhat is AI evaluation data?
- SolutionHow AI developers source data
- IndustryBPO & contact centers data
- IndustryRecruiting & staffing data
- DataInternal knowledge bases
- QuestionShould companies sell or license their data?
- QuestionCan CRM data be licensed?
- InsightCan you license spreadsheets and financial models to AI companies?
- InsightCan you license training materials and course content to AI companies?
- InsightCan I limit licensing to evaluation only?
- DataWorkflow data
- GlossaryDataset
See if your company qualifies
A short company assessment. No data uploads are needed.