For AI teams
Contamination checks for licensed evaluation data
Short answer
Evaluation data is only useful if it hasn't leaked into training. Private licensed records help, but you still need checks.
Checks#
- Keep evaluation sets separate from training pipelines
- Search for overlap with public data
- Restrict access to evaluation sets
- License evaluation-only use where needed