Glossary
Tokens
Quick answer
The small chunks of text, often word pieces, that language models read and produce.
In English, a token averages roughly four characters.
Dataset size is often described in tokens, and some deals price by token count.
Related terms
Related resources
- SolutionWhat is AI evaluation data?
- SolutionHow AI developers source data
- IndustryBPO & contact centers data
- IndustryRecruiting & staffing data
- DataInternal knowledge bases
- QuestionShould companies sell or license their data?
- QuestionCan CRM data be licensed?
- InsightCan you license spreadsheets and financial models to AI companies?
- InsightCan you license training materials and course content to AI companies?
- InsightCan I limit licensing to evaluation only?
- DataWorkflow data
- GlossaryDataset
See if your company qualifies
A short company assessment. No data uploads are needed.