Glossary
Pretraining
Quick answer
The first, large-scale stage of training a language model on broad text to learn general patterns.
It uses vast amounts of data and compute.
Specialized business data is more often used in later stages, such as fine-tuning and evaluation.
Related terms
Related resources
- QuestionShould companies sell or license their data?
- QuestionDo AI labs buy spreadsheets?
- SolutionWhat is AI evaluation data?
- SolutionHow AI developers source data
- IndustryBPO & contact centers data
- IndustryRecruiting & staffing data
- DataInternal knowledge bases
- GlossaryRevenue share
- InsightCan fitness and wellness businesses sell their data to AI companies?
- InsightCan you license spreadsheets and financial models to AI companies?
- InsightCan you license training materials and course content to AI companies?
- DataWorkflow data
See if your company qualifies
A short company assessment. No data uploads are needed.