Skip to content

Question

Can AI models reveal my data?

By SourceX Editorial · Updated

Short answer

Models can sometimes memorize and reproduce rare details from training data. That risk is reduced by removing personal and confidential details first, deduplicating records and contract terms that prohibit extraction attempts.

Part of: How licensing works

Explanation#

Research has shown memorization of repeated or unique strings.

Evaluation-only licenses avoid training exposure altogether.

Rights and privacy#

  • Confirm customer, vendor and employee agreements allow the use
  • Remove or de-identify personal details before anything leaves the company
  • Approve the final dataset and permitted uses in writing

How licensing works#

A business describes its data, buyer demand is assessed, scope and permitted use are proposed, the data is prepared and de-identified, an agreement is signed, and the approved dataset is delivered. See data licensing for detail.

Related questions

Sources

  1. Carlini et al., Extracting Training Data from Large Language Models (2021)

General information, not legal advice. Editorial policy.

Related resources

See if your company qualifies

A short company assessment. No data uploads are needed.

See if you qualify