Skip to content

Question

What is human-feedback data?

By SourceX Editorial · Updated

Short answer

Human-feedback data is information in which people evaluate or correct AI or other outputs: ratings, pairwise preferences, rankings, edits and written critiques, plus demonstrations of the correct answer. AI developers use it to align models with human judgment, most notably through reinforcement learning from human feedback (RLHF). Businesses sometimes hold naturally occurring feedback, such as reviewer edits or QA scores.

Part of: Human-generated data

Process

Human-feedback data

This page covers what is human-feedback data.Illustrative

Explanation

Feedback data is typically produced by hired annotators, but real-world review processes (editor corrections, QA scoring) can provide similar signals.

Its value depends on the expertise of the reviewers and the consistency of guidelines.

Examples

  • QA scorecards on support conversations
  • Senior editor corrections to junior drafts
  • Ranked alternative answers

Rights and privacy

  • Reviewer and employee consent
  • Removal of personal data in reviewed content

How licensing works

A business describes its data, Acquisition Partner demand is assessed, scope and permitted use are proposed, the business approves the scope and terms and signs an agreement, and the data is delivered and de-identified before it is used or shared. See data licensing for detail.

Related questions

Sources

  1. Ouyang et al., Training language models to follow instructions with human feedback (2022)
  2. Christiano et al., Deep reinforcement learning from human preferences (2017)

General information, not legal advice. Editorial policy.

See if your company qualifies

A short company assessment. No data uploads are needed.

See if your company qualifies