Logistics and distribution
OS&D records: preparing over, short and damaged reports for AI licensing
By SourceX Editorial · Updated
Short answer
OS&D records are ready for AI licensing when each over, short or damaged report links to its shipment documents, its evidence and its final resolution, and when party names are removed. Prepare them in that order: link first, then review photos and notes, then remove names and commercial terms, then document every change in a data dictionary.
Key takeaways
- An OS&D report without its shipment and resolution is an isolated complaint; once linked, it becomes a complete exception case.
- BOL, PRO, PO and ASN numbers are the keys that tie a report to the shipment, the receipt and the claim.
- Damage photos need review for labels, plates, people and embedded location data before they leave the company.
- Shipper, consignee, carrier and driver names are removed or tokenized, and claim amounts and settlement terms usually come out.
What makes an OS&D record worth licensing?#
An OS&D record is worth licensing when it captures a complete exception case: what was expected, what arrived, what evidence was gathered and how the discrepancy was resolved. Warehouses, cross-docks and carriers create these reports every day, but many archives keep only the first part.
AI teams use complete cases to train systems that classify exceptions at the dock, suggest the next step, draft claims and predict which shipments will end in a dispute. Each of those tasks needs the outcome, which is why a pile of exception notations without resolutions ranks low.
| Archive state | What a buyer can use | Typical priority |
|---|---|---|
| Report only, no shipment link | Free-text descriptions of damage or shortage | Low |
| Report linked to BOL and receipt | Expected versus actual quantities and condition | Medium |
| Report linked to receipt, photos and resolution | The full case from discovery to outcome | High |
| Full case plus claim correspondence | Decision reasoning and each party's response | Highest, after redaction |
The OS&D preparation checklist#
The OS&D preparation checklist runs in a fixed order so that linking happens before anything is removed. Redacting first destroys the keys you need to join records, and a join that fails after redaction cannot be repaired.
- Step 1: export OS&D reports with their internal IDs, dates, facility and exception type.
- Step 2: join each report to its shipment using BOL, PRO, PO or ASN numbers, and to the WMS receipt.
- Step 3: attach evidence, including dock photos, exception notations on the delivery receipt and inspection notes.
- Step 4: attach the resolution: concealed damage finding, carrier claim, customer credit, reshipment or write-off.
- Step 5: replace keys and party names with consistent tokens once the joins are complete.
- Step 6: review photos and free text for names, addresses, signatures and plates.
- Step 7: remove or generalize claim amounts and settlement terms as counsel directs.
- Step 8: record every treatment in a data dictionary that travels with the package.
Linking each report to its shipment and outcome#
Linking an OS&D report to its shipment depends on which identifiers your teams recorded at the dock. The bill of lading number is the most common key, but carriers think in PRO numbers, buyers in PO numbers and receiving systems in ASN or receipt IDs, so most archives need more than one join.
Carrier claim files are the link most often lost. Claims handled by email or through a carrier portal rarely carry the WMS receipt number, so match them by PRO and BOL, and record the match method on each joined case so a buyer can weigh the weaker joins.
Where a link is missing, do not fill it by guesswork. A report that cannot be joined with confidence should be marked unlinked or left out, because a wrong join teaches a model the wrong lesson about who caused a loss.
| Link | Usual source | What it adds |
|---|---|---|
| Bill of lading | Shipping documents, TMS | Expected pieces, weight and handling instructions |
| PRO number | Carrier records, freight bills | The carrier's view of the shipment and any delivery exceptions |
| ASN (EDI 856) or PO | EDI translator, ERP | Expected items and quantities at line level |
| Receipt record | WMS | What was actually counted and put away |
| Claim file | Claims log, email, carrier portal | The resolution and the reasoning behind it |
Reviewing damage photos and dock notes#
Damage photos and dock notes carry the evidence AI teams value most and the personal details that need the most care. A photo of a crushed pallet can also show a shipping label with a consignee name and address, a driver's face, a trailer plate or a handwritten signature.
Photos also carry hidden metadata. Many phone and handheld cameras store location and device details inside the image file, so strip metadata as a standard step. Automated tools can speed up the first pass; Google's API definition for Sensitive Data Protection, for instance, says the service inspects, classifies and de-identifies both text and images. A person should still look at a sample from every batch, because a missed label on one photo is a missed address.
Dock notes written in free text often name people, such as the driver who refused to wait for a recount or the receiver who signed. Replace names with roles, and keep the substance of the note.
Removing party names and commercial terms#
Party names and commercial terms come out because a buyer needs the pattern of the exception, not the identity of the shipper, consignee or carrier, and because claim settlements are often confidential between the parties.
Keep tokens consistent across the whole archive. If a receiving facility that habitually refuses partial deliveries keeps one token throughout, a model can learn the pattern without anyone learning which facility it is.
- Shippers, consignees and carriers: consistent tokens, with facility type and region kept where useful.
- Drivers, receivers and claims staff: removed or replaced with role labels.
- Claim amounts, settlement terms and payment details: removed or banded after counsel review.
- Customer account numbers and contact details: removed.
- Product descriptions: kept, unless they reveal a confidential customer item or a named private label.
Illustrative: a 3PL prepares a receiving exception package#
Illustrative: a fictional 3PL runs several warehouses for retail and industrial clients. Its receiving teams log OS&D reports in the WMS, take photos on handhelds and handle carrier claims by email through a single claims coordinator.
The COO's team joins reports to receipts and ASNs, then pulls claim outcomes from the coordinator's mailbox using PRO numbers. Client agreements are checked first, and records for clients whose contracts restrict secondary use are excluded. Photos are stripped of metadata and screened for labels and faces, and a reviewer checks a sample from each warehouse.
The final package covers complete cases only, with client, carrier and driver names tokenized or removed and claim amounts taken out. The 3PL approves a single permitted use, and the data dictionary lists every treatment applied.
How SourceX prepares OS&D packages#
SourceX prepares OS&D packages only once counsel has cleared which client and carrier records may go in, so redaction and tokenizing happen on an agreed scope as part of Preparation in the SourceX five-step transaction. SourceX does not host large photo archives; they remain on the supplier's servers or travel on encrypted drives.
For each OS&D package, the SourceX Evidence Packet lists where every record family came from, which redactions and tokens were applied, what use was permitted and who signed the release, so a buyer can trace how each case was prepared.
Frequently asked questions
Are concealed damage reports handled differently?
Concealed damage is found after a delivery was signed clean, so the record relies on later inspection and a separate claim. Keep the interval between delivery and discovery as a relative field and link the claim outcome. Those cases teach a model how disputes over responsibility unfold.
Do overages matter as much as shortages and damage?
Overages are less common in claims but useful for training, because they reveal receiving and labeling errors upstream. Keep them in the package with the same links, including how the extra freight was returned, reshipped or billed.
Can we include records our client contract treats as client data?
Only if the contract and the client allow it. Many 3PL agreements define shipment and inventory records as client data or restrict use outside the services. Check each client agreement during the rights review and exclude records you cannot clear.
What if photos were taken on personal phones?
Photos on personal devices are hard to collect completely and may mix work and personal images. Use only photos already stored in company systems and linked to a report, and leave device collection out of the first package.
Should we include claims we lost?
Yes. Denied and partially paid claims show how documentation quality, timing and dock notation affect outcomes, which helps AI teams build claim drafting and triage tools. Keep the outcome category and the stated reason, with amounts removed.
Should exception notations on delivery receipts be kept as images or text?
Keep both where you can. The image shows exactly what the receiver wrote at the dock, which matters in claims, while a keyed text version lets a model work with it at scale. If only images exist, transcription can be added during preparation, with the same redaction rules applied to both.
Sources
- Google's DLP API v2 definition states that Sensitive Data Protection provides a sensitive data inspection, classification and de-identification platform that works on text, images and Google Cloud storage repositories. Source
Related resources
See if your company qualifies
A short company assessment. No data uploads are needed.