Skip to content

Systems and records

Commercial real estate lease abstract data: amendment and source links

By SourceX Editorial · Reviewed by Noah Loul ·

9 sections

Short answer

Preserve four links for every abstracted value: the document that states it, the exact page and quoted span, the earlier value it replaced with the amendment that replaced it, and the date the change took effect. Add who reviewed the value and when. Without those links a lease abstract dataset can test extraction but not whether a model reads the lease as it stands today.

License terms

Commercial real estate lease

This page covers commercial real estate lease abstract data: amendment and source links.Illustrative

Key takeaways

  • Store one record per abstracted value, each with its source document, evidence span, supersession link, effective dates and review.
  • Keep superseded values with their dates and successors; they are what make amendment reasoning testable.
  • Pair quoted text with character offsets and a file hash so evidence spans survive re-scans and repeated boilerplate.
  • Fields that depend on events, such as option exercise or commencement, need the event record, not only the clause.
  • Counsel clears confidentiality clauses, personal information and abstract ownership before any lease family is offered.

Every abstracted value needs four links: the document it came from, the exact page and text span inside that document, the earlier value it replaced together with the amendment that replaced it, and the date the change took effect. Add a fifth record of who checked the value, against which documents, and when. Those links are what let a buyer test whether a model reads the lease as it stands today, not only whether it can lift a number from page four of the base lease.

At a glance

What source and amendment links should a lease abstraction dataset preserve

Commercial real estate lease abstract data is valuable because property managers, lease administrators and occupiers already maintain it as a working record: rent schedules, critical dates, options, recoveries and obligations that someone relied on to bill, budget and give notice. The value of that record as training or evaluation data depends on whether the path from each field back to the signed documents survives the export.

  • Document link: which file in the lease family supports the value, by a stable document id and a file hash.
  • Evidence span: page number, the quoted text and its position, so a reviewer can find it in seconds.
  • Supersession link: the value id this one replaces and the document that made the change.
  • Effective dating: when the value starts and stops applying, separate from when the document was signed.
  • Review record: who confirmed the value, against which documents, on what date, and with what result.

Because the abstract is a conclusion, and a conclusion without its evidence cannot be graded. A model that outputs an expiration date can be scored against the abstract, but if the abstract itself is out of date, or was taken from a superseded clause, the score rewards the wrong behavior. Linked evidence lets a buyer separate three failures: the model missed the clause, the model read the right clause in the wrong document, or the model failed to apply a later amendment.

Accounting rules show why amendment dating matters in practice. IFRS 16 defines a lease modification as a change in the scope of a lease, or the consideration for a lease, that was not part of the original terms and conditions, such as adding or terminating a right to use an asset or extending or shortening the term. The FASB's Topic 842 glossary defines a separate effective date of the modification, the date both the lessee and lessor approve it. A dataset needs both the date the parties approved an amendment and the date its new terms start to apply; with only one of them, or neither, it cannot reproduce how the business actually tracked the change.

Clause-level datasets exist, but they answer a different question. The Contract Understanding Atticus Dataset (CUAD), built by the Atticus Project and described in a 2021 paper, labels clause spans across 41 categories in more than 500 commercial contracts, with categories such as Expiration Date, Renewal Term and Notice Period to Terminate Renewal and a defined answer format for each. That is a useful model for answer formats; it is organized around clauses in individual contracts, not a maintained abstract with a supersession history.

Which documents belong to one lease family, and how are they linked?

A lease family is the base lease plus every document that changed, confirmed or depended on its terms. Give each document an id, a type, a signature date, an effective date where it differs, the parties, and a parent link to the base lease. Without the family, an amendment is a fragment that refers to sections it does not contain.

The table lists the documents that most often change a commercial abstract and the link each one needs. Which of them exist depends on the property type and how the business administered its leases.

Build the family list from more than one place. Lease administration software, the legal team's document store, the property manager's shared drive and the accounts receivable system often each hold a different subset, and the missing side letter or exercise notice usually turns up in the one nobody exported. Record where each document was found so a gap can be traced back to its source system.

Which documents belong to one lease family, and how are they linked?
DocumentWhat it can changeLink fields to keepCommon gap
Base lease and exhibitsEvery field; exhibits often hold the rent table and premises plandocument_id, family_id, signed_date, page count, file hashExhibits scanned separately or missing
Numbered amendmentTerm, rent, premises, options, recoveriesparent_id, amendment_number, signed_date, effective_date, sections_amendedNumbering skips or two documents share a number
Side letterConcessions or rights outside the lease bodyparent_id, signed_date, fields_affected, confidentiality flagKept by the deal team, not in the lease file
Commencement date memoActual commencement and expiration datesparent_id, confirmed dates, signatoriesNever countersigned, so dates stay estimates
Option exercise noticeRenewal, expansion or termination termsparent_id, option clause reference, sent date, delivery methodNotice sent by email and never filed
Assignment or sublease consentParties and permitted useparent_id, consent date, new party roleConsent granted but the abstract keeps the old tenant
Estoppel certificateNothing; it confirms the parties' view of the terms on a dateparent_id, as_of date, fields confirmed, exceptions notedTreated as a source of terms rather than a check

The counsel-reviewed clause and evidence schema

The schema stores one record per abstracted value, not one row per lease. That shape lets a value carry its own evidence, history and review, and it lets a buyer reconstruct the abstract on any date by selecting the values in effect on that date. Field names below are a suggested convention; the relationships matter more than the names.

At a glance

The counsel-reviewed clause and evidence schema

Counsel reviewed means a qualified reviewer has confirmed how the clause categories are defined and where interpretation is required, for example whether a rent abatement is a change in consideration or a concession, before labels are applied at volume. Record that review as data, not a meeting note.

The counsel-reviewed clause and evidence schema
FieldPurposeIllustrative valueValidation rule
value_idStable id for this abstracted valueLV-000417Unique across the dataset
family_id and field_nameWhich lease and which abstract fieldLF-0093, renewal_option_termfield_name in the controlled list
value and unitThe normalized value60, monthsType and unit match the field definition
source_document_idDocument that states the valueLD-0093-A2 (second amendment)Document belongs to the same family
evidence_spanPage, quoted text and character offsetspage 3; quote 'one (1) additional term of sixty (60) months'Quote found verbatim at the page and offsets
supersedes_value_idEarlier value this replacesLV-000122Points to the same field in the same family
effective_from and effective_toWhen the value applies2027-01-01 to openNo overlap with another current value for the field
statuscurrent, superseded, conditional or disputedcurrentExactly one current value per field and date
interpretation_noteWhy a reader chose this readingAmendment 2 section 4 replaces lease section 3.2 in fullRequired when status is disputed or conditional
reviewReviewer role, date, resultlease administrator, 2026-06-02, confirmedPresent before the record is released

How should each value point back to the page it came from?

Store the quoted text, its surrounding context and its position, and store them against a fixed version of the file. Page numbers alone break when a PDF is re-scanned or OCR is rerun; quotes alone break when the same boilerplate appears twice. The pair survives both.

The W3C Web Annotation Data Model gives a ready pattern. Its TextQuoteSelector records the exact text with an optional prefix and suffix for context, and its TextPositionSelector records start and end character offsets. Using those two together, plus a page number and a hash of the file the offsets refer to, makes every evidence span checkable by a script before a human ever looks at it.

Measurements need the same discipline. Rentable area depends on the measurement standard behind it, and BOMA publishes more than one office standard, including the 2017 and 2024 editions. An abstract field for rentable square feet should name the standard and edition the lease or the remeasurement used, or two correct-looking values for the same suite will disagree for no visible reason.

  • Keep the source file immutable and reference it by hash; if OCR is rerun, create a new version and remap spans.
  • Record the page as printed and the page index in the file; they often differ in leases with unnumbered exhibits.
  • For tables such as rent schedules, link the whole table region and also each row used for a value.
  • Flag spans taken from handwritten edits or initialed strike-throughs; they need a human check.

Each changed value points back to the value it replaced and to the document that replaced it, so the chain can be walked in either direction. When the second amendment extends the term, the old expiration value is not deleted: its status becomes superseded, its effective_to is set, and the new value records supersedes_value_id and the amendment as its source.

This is the same relationship the W3C PROV Ontology names. In PROV-O, wasRevisionOf is a more specific form of wasDerivedFrom used when the newer entity contains substantial content from the older one. Mapping supersession to that vocabulary is optional, but it gives a buyer a standard way to read the history and gives your own team a test: if you cannot say which earlier value a current value revises, the chain has a hole.

Partial amendments are the hard case. An amendment that changes one option, relocates part of the premises or replaces a rent table only for a later period leaves the rest of the earlier value in force. Split those values so that each piece carries its own dates and source, rather than storing one blended value with a note.

  • Exactly one current value per field for any given date.
  • Every superseded value has an effective_to date and a successor.
  • Every successor's source document is dated on or after the document it supersedes.
  • Conditional values, such as an unexercised option, never become current without an event record.

A valid record and a failing record (illustrative)

A schema is only as good as the record that fails it. The pair below is illustrative: the property, parties, dates and quoted text are invented and are not drawn from any real lease or customer record.

The valid record states a renewal option term from a second amendment, quotes the text, points to the value it replaced and carries a review. The failing record looks complete to a person skimming a spreadsheet, which is why a validator has to read the links rather than the values.

Run the validator on the whole export before anyone samples it by hand, and keep its report with the dataset version. A report that lists, per lease family, how many values passed each check and which failed is more useful to a buyer than a promise that the abstracts were reviewed, and it shows your own team where the lease files themselves are incomplete.

  • Validator check 1: every evidence_span resolves verbatim in the hashed file at the stated page and offsets.
  • Validator check 2: for each family, field and date, exactly one value has status current.
  • Validator check 3: every supersedes_value_id points to the same field and family and to an earlier effective_from.
  • Validator check 4: source documents are in the family and dated no later than the value's effective_from.
  • Validator check 5: disputed or conditional values carry an interpretation_note and a reviewer.
A valid record and a failing record (illustrative)
FieldValid recordFailing recordWhy the failing record fails
source_document_idLD-0093-A2, second amendmentLD-0093-BASE, base leaseA later amendment changed the field; the base lease is no longer the source
evidence_spanPage 3, quote found at the stated offsetsPage 14, quote not found on that pageSpan does not resolve in the referenced file version
supersedes_value_idLV-000122BlankA current value with an older value for the same field must link to it
effective_from2027-01-012026-03-15 (amendment signed date)Signature date used where the amendment states a later effective date
statuscurrentcurrent, alongside LV-000122 also currentTwo current values for one field on one date
reviewLease administrator, confirmed against base lease and amendments 1-2NoneUnreviewed values cannot be released

Which condition or event decides whether an obligation was met?

For fields that depend on something happening, the clause alone does not settle the value; the event record does. Rent commencement may depend on delivery of the premises, an option may exist only if notice went out inside a window, and a co-tenancy remedy may depend on another tenant closing. Link the evidence of the event, not just the clause that describes it.

Model the event as its own record with a date, a type, a source and a link to the clause it satisfies. A renewal option then has two states: conditional, pointing to the option clause, and current, pointing to both the clause and the exercise notice with its sent date and delivery method. If the notice is missing, the value stays conditional however confident the abstract looks.

This is also where operating records add the most to the legal documents. Work completion certificates, delivery letters, notice logs and billing changes show what actually happened, and they let a buyer evaluate a model on obligation questions such as whether a notice window was met, instead of only on clause extraction.

  • Commencement: delivery or substantial completion letter, with date and signatory.
  • Option exercise: the notice, its sent date, delivery method and the clause window it relied on.
  • Rent change: the billing record or rent roll entry showing when the new amount was applied.
  • Termination or surrender: the agreement or notice and the date possession returned.

What counsel and the rights reviewer settle before any lease leaves the company

Access to a lease file is not permission to license it. Leases often contain confidentiality clauses that restrict disclosing terms, they name counterparties and sometimes individual guarantors, and the abstract itself may have been prepared by an outside firm under a contract that says who owns the work product. Counsel reviews those points against the specific documents before any record is offered, and de-identification alone does not create a right to license.

Decide perspective and scope early. A landlord, a tenant and a property manager each hold different copies and different rights in the same lease family, and a dataset should say whose records it is and what was excluded, such as side letters under separate confidentiality or guarantor details.

If you hold lease families and the abstracts your team maintained, the first step with SourceX is a short company assessment that needs no uploads. Nothing is delivered until your company approves the scope and terms and signs the agreement, and only then may SourceX use and sublicense the de-identified dataset as that agreement allows.

  • Confidentiality clauses in each lease and side letter, and whether any carve-out covers anonymized or aggregated use.
  • Personal information of guarantors, signatories and contacts, and how it is removed or masked.
  • Ownership of abstracts and summaries prepared by outside abstractors or brokers.
  • Which party's copy is offered and whether counterpart documents are excluded.

Frequently asked questions

Is an estoppel certificate a source of lease terms?

Treat it as a check, not a source. It records what a party confirmed about the lease on a given date, including any exceptions, so it is useful for validating values. The terms themselves still come from the lease and its amendments.

Should superseded values be removed before a lease abstract dataset is shared?

No. Superseded values with their dates and successors are what let a buyer test amendment reasoning and rebuild the abstract as of any date. Mark them clearly as superseded and keep exactly one current value per field and date.

Can leases with confidentiality clauses be licensed for AI training?

Sometimes, depending on the clause wording, the parties and what is removed. Counsel needs to read the specific clauses and decide whether the planned use is permitted, needs consent or must exclude those documents. De-identification alone does not settle the question.

What if an outside firm prepared the abstracts?

Check the engagement terms for who owns the abstracts and whether you can share them. If the firm retained rights, you may need its consent or may only be able to offer the source documents and your own reviewed values.

How is this different from a clause extraction dataset like CUAD?

CUAD labels clause spans in individual contracts with a defined answer format per category. A lease abstraction dataset adds a maintained abstract, the family of documents behind it, supersession links between values and the events that triggered them, which is what amendment reasoning requires.

Sources

  • IFRS 16 defines a lease modification as a change in the scope of a lease, or the consideration for a lease, that was not part of the original terms and conditions. Source
  • The Topic 842 glossary in ASU 2016-02 defines the effective date of a lease modification as the date it is approved by both the lessee and the lessor. Source
  • CUAD is an expert-annotated dataset of more than 500 commercial contracts labeled across 41 clause categories. Source
  • CUAD's category list includes Expiration Date, Renewal Term and Notice Period to Terminate Renewal, each with a defined answer format. Source
  • The Web Annotation Data Model's TextQuoteSelector records exact text with prefix and suffix, and TextPositionSelector records start and end offsets. Source
  • In PROV-O, wasRevisionOf specializes wasDerivedFrom for a newer entity that contains substantial content from the original. Source
  • BOMA publishes office floor measurement standards, including BOMA 2024 for Office Buildings, whose primary purpose is calculating rentable area. Source

See if your company qualifies

A short company assessment. No data uploads are needed.

See if your company qualifies