Skip to content

Multimodal and embodied data

Operational Logs from Deployed Robot Fleets as Training and Evaluation Data

Quick answer

Deployed robot fleet logs are the records that autonomous mobile robots (AMRs), AGVs and cobots produce while doing paid work: task orders, paths, stops, faults, operator interventions, battery and maintenance events, and on some systems camera or LiDAR snapshots. They are valuable for policy fine-tuning, failure analysis and real-world evaluation because they capture outcomes in live facilities. The facility operator usually holds them, but OEM terms may also claim telemetry, so ownership, retention and de-identification need checking before any license.

By SourceX Editorial · Updated

What fleet logs contain and why they differ from demonstrations

Fleet logs record robots acting autonomously under production constraints, which makes them a different asset from teleoperated demonstrations. Demonstration corpora such as those pooled in Open X-Embodiment were collected to teach skills, with consistent episodes across many embodiments [1]. Operational logs instead record what happened when a deployed policy met real aisles, pallets, people and shift patterns, including the failures. For demonstrations, see robot teleoperation data and the owner page on robotics training data for embodied AI.

A typical operator holds several layers, often in different systems:

  • Fleet manager and WMS/MES events: task requests, assignments, completion or cancellation codes, timestamps and station IDs.
  • Vehicle state streams: pose, velocity, battery, load state, operating mode, safety state and active errors. Fleets that speak VDA 5050 publish this as JSON over MQTT on a state topic alongside order, instantActions, visualization, connection and factsheet [4][5].
  • Onboard recordings: ROS 2 bags, increasingly in MCAP, holding laser scans, odometry, costmaps and sometimes compressed images [6][7].
  • Interventions and maintenance: remote-assist sessions, manual pushes, e-stop events, CMMS work orders and part replacements.

Where the training and evaluation value sits

The main value is real success and failure distributions across facilities, which simulation and lab demonstrations rarely reproduce. Fleet research stresses that useful generalist models must learn from heterogeneous data across sensor modalities and embodiments [2], and deployed fleets are one of the few sources of that heterogeneity at production scale.

Buyers usually target four uses:

  • Policy fine-tuning on navigation or pick sequences, weighted toward hard cases such as narrow aisles and mixed traffic.
  • Failure analysis: joining fault codes and interventions to the sensor context just before them. See robot failure, intervention and recovery data.
  • Real-world evaluation: held-out facilities or time periods with ground-truth task outcomes, kept separate from training. See private evaluation sets for multimodal models.
  • World models and forecasting: predicting congestion, battery depletion or fault onset from state sequences, often paired with operator notes as covered in paired time-series and text data.

Retention, sampling and format gaps to check first

Most fleets do not keep full-rate sensor data, so assume logs are sampled, truncated or event-triggered until the operator shows otherwise. Fleets can generate terabytes of video and LiDAR, and uploading all of it from the field is impractical [3]. Some operators keep fleet-manager events for months but rotate onboard bags within days, saving only snippets around faults.

Common failure modes buyers find late:

  • Ring-buffer bags: only the seconds before an e-stop survive, so successful runs have no sensor context and the class balance is skewed.
  • Clock drift: vehicle, fleet-manager and WMS clocks disagree, breaking joins between a fault code and its scan.
  • Firmware and map churn: error codes, map IDs and coordinate frames change between software releases without a version field in the export.
  • Schema drift between protocol versions: VDA 5050 messages carry a protocol version in their header, major versions differ in fields, and mixed fleets may run more than one [4].
  • Lossy exports: CSV dumps from a vendor dashboard drop the MCAP schema and channel definitions that make recordings self-describing [7].

Who owns robot telemetry

Ownership is often split between the operator, the robot OEM and the facility owner, so rights must be traced before pricing. Some robots-as-a-service and fleet software agreements give the OEM rights to telemetry for product improvement, and some restrict the operator from sharing it with third parties. Buyers should read the operator's OEM agreement, not only the operator's own consent.

Terms can also shift over time. FTC staff have warned that quietly changing terms of service to permit AI training on previously collected data may be unfair or deceptive [8], which matters if an OEM or operator relies on a recent terms update. Public datasets carry license risk too: an audit of 1,800+ text datasets found licenses omitted or mislabeled at high rates on popular hosting sites [9], so check open robot data the same way. For the full ownership analysis, see who owns robot data and chain of title for AI training data.

This page is general information, not legal advice. Confirm requirements with counsel for your jurisdiction and use case.

People, layouts and other sensitive content

Camera and LiDAR snapshots from working facilities capture workers, visitors and site layouts, so de-identification has to cover more than log fields. Faces and badges in images, operator IDs in intervention records, and named stations or customer SKUs in task data are the usual direct identifiers. Floor maps and rack layouts can reveal a supplier's operations even when no person appears.

Practical controls include blurring or dropping image frames, hashing operator and vehicle IDs consistently so sequences still join, and coarsening map coordinates or transforming them into a local frame. The owner guide on how to de-identify sensor and IoT data covers methods in more depth.

Request template for a fleet log dataset

A precise request names the robot class, tasks, fields and retention you need, so suppliers can say quickly whether their logs fit.

Illustrative example: invented to show structure; it does not describe an available dataset.

FieldExample specification
Robot classAMRs doing tote transport in US fulfillment or manufacturing sites; cobots at palletizing cells as a secondary option
Fleet interfaceVDA 5050 state/order messages or vendor fleet-manager API export, with protocol version recorded
Event tablestask_id, order_id, robot_id (hashed), start/end timestamps (UTC), outcome code, cancel reason, station_id
Faults and interventionserror_type, error_level, timestamp, remote-assist or manual action, time to recovery
Sensor contextMCAP or ROS 2 bag snippets, 30 s before and 10 s after each fault, plus a random sample of successful runs
CoverageSeveral facilities and multiple firmware versions, with release dates per site
Retention evidenceWritten description of what is kept, sampled or rotated, and for how long
RightsOEM agreement terms on telemetry, operator consent, facility owner position
PrivacyFaces and badges blurred or frames dropped; operator IDs pseudonymized; method documented
Intended useNavigation policy fine-tuning and a held-out evaluation split by facility

Before payment, run the acceptance checks in acceptance checks for robot datasets: verify join rates between events and recordings, outcome-code consistency and timestamp alignment on a sample.

How SourceX handles requests for fleet logs

SourceX sources operational datasets from US companies on request and manages the commercial process, including licensing and ongoing purchases. Fleet logs are not held in stock, and a request does not guarantee a match. You describe the data, SourceX looks for US businesses that hold it, and every release is approved by the supplying company. To start, describe your target logs on the SourceX buyer page.

Each dataset is rights-reviewed for ownership and consents, then delivered under a license that defines the records, uses, term and delivery. Personal details are removed or replaced before delivery, the method is recorded and a sample is checked, though no method is perfect. Delivery runs through private, access-controlled workflows after an executed agreement and supplier approval. SourceX does not train models and does not publish prices. More context on the wider category is in the multimodal training data hub and the owner page to license sensor and IoT data.

Source deployed robot fleet logs for your models

SourceX finds US companies that hold the operational data you describe, assesses data and licensing permissions, and agrees pricing and allowed uses in a license before anything is delivered. Nothing is contracted until a supplier agrees. Describe the fleet logs you need on the SourceX buyer page.

Frequently asked questions

Are robot OEMs or operators the better source of fleet logs?

Operators hold the task context (orders, stations, outcomes) that gives logs their labels, while OEMs may hold richer onboard telemetry across many customers. OEM data often lacks site-level outcome codes, and operator data may be limited by the OEM agreement, so many buyers need both parties' positions documented.

Can fleet logs replace simulation or teleoperation data?

Usually not on their own. Fleet logs show real distributions and failures, but they rarely contain the dense, consistent episodes that manipulation learning needs. See real-world vs simulated robot data for how teams combine sources.

How should I split fleet logs for evaluation?

Split by facility or by time period, not by random episode, so near-duplicate runs from the same aisle or shift do not leak into both training and test sets.

Sources

  1. Open X-Embodiment Collaboration (arXiv:2310.08864), "Open X-Embodiment: Robotic Learning Datasets and RT-X Models" (2023). https://arxiv.org/abs/2310.08864v1
  2. MIT DSpace, "Robot Fleet Learning From Heterogeneous Data". https://dspace.mit.edu/handle/1721.1/158917?show=full
  3. Cornell Robotics, "Robotics seminar on learning from robot fleets". https://robotics.cornell.edu/?p=1742
  4. ROS Documentation (Open Robotics), "control_msgs/msg/VDA5050State". https://docs.ros.org/en/kilted/p/control_msgs/msg/VDA5050State.html
  5. Cybus, "VDA 5050 AGV Integration". https://docs.cybus.io/guides/system-connectivity/industry-standards-interoperability/vda-5050-agv-integration
  6. ROS Documentation (Open Robotics), "rosbag2_storage_mcap". https://docs.ros.org/en/jazzy/p/rosbag2_storage_mcap/
  7. Foxglove, "Announcing the MCAP Storage Plugin for ROS 2" (2022). https://www.foxglove.dev/blog/announcing-the-mcap-storage-plugin-for-ros2
  8. Federal Trade Commission, Office of Technology, "AI (and other) Companies: Quietly Changing Your Terms of Service Could Be Unfair or Deceptive" (2024). https://www.ftc.gov/policy/advocacy-research/tech-at-ftc/2024/02/ai-other-companies-quietly-changing-your-terms-service-could-be-unfair-or-deceptive
  9. Longpre et al. (arXiv:2310.16787), "The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI" (2023). https://arxiv.org/abs/2310.16787

Tell us what your models need

Share scope, volume, language, format, timing and licensing requirements.

Request data