Short answer
A measuring-instrument dataset needs two things in the same clip: how the instrument is handled and what it reads. Video from labs and technicians can show probe placement, jaw closure and display reading, but only an independently recorded ground-truth value tells you whether the reading was right. Contact force and robot actions are not in the video and need instrumentation or robot hardware.
Why handling and reading belong together
Measurement tasks look simple, which hides how many ways they fail. A caliper reads wrong if the jaws sit at an angle to the part. A multimeter reads nothing useful if a probe is in the wrong jack or the dial is on the wrong function. A gauge reading taken at an oblique angle shifts with parallax. Each failure is a handling error that shows up as a reading error.
Recognition-oriented image collections typically label an instrument as an object and stop there; they do not link the handling step to the number that results. A buyer building a model that performs or verifies measurements needs both, so the capture has to record the instrument display and an independent truth value. The analog gauge and meter reading page covers the recognition-only case with legacy dials, and this page covers the combined case.
For the cluster context see the maintenance hub and the humanoid data sourcing guide.
Task anatomy by instrument
Vernier, dial or digital caliper
- Clean the jaws and the part; close the jaws and zero the display.
- Choose the jaw type: outside, inside, depth or step.
- Close the jaws on the feature with light, consistent pressure and the part seated flat.
- Lock or hold, remove without disturbing, and read the value.
- Repeat and record, and note the unit setting.
Digital multimeter
- Select the function (voltage, current, resistance, continuity) and the range if not automatic.
- Check lead placement in the correct jacks for that function.
- Confirm the circuit state; contact the test points; keep both hands clear of live parts.
- Read the display, unit and any overload indication; record.
Pressure, temperature or dial gauge
- Position the camera or eye square to the dial.
- Identify the scale, unit and any colored bands.
- Read the needle position against the scale, interpolating between marks.
Objects, lighting and posture change what is visible. Calipers are small and often held close to the body; multimeter displays are glossy and reflect lights; wearing gloves limits fine adjustment of a thumbwheel. Failure modes include a worn zero, low battery, wrong range, loose contact and misread units.
What published capture designs suggest
Ego-Exo4D recorded skilled activities, among them bike repair, with a head-mounted egocentric camera and several exocentric cameras at once, and added multichannel audio, eye gaze, 3D point clouds, camera poses and IMU, along with expert commentary and a proficiency-estimation benchmark (Grauman et al., 2023). The relevant lesson for measurement tasks is the combination: a close first-person view of the display, a third-person view of posture and grip, and expert commentary that explains why a step was done. Proficiency labels are also useful here, because the difference between a careful and careless reading is a skill difference.
Ego-Exo4D is a research dataset collected under its own protocol, not a source of measurement tasks. It is evidence of the capture pattern, not of any available data for this task.
What the data can support, and what it cannot
| Question | Can video and images answer it? | What else is needed |
|---|---|---|
| Which instrument and function is in use | Yes | Labels |
| Was the instrument held and positioned correctly | Partly | Third-person view, expert labels |
| What value is displayed | Yes, if the display is legible | Independent truth value to validate |
| Was the measurement accurate | No, from video alone | Reference measurement, calibration record |
| How hard were the jaws closed or probes pressed | No | Instrumented tool or force sensor |
| What would a robot's gripper do | No | Robot action data |
Instrument handling by a human hand does not transfer directly to a robot gripper. A caliper held in a human hand is positioned with many degrees of freedom and fine pressure control. The human-to-humanoid embodiment gap is the reason a robot-specific interface, such as a fixture or probe holder, is often needed.
Suppliers and the sourcing route
Calibration and test labs handle instruments constantly under documented procedures, and may have bench setups where cameras can be mounted. Field technicians in electrical, HVAC and equipment service use multimeters and gauges in real conditions, and their body-worn or phone recordings may exist already. Machine shops and quality departments use calipers and micrometers against inspection plans.
Existing material is mostly unlabeled and rarely includes a truth value. A commissioned capture can place a reference instrument beside the one being used, log both readings and fix the viewpoints. The existing footage versus commissioned recording page sets out the trade-off. For labs that already document calibration steps, see instrument calibration procedures.
Illustrative capture design
# Illustrative only - synthetic values
task_family: measurement_and_reading
instruments:
- caliper_digital_150mm_A
- multimeter_digital_B
- dial_gauge_C
parts_and_targets:
- gauge_blocks_set_01 # known dimensions
- bench_supply_fixture # known voltage setpoints
views:
display_closeup: macro lens, glare-controlled light
hands_third_person: 2 fixed cameras, time-synchronized
egocentric: 1 head-mounted
ground_truth:
reading_log: instrument reading entered per trial by an observer
reference: second instrument or known standard
labels:
steps: instrument-specific (see task anatomy)
errors: [jaw_tilt, wrong_jack, wrong_range, parallax, unit_misread]
proficiency: novice | competent | expert (per operator)
metadata: lab_004, operator_A12 (pseudonymous), gloves_worn, lighting_setup
Pairing handling data with image and pose assets
Instrument handling data becomes more reusable when it connects to other assets. Still images of the same instruments, taken against plain backgrounds, support recognition and can be sourced as tool identification image data. Where the goal is to learn how a handheld instrument moves relative to a part, tracked pose of the instrument adds geometry that video alone lacks; tool pose tracking explains the options and their calibration needs.
Keep one identifier scheme across all three assets so a recognition image, a handling clip and a pose track of the same caliper can be joined. Without that, buyers end up with three disconnected collections that cannot be evaluated together.
Quality and acceptance criteria
- Display legible in a share of readings that you set, tested by independent human reading from frames.
- Truth value present on every trial that will be used for reading evaluation.
- Camera and instrument identifiers consistent across sessions.
- Error trials present in proportions the capture plan states, not left to chance.
- Evaluation split held out by operator or lab so reading accuracy is not measured on operators seen in training.
Limitations to plan for
Reflections, auto-ranging displays and tiny seven-segment digits defeat many camera setups. Captured readings may reveal proprietary component dimensions or test limits. Operators are identifiable by hands, tattoos, badges and voices, so consent matters, and the worker consent page covers the questions. Instrument-use data from one lab may generalize poorly to another with different brands, and the data does not show the broader repair context around the measurement.
Questions to ask suppliers
- Which instrument models and display types are included?
- Is a ground-truth or reference reading recorded for each trial?
- Are there close-up views of the display, and what lighting was used?
- Were incorrect handling and misreadings captured, or only correct trials?
- Do recordings include audio commentary or expert explanation?
- How many operators are represented, and what is their experience level?
- Was calibration status of each instrument documented?
- What consent did operators give for AI-training use?
Discuss your requirements
If you need instrument-use demonstrations, describe the instruments, viewpoints, ground-truth needs and permitted uses to SourceX. SourceX reviews the requirement and follows up about potential sources among US businesses; whether a new recording is feasible is discussed case by case, and a request does not guarantee a match. The catalog entry for first-person video of manual work describes related existing-footage routes, and the hand tool use page covers unpowered tool handling more broadly.
Describe the workplace demonstration data your robotics project needs
Sources
- Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives — simultaneous egocentric and exocentric capture, expert commentary and proficiency benchmarks.