← All work

Structural Monitoring

DeepTag vision for structural displacement measurement

A low-cost marker pipeline for 6-DoF pose and displacement measurement, characterized against controlled reference motion and applied to structural experiments.

My role
I contributed to marker tracking and evaluation as a computer-vision co-author. The papers do not specify a finer per-author task split.
What I built
Detect marker regions, rectify each ROI, decode keypoints, map them back to the original frame, and estimate pose. Physical displacement is compared with a theoretical or controlled reference response.
Key results
  • 0.29° maximum expanded orientation uncertainty (k = 2; characterization study)
  • 0.12 mm maximum segment-distance IQR (repeatability study)
  • < 0.3 mm beam displacement RMSE (preliminary 2 Hz and 3 Hz tests)
Stack
Python · OpenCV · DeepTag · Camera calibration · PnP · Uncertainty analysis
Illustrative laboratory scene showing a camera and tracking markers on a structural model.
Illustrative rendering of camera-based displacement measurement on a structural test specimen.

Problem

What needed to be understood or measured

Scaled structural tests need synchronized, non-contact measurements across multiple elements without a dense network of wired sensors.

My contribution

My contribution

I contributed to marker tracking and evaluation as a computer-vision co-author. The papers do not specify a finer per-author task split.

Experimental setup

Data and setup

DeepTag markers, calibrated camera geometry, PnP pose estimation, a 6-DoF motorized reference for characterization, and later cantilever-beam dynamic tests at 2 Hz and 3 Hz.

Method

From input to interpretable output

Detect marker regions, rectify each ROI, decode keypoints, map them back to the original frame, and estimate pose. Physical displacement is compared with a theoretical or controlled reference response.

Results

Reported results

0.29°

maximum expanded orientation uncertainty

k = 2; characterization study

0.12 mm

maximum segment-distance IQR

repeatability study

< 0.3 mm

beam displacement RMSE

preliminary 2 Hz and 3 Hz tests

Validation & uncertainty

Reference and uncertainty checks

The marker study reports repeatability and expanded uncertainty under controlled motion. The later cantilever experiment compares vision-derived displacement with a reference response at two excitation frequencies.

Limitations & failure modes

Operating limits and failure modes

Marker visibility, blur, oblique viewing angles, calibration drift, synchronization error, and out-of-plane motion can all degrade pose or displacement estimates.

The reported results belong to controlled characterization and preliminary laboratory tests. They do not establish field-scale bridge monitoring performance.

Technical stack

Tools selected for the measurement chain

  • Python
  • OpenCV
  • DeepTag
  • Camera calibration
  • PnP
  • Uncertainty analysis

Sources & project links

Papers and code

DeepTag characterization paper (ET 2024), masonry tracking paper (ET 2024), and cantilever-beam paper (MetroSustainability 2025).

DeepTag paper ↗Dynamic testing paper ↗