← All work

Visual Localization

Uncertainty-aware UAV visual localization

Monocular visual and visual-inertial localization studies that propagate feature, camera, attitude, and altitude uncertainty into UAV position estimates.

My role
I contributed to the computer-vision methodology and experiments as a co-author. The papers do not specify a finer per-author task split.
What I built
Feature extraction and matching feed a relative visual-localization model. The companion sensitivity study compares classical features and semantic segmentation while propagating input uncertainties through the modeled VIO measurement chain.
Key results
  • 1 px feature localization uncertainty (semantic segmentation; VIO simulation study)
  • 2 px feature localization uncertainty (ORB, best traditional method in the comparison)
  • < 0.8 m maximum trajectory error (simulated flight; ORB and semantic segmentation)
Stack
MATLAB · Simulink · QGroundControl · Monocular VO · Visual-inertial odometry · Uncertainty propagation
QGroundControl mission planning beside an urban UAV simulation.
Published simulation setup: QGroundControl and the 3D flight environment. Publication figure, not a field photograph.

Problem

What needed to be understood or measured

A trajectory can look plausible while concealing how image disparity, camera geometry, feature selection, attitude, and altitude measurements affect the reliability of each estimated position.

My contribution

My contribution

I contributed to the computer-vision methodology and experiments as a co-author. The papers do not specify a finer per-author task split.

Experimental setup

Data and setup

A MATLAB/Simulink UAV flight simulator, QGroundControl mission planning, an urban 3D environment, monocular image sequences, camera intrinsics, attitude and altitude inputs, and simulated reference positions.

Method

From input to interpretable output

Feature extraction and matching feed a relative visual-localization model. The companion sensitivity study compares classical features and semantic segmentation while propagating input uncertainties through the modeled VIO measurement chain.

Results

Reported results

1 px

feature localization uncertainty

semantic segmentation; VIO simulation study

2 px

feature localization uncertainty

ORB, best traditional method in the comparison

< 0.8 m

maximum trajectory error

simulated flight; ORB and semantic segmentation

Validation & uncertainty

Reference and uncertainty checks

Estimated trajectories are compared with simulator reference coordinates. Expanded uncertainty bands and feature-method comparisons show where the estimate is precise, where drift accumulates, and how the selected visual representation changes the result.

Limitations & failure modes

Operating limits and failure modes

Low texture, repeated structures, mismatches, disparity error, camera-calibration error, altitude and attitude uncertainty, motion blur, and scene-domain shift can all degrade the estimated trajectory.

The results are simulation-based and do not establish field performance under arbitrary weather, flight dynamics, camera hardware, or GNSS-denied operational conditions.

Technical stack

Tools selected for the measurement chain

  • MATLAB
  • Simulink
  • QGroundControl
  • Monocular VO
  • Visual-inertial odometry
  • Uncertainty propagation

Sources & project links

Papers and code

MetroAeroSpace 2023 relative-localization uncertainty paper and I2MTC 2024 VIO sensitivity paper. All displayed trajectories and uncertainty plots are publication figures.

Localization paper ↗VIO sensitivity paper ↗