Logo image
ARVA: An Augmented Reality-based Visual Aid for Mobility Enhancement Through Real-time Video Stream Transformation
Journal article   Open access   Peer reviewed

ARVA: An Augmented Reality-based Visual Aid for Mobility Enhancement Through Real-time Video Stream Transformation

Arezoo Sadeghzadeh, Md Baharul Islam, Md Nur Uddin and Tarkan Aydin
IEEE access, Vol.12, pp.1-1
01-01-2024

Abstract

Augmented reality Empirical Evaluation Extended reality Headphones Mobility Enhancement Streaming media Testing Video Remapping Videos Virtual assistants Visual Assistant Visual impairment Visualization
Visual field loss (VFL) is a persistent visual impairment characterized by blind spots (scotoma) within the normal visual field, significantly impacting daily activities for affected individuals. CurrentVirtual Reality (VR) and Augmented Reality (AR)-based visual aids suffer from low video quality, content loss, high levels of contradiction, and limited mobility assessment. To address these issues, we propose an innovative vision aid utilizing AR headset and integrating advanced video processing techniques to elevate the visual perception of individuals with moderate to severe VFL to levels comparable to those with unimpaired vision. Our approach introduces a pioneering optimal video remapping function tailored to the characteristics of AR glasses. This function strategically maps the content of live video captures to the largest intact region of the visual field map, preserving quality while minimizing blurriness and content distortion. To evaluate the performance of our proposed method, a comprehensive empirical user study is conducted including object counting and multi-tasking walking track tests and involving 15 subjects with artificially induced scotomas in their normal visual fields. The proposed vision aid achieves 41.56% enhancement (from 57.31% to 98.87%) in the mean value of the average object recognition rates for all subjects in object counting test. In walking track test, the average mean scores for obstacle avoidance, detected signs, recognized signs, and grasped objects are significantly enhanced after applying the remapping function, with improvements of 7.56% (91.10% to 98.66%), 51.81% (44.85% to 96.66%), 49.31% (43.18% to 92.49%), and 77.77% (13.33% to 91.10%), respectively. Statistical analysis of data before and after applying the remapping function demonstrates the promising performance of our method in enhancing visual awareness and mobility for individuals with VFL.
url
https://doi.org/10.1109/ACCESS.2024.3462628View
Published (Version of record) Open

Related links

Metrics

33 Record Views
2 Times Cited - Scopus

Details

UN Sustainable Development Goals (SDGs)

This output has contributed to the advancement of the following goals:

#3 Good Health and Well-Being
Logo image