top of page

AR Stair Navigation for People with Low Vision

Navigating stairs can be a dangerous mobility challenge for people with low vision. Inadequate handrails, poorly marked steps, and other obstacles can reduce mobility and lead to accidents. While past research has proposed audio stair-navigation aids for blind people, no research on people with low vision has yet addressed this challenge. Cx PhD student Yuhang Zhao, along with Cx faculty member Shiri Azenkot and other researchers from Cornell Tech and Columbia University, built on this research to design several AR navigation systems for people with low vision. They tested both projection-based and optical see-through smart glasses systems to determine the most effective navigation techniques. In the projection-based AR systems, experimental participants carried a handheld projector that projected a variety of different animated highlights on stairs, as well as playing auditory feedback. Results showed that participants appreciated highlights that marked the end of a staircase. While some appreciated moving highlights that attracted attention, others found these animations distracting.

Image showing graphical stair navigation options using smart glasses.

Participants using the optical see-through smart classes were shown a glow effect on the display to demonstrate their progress on the staircase, along with an animation showing a virtual path. Most participants found the glow animation helpful, and some appreciated that the path graphic gave them a clear indication of the direction of the stairs. In addition to ease of navigation concerns, both types of AR systems reduced participants' walking time. Participants also reported feeling more psychologically secure when navigating using both types of AR. These results advance understanding of the benefits of different types of graphics and devices that can assist people with low vision with navigating stairs. The results can also be applied to assisting with other types of navigation, such as in unfamiliar settings. This project was presented at ACM UIST 2019 in New Orleans, LA. You can read the full paper here >


Recent Posts

See All

Cx PhD student Yiqing Hua has been working on using natural language processing techniques to detect propaganda in news. As a participant in the 2nd Workshop on NLP for Internet Freedom (NLP4IF), Y

bottom of page