The cameras are currently mounted on glasses, but the team is working on making the devices lighter and more discreet.Credit: Tang et al., Nature Machine Intelligence
The Future of Assistive Technology
Developed by researchers from Shanghai Jiao Tong University and the Hong Kong University of Science and Technology, this innovative system combines smart glasses, bone-conducting headphones, vibrating wrist patches, and fingertip sensors. Together, they create a comprehensive navigation aid that interprets the environment and communicates directions to the user.
A study participant tests out the device (left), which uses AI to interpret camera footage (top right) and give audio cues to help navigation.Credit: Tang et al., Nature Machine Intelligence
How It Works
- Smart Glasses with Embedded Cameras: Capture real-time visual data to detect obstacles and analyze surroundings.
- Bone-Conducting Headphones: Deliver auditory cues without obstructing ambient sounds, ensuring situational awareness.
- Vibrating Wrist Patches: Provide haptic feedback, indicating directional guidance through subtle vibrations.
- Fingertip Sensors: Act as peripheral vision substitutes, detecting objects to the sides and assisting in object grasping.
The AI processes visual and tactile data, enabling the system to guide users with simple commands like “turn left” or precise instructions such as “right 50 degrees.”
Overview of the wearable multimodal visual assistance system. Credit: Nature Machine Intelligence (2025). DOI: 10.1038/s42256-025-01018-6
Real-World Impact
In tests involving blind and partially sighted participants, the wearable demonstrated significant improvements in navigation and object interaction. Users successfully navigated mazes and grasped objects without collisions after training with the device. The system’s intuitive design minimizes physical and cognitive strain, enhancing the quality of life for users.
A Glimpse into the Future
This wearable represents a significant leap forward in assistive technology, offering a user-friendly alternative to invasive treatments and complex prosthetics. By integrating AI with multisensory feedback, it paves the way for more accessible and empowering solutions for the visually impaired.
Curious about how AI continues to transform lives? Explore more groundbreaking innovations at DailySciTech.com
