EnPower: Haptic Interfaces for Deafblind Individuals to Interact, Communicate, and Entertain Chapter uri icon

Overview

abstract

  • For deafblind individuals, the absence of visual and auditory communication channels prevents meaningful interactions with the people and world around them, leading many to suffer from both mental and social issues. Among the remaining sensory channels (e.g., taste, haptic, and olfactory) of deafblind individuals, haptic stimuli are an effective medium that can be digitally employed to enable interactions with the outside world. Thus, this paper discusses the development of a digital communication platform for deafblind individuals called ´┐ŻEnPower" (Enable and Empower individuals with auditory and visual impairments). EnPower enables bi-directional communication between deafblind and non-impaired individuals by using sensory substitution techniques to present information via accessible haptic stimuli. The EnPower platform consists of a physical interface (in wearable and desktop versions) that is paired with a wireless mobile application. Similar to concepts such as Finger Braille, the assistive devices can deliver textual information via tactile stimuli to the deafblind individual, and vice versa. Additionally, the system can translate speech and visual input into tactile stimuli, providing users with greater access to digital information platforms. Using the two devices, a stimuli perception study, as well as a field trial, was conducted to evaluate the effectiveness of our approach (delivering information via tactile sensations on fingertips). Findings not only suggest that participants could understand the information presented via tactile sensations but also reveal several important avenues for future research.

publication date

  • January 1, 2020

Full Author List

  • Ranasinghe N; Jain P; Tolley D; Chew B; Bansal A; Karwita Tailan S; Yen CC; Do EY-L

book title

  • Advances in Intelligent Systems and Computing, Future Technologies Conference (FTC) 2020, Volume 2. FTC 2020

Other Profiles

International Standard Book Number (ISBN) 13

  • 978-3-030-63088-1