Skip to main content

REHABDATA Detailed Record

How do people with limited movement personalize upper-body gestures? Considerations for the design of personalized and accessible gesture interfaces. In Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '23), October 22-25, 2023, New York, NY.

NARIC Accession Number: O23505. What's this? Download article in Full Text
ISSN:.
Author(s): Yamagami, Momona, Portnova-Fahreeva, Alexandra A., Kong, Junhan, Wobbrock, Jacob O., Mankoff, Jennifer.
Project Number: 90ARCP0005.
Publication Year: 2023.
Number of Pages: 15.
Abstract: This study explored the types of gestures and types of sensor technologies that could be used for personalized upper-body gesture recognition to ensure that gesture systems are accessible. The personalized gestures that 25 participants with upper-body motor impairments designed for 10 functions (e.g., zoom-in, select, open) were analyzed. Results indicated that the personalized gesture sets that participants designed were highly ability specific. Even within a specific type of disability, there were significant differences in what muscles participants used to perform upper-body gestures, with some predominantly using shoulder and upper-arm muscles, and others solely using their finger muscles. Eight percent of gestures that participants designed were with their head, neck, and shoulders, rather than their hands and fingers, demonstrating the importance of tracking the whole upper body. To combat fatigue, participants performed 51 percent of gestures with their hands resting on or barely coming off their armrest, highlighting the importance of using sensing mechanisms that are agnostic to the location and orientation of the body. Lastly, participants activated their muscles but did not visibly move during 10 percent of the gestures, demonstrating the need for using sensors that can sense muscle activations without movement. Both inertial measurement unit and electromyography wearable sensors proved to be promising sensors to differentiate between personalized gestures. Personalized upper-body gesture interfaces that take advantage of each person’s abilities are critical for enabling accessible upper-body gestures for people with upper-body motor impairments.
Descriptor Terms: ACCESSIBILITY, ASSISTIVE TECHNOLOGY, BODY MOVEMENT, COMMUNICATION SKILLS, COMPUTERS, ELECTRONICS, LIMBS, MOTOR SKILLS.


Can this document be ordered through NARIC's document delivery service*?: Y.
Get this Document: https://doi.org/10.1145/3597638.3608430.

Citation: Yamagami, Momona, Portnova-Fahreeva, Alexandra A., Kong, Junhan, Wobbrock, Jacob O., Mankoff, Jennifer. (2023.) How do people with limited movement personalize upper-body gestures? Considerations for the design of personalized and accessible gesture interfaces. In Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '23), October 22-25, 2023, New York, NY Retrieved 5/10/2026, from REHABDATA database.


* The majority of journal articles, books, and reports in our collection are only available by regular mail, rather than downloadable electronic format. Learn more about our digital collection and our document delivery service.