ABSTRACT: This video describes three studies that investigated the preferences of 39 Deaf and Hard-of-Hearing (DHH) caption users for different caption styles and how effective they were in conveying a speaker’s emotions to DHH participants. Study 1 assessed preferences for nine of these styles, each conveying either valence or arousal separately. Study 2 combined Study 1's top-performing styles and measured preferences for captions depicting both valence and arousal simultaneously. Participants outlined readability, minimal distraction, intuitiveness, and emotional clarity as key factors behind their choices. In Study 3, these factors and an emotion-recognition task were used to compare how Study 2's winning styles performed versus a non-styled baseline. Based on the findings, the two best-performing styles (font-color with font-weight and font-color with font-size) are presented as design recommendations for applications employing affective captions. Run time: 8 minutes, 38 seconds
NARIC Accession Number: O23813
Author(s): de Lacerda Pataca, Caluã; Hassan, Saad; Tinker, Nathan; Peiris, Roshan L.; Huenerfauth, Matt
Project Number: 90DCPC0002
Publisher(s): Twenty-First Century Captioning Technology Metrics and Usability, Gallaudet University, 800 Florida Avenue, NE, Technology Access Program, SLCC 1116, Washington DC, 20002-3695; 202/250-2795 (V/Video)
Date Published: 2024
Descriptor Terms: ACCESSIBILITY, ASSISTIVE TECHNOLOGY, AUDIOVISUAL MATERIALS, CAPTIONING, DEAF, EMOTIONS, HEARING IMPAIRMENTS