Mobile Screen Size Limits Multimodal Synergy
Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Standard
Mobile Screen Size Limits Multimodal Synergy. / van der Sluis, Frans; van den Broek, Egon L.; van Drunen, Annemiek; Beerends, John G.
ECCE'18: Proceedings of the 36th European Conference on Cognitive Ergonomics . Vol. 36 New York, NY, USA : Association for Computing Machinery, Inc, 2018. 16.Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - GEN
T1 - Mobile Screen Size Limits Multimodal Synergy
AU - van der Sluis, Frans
AU - van den Broek, Egon L.
AU - van Drunen, Annemiek
AU - Beerends, John G.
N1 - Conference code: 36
PY - 2018
Y1 - 2018
N2 - Available bandwidth is still a limiting factor for mobile communication applications. Multisensory communication has already been identified as an possibility to moderate this limitation. One of the strengths of mobile communication lies in its combination of visual and auditory modalities. However, one of the most salient features of mobile devices have are their small screen size. This paper explores how the potential for multimodal synergy relates to the small screen size. In an experiment with 54 participants, the intelligibility was tested using a standardized video-listening test. The videos had a signal-to-noise ratio of -9dB and were presented on three different screen sizes, whilst keeping the video and auditory signals equal. Intelligibility was found to be significantly higher when using a large screen in comparison to using either of both smaller screens. We conclude that multisensory synergy is key to mobile applications, yet that screen size is a substantial constraint to this synergy. We argue that knowledge about human sensory processing can alleviate this constraint and maximize the potential quality of service of mobile video technology.
AB - Available bandwidth is still a limiting factor for mobile communication applications. Multisensory communication has already been identified as an possibility to moderate this limitation. One of the strengths of mobile communication lies in its combination of visual and auditory modalities. However, one of the most salient features of mobile devices have are their small screen size. This paper explores how the potential for multimodal synergy relates to the small screen size. In an experiment with 54 participants, the intelligibility was tested using a standardized video-listening test. The videos had a signal-to-noise ratio of -9dB and were presented on three different screen sizes, whilst keeping the video and auditory signals equal. Intelligibility was found to be significantly higher when using a large screen in comparison to using either of both smaller screens. We conclude that multisensory synergy is key to mobile applications, yet that screen size is a substantial constraint to this synergy. We argue that knowledge about human sensory processing can alleviate this constraint and maximize the potential quality of service of mobile video technology.
U2 - 10.1145/3232078.3232101
DO - 10.1145/3232078.3232101
M3 - Article in proceedings
VL - 36
BT - ECCE'18
PB - Association for Computing Machinery, Inc
CY - New York, NY, USA
T2 - European Conference on Cognitive Ergonomics
Y2 - 5 September 2018 through 7 September 2018
ER -
ID: 212266035