Enhancing the quality of service of mobile video technology by increasing multimodal synergy

Research output: Contribution to journalJournal articlepeer-review

Standard

Enhancing the quality of service of mobile video technology by increasing multimodal synergy. / van der Sluis, Frans; van den Broek, Egon L.; van Drunen, Annemiek; Beerends, John G.

In: Behaviour and Information Technology, Vol. 37, No. 9, 2018, p. 874-883.

Research output: Contribution to journalJournal articlepeer-review

Harvard

van der Sluis, F, van den Broek, EL, van Drunen, A & Beerends, JG 2018, 'Enhancing the quality of service of mobile video technology by increasing multimodal synergy', Behaviour and Information Technology, vol. 37, no. 9, pp. 874-883. https://doi.org/10.1080/0144929X.2018.1505954

APA

van der Sluis, F., van den Broek, E. L., van Drunen, A., & Beerends, J. G. (2018). Enhancing the quality of service of mobile video technology by increasing multimodal synergy. Behaviour and Information Technology, 37(9), 874-883. https://doi.org/10.1080/0144929X.2018.1505954

Vancouver

van der Sluis F, van den Broek EL, van Drunen A, Beerends JG. Enhancing the quality of service of mobile video technology by increasing multimodal synergy. Behaviour and Information Technology. 2018;37(9):874-883. https://doi.org/10.1080/0144929X.2018.1505954

Author

van der Sluis, Frans ; van den Broek, Egon L. ; van Drunen, Annemiek ; Beerends, John G. / Enhancing the quality of service of mobile video technology by increasing multimodal synergy. In: Behaviour and Information Technology. 2018 ; Vol. 37, No. 9. pp. 874-883.

Bibtex

@article{d6321d3049f14e8f8027bc671f747be7,
title = "Enhancing the quality of service of mobile video technology by increasing multimodal synergy",
abstract = "ABSTRACTBandwidth is still a limiting factor for the Quality of Service (QoS) of mobile communication applications. In particular, for Voice over IP the QoS is not yet as good as for common, well-engineered, public-switched telephone networks. Multisensory communication has been identified as a possibility to moderate this limitation. One of the strengths of mobile video technology lies in its combination of visual and auditory modalities. However, one of the most salient features of mobile video applications is its small screen size. To test the potential of multimodal synergy for mobile devices, we assessed to what extent small screens affect multimodal synergy. This potential was assessed in an experiment with 54 participants, who conducted a standardised video-listening test for three talking-heads videos with a signal-to-noise ratio of –9 dB. The videos were presented on three different screen sizes, whilst keeping the video and auditory signals equal. Compared to a ground truth based on 359 participants, intelligibility was found to be significantly higher when using a large screen than when using a small screen. This indicates that mobile video technology has the potential for a significant multimodal synergy to which screen size is a substantial constraint. To optimally benefit from their multimodal potential, we offer suggestions on how to increase the effective screen size for small screen (e.g. mobile) devices and applications through elaborating the most relevant (visual) features. We conclude that knowledge about human sensory processing can alleviate the identified constraint and maximise the potential QoS of mobile video technology.",
author = "{van der Sluis}, Frans and {van den Broek}, {Egon L.} and {van Drunen}, Annemiek and Beerends, {John G.}",
year = "2018",
doi = "10.1080/0144929X.2018.1505954",
language = "English",
volume = "37",
pages = "874--883",
journal = "Behaviour and Information Technology",
issn = "0144-929X",
publisher = "Taylor & Francis",
number = "9",

}

RIS

TY - JOUR

T1 - Enhancing the quality of service of mobile video technology by increasing multimodal synergy

AU - van der Sluis, Frans

AU - van den Broek, Egon L.

AU - van Drunen, Annemiek

AU - Beerends, John G.

PY - 2018

Y1 - 2018

N2 - ABSTRACTBandwidth is still a limiting factor for the Quality of Service (QoS) of mobile communication applications. In particular, for Voice over IP the QoS is not yet as good as for common, well-engineered, public-switched telephone networks. Multisensory communication has been identified as a possibility to moderate this limitation. One of the strengths of mobile video technology lies in its combination of visual and auditory modalities. However, one of the most salient features of mobile video applications is its small screen size. To test the potential of multimodal synergy for mobile devices, we assessed to what extent small screens affect multimodal synergy. This potential was assessed in an experiment with 54 participants, who conducted a standardised video-listening test for three talking-heads videos with a signal-to-noise ratio of –9 dB. The videos were presented on three different screen sizes, whilst keeping the video and auditory signals equal. Compared to a ground truth based on 359 participants, intelligibility was found to be significantly higher when using a large screen than when using a small screen. This indicates that mobile video technology has the potential for a significant multimodal synergy to which screen size is a substantial constraint. To optimally benefit from their multimodal potential, we offer suggestions on how to increase the effective screen size for small screen (e.g. mobile) devices and applications through elaborating the most relevant (visual) features. We conclude that knowledge about human sensory processing can alleviate the identified constraint and maximise the potential QoS of mobile video technology.

AB - ABSTRACTBandwidth is still a limiting factor for the Quality of Service (QoS) of mobile communication applications. In particular, for Voice over IP the QoS is not yet as good as for common, well-engineered, public-switched telephone networks. Multisensory communication has been identified as a possibility to moderate this limitation. One of the strengths of mobile video technology lies in its combination of visual and auditory modalities. However, one of the most salient features of mobile video applications is its small screen size. To test the potential of multimodal synergy for mobile devices, we assessed to what extent small screens affect multimodal synergy. This potential was assessed in an experiment with 54 participants, who conducted a standardised video-listening test for three talking-heads videos with a signal-to-noise ratio of –9 dB. The videos were presented on three different screen sizes, whilst keeping the video and auditory signals equal. Compared to a ground truth based on 359 participants, intelligibility was found to be significantly higher when using a large screen than when using a small screen. This indicates that mobile video technology has the potential for a significant multimodal synergy to which screen size is a substantial constraint. To optimally benefit from their multimodal potential, we offer suggestions on how to increase the effective screen size for small screen (e.g. mobile) devices and applications through elaborating the most relevant (visual) features. We conclude that knowledge about human sensory processing can alleviate the identified constraint and maximise the potential QoS of mobile video technology.

U2 - 10.1080/0144929X.2018.1505954

DO - 10.1080/0144929X.2018.1505954

M3 - Journal article

VL - 37

SP - 874

EP - 883

JO - Behaviour and Information Technology

JF - Behaviour and Information Technology

SN - 0144-929X

IS - 9

ER -

ID: 212266155