دانلود Beyond Multimedia Adaptation: Quality of Experience-Aware Multi-Sensorial Media Delivery

Abstract

Multiple  sensorial  media  (mulsemedia)  combines multiple media elements which engage three or more of human senses, and as most other media content, requires support for delivery over the existing networks. This paper proposes an adaptive  mulsemedia  framework  (ADAMS)  for  delivering  scalable video and sensorial data to users. Unlike existing two-dimensional joint  source-channel  adaptation  solutions  for  video  streaming, the ADAMS framework includes three joint adaptation dimensions: video source, sensorial source, and network optimization.UsinganMPEG-7descriptionscheme, ADAMS recommends the integration  of  multiple  sensorial  effects  (i.e.,  haptic,  olfaction, air motion, etc.) as metadata into multimedia streams. ADAMS design includes both coarse- and fine-grained adaptation modules on the server side: mulsemedia flow adaptation and packet priority scheduling. Feedback from subjective quality evaluation and  network  conditions  is  used  to  develop  the  two  modules. Subjective evaluation investigated users’ enjoyment levels when exposed to mulsemedia and multimedia sequences, respectively and to study users’ preference levels of some sensorial effects in the context of mulsemedia sequences with video components at different quality levels. Results of the subjective study inform guidelines for an adaptive strategy that selects the optimal combination for video segments and sensorial data for a given bandwidth constraint and user requirement. User perceptual tests show how ADAMS outperforms existing multimedia delivery solutions in terms of both user perceived quality and user enjoyment during adaptive streaming of various mulsemedia content. In doing so, it highlights the case for tailored, adaptive mulsemedia delivery over traditional multimedia adaptive transport mechanisms.