Embed Size (px)
Citation preview
TOWARDS “WOW!” MULTIMEDIA QUALITY OF EXPERIENCE:
IF YOU CAN MEASURE IT, YOU CAN ACHIEVE ITJUDITH REDI
MULTIMEDIA COMPUTING, TU DELFT DISTRIBUTED AND INTERACTIVE SYSTEMS, CWI
WOW! EXPERIENCES
WOW! EXPERIENCES
VIDEO CONSUMPTION
Broadband speedUser Expectations
The amount of time lost from a viewing session due to a 1% buffering increase, has quadrupled in the past 4 years (Conviva 2015)
It would take an individual over 5 million years to watch the amount of video that will cross global IP networks each month in 2020(CISCO white paper 2016)
HDRUHD360!
Hex
abite
spe
r mon
th
QOE CONTROL
Adaptive streaming
Perceptual coding
… Optimization …
Quality Preservation
Postprocessing
QoE-based network MGMT
QOE CONTROL
The quality measurement system should reproduce accurately human QoE appreciation
Adaptive streaming
Perceptual coding
… Optimization …
Quality Measurement Quality Preservation
Postprocessing
QoE-based network MGMT
Lower quality! Q = 0.3!
OBJECTIVE QUALITY MEASUREMENT
Distortion (=blockiness, stalls, freezes…) visibility ~ QoE
Prediction module QoE
CBP Neural Network
Circular Extreme Learning
MachineTCSVT 2010SPIC 2013Neurocomputing 2013
OBJECTIVE QUALITY MEASUREMENT
Distortion (=blockiness, stalls, freezes…) visibility ~ QoE
TCSVT 2010SPIC 2013Neurocomputing 2013
But… is this really measuring QoE?
QoE
QoE is the degree of delight or annoyance of the user of an application or service.It results from the fulfillment of his or her expectations with respect to the utility and / or enjoyment of the application or service in the light of the user’s personality and current state
SO, WHAT IS (WOW) QOE?
QoE is the degree of delight or annoyance of the user of an application or service.It results from the fulfillment of his or her expectations with respect to the utility and / or enjoyment of the application or service in the light of the user’s personality and current state
SO, WHAT IS (WOW) QOE?
Variance explained by user factorsVariance explained by system factorsQoMEX 2016, PQS 2016
ENABLING “WOW!” EXPERIENCES
Providing the right video to the right user at the right time and at the right quality for that user
ENABLING “WOW!” EXPERIENCES
Providing the right video to the right user at the right time and at the right quality for that user
Perception
System Factors
Bitrate, loss, ...
QoE
ENABLING “WOW!” EXPERIENCES
Providing the right video to the right user at the right time and at the right quality for that user
Perception
System Factors
Bitrate, loss, ...
QoE
Context Factors
TaskSocial Context
Economical Cont.
Semantic ContentAffective ContentISM’16
User Factors
PersonalityInterestGender..MM’16
CHB’15
ENABLING “WOW!” EXPERIENCES
Providing the right video to the right user at the right time and at the right quality for that user
Perception
System Factors
Bitrate, loss, ...
QoE
Context Factors
TaskSocial Context
Economical Cont.Interaction
TVX’15
Semantic ContentAffective ContentISM’16
User Factors
PersonalityInterestGender..MM’16
CHB’15
WOW! EMPATHIC EXPERIENCES
8
WOW! EMPATHIC EXPERIENCES
8
WOW! EMPATHIC EXPERIENCES
Can we design MM systems that are so intelligentthat they can detect negative affective states and
and provide empathic experiences to make the user feel better?
8
EMPATHIC MM EXPERIENCES: CHALLENGES
User Sensing and Modeling
Design: MM Alternate Realities
