Reports & Publications

Technical reports from our own measurements, and peer-reviewed research and contributions to international standards by our team.

Technical Reports and White Papers

Findings from our own measurement studies and from the expert groups we work in.

Cover of Network Requirements for Good Web Page Load Quality

Technical report October 2026 20 pages

Network Requirements for Good Web Page Load Quality

Technical Report on Website QoE Measurements

We loaded 22 production websites over nine shaped network tiers to find out how much bandwidth and how little latency good page loading needs, and how much the design of a website matters.

  • Above 16 to 25 Mbit/s, bandwidth is no longer the bottleneck
  • Every millisecond of round-trip time adds about 4 ms to the time to first byte
  • The slowest type of site took ten times as long to load as the fastest
Cover of VQEG White Paper on Quality of Experience-Aware Management for Collaboration Between Network and Application Providers

White paper March 2026 73 pages

VQEG White Paper on Quality of Experience-Aware Management for Collaboration Between Network and Application Providers

How network operators and application providers can share information to manage the quality of experience of their users, from the Video Quality Experts Group.

Pérez, P., Blouin, F., Adsumilli, B., Baldoni, S., Battisti, F., Birkbeck, N., et al.

Read on VQEG

Academic Publications

Sort by

Robitza, W., Raake, A. (2026)

Between the Labs: An Analysis of Individual Rating Biases in Multi-Lab Subjective Experiments

18th International Conference on Quality of Multimedia Experience (QoMEX).

Read on IEEE

Chen, B., Shang, Z., Chung, J. W., Lerner, D., Robitza, W., Rao, R. R. R., Raake, A., Bovik, A. C. (2025)

Satellite Streaming Video QoE Prediction: A Real-World Subjective Database and Network-Level Prediction Models

IEEE Access.

Read on IEEE

Seufert, M., Spangenberger, M., Poignée, F., Wamser, F., Robitza, W., Timmerer, C., Hossfeld, T. (2024)

COBIRAS: Offering a Continuous Bit Rate Slide to Maximize DASH Streaming Bandwidth Utilization

ACM Transactions on Multimedia Computing, Communications, and Applications.

Download PDF

Raake, A., Borer, S., Satti, S. M., Gustafsson, J., Rao, R. R. R., Medagli, S., List, P., Göring, S., Lindero, D., Robitza, W., Heikkilä, G., Broom, S., Schmidmer, C., Feiten, B., Wüstenhagen, U., Wittmann, T., Obermann, M., Bitto, R. (2020)

Multi-Model Standard for Bitstream-, Pixel-Based and Hybrid Video Quality Assessment of UHD/4K: ITU-T P.1204

IEEE Access, 8, 193020–193049.

Download from IEEE

Herglotz, C., Robitza, W., Raake, A., Hossfeld, T., Kaup, A. (2023)

Power Reduction Opportunities on End-User Devices in Quality-Steady Video Streaming

15th International Conference on Quality of Multimedia Experience (QoMEX).

Read on IEEE

Braun, F., Rao, R. R. R., Robitza, W., Raake, A. (2023)

Automatic Audiovisual Asynchrony Measurement for Quality Assessment of Videoconferencing

15th International Conference on Quality of Multimedia Experience (QoMEX).

Read on IEEE

Herglotz, C., Robitza, W., Kränzler, M., Kaup, A., Raake, A. (2022)

Modeling of Energy Consumption and Streaming Video QoE using a Crowdsourcing Dataset

14th International Conference on Quality of Multimedia Experience (QoMEX).

Read on arXiv

Robitza, W., Ramachandra-Rao, R. R., Göring, S., Dethof, A., Raake, A. (2022)

Deploying the ITU-T P.1203 QoE model in the wild and retraining for new codecs

Proceedings of the 1st Conference on Mile-High Video, 121–122.

Read on ACM

Robitza, W., Rao Ramachandra Rao, R., Göring, S., Raake, A. (2021)

Impact of spatial and temporal information on video quality and compressibility

2021 13th International Conference on Quality of Multimedia Experience, QoMEX 2021, 65–68.

Read on ResearchGate

Schwarzmann, S., Hainke, N., Zinner, T., Sieber, C., Robitza, W., Raake, A. (2020)

Comparing fixed and variable segment durations for adaptive video streaming

Proceedings of the 11th ACM Multimedia Systems Conference, 38–53.

Read on ACM

Robitza, W., Dethof, A. M., Göring, S., Raake, A., Polzehl, T., Beyer, A. (2020)

Are You Still Watching? Streaming Video Quality and Engagement Assessment in the Crowd

12th International Conference on Quality of Multimedia Experience (QoMEX 2020). Athlone, Ireland.

Read on IEEE

Rao, R. R. R., Göring, S., Robitza, W., Raake, A., Feiten, B., List, P., Wüstenhagen, U. (2020)

Bitstream-based Model Standard for 4K/UHD: ITU-T P.1204.3 – Model Details, Evaluation, Analysis and Open Source Implementation

12th International Conference on Quality of Multimedia Experience (QoMEX 2020). Athlone, Ireland.

Read on ResearchGate

Raake, A., Singla, A., Rao, R. R. R., Robitza, W., Hofmeyer, F. (2020)

SiSiMo: Towards Simulator Sickness Modeling for 360° Videos Viewed with an HMD

27th IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR).

Read on IEEE

Singla, A., Fremerey, S., Hofmeyer, F., Robitza, W., Raake, A. (2020)

Quality assessment protocols for omnidirectional video quality evaluation

In Human Vision and Electronic Imaging (HVEI). Burlingame, CA.

Read online

Kara, P. A., Robitza, W., Pinter, N., Martini, M. G., Raake, A., Simon, A. (2019)

Comparison of HD and UHD video quality with and without the influence of the labeling effect

Quality and User Experience, 4(1), 4.

Read on Springer

Rao, R. R. R., Göring, S., Robitza, W., Feiten, B., Raake, A. (2019)

AVT-VQDB-UHD-1: A Large Scale Video Quality Database for UHD-1

21st IEEE International Symposium on Multimedia (IEEE ISM). San Diego, CA.

Read on ResearchGate

Rao, R. R. R., Göring, S., Vogel, P., Pachatz, N., Juan, J. V. V., Robitza, W., List, P., Feiten, B., Raake, A. (2019)

Adaptive video streaming with current codecs and formats: Extensions to parametric video quality model ITU-T P.1203

In Human Vision and Electronic Imaging (HVEI). Burlingame, CA.

Read on ResearchGate

Asan, A., Robitza, W., Mkwawa, I.-H., Sun, L., Begen, A. C. (2018)

Optimum Encoding Approaches on Video Resolution Changes: A Comparative Study

In IEEE International Conference on Image Processing (ICIP 2018). Athens.

Read on IEEE

Robitza, W., Göring, S., Raake, A., Lindegren, D., Heikkilä, G., Gustafsson, J., List, P., Feiten, B., Wüstenhagen, U., Garcia, M.-N., Yamagishi, K., Broom, S. (2018)

HTTP Adaptive Streaming QoE Estimation with ITU-T Rec. P.1203 – Open Databases and Software

In 9th ACM Multimedia Systems Conference. Amsterdam.

Read on ACM

Robitza, W., Kittur, D. G., Dethof, A. M., Göring, S., Feiten, B., Raake, A. (2018)

Measuring YouTube QoE with ITU-T P.1203 under Constrained Bandwidth Conditions

In 10th International Conference on Quality of Multimedia Experience (QoMEX 2018). Santa Margherita di Pula.

Read on ResearchGate

Singla, A., Robitza, W., Raake, A. (2018)

Comparison of Subjective Quality Evaluation Methods for Omnidirectional Videos with DSIS and Modified ACR

In Human Vision and Electronic Imaging (HVEI). Burlingame.

Read on ResearchGate

Robitza, W., Ahmad, A., Kara, P. A., Atzori, L., Martini, M. G., Raake, A., Sun, L. (2017)

Challenges of future multimedia QoE monitoring for internet service providers

Multimedia Tools and Applications, Volume 76, pages 22243–22266.

Download from Springer

Singla, A., Fremerey, S., Robitza, W., Lebreton, P., Raake, A. (2017)

Comparison of Subjective Quality Evaluation for HEVC Encoded Omnidirectional Videos at Different Bit-rates for UHD and FHD Resolution

In ACM Multimedia (ACMMM 2017), Thematic Workshops. Mountain View.

Read on ACM

Asan, A., Robitza, W., Mkwawa, I., Sun, L., Ifeachor, E., Raake, A. (2017)

Impact of Video Resolution Changes on QoE for Adaptive Video Streaming

In IEEE International Conference on Multimedia and Expo. Hong Kong.

Read on ResearchGate

Robitza, W. (2017)

Towards Behavior-oriented Quality of Experience Assessment for Online Video Services

In ACM International Conference on Interactive Experiences for TV and Online Video (TVX 2017), Doctoral Consortium. Hilversum.

Read on ACM

Raake, A., Garcia, M.-N., Robitza, W., List, P., Göring, S., Feiten, B. (2017)

A Bitstream-based, Scalable Video-Quality Model for HTTP Adaptive Streaming: ITU-T P.1203.1

In 9th International Conference on Quality of Multimedia Experience (QoMEX 2017). Erfurt.

Read on IEEE

Robitza, W., Garcia, M.-N., Raake, A. (2017)

A Modular HTTP Adaptive Streaming QoE Model – Candidate for ITU-T P.1203 (“P.NATS”)

In 9th International Conference on Quality of Multimedia Experience (QoMEX 2017). Erfurt.

Read on ResearchGate

Singla, A., Fremerey, S., Robitza, W., Raake, A. (2017)

Measuring and Comparing QoE and Simulator Sickness of Omnidirectional Videos in Different Head Mounted Displays

In 9th International Conference on Quality of Multimedia Experience (QoMEX 2017). Erfurt.

Read on IEEE

Kara, P. A., Robitza, W., Raake, A., Martini, M. G. (2017)

The Label Knows Better: The Impact of Labeling Effects on Perceived Quality of HD and UHD Video Streaming

In 9th International Conference on Quality of Multimedia Experience (QoMEX 2017). Erfurt.

Read on IEEE

Robitza, W., Kara, P. A., Martini, M. G., Raake, A. (2016)

On the Experimental Biases in User Behavior and QoE Assessment in the Lab

In Fifth IEEE International Workshop on Quality of Experience for Multimedia Communications (QoEMC). Washington.

Read on IEEE

Kara, P. A., Robitza, W., Martini, M. G., Hewage, C. T., Felisberti, F. M. (2016)

Getting Used to or Growing Annoyed: How Perception Thresholds and Acceptance of Frame Freezing Vary Over Time in 3D Video Streaming

In IEEE International Conference on Multimedia and Expo (ICME). Seattle.

Read on IEEE

Dethof, A. M., Robitza, W., Garcia, M.-N. (2016)

StreamSim: A Video Streaming Simulation Toolchain for Unreliable Transport Mechanisms

In Eighth International Workshop on Quality of Multimedia Experience (QoMEX). Lisbon.

Read on ResearchGate

Robitza, W., Raake, A. (2016)

(Re-)Actions Speak Louder Than Words? A Novel Test Method for Tracking User Behavior in Web Video Services

In Eighth International Workshop on Quality of Multimedia Experience (QoMEX). Lisbon.

Read on IEEE

Robitza, W., Schönfellner, S., Raake, A. (2016)

A Theoretical Approach to the Formation of Quality of Experience and User Behavior in Multimedia Services

In 5th ISCA/DEGA Workshop on Perceptual Quality of Systems (PQS). Berlin.

Read online

Robitza, W., Garcia, M.-N., Raake, A. (2015)

At Home in the Lab: Assessing Audiovisual Quality of HTTP-based Adaptive Streaming with an Immersive Test Paradigm

In Seventh International Workshop on Quality of Multimedia Experience (QoMEX). Costa Navarino.

Read on ResearchGate

Garcia, M.-N., Robitza, W., Raake, A. (2015)

On The Accuracy of Short-Term Quality Models for Long-Term Quality Prediction

In Seventh International Workshop on Quality of Multimedia Experience (QoMEX). Costa Navarino.

Read on IEEE

Buchinger, S., Robitza, W., Nezveda, M., Hotop, E., Hummelbrunner, P., Sack, M. C., Hlavacs, H. (2014)

Evaluating feedback devices for time-continuous mobile multimedia quality assessment

Signal Processing: Image Communication, 29(9), 921–934.

Read on ScienceDirect

Robitza, W., Hlavacs, H. (2014)

Assessing the validity of subjective QoE data through rating times and self-reported confidence

In 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX) (pp. 297–302). Singapore: IEEE.

Read on ResearchGate

Robitza, W., Pitrey, Y., Hlavacs, H. (2013)

The NappingPlayer — Projective Mapping Experiments on Android Tablets

In Fourth International Workshop on Perceptual Quality of Systems (PQS). Vienna.

Read online

Want to learn more?

We are always open for research collaborations and discussions on video quality.

Contact us