AVEQ
  • Home
  • Solutions
    • Video Quality Measurement
    • Web and Video Streaming Analytics
    • Crowdsourcing Data
  • Products
    • Surfmeter Lab
    • Surfmeter Automator
    • Surfmeter Analytics Dashboard
  • Resources
    • News
    • Blog
    • Factsheets
  • About Us
  • Contact Us
  • Search
  • Menu Menu

Compare your Services — with our QoE Comparison Dashboard

Blog
Do you have a good MOS for your video streams?

Do you operate a streaming service and want to understand how your offering compares against competitors? Are you a network operator who needs to know whether OTT platforms operate well for your customers?

Set up our dashboard for different services, OTTs, ISPs, content streams — and start monitoring! Our analytics suite will give you three unique features:

  • A composite MOS — to understand the overall service quality at a glance. We use advanced QoE models to calculate the MOS for video streams.
  • All the important KPIs — to be able to drill down to pinpoint issues. All the metrics are there, such as stalling or video resolution and bitrate.
  • Direct comparisons between services and operators — easily configurable to show what you need.

Read on to find out more about how you can set up our dashboards to your liking. In this post we’ll focus on video streaming.

Let’s compare multiple providers

If you are an OTT provider, you likely have insights into your own streams already, for instance through client plugins. (If you don’t, you should talk to us!) Our Surfmeter measurement solution is not restricted to your own services though — we can integrate measurements of your competitor too. This allows us to directly compare the quality and performance from the same context. So when we compare multiple providers, it starts to get really interesting.

Let’s start with an example, where we’ve set up a test in which we compared four streaming providers that all streamed the same linear TV channels through a web interface. Due to licensing restrictions we know that some of those channels were DRM-protected, and some were not. We measured, among other KPIs, the initial loading delay of the video, as a proxy for overall quality. The graph below shows the average loading time in seconds, over the course of several days. It clearly shows the increased loading times Provider A has with DRM streams. If you were Provider A, you would have reason to act, while as Provider C you would see your strength compared to A and B.

Comparison of multiple providers utilizing both DRM-protected and non-DRM streams.

Below, you can see another example from our dashboard — an overview of various MOS indicators. Look at the top left gauge: the overall MOS has dropped to below 3, which indicates badly performing streams. This confirms: Provider A needs to act, as the experience for DRM protected streams is less than ideal, with long initial loading times. Looking at the bottom right, we can see that resolution was also capped at non-HD, which users may perceive as suboptimal.

Bad MOS calculated for provider A – something needs to be done before customers leave

As you can see below, our dashboard also allows you do filter by OTT provider or device — and those are just examples. We can fully customize the available filter options, enabling you to not only perform general comparisons, but also see detailed charts for selected services or test devices.

Filtering by service or client ID is included.

Let’s compare multiple providers

Here is another demo of our Surfmeter Analytics Dashboard capabilities — again, we’re looking at the initial loading delay of two OTT providers directly compared. In the graph below, each colored line represents one monitoring probe equipped with Surfmeter Automator. All probes measure a video from both providers every few minutes, enabling us to check what the typical performance is.

Each monitoring probe uses a different connection speed, meaning that we can see the impact of download/upload bandwidth on the results. The green and blue lines correspond to probe with 16 or 50 MBit/s DSL connections, and the purple line has a 1 GBit/s fiber access. The differences are considerable: video service provider A requires a much longer loading time until a video starts to play — up to 10 seconds or more. For provider B, the loading delay can be kept almost constant at an agreeable 2.5 seconds.

We can see that the design of video services strongly impacts the customer-experienced quality, depending on the available bandwidth. Providers with efficient caching and service design may be able to start streaming much earlier.

Released now: Service Comparison Dashboard as part of our Surfmeter product

As you could see above, good visualizations help you understand how well different services operate. We’ve been working on our Analytics Dashboard for a while — and you can get it with any Surfmeter client application.

Our comparison dashboard lets you compare QoE data for different providers, streams, and devices. It gives you all the important KPIs, and, in addition, a single MOS for the video streaming experience. If you’re an OTT provider, you can get detailed insights into your offering and your competitors, enabling you to improve certain aspects (like service loading times). Or, if you are an ISP, you’ll receive an overview of representative OTT services that get streamed on your network.

Here are the main benefits:

  • Quickly see how your service and streams compare against competitors.
  • Detect service degradation in a timely manner.
  • Act before your customers complain and reduce churn.
  • Know where to spend effort to provide the best service.
You want to see a demo? Get in touch

But wait … there’s more

Streaming is a top priority for most providers, as users are spending more and more time consuming video online. But that’s not the full picture: underlying network performance metrics are vital for understanding the reasons behind application-level service failures. In the next posts, we’ll have a deeper look at web page performance tests, ping and DNS resolution measurements, and speed tests.

Standards-backed solutions and custom integrations — how can we help you?

Do you have competition and want to know how well customers perceive your streams? At AVEQ we don’t just have ready-to-go solutions for measuring streaming video quality, but also the expertise needed to develop custom applications for your use cases.

In the end, the user’s satisfaction is what matters, and you can only quantify that with the right tools at your disposal. Getting a single quality score through the use of QoE models can tremendously help in operationalizing your new service and reacting immediately to service issues. We’re constantly exchanging with standards bodies and forums like ITU-T and VQEG to deliver you the newest in terms of automated QoE measurements.

Don’t hesitate to get in touch with us if you want to find out more — we’d like to hear from you!

14. July 2022
Share this entry
  • Share on Facebook
  • Share on Twitter
  • Share on WhatsApp
  • Share on LinkedIn
  • Share by Mail

Latest Articles

  • Network Performance Tests made easy with our QoS Dashboard3. August 2022 - 13:45
  • Compare your Services — with our QoE Comparison Dashboard14. July 2022 - 15:55
  • Video Quality Models from ITU-T — An Overview17. February 2022 - 13:10
  • Cloud Gaming QoE measurements on 5G and DSL — how fast is good enough?16. February 2022 - 9:46
  • How to do browser automation for videos? Insights from the developer1. February 2022 - 15:23

Contact

AVEQ GmbH
hello@aveq.info
Habitzlgasse 4/30
1210 Vienna
Austria

About Us

  • About Us
  • Contact Us
  • Careers

Solutions

  • Video Quality Measurement
  • Web and Video Streaming Analytics
  • Crowdsourcing Data

Legal

  • Legal Notice
  • Terms and Conditions
  • Privacy Policy
Video Quality Models from ITU-T — An OverviewNetwork Performance Tests made easy with our QoS Dashboard
Scroll to top

This site uses cookies. Please accept or decline the relevant cookie type to proceed.

Accept allDo not acceptSettings

Cookie and Privacy Settings



How we use Cookies

Our website, like many others, stores and retrieves information on your browser using cookies. This information is used to make the site work as you expect it to. It is not personally identifiable to you, but it can be used to give you a more personalised web experience.

You can modify our use of cookies in these settings.

Necessary Cookies

These cookies are strictly necessary to provide you with services available through our website and to use some of its features.

Because these cookies are strictly necessary to deliver the website, refuseing them will have impact how our site functions. You always can block or delete cookies by changing your browser settings and force blocking all cookies on this website. But this will always prompt you to accept/refuse cookies when revisiting our site.

We fully respect if you want to refuse cookies but to avoid asking you again and again kindly allow us to store a cookie for that. You are free to opt out any time or opt in for other cookies to get a better experience. If you refuse cookies we will remove all set cookies in our domain.

Google Analytics Cookies

These cookies collect information that is used either in aggregate form to help us understand how our website is being used or how effective our marketing campaigns are, or to help us customize our website and application for you in order to enhance your experience.

If you do not want that we track your visit to our site you can disable tracking in your browser here:

Other external services

We may also use different external services like Google reCAPTCHA, Google Webfonts, Google Maps, and external Video providers. Since these providers may collect personal data like your IP address we allow you to block them here. Please be aware that this might heavily reduce the functionality and appearance of our site. Changes will take effect once you reload the page.

Google Webfont Settings:

Google reCaptcha Settings:

Privacy Policy

You can find more details on our use of external services and cookies in our privacy policy

Privacy Policy
Accept allAccept current settingsDo not accept
Open Message Bar