Video QoE Testing
Automated playback tests against real OTT services with ITU-T P.1203 MOS scoring. Measures loading delay, stalling, bitrate adaptation, and resolution quality.
Surfmeter Automator
CLI-based automation for scheduled QoE and QoS measurements.
Deploy lightweight probes on Linux machines, Docker containers, or VMs to continuously measure video streaming quality, web performance, and network health. Automate everything from a single configuration file.
Product Overview
Automated testing, zero user interaction
The Surfmeter Automator is a headless, CLI-driven measurement engine. It runs scheduled test sequences against real OTT streaming services, websites, and network endpoints — producing standardized quality metrics without any manual intervention. Ideal for always-on probing infrastructure.
Key Features
What it does
Web Browsing Tests
Chromium-based page load measurements capturing Core Web Vitals: Largest Contentful Paint, First Contentful Paint, Time to First Byte, and more.
Speed & Network Tests
Download/upload speed measurements, latency, jitter, packet loss, and traceroute diagnostics for end-to-end network path analysis.
Flexible Scheduling
Configure test sequences, intervals, and service targets via a single configuration file. Run continuously or on-demand.
Short-form video
Swipe testing for short-form feeds
Most videos watched today are shorts, and nobody watches just one. The Automator swipes through YouTube Shorts and TikTok feeds the way a viewer does and treats every video as its own measurement. You get initial loading delay, resolution, bitrate, and P.1203 MOS per video. By default a test covers 5 videos with 8 seconds of viewing each, and both values are configurable.
Real user behavior
Tests that behave like a real viewer
The Automator drives a real browser. It opens the service, starts playback, and watches the stream the way a person at home would. What it measures is what your customers see on their screens.
Deployment
Runs on Linux machines, VMs, and Docker
Install the Automator on a small physical probe, a virtual machine, or a server in your data center, or run it as a Docker container. Debian and Ubuntu based systems and Raspberry Pi are supported. One configuration file defines what each probe tests and when.
Dashboard
All results in the Surfmeter Dashboard
Every measurement lands in the Surfmeter Dashboard. Compare probes, services, and locations over time, see color-graded KPIs at a glance, and open any single session to see its full playback timeline.
Explore the Surfmeter Dashboard
CDN & peering
Correlate QoE with CDN and peering
Video results come together with network data such as traceroute, latency, jitter, and DNS. When a QoE score drops, you can see whether the cause is your own network, a CDN, or a degraded peering link.
Learn about CDN performance analysis
AI-assisted analysis
Ask your measurement data in plain language
The AI assistant in the dashboard queries your measurements, explains individual results, and surfaces trends. It works with your current filters and time range, so you get from a question to an answer without building a report first.
Ready to see it in action?
Get a personalized demo and see how Surfmeter fits your use case.
How It Works
From deployment to insights in 4 steps
The Automator runs on any Linux-based system — physical probes, VMs, or Docker containers. No GUI required.
1
Deploy the probe
Install the Surfmeter Automator on your target hardware or VM. Supports Debian/Ubuntu-based systems, Docker, and Raspberry Pi.
2
Configure tests
Define which services to test (Netflix, YouTube, websites, speed endpoints), set schedules, and specify test parameters in the configuration file.
3
Run measurements
The Automator executes test sequences on schedule — launching browsers, playing video streams, running speed tests — all headless and automated.
4
Analyze results
Measurement data flows to the Surfmeter analytics platform. View dashboards, set alerts, compare locations, and export raw data.
Data & KPIs
Supported services and KPIs
YouTube YouTube Shorts Netflix Amazon Prime Video Disney+ DAZN Paramount+ Vimeo Rakuten TV Facebook Instagram TikTok Snapchat ARD Mediathek ZDF Mediathek WDR 3sat ORF ServusTV Joyn RTL+ Magenta TV waipu.tv Zattoo SRF Google Meet Microsoft Teams and more
Video QoE
- P.1203 Overall MOSPerceptual quality score (1–5)
- Initial Loading DelayTime until video starts playing
- Stalling RatioPlayback time spent stalling
- Average Video BitrateAverage data rate of video stream
- Resolution & Quality SwitchesHow often quality changes mid-stream
- Video Completion RatioPercentage of video watched to the end
Web Performance
- Largest Contentful Paint (LCP)Time until main content is visible
- First Contentful Paint (FCP)Time until first content appears
- Time to First Byte (TTFB)Server response time
- Page Load TimeTotal time to fully load the page
- DNS Resolution TimeTime to resolve domain name
Network & Speed
- Download / Upload SpeedMaximum throughput in both directions
- Latency (RTT)Round-trip delay to server
- JitterVariation in packet arrival times
- Packet LossPercentage of data packets lost
- Traceroute & DNSNetwork path and name resolution
Short-Form Video (per video)
- Initial Loading DelayTime until video starts playing
- ResolutionVideo output resolution
- Average Video BitrateAverage data rate of video stream
- P.1203 Overall MOSPerceptual quality score (1–5)
CDN & Delivery
- CDN ProviderContent delivery network used
- CDN Server IdentificationEdge server hostname and IP
- Traceroute to CDN EdgeNetwork hops to CDN edge server
Use Cases
Who it's for
Proven in Practice
Tier-1 Operator Network Benchmarking
“We are delighted to have AVEQ, a renowned expert in the field of video streaming analyses, on our team.”
zafaco and AVEQ collaborate to establish new standards for measuring and optimising video streaming quality for broadband providers in the DACH region. Surfmeter’s QoE algorithms enable standardised quality ratings for international services like YouTube, Netflix, and TikTok, as well as national broadcasters and media libraries — based on ITU-T standards and the latest research. Together, they analyse IPTV streaming quality of leading broadband providers across Germany, Austria, and Switzerland in a complex test setup covering realistic end-user scenarios.
Results
- Integrated Surfmeter’s ITU-T P.1203 QoE module into zafaco’s measurement platform
- Deployed across hundreds of measurement probes in Germany, Austria, and Switzerland
- Enabled standardised video quality benchmarking for broadband providers across the DACH region
- Results published annually in public comparative reports
“We're using Surfmeter to gain unprecedented visibility into our network performance through automated, active measurements that simulate actual streaming video quality, exactly as end-users experience it”
Gcore, operating a global CDN with 210 points of presence across six continents, needed deeper insights into the interactions between streaming applications and their edge network. Traditional server-side monitoring couldn’t capture what end-users actually experience. With Surfmeter, Gcore gained real-world QoE visibility by measuring actual video streams from the same platforms and players that end-users rely on.
Results
- Deployed Surfmeter probes at CDN edge nodes and end-user locations
- Pinpointed performance issues across CDN, peering, and server-side layers
- Enabled competitive benchmarking against other CDN and network providers
- Unified video QoE, ping, and traceroute data through a single API
Creanord, a Finnish provider of network quality monitoring solutions, wanted to extend their probe-based platform with video streaming QoE metrics. By integrating Surfmeter Automator as a measurement component, they added ITU-standardized video MOS testing to their existing network monitoring infrastructure.
Results
- Integrated Surfmeter Automator for video quality testing on existing probes
- Added ITU-T P.1203 video MOS to their PULScore network quality reporting
- Expanded their platform’s capabilities without in-house QoE R&D
Automate Your Quality Monitoring
See how the Surfmeter Automator fits into your measurement infrastructure. Get in touch for a demo.
Thank you! We'll get back to you shortly.
Something went wrong. Please try again.
