Video QoE for Automation Testing

Add standardized video quality measurement to your automated test workflows.

For QA teams, test automation platforms, and CI/CD pipelines that need to verify video streaming quality as part of their automated testing. Our Auto SDK integrates with browser automation frameworks — Selenium, Playwright, or Puppeteer — to measure ITU-standardized video MOS during automated test runs.

The Challenge

Automated tests check if video plays, not how well it plays

Your Selenium tests verify that the video element loads and playback starts, but they cannot tell you if the video buffers, if quality drops to 360p, or if startup takes 8 seconds. Without QoE metrics in your test pipeline, quality regressions ship to production undetected.

Our Approach

QoE metrics inside your automated browser tests

The Surfmeter Auto SDK injects quality measurement into browser-based video playback. It works with Selenium, Playwright, Puppeteer, or direct JavaScript injection to capture P.1203 MOS scores, stalling events, resolution tracking, and loading delays during your automated test runs. Results can feed into your CI/CD pipeline, test reports, and quality gates.

Key Capabilities

What you can do with this solution

Browser Automation Integration

Works with Selenium, Playwright, Puppeteer, or direct JavaScript injection. Add QoE measurement to existing browser automation scripts with minimal code changes.

CI/CD Pipeline Ready

Run video QoE tests as part of your build pipeline. Set quality gates that fail builds when video MOS drops below thresholds.

Real Browser Playback

Tests use real browser rendering (Chrome, Firefox) with actual adaptive streaming playback — not synthetic traffic simulation.

ITU-Standardized Scoring

Every test run produces a P.1203 MOS score, giving you an objective, standardized quality metric for pass/fail decisions.

Proven in Practice

QoE quality gates for a test automation platform

Ready to see it in action?

Get a personalized demo and see how Surfmeter fits your use case. It only takes 30 minutes.

Business Benefits

Real outcomes for your business

Catch Quality Regressions

Detect video quality problems during development and testing, before they affect production viewers.

Automate Quality Assurance

Replace manual video quality spot-checks with automated, repeatable measurements in every test run.

Objective Quality Gates

Set pass/fail thresholds on ITU-standardized MOS scores. No subjective quality judgments needed.

Faster Release Cycles

Automated QoE testing removes the bottleneck of manual quality verification from your release process.

How It Works

Adding QoE to your test pipeline

The Auto SDK wraps around your existing browser automation with minimal integration effort.

1

Add the Auto SDK

Add the Surfmeter Auto SDK to your test project. Works with Selenium (any language), Playwright, Puppeteer, or direct JavaScript injection.

2

Instrument test scripts

Wrap video playback sections of your test scripts with Surfmeter measurement calls. The SDK injects analytics into the video player and captures telemetry during playback.

3

Execute in CI/CD

Run tests in your CI/CD pipeline (Jenkins, GitLab CI, GitHub Actions). The SDK works in headless and headed browser modes.

4

Evaluate & report

QoE results (P.1203 MOS, stalling, loading delay) are available as test artifacts. Set quality gates to fail builds below MOS thresholds.

Data & KPIs

Test automation data and metrics

Video QoE Metrics

  • P.1203 Overall MOS
    Perceptual quality score (1–5)
  • Initial Loading Delay
    Time until video starts playing
  • Stalling Events
    Number and duration of stalling
  • Total Stalling Time
    Cumulative stalling duration
  • Average Bitrate
    Average data rate of stream
  • Resolution Profile
    Video resolution over time

Test Context

  • Browser Type & Version
    Browser used for testing
  • Viewport Size
    Browser window dimensions
  • Network Throttle Profile
    Simulated network conditions
  • Test Suite / Run ID
    Test run identifier
  • Timestamp & Duration
    Test timing and length

Web Performance

  • Page Load Time
    Total time to fully load the page
  • DOM Ready Time
    Time until DOM is interactive
  • Resource Load Count
    Number of resources loaded
  • JavaScript Errors
    Script errors during page load

Stop Guessing. Start Measuring.

See how the Surfmeter Auto SDK fits your test automation workflow.

By contacting us, you agree to receive occasional email updates from us about our products or features.