Raptor

Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, and Chrome.

Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) “scenario”-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).

Locally, Raptor can be invoked with the following command:

./mach raptor

Raptor tests

The following documents all testing we have for Raptor.

Benchmarks

Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see Updating Benchmark Tests.

ares6

Owner: :jandem and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 4

  • page timeout: 270000

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/ARES-6/index.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-ares6

browsertime-benchmark-firefox-ares6

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-ares6

browsertime-benchmark-firefox-ares6

browsertime-benchmark-safari-ares6

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-ares6

browsertime-benchmark-firefox-ares6

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-ares6

browsertime-benchmark-firefox-ares6

assorted-dom

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 1

  • page timeout: 60000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/assorted-dom

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • screen capture: true

  • test url: http://<host>:<port>/assorted/driver.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-assorted-dom

browsertime-benchmark-firefox-assorted-dom

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-assorted-dom

browsertime-benchmark-firefox-assorted-dom

browsertime-benchmark-safari-assorted-dom

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-assorted-dom

browsertime-benchmark-firefox-assorted-dom

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-assorted-dom

browsertime-benchmark-firefox-assorted-dom

jetstream2

Owner: :jandem and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 4

  • page timeout: 2000000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/JetStream2

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • subtest lower is better: false

  • subtest unit: score

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-jetstream2

browsertime-benchmark-firefox-jetstream2

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-jetstream2

browsertime-benchmark-firefox-jetstream2

browsertime-benchmark-safari-jetstream2

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-jetstream2

browsertime-benchmark-firefox-jetstream2

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-jetstream2

browsertime-benchmark-firefox-jetstream2

matrix-react-bench

Owner: :jandem and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 30

  • page timeout: 2000000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/matrix-react-bench

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/matrix_demo.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-matrix-react-bench

browsertime-benchmark-firefox-matrix-react-bench

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-matrix-react-bench

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-matrix-react-bench

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-matrix-react-bench

browsertime-benchmark-firefox-matrix-react-bench

motionmark-animometer

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-animometer-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-animometer-nofis

browsertime-benchmark-motionmark-fenix-motionmark-animometer-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

browsertime-benchmark-safari-motionmark-animometer

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-animometer-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-animometer-nofis

browsertime-benchmark-motionmark-fenix-motionmark-animometer-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

browsertime-benchmark-safari-motionmark-animometer

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

motionmark-animometer-ramp

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-ramp-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-fenix-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-ramp-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

browsertime-benchmark-safari-motionmark-animometer-ramp

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-ramp-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-fenix-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-ramp-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

browsertime-benchmark-safari-motionmark-animometer-ramp

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

motionmark-htmlsuite

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

browsertime-benchmark-safari-motionmark-htmlsuite

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

browsertime-benchmark-safari-motionmark-htmlsuite

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

motionmark-htmlsuite-ramp

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-ramp-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-ramp-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

browsertime-benchmark-safari-motionmark-htmlsuite-ramp

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-ramp-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-ramp-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

browsertime-benchmark-safari-motionmark-htmlsuite-ramp

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

speedometer

Owner: SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari, custom-car

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 5

  • page timeout: 600000

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/Speedometer/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-p6-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

browsertime-benchmark-safari-speedometer

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

browsertime-benchmark-safari-speedometer

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-firefox-speedometer

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

Owner: SpiderMonkey Team

  • alert threshold: 2.0

  • apps: fenix, geckoview, refbrow, chrome-m, cstm-car-m

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 5

  • page timeout: 420000

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/Speedometer/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-p6-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

browsertime-benchmark-safari-speedometer

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

browsertime-benchmark-safari-speedometer

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-firefox-speedometer

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

speedometer3

Owner: Performance Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari, custom-car

  • browser cycles: 5

  • cold: true

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • host from parent: false

  • lower is better: false

  • page cycles: 5

  • page timeout: 600000

  • repository: https://github.com/WebKit/Speedometer

  • repository revision: 64a5e7c0ba0f668834c0adf01b933e54d2b0d1f0

  • subtest lower is better: true

  • subtest unit: ms

  • support class: speedometer3.py

  • test script: speedometer3.js

  • test url: http://<host>:<port>/index.html

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-p6-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

browsertime-benchmark-safari-speedometer3

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-firefox-speedometer3

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

Owner: Performance Team

  • alert threshold: 2.0

  • apps: fenix, geckoview, refbrow, chrome-m, cstm-car-m

  • browser cycles: 5

  • cold: true

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • host from parent: false

  • lower is better: false

  • page cycles: 5

  • page timeout: 420000

  • repository: https://github.com/WebKit/Speedometer

  • repository revision: 64a5e7c0ba0f668834c0adf01b933e54d2b0d1f0

  • subtest lower is better: true

  • subtest unit: ms

  • support class: speedometer3.py

  • test script: speedometer3.js

  • test url: http://<host>:<port>/index.html

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-p6-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

browsertime-benchmark-safari-speedometer3

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-firefox-speedometer3

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

stylebench

Owner: :emelio and Layout Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 5

  • page timeout: 140000

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/StyleBench/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-stylebench

browsertime-benchmark-firefox-stylebench

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-stylebench

browsertime-benchmark-firefox-stylebench

browsertime-benchmark-safari-stylebench

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-stylebench

browsertime-benchmark-firefox-stylebench

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-stylebench

browsertime-benchmark-firefox-stylebench

sunspider

Owner: :jandem and SpiderMonkey Team

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-sunspider

browsertime-benchmark-firefox-sunspider

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-sunspider

browsertime-benchmark-firefox-sunspider

browsertime-benchmark-safari-sunspider

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-sunspider

browsertime-benchmark-firefox-sunspider

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-sunspider

browsertime-benchmark-firefox-sunspider

twitch-animation

Owner: :jrmuizel

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 1

  • page timeout: 2000000

  • perfstats: true

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/twitch-animation

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/index.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

unity-webgl

Owner: :jgilbert and Graphics(gfx) Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 5

  • page timeout: 420000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/unity-webgl

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-unity-webgl-mobile-fenix-nofis

browsertime-benchmark-unity-webgl-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis

browsertime-benchmark-unity-webgl-mobile-fenix-nofis

browsertime-benchmark-unity-webgl-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

browsertime-benchmark-safari-unity-webgl

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

Owner: :jgilbert and Graphics(gfx) Team

  • alert threshold: 2.0

  • apps: geckoview, refbrow, fenix, chrome-m

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 1

  • page timeout: 420000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/unity-webgl

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-unity-webgl-mobile-fenix-nofis

browsertime-benchmark-unity-webgl-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis

browsertime-benchmark-unity-webgl-mobile-fenix-nofis

browsertime-benchmark-unity-webgl-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

browsertime-benchmark-safari-unity-webgl

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

wasm-godot

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • newtab per cycle: true

  • page cycles: 5

  • page timeout: 120000

  • test url: http://localhost:<port>/wasm-godot/index.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-godot

browsertime-benchmark-wasm-firefox-wasm-godot

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-godot

browsertime-benchmark-wasm-firefox-wasm-godot

browsertime-benchmark-wasm-safari-wasm-godot

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-godot

browsertime-benchmark-wasm-firefox-wasm-godot

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-godot

browsertime-benchmark-wasm-firefox-wasm-godot

wasm-godot-baseline

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • newtab per cycle: true

  • page cycles: 5

  • page timeout: 120000

  • preferences: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false

  • test url: http://localhost:<port>/wasm-godot/index.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

wasm-godot-optimizing

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • newtab per cycle: true

  • page cycles: 5

  • page timeout: 120000

  • preferences: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true

  • test url: http://localhost:<port>/wasm-godot/index.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

wasm-misc

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 5

  • page timeout: 1200000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/wasm-misc

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-misc

browsertime-benchmark-wasm-firefox-wasm-misc

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-misc

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-misc

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-misc

browsertime-benchmark-wasm-firefox-wasm-misc

wasm-misc-baseline

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 5

  • page timeout: 1200000

  • preferences: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/wasm-misc

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

wasm-misc-optimizing

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 5

  • page timeout: 1200000

  • preferences: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/wasm-misc

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

webaudio

Owner: :padenot and Media Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 5

  • page timeout: 360000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • test url: http://<host>:<port>/webaudio/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-webaudio

browsertime-benchmark-firefox-webaudio

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-webaudio

browsertime-benchmark-firefox-webaudio

browsertime-benchmark-safari-webaudio

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-webaudio

browsertime-benchmark-firefox-webaudio

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-webaudio

browsertime-benchmark-firefox-webaudio

youtube-playback

Owner: PerfTest Team

youtube-playback-av1-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-av1-sfr

youtube-playback-h264-1080p30

Owner: PerfTest Team

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

youtube-playback-h264-1080p60

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

youtube-playback-h264-full-1080p30

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

youtube-playback-h264-full-1080p60

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

youtube-playback-h264-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis

browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis

browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

youtube-playback-hfr

Owner: PerfTest Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-hfr-nofis

browsertime-mobile-geckoview-youtube-playback-hfr-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-hfr-nofis

browsertime-mobile-geckoview-youtube-playback-hfr-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

youtube-playback-v9-1080p30

Owner: PerfTest Team

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

youtube-playback-v9-1080p60

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

youtube-playback-v9-full-1080p30

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

youtube-playback-v9-full-1080p60

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

youtube-playback-vp9-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

youtube-playback-widevine-h264-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

youtube-playback-widevine-hfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

youtube-playback-widevine-vp9-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

Custom

Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.

addMab1

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMab1

browsertime-indexeddb-chromium-addMab1

browsertime-indexeddb-firefox-addMab1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMab1

browsertime-indexeddb-chromium-addMab1

browsertime-indexeddb-firefox-addMab1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMab1

browsertime-indexeddb-chromium-addMab1

browsertime-indexeddb-firefox-addMab1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMab1

browsertime-indexeddb-chromium-addMab1

browsertime-indexeddb-firefox-addMab1

addMabN

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMabN

browsertime-indexeddb-chromium-addMabN

browsertime-indexeddb-firefox-addMabN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMabN

browsertime-indexeddb-chromium-addMabN

browsertime-indexeddb-firefox-addMabN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMabN

browsertime-indexeddb-chromium-addMabN

browsertime-indexeddb-firefox-addMabN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMabN

browsertime-indexeddb-chromium-addMabN

browsertime-indexeddb-firefox-addMabN

addMar1

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Array –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMar1

browsertime-indexeddb-chromium-addMar1

browsertime-indexeddb-firefox-addMar1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMar1

browsertime-indexeddb-chromium-addMar1

browsertime-indexeddb-firefox-addMar1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMar1

browsertime-indexeddb-chromium-addMar1

browsertime-indexeddb-firefox-addMar1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMar1

browsertime-indexeddb-chromium-addMar1

browsertime-indexeddb-firefox-addMar1

addMarN

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Array –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMarN

browsertime-indexeddb-chromium-addMarN

browsertime-indexeddb-firefox-addMarN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMarN

browsertime-indexeddb-chromium-addMarN

browsertime-indexeddb-firefox-addMarN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMarN

browsertime-indexeddb-chromium-addMarN

browsertime-indexeddb-firefox-addMarN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMarN

browsertime-indexeddb-chromium-addMarN

browsertime-indexeddb-firefox-addMarN

addMbl1

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Blob –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMbl1

browsertime-indexeddb-chromium-addMbl1

browsertime-indexeddb-firefox-addMbl1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMbl1

browsertime-indexeddb-chromium-addMbl1

browsertime-indexeddb-firefox-addMbl1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMbl1

browsertime-indexeddb-chromium-addMbl1

browsertime-indexeddb-firefox-addMbl1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMbl1

browsertime-indexeddb-chromium-addMbl1

browsertime-indexeddb-firefox-addMbl1

addMblN

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Blob –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMblN

browsertime-indexeddb-chromium-addMblN

browsertime-indexeddb-firefox-addMblN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMblN

browsertime-indexeddb-chromium-addMblN

browsertime-indexeddb-firefox-addMblN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMblN

browsertime-indexeddb-chromium-addMblN

browsertime-indexeddb-firefox-addMblN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMblN

browsertime-indexeddb-chromium-addMblN

browsertime-indexeddb-firefox-addMblN

addkAB1

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAB1

browsertime-indexeddb-chromium-addkAB1

browsertime-indexeddb-firefox-addkAB1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAB1

browsertime-indexeddb-chromium-addkAB1

browsertime-indexeddb-firefox-addkAB1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAB1

browsertime-indexeddb-chromium-addkAB1

browsertime-indexeddb-firefox-addkAB1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAB1

browsertime-indexeddb-chromium-addkAB1

browsertime-indexeddb-firefox-addkAB1

addkABN

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkABN

browsertime-indexeddb-chromium-addkABN

browsertime-indexeddb-firefox-addkABN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkABN

browsertime-indexeddb-chromium-addkABN

browsertime-indexeddb-firefox-addkABN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkABN

browsertime-indexeddb-chromium-addkABN

browsertime-indexeddb-firefox-addkABN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkABN

browsertime-indexeddb-chromium-addkABN

browsertime-indexeddb-firefox-addkABN

addkAR1

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Array –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAR1

browsertime-indexeddb-chromium-addkAR1

browsertime-indexeddb-firefox-addkAR1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAR1

browsertime-indexeddb-chromium-addkAR1

browsertime-indexeddb-firefox-addkAR1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAR1

browsertime-indexeddb-chromium-addkAR1

browsertime-indexeddb-firefox-addkAR1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAR1

browsertime-indexeddb-chromium-addkAR1

browsertime-indexeddb-firefox-addkAR1

addkARN

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Array –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkARN

browsertime-indexeddb-chromium-addkARN

browsertime-indexeddb-firefox-addkARN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkARN

browsertime-indexeddb-chromium-addkARN

browsertime-indexeddb-firefox-addkARN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkARN

browsertime-indexeddb-chromium-addkARN

browsertime-indexeddb-firefox-addkARN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkARN

browsertime-indexeddb-chromium-addkARN

browsertime-indexeddb-firefox-addkARN

addkBL1

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Blob –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBL1

browsertime-indexeddb-chromium-addkBL1

browsertime-indexeddb-firefox-addkBL1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBL1

browsertime-indexeddb-chromium-addkBL1

browsertime-indexeddb-firefox-addkBL1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBL1

browsertime-indexeddb-chromium-addkBL1

browsertime-indexeddb-firefox-addkBL1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBL1

browsertime-indexeddb-chromium-addkBL1

browsertime-indexeddb-firefox-addkBL1

addkBLN

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Blob –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBLN

browsertime-indexeddb-chromium-addkBLN

browsertime-indexeddb-firefox-addkBLN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBLN

browsertime-indexeddb-chromium-addkBLN

browsertime-indexeddb-firefox-addkBLN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBLN

browsertime-indexeddb-chromium-addkBLN

browsertime-indexeddb-firefox-addkBLN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBLN

browsertime-indexeddb-chromium-addkBLN

browsertime-indexeddb-firefox-addkBLN

browsertime

Owner: PerfTest Team

  • alert on: fcp, loadtime

  • alert threshold: 2.0

  • apps: firefox

  • browser cycles: 1

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • measure: fnbpaint, fcp, dcf, loadtime

  • page cycles: 1

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: null.manifest

  • playback version: 8.1.1

  • test script: None

  • test url: None

  • type: pageload

  • unit: ms

  • use live sites: true

connect

Owner: Network Team

  • alert change type: absolute

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange

  • alert threshold: 10.0

  • apps: firefox

  • browser cycles: 3

  • cold: true

  • custom data: true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 1

  • page timeout: 60000

  • test script: speculative-connect.js

  • test url: None

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

constant-regression

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari, geckoview, fenix

  • browser cycles: 1

  • browsertime args: –browsertime.constant_value=1500

  • custom data: true

  • expected: pass

  • fore window: 1

  • gecko profile interval: 1

  • lower is better: true

  • max back window: 3

  • min back window: 2

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • subtest unit: ms

  • test script: constant_regression_test.js

  • test summary: flatten

  • test url: None

  • type: pageload

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-regression-tests-firefox-constant-regression

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-regression-tests-firefox-constant-regression

getkeyrng

Owner: DOM Lifecycle, Workers and Storage Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_getkeyrange.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-getkeyrng

browsertime-indexeddb-chromium-getkeyrng

browsertime-indexeddb-firefox-getkeyrng

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-getkeyrng

browsertime-indexeddb-chromium-getkeyrng

browsertime-indexeddb-firefox-getkeyrng

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-getkeyrng

browsertime-indexeddb-chromium-getkeyrng

browsertime-indexeddb-firefox-getkeyrng

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-getkeyrng

browsertime-indexeddb-chromium-getkeyrng

browsertime-indexeddb-firefox-getkeyrng

grandprix

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • browsertime args: –browsertime.grandprix_iterations=25

  • custom data: true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • subtest name filters: tests/,iterations/

  • subtest unit: ms

  • test script: grandprix.js

  • test summary: flatten

  • test url: None

  • type: pageload

  • unit: score

  • use live sites: true

process-switch

Owner: PerfTest Team

  • accept zero vismet: true

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium

  • browser cycles: 25

  • browsertime args: –pageCompleteWaitTime=1000 –pageCompleteCheckInactivity=true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-proc-switch.manifest

  • playback version: 5.1.1

  • test script: process_switch.js

  • test url: https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

sample-python-support

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • browser cycles: 1

  • browsertime args: –browsertime.constant_value={replace-with-constant-value}

  • custom data: true

  • expected