Raptor

Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, and Chrome.

Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) “scenario”-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).

Locally, Raptor can be invoked with the following command:

./mach raptor

Raptor tests

The following documents all testing we have for Raptor.

Benchmarks

Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see Updating Benchmark Tests.

ares6

Owner: :jandem and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 4

  • page timeout: 270000

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/ARES-6/index.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-ares6

browsertime-benchmark-firefox-ares6

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-ares6

browsertime-benchmark-firefox-ares6

browsertime-benchmark-safari-ares6

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-ares6

browsertime-benchmark-firefox-ares6

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-ares6

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-ares6

browsertime-benchmark-firefox-ares6

assorted-dom

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 1

  • page timeout: 60000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/assorted-dom

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • screen capture: true

  • test url: http://<host>:<port>/assorted/driver.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-assorted-dom

browsertime-benchmark-firefox-assorted-dom

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-assorted-dom

browsertime-benchmark-firefox-assorted-dom

browsertime-benchmark-safari-assorted-dom

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-assorted-dom

browsertime-benchmark-firefox-assorted-dom

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-assorted-dom

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-assorted-dom

browsertime-benchmark-firefox-assorted-dom

jetstream2

Owner: :jandem and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 4

  • page timeout: 2000000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/JetStream2

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • subtest lower is better: false

  • subtest unit: score

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-jetstream2

browsertime-benchmark-firefox-jetstream2

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-jetstream2

browsertime-benchmark-firefox-jetstream2

browsertime-benchmark-safari-jetstream2

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-jetstream2

browsertime-benchmark-firefox-jetstream2

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-jetstream2

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-jetstream2

browsertime-benchmark-firefox-jetstream2

matrix-react-bench

Owner: :jandem and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 30

  • page timeout: 2000000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/matrix-react-bench

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/matrix_demo.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-matrix-react-bench

browsertime-benchmark-firefox-matrix-react-bench

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-matrix-react-bench

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-matrix-react-bench

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-matrix-react-bench

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-matrix-react-bench

browsertime-benchmark-firefox-matrix-react-bench

motionmark-1-3

Owner: Graphics Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis

browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis

browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis

browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis

browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-custom-car-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-custom-car-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

browsertime-benchmark-safari-motionmark-1-3

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-custom-car-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

browsertime-benchmark-safari-motionmark-1-3

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-custom-car-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

Owner: Graphics Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis

browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis

browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis

browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis

browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-custom-car-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-custom-car-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

browsertime-benchmark-safari-motionmark-1-3

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-custom-car-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

browsertime-benchmark-safari-motionmark-1-3

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-1-3

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-1-3

browsertime-benchmark-custom-car-motionmark-1-3

browsertime-benchmark-firefox-motionmark-1-3

motionmark-animometer

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-animometer-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-animometer-nofis

browsertime-benchmark-motionmark-fenix-motionmark-animometer-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

browsertime-benchmark-safari-motionmark-animometer

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-animometer-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-animometer-nofis

browsertime-benchmark-motionmark-fenix-motionmark-animometer-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

browsertime-benchmark-safari-motionmark-animometer

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer

browsertime-benchmark-firefox-motionmark-animometer

motionmark-animometer-ramp

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-ramp-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-fenix-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-ramp-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

browsertime-benchmark-safari-motionmark-animometer-ramp

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-ramp-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-fenix-motionmark-animometer-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-animometer-ramp-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

browsertime-benchmark-safari-motionmark-animometer-ramp

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-animometer-ramp

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-animometer-ramp

browsertime-benchmark-custom-car-motionmark-animometer-ramp

browsertime-benchmark-firefox-motionmark-animometer-ramp

motionmark-htmlsuite

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

browsertime-benchmark-safari-motionmark-htmlsuite

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

browsertime-benchmark-safari-motionmark-htmlsuite

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite

browsertime-benchmark-firefox-motionmark-htmlsuite

motionmark-htmlsuite-1-3

Owner: Graphics Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis

browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis

browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis

browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis

browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

browsertime-benchmark-safari-motionmark-htmlsuite-1-3

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

browsertime-benchmark-safari-motionmark-htmlsuite-1-3

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

Owner: Graphics Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis

browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis

browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis

browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis

browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

browsertime-benchmark-safari-motionmark-htmlsuite-1-3

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

browsertime-benchmark-safari-motionmark-htmlsuite-1-3

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-1-3

browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3

browsertime-benchmark-firefox-motionmark-htmlsuite-1-3

motionmark-htmlsuite-ramp

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-ramp-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-ramp-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

browsertime-benchmark-safari-motionmark-htmlsuite-ramp

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

Owner: :jgilbert and Graphics(gfx) Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-ramp-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-motionmark-chrome-m-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-fenix-motionmark-htmlsuite-ramp-nofis

browsertime-benchmark-motionmark-geckoview-motionmark-htmlsuite-ramp-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

browsertime-benchmark-safari-motionmark-htmlsuite-ramp

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-motionmark-htmlsuite-ramp

browsertime-benchmark-custom-car-motionmark-htmlsuite-ramp

browsertime-benchmark-firefox-motionmark-htmlsuite-ramp

speedometer

Owner: SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 5

  • page timeout: 600000

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/Speedometer/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-p6-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

browsertime-benchmark-safari-speedometer

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

browsertime-benchmark-safari-speedometer

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-firefox-speedometer

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

Owner: SpiderMonkey Team

  • alert threshold: 2.0

  • apps: fenix, geckoview, refbrow, chrome-m, cstm-car-m

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 5

  • page timeout: 420000

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/Speedometer/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-p6-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer-mobile-chrome-m-nofis

browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer-mobile-fenix-nofis

browsertime-benchmark-speedometer-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

browsertime-benchmark-safari-speedometer

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

browsertime-benchmark-safari-speedometer

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-firefox-speedometer

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer

browsertime-benchmark-custom-car-speedometer

browsertime-benchmark-firefox-speedometer

speedometer3

Owner: Performance Team

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • browser cycles: 5

  • cold: true

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • host from parent: false

  • lower is better: false

  • page cycles: 5

  • page timeout: 600000

  • repository: https://github.com/WebKit/Speedometer

  • repository revision: 8d67f28d0281ac4330f283495b7f48286654ad7d

  • subtest lower is better: true

  • subtest unit: ms

  • support class: speedometer3.py

  • test script: speedometer3.js

  • test url: http://<host>:<port>/index.html

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-p6-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

browsertime-benchmark-safari-speedometer3

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-firefox-speedometer3

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

Owner: Performance Team

  • alert threshold: 2.0

  • apps: fenix, geckoview, refbrow, chrome-m, cstm-car-m

  • browser cycles: 5

  • cold: true

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • host from parent: false

  • lower is better: false

  • page cycles: 5

  • page timeout: 420000

  • repository: https://github.com/WebKit/Speedometer

  • repository revision: 8d67f28d0281ac4330f283495b7f48286654ad7d

  • subtest lower is better: true

  • subtest unit: ms

  • support class: speedometer3.py

  • test script: speedometer3.js

  • test url: http://<host>:<port>/index.html

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-p6-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-android-hw-s21-13-0-android-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-speedometer3-mobile-chrome-m-nofis

browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis

browsertime-benchmark-speedometer3-mobile-fenix-nofis

browsertime-benchmark-speedometer3-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

test-macosx1400-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

browsertime-benchmark-safari-speedometer3

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-firefox-speedometer3

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-speedometer3

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-speedometer3

browsertime-benchmark-custom-car-speedometer3

browsertime-benchmark-firefox-speedometer3

stylebench

Owner: :emelio and Layout Team

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 5

  • page timeout: 140000

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/StyleBench/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-stylebench

browsertime-benchmark-firefox-stylebench

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-stylebench

browsertime-benchmark-firefox-stylebench

browsertime-benchmark-safari-stylebench

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-stylebench

browsertime-benchmark-firefox-stylebench

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-stylebench

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-stylebench

browsertime-benchmark-firefox-stylebench

sunspider

Owner: :jandem and SpiderMonkey Team

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-sunspider

browsertime-benchmark-firefox-sunspider

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-sunspider

browsertime-benchmark-firefox-sunspider

browsertime-benchmark-safari-sunspider

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-sunspider

browsertime-benchmark-firefox-sunspider

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-sunspider

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-sunspider

browsertime-benchmark-firefox-sunspider

twitch-animation

Owner: :jrmuizel

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 1

  • page timeout: 2000000

  • perfstats: true

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/twitch-animation

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • subtest lower is better: true

  • subtest unit: ms

  • test url: http://<host>:<port>/index.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-twitch-animation

unity-webgl

Owner: :jgilbert and Graphics(gfx) Team

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 5

  • page timeout: 420000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/unity-webgl

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-unity-webgl-mobile-fenix-nofis

browsertime-benchmark-unity-webgl-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis

browsertime-benchmark-unity-webgl-mobile-fenix-nofis

browsertime-benchmark-unity-webgl-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

browsertime-benchmark-safari-unity-webgl

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

Owner: :jgilbert and Graphics(gfx) Team

  • alert threshold: 2.0

  • apps: geckoview, refbrow, fenix, chrome-m

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: false

  • page cycles: 1

  • page timeout: 420000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/unity-webgl

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-unity-webgl-mobile-fenix-nofis

browsertime-benchmark-unity-webgl-mobile-geckoview-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis

browsertime-benchmark-unity-webgl-mobile-fenix-nofis

browsertime-benchmark-unity-webgl-mobile-geckoview-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

browsertime-benchmark-safari-unity-webgl

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-unity-webgl

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-unity-webgl

browsertime-benchmark-firefox-unity-webgl

wasm-godot

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • newtab per cycle: true

  • page cycles: 5

  • page timeout: 120000

  • test url: http://localhost:<port>/wasm-godot/index.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-godot

browsertime-benchmark-wasm-firefox-wasm-godot

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-godot

browsertime-benchmark-wasm-firefox-wasm-godot

browsertime-benchmark-wasm-safari-wasm-godot

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-godot

browsertime-benchmark-wasm-firefox-wasm-godot

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-godot

browsertime-benchmark-wasm-firefox-wasm-godot

wasm-godot-baseline

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • newtab per cycle: true

  • page cycles: 5

  • page timeout: 120000

  • preferences: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false

  • test url: http://localhost:<port>/wasm-godot/index.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-baseline

wasm-godot-optimizing

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • newtab per cycle: true

  • page cycles: 5

  • page timeout: 120000

  • preferences: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true

  • test url: http://localhost:<port>/wasm-godot/index.html

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-godot-optimizing

wasm-misc

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 5

  • page timeout: 1200000

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/wasm-misc

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-misc

browsertime-benchmark-wasm-firefox-wasm-misc

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-misc

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-misc

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-chrome-wasm-misc

browsertime-benchmark-wasm-firefox-wasm-misc

wasm-misc-baseline

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 5

  • page timeout: 1200000

  • preferences: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/wasm-misc

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-baseline

wasm-misc-optimizing

Owner: :lth and SpiderMonkey Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 5

  • page timeout: 1200000

  • preferences: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true

  • repository: https://github.com/mozilla/perf-automation

  • repository path: benchmarks/wasm-misc

  • repository revision: 61332db584026b73e37066d717a162825408c36b

  • test url: http://<host>:<port>/index.html?raptor

  • type: benchmark

  • unit: ms

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-wasm-firefox-wasm-misc-optimizing

webaudio

Owner: :padenot and Media Team

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 5

  • page timeout: 360000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • test url: http://<host>:<port>/webaudio/index.html?raptor

  • type: benchmark

  • unit: score

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-webaudio

browsertime-benchmark-firefox-webaudio

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-webaudio

browsertime-benchmark-firefox-webaudio

browsertime-benchmark-safari-webaudio

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-webaudio

browsertime-benchmark-firefox-webaudio

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-firefox-webaudio

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-benchmark-chrome-webaudio

browsertime-benchmark-firefox-webaudio

youtube-playback

Owner: PerfTest Team

youtube-playback-av1-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-av1-sfr

youtube-playback-h264-1080p30

Owner: PerfTest Team

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p30

youtube-playback-h264-1080p60

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-1080p60

youtube-playback-h264-full-1080p30

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p30

youtube-playback-h264-full-1080p60

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-h264-full-1080p60

youtube-playback-h264-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-h264-sfr

youtube-playback-hfr

Owner: PerfTest Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-hfr-nofis

browsertime-mobile-geckoview-youtube-playback-hfr-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-hfr-nofis

browsertime-mobile-geckoview-youtube-playback-hfr-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-hfr

youtube-playback-v9-1080p30

Owner: PerfTest Team

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p30

youtube-playback-v9-1080p60

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-1080p60

youtube-playback-v9-full-1080p30

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p30

youtube-playback-v9-full-1080p60

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • expose browser profiler: true

  • gather cpuTime: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 20

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-power-firefox-youtube-playback-v9-full-1080p60

youtube-playback-vp9-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-vp9-sfr

youtube-playback-widevine-h264-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-h264-sfr

youtube-playback-widevine-hfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-hfr

youtube-playback-widevine-vp9-sfr

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: firefox, geckoview, fenix, refbrow, chrome

  • expected: pass

  • expose browser profiler: true

  • gecko profile interval: 1000

  • gecko profile threads: MediaPlayback

  • lower is better: true

  • page cycles: 1

  • page timeout: 2700000

  • preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false

  • subtest lower is better: true

  • subtest unit: score

  • test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run

  • type: benchmark

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-firefox-youtube-playback-widevine-vp9-sfr

Custom

Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.

addMab1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small ArrayBuffers to IndexedDB in one transaction

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMab1

browsertime-indexeddb-firefox-addMab1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMab1

browsertime-indexeddb-firefox-addMab1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMab1

browsertime-indexeddb-firefox-addMab1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMab1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMab1

browsertime-indexeddb-firefox-addMab1

addMabN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small ArrayBuffers to IndexedDB independently

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMabN

browsertime-indexeddb-firefox-addMabN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMabN

browsertime-indexeddb-firefox-addMabN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMabN

browsertime-indexeddb-firefox-addMabN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMabN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMabN

browsertime-indexeddb-firefox-addMabN

addMar1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small Arrays to IndexedDB in one transaction

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Array –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMar1

browsertime-indexeddb-firefox-addMar1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMar1

browsertime-indexeddb-firefox-addMar1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMar1

browsertime-indexeddb-firefox-addMar1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMar1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMar1

browsertime-indexeddb-firefox-addMar1

addMarN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small Arrays to IndexedDB independently

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Array –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMarN

browsertime-indexeddb-firefox-addMarN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMarN

browsertime-indexeddb-firefox-addMarN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMarN

browsertime-indexeddb-firefox-addMarN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMarN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMarN

browsertime-indexeddb-firefox-addMarN

addMbl1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small Blobs to IndexedDB in one transaction

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Blob –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMbl1

browsertime-indexeddb-firefox-addMbl1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMbl1

browsertime-indexeddb-firefox-addMbl1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMbl1

browsertime-indexeddb-firefox-addMbl1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMbl1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMbl1

browsertime-indexeddb-firefox-addMbl1

addMblN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small Blobs to IndexedDB independently

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Blob –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMblN

browsertime-indexeddb-firefox-addMblN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMblN

browsertime-indexeddb-firefox-addMblN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMblN

browsertime-indexeddb-firefox-addMblN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addMblN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addMblN

browsertime-indexeddb-firefox-addMblN

addkAB1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large ArrayBuffers to IndexedDB in one transaction

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAB1

browsertime-indexeddb-firefox-addkAB1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAB1

browsertime-indexeddb-firefox-addkAB1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAB1

browsertime-indexeddb-firefox-addkAB1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAB1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAB1

browsertime-indexeddb-firefox-addkAB1

addkABN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large ArrayBuffers to IndexedDB independently

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkABN

browsertime-indexeddb-firefox-addkABN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkABN

browsertime-indexeddb-firefox-addkABN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkABN

browsertime-indexeddb-firefox-addkABN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkABN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkABN

browsertime-indexeddb-firefox-addkABN

addkAR1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large JS Arrays to IndexedDB in one transaction

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Array –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAR1

browsertime-indexeddb-firefox-addkAR1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAR1

browsertime-indexeddb-firefox-addkAR1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAR1

browsertime-indexeddb-firefox-addkAR1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkAR1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkAR1

browsertime-indexeddb-firefox-addkAR1

addkARN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large JS Arrays to IndexedDB independently

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Array –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkARN

browsertime-indexeddb-firefox-addkARN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkARN

browsertime-indexeddb-firefox-addkARN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkARN

browsertime-indexeddb-firefox-addkARN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkARN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkARN

browsertime-indexeddb-firefox-addkARN

addkBL1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large Blobs to IndexedDB in one transaction

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Blob –browsertime.atomic=1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBL1

browsertime-indexeddb-firefox-addkBL1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBL1

browsertime-indexeddb-firefox-addkBL1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBL1

browsertime-indexeddb-firefox-addkBL1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBL1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBL1

browsertime-indexeddb-firefox-addkBL1

addkBLN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large Blobs to IndexedDB independently

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Blob –browsertime.atomic=0

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_write.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBLN

browsertime-indexeddb-firefox-addkBLN

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBLN

browsertime-indexeddb-firefox-addkBLN

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBLN

browsertime-indexeddb-firefox-addkBLN

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-addkBLN

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-addkBLN

browsertime-indexeddb-firefox-addkBLN

browsertime

Owner: PerfTest Team

Description: Used to run vanilla browsertime tests through raptor. For example: ./mach raptor –browsertime -t browsertime –browsertime-arg url=https://www.sitespeed.io –browsertime-arg iterations=3

  • alert on: fcp, loadtime

  • alert threshold: 2.0

  • apps: firefox

  • browser cycles: 1

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • measure: fnbpaint, fcp, dcf, loadtime

  • page cycles: 1

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: null.manifest

  • playback version: 8.1.1

  • test script: None

  • test url: None

  • type: pageload

  • unit: ms

  • use live sites: true

connect

Owner: Network Team

Description: Verifies that connection time on a pageload is zero when a speculative connection has first been made

  • alert change type: absolute

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange

  • alert threshold: 10.0

  • apps: firefox

  • browser cycles: 3

  • cold: true

  • custom data: true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 1

  • page timeout: 60000

  • test script: speculative-connect.js

  • test url: None

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-speculative-firefox-connect

constant-regression

Owner: PerfTest Team

Description: Generates a constant value that can be changed to induce a regression.

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, geckoview, fenix

  • browser cycles: 1

  • browsertime args: –browsertime.constant_value=1500

  • custom data: true

  • expected: pass

  • fore window: 1

  • gecko profile interval: 1

  • lower is better: true

  • max back window: 3

  • min back window: 2

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • subtest unit: ms

  • test script: constant_regression_test.js

  • test summary: flatten

  • test url: None

  • type: pageload

  • unit: score

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-regression-tests-firefox-constant-regression

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-regression-tests-firefox-constant-regression

getkeyrng

Owner: DOM Lifecycle, Workers and Storage Team

Description: Measures the speed of key-range based reads of IndexedDB

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • custom data: true

  • expected: pass

  • gecko profile entries: 131072000

  • gecko profile features: js,stackwalk,cpu

  • gecko profile threads: GeckoMain,DOM Worker,IndexedDB

  • lower is better: true

  • measure: cpuTime

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-example.manifest

  • subtest unit: ms

  • test script: indexeddb_getkeyrange.js

  • test summary: flatten

  • test url: https://www.example.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-getkeyrng

browsertime-indexeddb-firefox-getkeyrng

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-getkeyrng

browsertime-indexeddb-firefox-getkeyrng

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-getkeyrng

browsertime-indexeddb-firefox-getkeyrng

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-firefox-getkeyrng

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-indexeddb-chrome-getkeyrng

browsertime-indexeddb-firefox-getkeyrng

grandprix

Owner: PerfTest Team

Description: Runs the Grandprix benchmark

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.grandprix_iterations=25

  • custom data: true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • subtest name filters: tests/,iterations/

  • subtest unit: ms

  • test script: grandprix.js

  • test summary: flatten

  • test url: None

  • type: pageload

  • unit: score

  • use live sites: true

process-switch

Owner: PerfTest Team

Description: Measures process switch time

  • accept zero vismet: true

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: firefox, chrome

  • browser cycles: 25

  • browsertime args: –pageCompleteWaitTime=1000 –pageCompleteCheckInactivity=true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-proc-switch.manifest

  • playback version: 5.1.1

  • test script: process_switch.js

  • test url: https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-custom-firefox-process-switch

sample-python-support

Owner: PerfTest Team

Description: A sample test that uses a python support file to modify the test command.

  • alert threshold: 2.0

  • apps: firefox

  • browser cycles: 1

  • browsertime args: –browsertime.constant_value={replace-with-constant-value}

  • custom data: true

  • expected: pass

  • fore window: 1

  • gecko profile interval: 1

  • lower is better: true

  • max back window: 3

  • min back window: 2

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • subtest unit: ms

  • support class: sample_python_support.py

  • test script: constant_regression_test.js

  • test summary: flatten

  • test url: None

  • type: pageload

  • unit: score

  • use live sites: true

throttled

Owner: Network Team

Description: Pageload test using a throttled network environment

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange

  • alert threshold: 2.0

  • apps: firefox

  • browser cycles: 3

  • cold: true

  • custom data: true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 1

  • page timeout: 60000

  • test script: throttled_pageload.js

  • test url: None

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-throttled-firefox-throttled

tp6-bench

Owner: PerfTest Team

Description: A pageload benchmark test that quickly runs through a selection of the pages available to produce a single overall metric for fcp, lcp, and loadtime. The metrics from all pages get summarized with the geomean, and mean.

  • alert threshold: 2.0

  • apps: firefox, chrome, chromium, safari

  • browser cycles: 1

  • cold: true

  • custom data: true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • playback: mitmproxy

  • playback pageset manifest: None

  • playback version: 8.1.1

  • subtest unit: ms

  • support class: browsertime_tp6_bench.py

  • test script: browsertime_tp6_bench.js

  • test summary: flatten

  • test url: None

  • type: pageload

  • unit: ms

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-pageload-benchmark-firefox-tp6-bench

upload

Owner: Network Team

Description: Measures http/2 file upload throughput

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.upload_iterations=10 –firefox.preference=network.http.http3.enable:false –chrome.args disable-quic

  • custom data: true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: false

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • subtest lower is better: false

  • subtest name filters: tests/,iterations/

  • subtest unit: mbps

  • test script: upload.js

  • test url: None

  • type: pageload

  • unit: mbps

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-chrome-upload

browsertime-upload-firefox-upload

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-chrome-upload

browsertime-upload-firefox-upload

browsertime-upload-safari-upload

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-chrome-upload

browsertime-upload-firefox-upload

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-chrome-upload

browsertime-upload-firefox-upload

upload-h3

Owner: Network Team

Description: Measures http/3 file upload throughput

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 1

  • browsertime args: –browsertime.upload_iterations=10 –firefox.preference=network.http.http3.enable:true

  • custom data: true

  • expected: pass

  • gecko profile interval: 1

  • lower is better: false

  • output timeout: 2000000

  • page cycles: 1

  • page timeout: 1800000

  • subtest lower is better: false

  • subtest name filters: tests/,iterations/

  • subtest unit: mbps

  • test script: upload.js

  • test url: None

  • type: pageload

  • unit: mbps

  • use live sites: true

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload-h3

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload-h3

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-chrome-upload-h3

browsertime-upload-firefox-upload-h3

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload-h3

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload-h3

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-chrome-upload-h3

browsertime-upload-firefox-upload-h3

browsertime-upload-safari-upload-h3

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload-h3

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-chrome-upload-h3

browsertime-upload-firefox-upload-h3

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload-h3

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-firefox-upload-h3

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-upload-chrome-upload-h3

browsertime-upload-firefox-upload-h3

welcome

Owner: PerfTest Team

Description: Measures pageload metrics for the first-install about:welcome page

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: firefox

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-welcome.manifest

  • playback version: 8.1.1

  • test script: welcome.js

  • test url: about:welcome

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-first-install-firefox-welcome

Desktop

Tests for page-load performance. The links direct to the actual websites that are being tested.

amazon

Owner: PerfTest Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-amazon

browsertime-tp6m-fenix-amazon-nofis

browsertime-tp6m-geckoview-amazon

browsertime-tp6m-geckoview-amazon-nofis

browsertime-tp6m-live-fenix-amazon-nofis

browsertime-tp6m-live-geckoview-amazon-nofis

browsertime-tp6m-refbrow-amazon

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-amazon

browsertime-tp6m-chrome-m-amazon-nofis

browsertime-tp6m-fenix-amazon

browsertime-tp6m-fenix-amazon-nofis

browsertime-tp6m-geckoview-amazon

browsertime-tp6m-geckoview-amazon-nofis

browsertime-tp6m-live-chrome-m-amazon-nofis

browsertime-tp6m-live-fenix-amazon-nofis

browsertime-tp6m-live-geckoview-amazon-nofis

browsertime-tp6m-refbrow-amazon

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-chrome-amazon

browsertime-tp6-essential-custom-car-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-chrome-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-profiling-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-chrome-amazon

browsertime-tp6-essential-custom-car-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-chrome-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-live-safari-amazon

browsertime-tp6-profiling-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-chrome-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-chrome-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-chrome-amazon

browsertime-tp6-essential-custom-car-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-chrome-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

bing-search

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-bing-search.manifest

  • playback version: 8.1.1

  • test url: https://www.bing.com/search?q=barack+obama

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-firefox-bing-search

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-firefox-bing-search

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-firefox-bing-search

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-chrome-bing-search

browsertime-tp6-essential-custom-car-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-chrome-bing-search

browsertime-tp6-live-firefox-bing-search

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-firefox-bing-search

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-firefox-bing-search

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-chrome-bing-search

browsertime-tp6-essential-custom-car-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-chrome-bing-search

browsertime-tp6-live-firefox-bing-search

browsertime-tp6-live-safari-bing-search

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-firefox-bing-search

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-chrome-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-chrome-bing-search

browsertime-tp6-live-firefox-bing-search

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-firefox-bing-search

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-firefox-bing-search

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-bing-search

browsertime-tp6-essential-chrome-bing-search

browsertime-tp6-essential-custom-car-bing-search

browsertime-tp6-essential-firefox-bing-search

browsertime-tp6-live-chrome-bing-search

browsertime-tp6-live-firefox-bing-search

buzzfeed

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: false

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-buzzfeed.manifest

  • playback version: 8.1.1

  • secondary url: https://www.buzzfeed.com/quizzes

  • test url: https://www.buzzfeed.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-buzzfeed

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-buzzfeed

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-buzzfeed

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-buzzfeed

browsertime-tp6-firefox-buzzfeed

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-buzzfeed

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-buzzfeed

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-buzzfeed

browsertime-tp6-firefox-buzzfeed

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-buzzfeed

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-buzzfeed

browsertime-tp6-firefox-buzzfeed

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-buzzfeed

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-buzzfeed

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-buzzfeed

browsertime-tp6-firefox-buzzfeed

cnn

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-cnn.manifest

  • playback version: 8.1.1

  • secondary url: https://www.cnn.com/weather

  • test url: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-cnn

browsertime-tp6m-fenix-cnn-nofis

browsertime-tp6m-geckoview-cnn

browsertime-tp6m-geckoview-cnn-nofis

browsertime-tp6m-live-fenix-cnn-nofis

browsertime-tp6m-live-geckoview-cnn-nofis

browsertime-tp6m-refbrow-cnn

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-cnn

browsertime-tp6m-chrome-m-cnn-nofis

browsertime-tp6m-fenix-cnn

browsertime-tp6m-fenix-cnn-nofis

browsertime-tp6m-geckoview-cnn

browsertime-tp6m-geckoview-cnn-nofis

browsertime-tp6m-live-chrome-m-cnn-nofis

browsertime-tp6m-live-fenix-cnn-nofis

browsertime-tp6m-live-geckoview-cnn-nofis

browsertime-tp6m-refbrow-cnn

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-chrome-cnn

browsertime-tp6-essential-custom-car-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-chrome-cnn

browsertime-tp6-essential-custom-car-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-chrome-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-chrome-cnn

browsertime-tp6-essential-custom-car-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

ebay

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-ebay.manifest

  • playback version: 8.1.1

  • secondary url: https://www.ebay.com/deals

  • test url: https://www.ebay.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-ebay

browsertime-tp6-live-firefox-ebay

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-ebay

browsertime-tp6-live-firefox-ebay

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-ebay

browsertime-tp6-live-firefox-ebay

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-ebay

browsertime-tp6-firefox-ebay

browsertime-tp6-live-chrome-ebay

browsertime-tp6-live-firefox-ebay

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-ebay

browsertime-tp6-live-firefox-ebay

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-ebay

browsertime-tp6-live-firefox-ebay

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-ebay

browsertime-tp6-firefox-ebay

browsertime-tp6-live-chrome-ebay

browsertime-tp6-live-firefox-ebay

browsertime-tp6-live-safari-ebay

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-ebay

browsertime-tp6-live-firefox-ebay

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-ebay

browsertime-tp6-firefox-ebay

browsertime-tp6-live-chrome-ebay

browsertime-tp6-live-firefox-ebay

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-ebay

browsertime-tp6-live-firefox-ebay

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-ebay

browsertime-tp6-live-firefox-ebay

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-ebay

browsertime-tp6-firefox-ebay

browsertime-tp6-live-chrome-ebay

browsertime-tp6-live-firefox-ebay

espn

Owner: PerfTest Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-fenix-espn-nofis

browsertime-tp6m-essential-geckoview-espn-nofis

browsertime-tp6m-live-fenix-espn-nofis

browsertime-tp6m-live-geckoview-espn-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-chrome-m-espn-nofis

browsertime-tp6m-essential-fenix-espn-nofis

browsertime-tp6m-essential-geckoview-espn-nofis

browsertime-tp6m-live-chrome-m-espn-nofis

browsertime-tp6m-live-fenix-espn-nofis

browsertime-tp6m-live-geckoview-espn-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-espn

browsertime-tp6-firefox-espn

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-espn

browsertime-tp6-firefox-espn

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-espn

browsertime-tp6-firefox-espn

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-espn

browsertime-tp6-firefox-espn

expedia

Owner: PerfTest Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-expedia-nofis

browsertime-tp6m-live-geckoview-expedia-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-expedia-nofis

browsertime-tp6m-live-fenix-expedia-nofis

browsertime-tp6m-live-geckoview-expedia-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-expedia

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-expedia

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-expedia

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-expedia

browsertime-tp6-firefox-expedia

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-expedia

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-expedia

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-expedia

browsertime-tp6-firefox-expedia

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-expedia

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-expedia

browsertime-tp6-firefox-expedia

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-expedia

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-expedia

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-expedia

browsertime-tp6-firefox-expedia

facebook

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-linux-firefox-facebook.manifest

  • playback version: 8.1.1

  • secondary url: https://www.facebook.com/marketplace/?ref=bookmark

  • test url: https://www.facebook.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-facebook-nofis

browsertime-tp6m-live-geckoview-facebook-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-facebook-nofis

browsertime-tp6m-live-fenix-facebook-nofis

browsertime-tp6m-live-geckoview-facebook-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-facebook

browsertime-tp6-firefox-facebook

browsertime-tp6-live-chrome-facebook

browsertime-tp6-live-firefox-facebook

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-facebook

browsertime-tp6-firefox-facebook

browsertime-tp6-live-chrome-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-facebook

browsertime-tp6-firefox-facebook

browsertime-tp6-live-chrome-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-facebook

browsertime-tp6-firefox-facebook

browsertime-tp6-live-chrome-facebook

browsertime-tp6-live-firefox-facebook

fandom

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: false

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-fandom.manifest

  • playback version: 8.1.1

  • test url: https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-firefox-fandom

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-firefox-fandom

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-firefox-fandom

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-chrome-fandom

browsertime-tp6-essential-custom-car-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-chrome-fandom

browsertime-tp6-live-firefox-fandom

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-firefox-fandom

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-firefox-fandom

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-chrome-fandom

browsertime-tp6-essential-custom-car-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-chrome-fandom

browsertime-tp6-live-firefox-fandom

browsertime-tp6-live-safari-fandom

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-firefox-fandom

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-chrome-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-chrome-fandom

browsertime-tp6-live-firefox-fandom

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-firefox-fandom

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-firefox-fandom

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-fandom

browsertime-tp6-essential-chrome-fandom

browsertime-tp6-essential-custom-car-fandom

browsertime-tp6-essential-firefox-fandom

browsertime-tp6-live-chrome-fandom

browsertime-tp6-live-firefox-fandom

google-docs

Owner: PerfTest Team

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-firefox-google-docs

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-firefox-google-docs

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-firefox-google-docs

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-docs

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-chrome-google-docs

browsertime-tp6-live-firefox-google-docs

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-firefox-google-docs

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-firefox-google-docs

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-docs

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-chrome-google-docs

browsertime-tp6-live-firefox-google-docs

browsertime-tp6-live-safari-google-docs

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-firefox-google-docs

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-docs

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-chrome-google-docs

browsertime-tp6-live-firefox-google-docs

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-firefox-google-docs

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-firefox-google-docs

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-docs

browsertime-tp6-firefox-google-docs

browsertime-tp6-live-chrome-google-docs

browsertime-tp6-live-firefox-google-docs

google-mail

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: false

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-google-mail.manifest

  • playback version: 8.1.1

  • test url: https://mail.google.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-firefox-google-mail

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-firefox-google-mail

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-firefox-google-mail

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-mail

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-chrome-google-mail

browsertime-tp6-live-firefox-google-mail

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-firefox-google-mail

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-firefox-google-mail

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-mail

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-chrome-google-mail

browsertime-tp6-live-firefox-google-mail

browsertime-tp6-live-safari-google-mail

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-firefox-google-mail

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-mail

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-chrome-google-mail

browsertime-tp6-live-firefox-google-mail

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-firefox-google-mail

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-firefox-google-mail

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-mail

browsertime-tp6-firefox-google-mail

browsertime-tp6-live-chrome-google-mail

browsertime-tp6-live-firefox-google-mail

google-search

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-google-search.manifest

  • playback version: 8.1.1

  • test url: https://www.google.com/search?hl=en&q=barack+obama&cad=h

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-search

browsertime-tp6-live-firefox-google-search

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-search

browsertime-tp6-live-firefox-google-search

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-search

browsertime-tp6-live-firefox-google-search

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-search

browsertime-tp6-firefox-google-search

browsertime-tp6-live-chrome-google-search

browsertime-tp6-live-firefox-google-search

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-search

browsertime-tp6-live-firefox-google-search

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-search

browsertime-tp6-live-firefox-google-search

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-search

browsertime-tp6-firefox-google-search

browsertime-tp6-live-chrome-google-search

browsertime-tp6-live-firefox-google-search

browsertime-tp6-live-safari-google-search

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-search

browsertime-tp6-live-firefox-google-search

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-search

browsertime-tp6-firefox-google-search

browsertime-tp6-live-chrome-google-search

browsertime-tp6-live-firefox-google-search

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-search

browsertime-tp6-live-firefox-google-search

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-google-search

browsertime-tp6-live-firefox-google-search

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-google-search

browsertime-tp6-firefox-google-search

browsertime-tp6-live-chrome-google-search

browsertime-tp6-live-firefox-google-search

google-slides

Owner: PerfTest Team

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-firefox-google-slides

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-firefox-google-slides

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-firefox-google-slides

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-chrome-google-slides

browsertime-tp6-essential-custom-car-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-chrome-google-slides

browsertime-tp6-live-firefox-google-slides

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-firefox-google-slides

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-firefox-google-slides

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-chrome-google-slides

browsertime-tp6-essential-custom-car-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-chrome-google-slides

browsertime-tp6-live-firefox-google-slides

browsertime-tp6-live-safari-google-slides

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-firefox-google-slides

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-chrome-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-chrome-google-slides

browsertime-tp6-live-firefox-google-slides

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-firefox-google-slides

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-firefox-google-slides

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-google-slides

browsertime-tp6-essential-chrome-google-slides

browsertime-tp6-essential-custom-car-google-slides

browsertime-tp6-essential-firefox-google-slides

browsertime-tp6-live-chrome-google-slides

browsertime-tp6-live-firefox-google-slides

imdb

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-imdb.manifest

  • playback version: 8.1.1

  • secondary url: https://www.imdb.com/title/tt0084967/episodes/?ref_=tt_ov_epl

  • test url: https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-imdb

browsertime-tp6m-fenix-imdb-nofis

browsertime-tp6m-geckoview-imdb

browsertime-tp6m-geckoview-imdb-nofis

browsertime-tp6m-live-fenix-imdb-nofis

browsertime-tp6m-live-geckoview-imdb-nofis

browsertime-tp6m-refbrow-imdb

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-imdb

browsertime-tp6m-chrome-m-imdb-nofis

browsertime-tp6m-fenix-imdb

browsertime-tp6m-fenix-imdb-nofis

browsertime-tp6m-geckoview-imdb

browsertime-tp6m-geckoview-imdb-nofis

browsertime-tp6m-live-chrome-m-imdb-nofis

browsertime-tp6m-live-fenix-imdb-nofis

browsertime-tp6m-live-geckoview-imdb-nofis

browsertime-tp6m-refbrow-imdb

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imdb

browsertime-tp6-firefox-imdb

browsertime-tp6-live-chrome-imdb

browsertime-tp6-live-firefox-imdb

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imdb

browsertime-tp6-firefox-imdb

browsertime-tp6-live-chrome-imdb

browsertime-tp6-live-firefox-imdb

browsertime-tp6-live-safari-imdb

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imdb

browsertime-tp6-firefox-imdb

browsertime-tp6-live-chrome-imdb

browsertime-tp6-live-firefox-imdb

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imdb

browsertime-tp6-firefox-imdb

browsertime-tp6-live-chrome-imdb

browsertime-tp6-live-firefox-imdb

imgur

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: false

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-imgur.manifest

  • playback version: 8.1.1

  • preferences: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true

  • secondary url: https://imgur.com/gallery/WuOobqV

  • test url: https://imgur.com/gallery/uTI7fKy

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imgur

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imgur

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

browsertime-tp6-live-safari-imgur

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imgur

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imgur

browsertime-tp6-firefox-imgur

browsertime-tp6-live-firefox-imgur

instagram

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-linux-firefox-instagram.manifest

  • playback version: 8.1.1

  • secondary url: https://www.instagram.com/nobelprize_org/

  • test url: https://www.instagram.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-instagram

browsertime-tp6m-fenix-instagram-nofis

browsertime-tp6m-geckoview-instagram

browsertime-tp6m-geckoview-instagram-nofis

browsertime-tp6m-live-fenix-instagram-nofis

browsertime-tp6m-live-geckoview-instagram-nofis

browsertime-tp6m-refbrow-instagram

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-instagram

browsertime-tp6m-chrome-m-instagram-nofis

browsertime-tp6m-fenix-instagram

browsertime-tp6m-fenix-instagram-nofis

browsertime-tp6m-geckoview-instagram

browsertime-tp6m-geckoview-instagram-nofis

browsertime-tp6m-live-chrome-m-instagram-nofis

browsertime-tp6m-live-fenix-instagram-nofis

browsertime-tp6m-live-geckoview-instagram-nofis

browsertime-tp6m-refbrow-instagram

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-chrome-instagram

browsertime-tp6-essential-custom-car-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-chrome-instagram

browsertime-tp6-live-firefox-instagram

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-chrome-instagram

browsertime-tp6-essential-custom-car-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-chrome-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-chrome-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-chrome-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-chrome-instagram

browsertime-tp6-essential-custom-car-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-chrome-instagram

browsertime-tp6-live-firefox-instagram

linkedin

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-linux-firefox-linkedin.manifest

  • playback version: 8.1.1

  • secondary url: https://www.linkedin.com/in/thommy-harris-hk-385723106/

  • test url: https://www.linkedin.com/feed/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-firefox-linkedin

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-firefox-linkedin

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-firefox-linkedin

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-linkedin

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-chrome-linkedin

browsertime-tp6-live-firefox-linkedin

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-firefox-linkedin

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-firefox-linkedin

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-linkedin

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-chrome-linkedin

browsertime-tp6-live-firefox-linkedin

browsertime-tp6-live-safari-linkedin

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-firefox-linkedin

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-linkedin

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-chrome-linkedin

browsertime-tp6-live-firefox-linkedin

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-firefox-linkedin

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-firefox-linkedin

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-linkedin

browsertime-tp6-firefox-linkedin

browsertime-tp6-live-chrome-linkedin

browsertime-tp6-live-firefox-linkedin

microsoft

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-microsoft.manifest

  • playback version: 8.1.1

  • secondary url: https://support.microsoft.com/en-us

  • test url: https://www.microsoft.com/en-us/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-firefox-microsoft

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-firefox-microsoft

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-firefox-microsoft

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-microsoft

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-chrome-microsoft

browsertime-tp6-live-firefox-microsoft

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-firefox-microsoft

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-firefox-microsoft

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-microsoft

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-chrome-microsoft

browsertime-tp6-live-firefox-microsoft

browsertime-tp6-live-safari-microsoft

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-firefox-microsoft

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-microsoft

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-chrome-microsoft

browsertime-tp6-live-firefox-microsoft

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-firefox-microsoft

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-firefox-microsoft

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-microsoft

browsertime-tp6-firefox-microsoft

browsertime-tp6-live-chrome-microsoft

browsertime-tp6-live-firefox-microsoft

netflix

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-linux-firefox-netflix.manifest

  • playback version: 8.1.1

  • secondary url: https://www.netflix.com/title/699257

  • test url: https://www.netflix.com/title/80117263

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-netflix

browsertime-tp6-live-firefox-netflix

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-netflix

browsertime-tp6-live-firefox-netflix

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-netflix

browsertime-tp6-live-firefox-netflix

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-netflix

browsertime-tp6-firefox-netflix

browsertime-tp6-live-chrome-netflix

browsertime-tp6-live-firefox-netflix

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-netflix

browsertime-tp6-live-firefox-netflix

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-netflix

browsertime-tp6-live-firefox-netflix

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-netflix

browsertime-tp6-firefox-netflix

browsertime-tp6-live-chrome-netflix

browsertime-tp6-live-firefox-netflix

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-netflix

browsertime-tp6-live-firefox-netflix

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-netflix

browsertime-tp6-firefox-netflix

browsertime-tp6-live-chrome-netflix

browsertime-tp6-live-firefox-netflix

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-netflix

browsertime-tp6-live-firefox-netflix

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-netflix

browsertime-tp6-live-firefox-netflix

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-netflix

browsertime-tp6-firefox-netflix

browsertime-tp6-live-chrome-netflix

browsertime-tp6-live-firefox-netflix

nytimes

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-nytimes.manifest

  • playback version: 8.1.1

  • secondary url: https://www.nytimes.com/section/opinion/columnists

  • test url: https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-nytimes-nofis

browsertime-tp6m-live-geckoview-nytimes-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-nytimes-nofis

browsertime-tp6m-live-fenix-nytimes-nofis

browsertime-tp6m-live-geckoview-nytimes-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-nytimes

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-nytimes

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-nytimes

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-nytimes

browsertime-tp6-firefox-nytimes

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-nytimes

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-nytimes

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-nytimes

browsertime-tp6-firefox-nytimes

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-nytimes

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-nytimes

browsertime-tp6-firefox-nytimes

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-nytimes

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-nytimes

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-nytimes

browsertime-tp6-firefox-nytimes

office

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-office.manifest

  • playback version: 8.1.1

  • secondary url: https://www.office.com/

  • test url: https://www.office.com/launch/powerpoint?auth=1

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-office

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-office

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-office

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-office

browsertime-tp6-firefox-office

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-office

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-office

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-office

browsertime-tp6-firefox-office

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-office

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-office

browsertime-tp6-firefox-office

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-office

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-office

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-office

browsertime-tp6-firefox-office

outlook

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-live.manifest

  • playback version: 8.1.1

  • test url: https://outlook.live.com/mail/inbox

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-outlook

browsertime-tp6-live-firefox-outlook

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-outlook

browsertime-tp6-live-firefox-outlook

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-outlook

browsertime-tp6-live-firefox-outlook

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-outlook

browsertime-tp6-firefox-outlook

browsertime-tp6-live-chrome-outlook

browsertime-tp6-live-firefox-outlook

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-outlook

browsertime-tp6-live-firefox-outlook

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-outlook

browsertime-tp6-live-firefox-outlook

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-outlook

browsertime-tp6-firefox-outlook

browsertime-tp6-live-chrome-outlook

browsertime-tp6-live-firefox-outlook

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-outlook

browsertime-tp6-live-firefox-outlook

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-outlook

browsertime-tp6-firefox-outlook

browsertime-tp6-live-chrome-outlook

browsertime-tp6-live-firefox-outlook

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-outlook

browsertime-tp6-live-firefox-outlook

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-outlook

browsertime-tp6-live-firefox-outlook

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-outlook

browsertime-tp6-firefox-outlook

browsertime-tp6-live-chrome-outlook

browsertime-tp6-live-firefox-outlook

paypal

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-paypal.manifest

  • playback version: 8.1.1

  • test url: https://www.paypal.com/myaccount/summary/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-paypal

browsertime-tp6-live-firefox-paypal

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-paypal

browsertime-tp6-live-firefox-paypal

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-paypal

browsertime-tp6-live-firefox-paypal

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-paypal

browsertime-tp6-firefox-paypal

browsertime-tp6-live-chrome-paypal

browsertime-tp6-live-firefox-paypal

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-paypal

browsertime-tp6-live-firefox-paypal

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-paypal

browsertime-tp6-live-firefox-paypal

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-paypal

browsertime-tp6-firefox-paypal

browsertime-tp6-live-chrome-paypal

browsertime-tp6-live-firefox-paypal

browsertime-tp6-live-safari-paypal

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-paypal

browsertime-tp6-live-firefox-paypal

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-paypal

browsertime-tp6-firefox-paypal

browsertime-tp6-live-chrome-paypal

browsertime-tp6-live-firefox-paypal

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-paypal

browsertime-tp6-live-firefox-paypal

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-paypal

browsertime-tp6-live-firefox-paypal

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-paypal

browsertime-tp6-firefox-paypal

browsertime-tp6-live-chrome-paypal

browsertime-tp6-live-firefox-paypal

pinterest

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: false

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-linux-firefox-pinterest.manifest

  • playback version: 8.1.1

  • secondary url: https://www.pinterest.com/today/best/halloween-costumes-for-your-furry-friends/75787/

  • test url: https://pinterest.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-firefox-pinterest

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-firefox-pinterest

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-firefox-pinterest

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-pinterest

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-chrome-pinterest

browsertime-tp6-live-firefox-pinterest

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-firefox-pinterest

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-firefox-pinterest

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-pinterest

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-chrome-pinterest

browsertime-tp6-live-firefox-pinterest

browsertime-tp6-live-safari-pinterest

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-firefox-pinterest

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-pinterest

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-chrome-pinterest

browsertime-tp6-live-firefox-pinterest

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-firefox-pinterest

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-firefox-pinterest

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-pinterest

browsertime-tp6-firefox-pinterest

browsertime-tp6-live-chrome-pinterest

browsertime-tp6-live-firefox-pinterest

reddit

Owner: PerfTest Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-reddit

browsertime-tp6m-fenix-reddit-nofis

browsertime-tp6m-geckoview-reddit

browsertime-tp6m-geckoview-reddit-nofis

browsertime-tp6m-live-fenix-reddit-nofis

browsertime-tp6m-live-geckoview-reddit-nofis

browsertime-tp6m-refbrow-reddit

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-reddit

browsertime-tp6m-chrome-m-reddit-nofis

browsertime-tp6m-fenix-reddit

browsertime-tp6m-fenix-reddit-nofis

browsertime-tp6m-geckoview-reddit

browsertime-tp6m-geckoview-reddit-nofis

browsertime-tp6m-live-chrome-m-reddit-nofis

browsertime-tp6m-live-fenix-reddit-nofis

browsertime-tp6m-live-geckoview-reddit-nofis

browsertime-tp6m-refbrow-reddit

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-reddit

browsertime-tp6-firefox-reddit

browsertime-tp6-live-chrome-reddit

browsertime-tp6-live-firefox-reddit

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-reddit

browsertime-tp6-firefox-reddit

browsertime-tp6-live-chrome-reddit

browsertime-tp6-live-firefox-reddit

browsertime-tp6-live-safari-reddit

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-reddit

browsertime-tp6-firefox-reddit

browsertime-tp6-live-chrome-reddit

browsertime-tp6-live-firefox-reddit

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-reddit

browsertime-tp6-firefox-reddit

browsertime-tp6-live-chrome-reddit

browsertime-tp6-live-firefox-reddit

tumblr

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-linux-firefox-tumblr.manifest

  • playback version: 8.1.1

  • secondary url: https://www.tumblr.com/tagged/funny+cats?sort=top

  • test url: https://www.tumblr.com/dashboard

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-firefox-tumblr

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-firefox-tumblr

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-firefox-tumblr

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-tumblr

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-chrome-tumblr

browsertime-tp6-live-firefox-tumblr

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-firefox-tumblr

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-firefox-tumblr

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-tumblr

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-chrome-tumblr

browsertime-tp6-live-firefox-tumblr

browsertime-tp6-live-safari-tumblr

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-firefox-tumblr

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-tumblr

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-chrome-tumblr

browsertime-tp6-live-firefox-tumblr

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-firefox-tumblr

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-firefox-tumblr

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-tumblr

browsertime-tp6-firefox-tumblr

browsertime-tp6-live-chrome-tumblr

browsertime-tp6-live-firefox-tumblr

twitch

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm8-linux-firefox-twitch.manifest

  • playback version: 8.1.1

  • preferences: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true

  • secondary url: https://www.twitch.tv/gmashley

  • test url: https://www.twitch.tv/videos/894226211

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-twitch

browsertime-tp6-live-firefox-twitch

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-twitch

browsertime-tp6-live-firefox-twitch

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-twitch

browsertime-tp6-live-firefox-twitch

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-twitch

browsertime-tp6-firefox-twitch

browsertime-tp6-live-chrome-twitch

browsertime-tp6-live-firefox-twitch

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-twitch

browsertime-tp6-live-firefox-twitch

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-twitch

browsertime-tp6-live-firefox-twitch

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-twitch

browsertime-tp6-firefox-twitch

browsertime-tp6-live-chrome-twitch

browsertime-tp6-live-firefox-twitch

browsertime-tp6-live-safari-twitch

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-twitch

browsertime-tp6-live-firefox-twitch

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-twitch

browsertime-tp6-firefox-twitch

browsertime-tp6-live-chrome-twitch

browsertime-tp6-live-firefox-twitch

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-twitch

browsertime-tp6-live-firefox-twitch

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-twitch

browsertime-tp6-live-firefox-twitch

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-twitch

browsertime-tp6-firefox-twitch

browsertime-tp6-live-chrome-twitch

browsertime-tp6-live-firefox-twitch

twitter

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: false

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-twitter.manifest

  • playback version: 8.1.1

  • test url: https://twitter.com/BarackObama

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-firefox-twitter

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-firefox-twitter

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-firefox-twitter

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-chrome-twitter

browsertime-tp6-essential-custom-car-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-chrome-twitter

browsertime-tp6-live-firefox-twitter

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-firefox-twitter

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-firefox-twitter

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-chrome-twitter

browsertime-tp6-essential-custom-car-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-chrome-twitter

browsertime-tp6-live-firefox-twitter

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-firefox-twitter

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-chrome-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-chrome-twitter

browsertime-tp6-live-firefox-twitter

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-firefox-twitter

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-firefox-twitter

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-twitter

browsertime-tp6-essential-chrome-twitter

browsertime-tp6-essential-custom-car-twitter

browsertime-tp6-essential-firefox-twitter

browsertime-tp6-live-chrome-twitter

browsertime-tp6-live-firefox-twitter

wikia

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: false

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-wikia.manifest

  • playback version: 8.1.1

  • secondary url: https://marvel.fandom.com/wiki/Celestials

  • test url: https://marvel.fandom.com/wiki/Black_Panther

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-wikia

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-wikia

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-wikia

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-wikia

browsertime-tp6-firefox-wikia

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-wikia

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-wikia

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-wikia

browsertime-tp6-firefox-wikia

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-wikia

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-wikia

browsertime-tp6-firefox-wikia

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-wikia

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-wikia

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-wikia

browsertime-tp6-firefox-wikia

wikipedia

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-wikipedia.manifest

  • playback version: 8.1.1

  • secondary url: https://en.wikipedia.org/wiki/Joe_Biden

  • test url: https://en.wikipedia.org/wiki/Barack_Obama

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-wikipedia

browsertime-tp6m-fenix-wikipedia-nofis

browsertime-tp6m-geckoview-wikipedia

browsertime-tp6m-geckoview-wikipedia-nofis

browsertime-tp6m-live-fenix-wikipedia-nofis

browsertime-tp6m-live-geckoview-wikipedia-nofis

browsertime-tp6m-refbrow-wikipedia

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-wikipedia

browsertime-tp6m-chrome-m-wikipedia-nofis

browsertime-tp6m-fenix-wikipedia

browsertime-tp6m-fenix-wikipedia-nofis

browsertime-tp6m-geckoview-wikipedia

browsertime-tp6m-geckoview-wikipedia-nofis

browsertime-tp6m-live-chrome-m-wikipedia-nofis

browsertime-tp6m-live-fenix-wikipedia-nofis

browsertime-tp6m-live-geckoview-wikipedia-nofis

browsertime-tp6m-refbrow-wikipedia

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-chrome-wikipedia

browsertime-tp6-essential-custom-car-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-chrome-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-chrome-wikipedia

browsertime-tp6-essential-custom-car-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-chrome-wikipedia

browsertime-tp6-live-firefox-wikipedia

browsertime-tp6-live-safari-wikipedia

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-chrome-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-chrome-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-chrome-wikipedia

browsertime-tp6-essential-custom-car-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-chrome-wikipedia

browsertime-tp6-live-firefox-wikipedia

yahoo-mail

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: false

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm5-linux-firefox-yahoo-mail.manifest

  • playback version: 8.1.1

  • test url: https://mail.yahoo.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-chrome-yahoo-mail

browsertime-tp6-essential-custom-car-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-chrome-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-chrome-yahoo-mail

browsertime-tp6-essential-custom-car-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-chrome-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

browsertime-tp6-live-safari-yahoo-mail

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-chrome-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-chrome-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-yahoo-mail

browsertime-tp6-essential-chrome-yahoo-mail

browsertime-tp6-essential-custom-car-yahoo-mail

browsertime-tp6-essential-firefox-yahoo-mail

browsertime-tp6-live-chrome-yahoo-mail

browsertime-tp6-live-firefox-yahoo-mail

youtube

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: firefox, chrome, safari, custom-car

  • benchmark page: true

  • browser cycles: 25

  • expected: pass

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-youtube.manifest

  • playback version: 8.1.1

  • secondary url: https://www.youtube.com/watch?v=JrdEMERq8MA

  • test url: https://www.youtube.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-youtube

browsertime-tp6m-fenix-youtube-nofis

browsertime-tp6m-geckoview-youtube

browsertime-tp6m-geckoview-youtube-nofis

browsertime-tp6m-live-fenix-youtube-nofis

browsertime-tp6m-live-geckoview-youtube-nofis

browsertime-tp6m-refbrow-youtube

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-youtube

browsertime-tp6m-chrome-m-youtube-nofis

browsertime-tp6m-fenix-youtube

browsertime-tp6m-fenix-youtube-nofis

browsertime-tp6m-geckoview-youtube

browsertime-tp6m-geckoview-youtube-nofis

browsertime-tp6m-live-chrome-m-youtube-nofis

browsertime-tp6m-live-fenix-youtube-nofis

browsertime-tp6m-live-geckoview-youtube-nofis

browsertime-tp6m-refbrow-youtube

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-youtube

browsertime-tp6-firefox-youtube

browsertime-tp6-live-chrome-youtube

browsertime-tp6-live-firefox-youtube

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-youtube

browsertime-tp6-firefox-youtube

browsertime-tp6-live-chrome-youtube

browsertime-tp6-live-firefox-youtube

browsertime-tp6-live-safari-youtube

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-youtube

browsertime-tp6-firefox-youtube

browsertime-tp6-live-chrome-youtube

browsertime-tp6-live-firefox-youtube

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-youtube

browsertime-tp6-firefox-youtube

browsertime-tp6-live-chrome-youtube

browsertime-tp6-live-firefox-youtube

Interactive

Browsertime tests that interact with the webpage. Includes responsiveness tests as they make use of this support for navigation. These form of tests allow the specification of browsertime commands through the test manifest.

cnn-nav

Owner: PerfTest Team

Description: Navigates to cnn main page, then to the world sub-page.

  • accept zero vismet: true

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 10

  • expected: pass

  • gecko profile interval: 1

  • interactive: true

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-cnn-nav.manifest

  • playback version: 8.1.1

  • test cmds: [‘measure.start’, ‘landing’] [‘navigate’, ‘https://www.cnn.com’] [‘wait.byTime’, ‘4000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘world’] [‘click.byXpathAndWait’, ‘/html/body/div[5]/div/div/header/div/div[1]/div/div[2]/nav/ul/li[2]/a’] [‘wait.byTime’, ‘1000’] [‘measure.stop’, ‘’]

  • test url: https://www.cnn.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-cnn-nav

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-cnn-nav

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-cnn-nav

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-cnn-nav

browsertime-responsiveness-firefox-cnn-nav

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-cnn-nav

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-cnn-nav

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-cnn-nav

browsertime-responsiveness-firefox-cnn-nav

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-cnn-nav

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-cnn-nav

browsertime-responsiveness-firefox-cnn-nav

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-cnn-nav

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-cnn-nav

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-cnn-nav

browsertime-responsiveness-firefox-cnn-nav

facebook-nav

Owner: PerfTest Team

Description: Navigates to facebook, then the sub-pages friends, marketplace, groups.

  • accept zero vismet: true

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 10

  • expected: pass

  • gecko profile interval: 1

  • interactive: true

  • lower is better: true

  • page cycles: 25

  • page timeout: 90000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-windows-firefox-facebook-nav.manifest

  • playback version: 8.1.1

  • test cmds: [‘measure.start’, ‘landing’] [‘navigate’, ‘https://www.facebook.com/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘marketplace’] [‘navigate’, ‘https://www.facebook.com/marketplace’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘groups’] [‘navigate’, ‘https://www.facebook.com/groups/discover/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘friends’] [‘navigate’, ‘https://www.facebook.com/friends/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’]

  • test url: https://www.facebook.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-facebook-nav

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-facebook-nav

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-facebook-nav

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-facebook-nav

browsertime-responsiveness-firefox-facebook-nav

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-facebook-nav

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-facebook-nav

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-facebook-nav

browsertime-responsiveness-firefox-facebook-nav

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-facebook-nav

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-facebook-nav

browsertime-responsiveness-firefox-facebook-nav

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-facebook-nav

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-facebook-nav

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-facebook-nav

browsertime-responsiveness-firefox-facebook-nav

reddit-billgates-ama

Owner: PerfTest Team

Description: Navigates from the Bill Gates AMA to the Reddit members section.

  • accept zero vismet: true

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 10

  • expected: pass

  • gecko profile interval: 1

  • interactive: true

  • lower is better: true

  • page cycles: 25

  • page timeout: 240000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-windows-firefox-reddit-billgates-ama.manifest

  • playback version: 8.1.1

  • test cmds: [‘measure.start’, ‘billg-ama’] [‘navigate’, ‘https://www.reddit.com/r/IAmA/comments/m8n4vt/im_bill_gates_cochair_of_the_bill_and_melinda/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘members’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div[3]/div[2]/div/div[1]/div/div[4]/div[1]/div’] [‘wait.byTime’, ‘1000’] [‘measure.stop’, ‘’]

  • test url: https://www.reddit.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-ama

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-ama

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-ama

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-ama

browsertime-responsiveness-firefox-reddit-billgates-ama

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-ama

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-ama

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-ama

browsertime-responsiveness-firefox-reddit-billgates-ama

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-ama

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-ama

browsertime-responsiveness-firefox-reddit-billgates-ama

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-ama

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-ama

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-ama

browsertime-responsiveness-firefox-reddit-billgates-ama

reddit-billgates-post-1

Owner: PerfTest Team

Description: Navigates the thisisbillgates user starting at the main user page, then to the posts, comments, hot, and top sections.

  • accept zero vismet: true

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 10

  • expected: pass

  • gecko profile interval: 1

  • interactive: true

  • lower is better: true

  • page cycles: 25

  • page timeout: 90000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-windows-firefox-reddit-billgates-post.manifest

  • playback version: 8.1.1

  • test cmds: [‘measure.start’, ‘billg’] [‘navigate’, ‘https://www.reddit.com/user/thisisbillgates/’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘measure.start’, ‘posts’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[2]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘measure.start’, ‘comments’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘wait.byTime’, ‘500’]

  • test url: https://www.reddit.com/user/thisisbillgates/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-post-1

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-post-1

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-post-1

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-1

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-post-1

browsertime-responsiveness-firefox-reddit-billgates-post-1

reddit-billgates-post-2

Owner: PerfTest Team

Description: Navigates the thisisbillgates user starting at the main user page, then to the posts, comments, hot, and top sections.

  • accept zero vismet: true

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: firefox, chrome, safari

  • browser cycles: 10

  • expected: pass

  • gecko profile interval: 1

  • interactive: true

  • lower is better: true

  • page cycles: 25

  • page timeout: 90000

  • playback: mitmproxy

  • playback pageset manifest: mitm6-windows-firefox-reddit-billgates-post.manifest

  • playback version: 8.1.1

  • test cmds: [‘measure.start’, ‘billg’] [‘navigate’, ‘https://www.reddit.com/user/thisisbillgates/’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]’] [‘wait.byTime’, ‘500’] [‘measure.start’, ‘hot’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[2]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘measure.start’, ‘top’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[3]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘wait.byTime’, ‘500’]

  • test url: https://www.reddit.com/user/thisisbillgates/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-post-2

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-post-2

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-post-2

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-firefox-reddit-billgates-post-2

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-responsiveness-chrome-reddit-billgates-post-2

browsertime-responsiveness-firefox-reddit-billgates-post-2

Live

A set of test pages that are run as live sites instead of recorded versions. These tests are available on all browsers, on all platforms.

booking-sf

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://www.booking.com/hotel/us/edwardian-san-francisco.html

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-booking-sf-nofis

browsertime-tp6m-live-geckoview-booking-sf-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-booking-sf-nofis

browsertime-tp6m-live-fenix-booking-sf-nofis

browsertime-tp6m-live-geckoview-booking-sf-nofis

discord

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://discordapp.com/

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-discord-nofis

browsertime-tp6m-live-geckoview-discord-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-discord-nofis

browsertime-tp6m-live-fenix-discord-nofis

browsertime-tp6m-live-geckoview-discord-nofis

fashionbeans

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://fashionbeans.com/article/coolest-menswear-stores-in-the-world

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-fashionbeans-nofis

browsertime-tp6m-live-geckoview-fashionbeans-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-fashionbeans-nofis

browsertime-tp6m-live-fenix-fashionbeans-nofis

browsertime-tp6m-live-geckoview-fashionbeans-nofis

google-accounts

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://accounts.google.com

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-google-accounts-nofis

browsertime-tp6m-live-geckoview-google-accounts-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-google-accounts-nofis

browsertime-tp6m-live-fenix-google-accounts-nofis

browsertime-tp6m-live-geckoview-google-accounts-nofis

imdb-firefox

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://m.imdb.com/title/tt0083943/

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-imdb-firefox-nofis

browsertime-tp6m-live-geckoview-imdb-firefox-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-imdb-firefox-nofis

browsertime-tp6m-live-fenix-imdb-firefox-nofis

browsertime-tp6m-live-geckoview-imdb-firefox-nofis

medium-article

Owner: PerfTest Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-medium-article-nofis

browsertime-tp6m-live-geckoview-medium-article-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-medium-article-nofis

browsertime-tp6m-live-fenix-medium-article-nofis

browsertime-tp6m-live-geckoview-medium-article-nofis

people-article

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://people.com/amp-stories/royal-a-to-z/

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-people-article-nofis

browsertime-tp6m-live-geckoview-people-article-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-people-article-nofis

browsertime-tp6m-live-fenix-people-article-nofis

browsertime-tp6m-live-geckoview-people-article-nofis

reddit-thread

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://www.reddit.com/r/firefox/comments/7dkq03/its_been_a_while/

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-reddit-thread-nofis

browsertime-tp6m-live-geckoview-reddit-thread-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-reddit-thread-nofis

browsertime-tp6m-live-fenix-reddit-thread-nofis

browsertime-tp6m-live-geckoview-reddit-thread-nofis

rumble-fox

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://rumble.com/v3c44t-foxes-jumping-on-my-trampoline.html

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-rumble-fox-nofis

browsertime-tp6m-live-geckoview-rumble-fox-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-rumble-fox-nofis

browsertime-tp6m-live-fenix-rumble-fox-nofis

browsertime-tp6m-live-geckoview-rumble-fox-nofis

stackoverflow-question

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://stackoverflow.com/questions/927358/how-do-i-undo-the-most-recent-commits-in-git

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-stackoverflow-question-nofis

browsertime-tp6m-live-geckoview-stackoverflow-question-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-stackoverflow-question-nofis

browsertime-tp6m-live-fenix-stackoverflow-question-nofis

browsertime-tp6m-live-geckoview-stackoverflow-question-nofis

urbandictionary-define

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://urbandictionary.com/define.php?term=awesome%20sauce

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-urbandictionary-define-nofis

browsertime-tp6m-live-geckoview-urbandictionary-define-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-urbandictionary-define-nofis

browsertime-tp6m-live-fenix-urbandictionary-define-nofis

browsertime-tp6m-live-geckoview-urbandictionary-define-nofis

wikia-marvel

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • test url: https://marvel.wikia.com/wiki/Black_Panther

  • type: pageload

  • unit: ms

  • use live sites: true

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-wikia-marvel-nofis

browsertime-tp6m-live-geckoview-wikia-marvel-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-wikia-marvel-nofis

browsertime-tp6m-live-fenix-wikia-marvel-nofis

browsertime-tp6m-live-geckoview-wikia-marvel-nofis

Mobile

Page-load performance test suite on Android. The links direct to the actual websites that are being tested.

allrecipes

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-allrecipes.manifest

  • playback version: 8.1.1

  • test url: https://www.allrecipes.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-fenix-allrecipes-nofis

browsertime-tp6m-essential-geckoview-allrecipes-nofis

browsertime-tp6m-live-fenix-allrecipes-nofis

browsertime-tp6m-live-geckoview-allrecipes-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-chrome-m-allrecipes-nofis

browsertime-tp6m-essential-fenix-allrecipes-nofis

browsertime-tp6m-essential-geckoview-allrecipes-nofis

browsertime-tp6m-live-chrome-m-allrecipes-nofis

browsertime-tp6m-live-fenix-allrecipes-nofis

browsertime-tp6m-live-geckoview-allrecipes-nofis

amazon

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-amazon.manifest

  • playback version: 8.1.1

  • test url: https://www.amazon.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-amazon

browsertime-tp6m-fenix-amazon-nofis

browsertime-tp6m-geckoview-amazon

browsertime-tp6m-geckoview-amazon-nofis

browsertime-tp6m-live-fenix-amazon-nofis

browsertime-tp6m-live-geckoview-amazon-nofis

browsertime-tp6m-refbrow-amazon

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-amazon

browsertime-tp6m-chrome-m-amazon-nofis

browsertime-tp6m-fenix-amazon

browsertime-tp6m-fenix-amazon-nofis

browsertime-tp6m-geckoview-amazon

browsertime-tp6m-geckoview-amazon-nofis

browsertime-tp6m-live-chrome-m-amazon-nofis

browsertime-tp6m-live-fenix-amazon-nofis

browsertime-tp6m-live-geckoview-amazon-nofis

browsertime-tp6m-refbrow-amazon

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-chrome-amazon

browsertime-tp6-essential-custom-car-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-chrome-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-profiling-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-chrome-amazon

browsertime-tp6-essential-custom-car-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-chrome-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-live-safari-amazon

browsertime-tp6-profiling-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-chrome-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-chrome-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-amazon

browsertime-tp6-essential-chrome-amazon

browsertime-tp6-essential-custom-car-amazon

browsertime-tp6-essential-firefox-amazon

browsertime-tp6-live-chrome-amazon

browsertime-tp6-live-firefox-amazon

browsertime-tp6-webextensions-firefox-amazon

amazon-search

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-amazon-search.manifest

  • playback version: 8.1.1

  • test url: https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-fenix-amazon-search-nofis

browsertime-tp6m-essential-geckoview-amazon-search-nofis

browsertime-tp6m-live-fenix-amazon-search-nofis

browsertime-tp6m-live-geckoview-amazon-search-nofis

browsertime-tp6m-webextensions-fenix-amazon-search-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-chrome-m-amazon-search-nofis

browsertime-tp6m-essential-fenix-amazon-search-nofis

browsertime-tp6m-essential-geckoview-amazon-search-nofis

browsertime-tp6m-live-chrome-m-amazon-search-nofis

browsertime-tp6m-live-fenix-amazon-search-nofis

browsertime-tp6m-live-geckoview-amazon-search-nofis

browsertime-tp6m-webextensions-fenix-amazon-search-nofis

bild-de

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm8-android-fenix-bild-de.manifest

  • playback version: 8.1.1

  • test url: https://www.bild.de/sport/american-football/nfl/super-bowl-rekordquote-fuer-die-nfl-87139668.bild.html

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-bild-de

browsertime-tp6m-fenix-bild-de-nofis

browsertime-tp6m-geckoview-bild-de

browsertime-tp6m-geckoview-bild-de-nofis

browsertime-tp6m-live-fenix-bild-de-nofis

browsertime-tp6m-live-geckoview-bild-de-nofis

browsertime-tp6m-refbrow-bild-de

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-bild-de

browsertime-tp6m-chrome-m-bild-de-nofis

browsertime-tp6m-fenix-bild-de

browsertime-tp6m-fenix-bild-de-nofis

browsertime-tp6m-geckoview-bild-de

browsertime-tp6m-geckoview-bild-de-nofis

browsertime-tp6m-live-chrome-m-bild-de-nofis

browsertime-tp6m-live-fenix-bild-de-nofis

browsertime-tp6m-live-geckoview-bild-de-nofis

browsertime-tp6m-refbrow-bild-de

bing

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-bing.manifest

  • playback version: 8.1.1

  • test url: https://www.bing.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-bing

browsertime-tp6m-fenix-bing-nofis

browsertime-tp6m-geckoview-bing

browsertime-tp6m-geckoview-bing-nofis

browsertime-tp6m-live-fenix-bing-nofis

browsertime-tp6m-live-geckoview-bing-nofis

browsertime-tp6m-refbrow-bing

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-bing

browsertime-tp6m-chrome-m-bing-nofis

browsertime-tp6m-fenix-bing

browsertime-tp6m-fenix-bing-nofis

browsertime-tp6m-geckoview-bing

browsertime-tp6m-geckoview-bing-nofis

browsertime-tp6m-live-chrome-m-bing-nofis

browsertime-tp6m-live-fenix-bing-nofis

browsertime-tp6m-live-geckoview-bing-nofis

browsertime-tp6m-refbrow-bing

bing-search-restaurants

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-bing-search-restaurants.manifest

  • playback version: 8.1.1

  • test url: https://www.bing.com/search?q=restaurants+in+exton+pa+19341

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-bing-search-restaurants

browsertime-tp6m-fenix-bing-search-restaurants-nofis

browsertime-tp6m-geckoview-bing-search-restaurants

browsertime-tp6m-geckoview-bing-search-restaurants-nofis

browsertime-tp6m-live-fenix-bing-search-restaurants-nofis

browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis

browsertime-tp6m-refbrow-bing-search-restaurants

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-bing-search-restaurants

browsertime-tp6m-chrome-m-bing-search-restaurants-nofis

browsertime-tp6m-fenix-bing-search-restaurants

browsertime-tp6m-fenix-bing-search-restaurants-nofis

browsertime-tp6m-geckoview-bing-search-restaurants

browsertime-tp6m-geckoview-bing-search-restaurants-nofis

browsertime-tp6m-live-chrome-m-bing-search-restaurants-nofis

browsertime-tp6m-live-fenix-bing-search-restaurants-nofis

browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis

browsertime-tp6m-refbrow-bing-search-restaurants

booking

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-booking.manifest

  • playback version: 8.1.1

  • test url: https://www.booking.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-booking

browsertime-tp6m-fenix-booking-nofis

browsertime-tp6m-geckoview-booking

browsertime-tp6m-geckoview-booking-nofis

browsertime-tp6m-live-fenix-booking-nofis

browsertime-tp6m-live-geckoview-booking-nofis

browsertime-tp6m-refbrow-booking

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-booking

browsertime-tp6m-chrome-m-booking-nofis

browsertime-tp6m-fenix-booking

browsertime-tp6m-fenix-booking-nofis

browsertime-tp6m-geckoview-booking

browsertime-tp6m-geckoview-booking-nofis

browsertime-tp6m-live-chrome-m-booking-nofis

browsertime-tp6m-live-fenix-booking-nofis

browsertime-tp6m-live-geckoview-booking-nofis

browsertime-tp6m-refbrow-booking

cnn

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-cnn.manifest

  • playback version: 8.1.1

  • test url: https://cnn.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-cnn

browsertime-tp6m-fenix-cnn-nofis

browsertime-tp6m-geckoview-cnn

browsertime-tp6m-geckoview-cnn-nofis

browsertime-tp6m-live-fenix-cnn-nofis

browsertime-tp6m-live-geckoview-cnn-nofis

browsertime-tp6m-refbrow-cnn

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-cnn

browsertime-tp6m-chrome-m-cnn-nofis

browsertime-tp6m-fenix-cnn

browsertime-tp6m-fenix-cnn-nofis

browsertime-tp6m-geckoview-cnn

browsertime-tp6m-geckoview-cnn-nofis

browsertime-tp6m-live-chrome-m-cnn-nofis

browsertime-tp6m-live-fenix-cnn-nofis

browsertime-tp6m-live-geckoview-cnn-nofis

browsertime-tp6m-refbrow-cnn

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-chrome-cnn

browsertime-tp6-essential-custom-car-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-chrome-cnn

browsertime-tp6-essential-custom-car-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-chrome-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-cnn

browsertime-tp6-essential-chrome-cnn

browsertime-tp6-essential-custom-car-cnn

browsertime-tp6-essential-firefox-cnn

browsertime-tp6-live-sheriffed-firefox-cnn

cnn-ampstories

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-cnn-ampstories.manifest

  • playback version: 8.1.1

  • test url: https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-cnn-ampstories

browsertime-tp6m-fenix-cnn-ampstories-nofis

browsertime-tp6m-geckoview-cnn-ampstories

browsertime-tp6m-geckoview-cnn-ampstories-nofis

browsertime-tp6m-live-fenix-cnn-ampstories-nofis

browsertime-tp6m-live-geckoview-cnn-ampstories-nofis

browsertime-tp6m-refbrow-cnn-ampstories

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-cnn-ampstories

browsertime-tp6m-chrome-m-cnn-ampstories-nofis

browsertime-tp6m-fenix-cnn-ampstories

browsertime-tp6m-fenix-cnn-ampstories-nofis

browsertime-tp6m-geckoview-cnn-ampstories

browsertime-tp6m-geckoview-cnn-ampstories-nofis

browsertime-tp6m-live-chrome-m-cnn-ampstories-nofis

browsertime-tp6m-live-fenix-cnn-ampstories-nofis

browsertime-tp6m-live-geckoview-cnn-ampstories-nofis

browsertime-tp6m-refbrow-cnn-ampstories

dailymail

Owner: PerfTest Team

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-dailymail

browsertime-tp6m-fenix-dailymail-nofis

browsertime-tp6m-geckoview-dailymail

browsertime-tp6m-geckoview-dailymail-nofis

browsertime-tp6m-live-fenix-dailymail-nofis

browsertime-tp6m-live-geckoview-dailymail-nofis

browsertime-tp6m-refbrow-dailymail

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-dailymail

browsertime-tp6m-chrome-m-dailymail-nofis

browsertime-tp6m-fenix-dailymail

browsertime-tp6m-fenix-dailymail-nofis

browsertime-tp6m-geckoview-dailymail

browsertime-tp6m-geckoview-dailymail-nofis

browsertime-tp6m-live-chrome-m-dailymail-nofis

browsertime-tp6m-live-fenix-dailymail-nofis

browsertime-tp6m-live-geckoview-dailymail-nofis

browsertime-tp6m-refbrow-dailymail

ebay-kleinanzeigen

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-ebay-kleinanzeigen.manifest

  • playback version: 8.1.1

  • test url: https://m.ebay-kleinanzeigen.de

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-ebay-kleinanzeigen

browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis

browsertime-tp6m-geckoview-ebay-kleinanzeigen

browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis

browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis

browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis

browsertime-tp6m-refbrow-ebay-kleinanzeigen

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-ebay-kleinanzeigen

browsertime-tp6m-chrome-m-ebay-kleinanzeigen-nofis

browsertime-tp6m-fenix-ebay-kleinanzeigen

browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis

browsertime-tp6m-geckoview-ebay-kleinanzeigen

browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis

browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-nofis

browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis

browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis

browsertime-tp6m-refbrow-ebay-kleinanzeigen

ebay-kleinanzeigen-search

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-ebay-kleinanzeigen-search.manifest

  • playback version: 8.1.1

  • test url: https://m.ebay-kleinanzeigen.de/s-anzeigen/auf-zeit-wg-berlin/zimmer/c199-l3331

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-ebay-kleinanzeigen-search

browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-geckoview-ebay-kleinanzeigen-search

browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-refbrow-ebay-kleinanzeigen-search

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search

browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-fenix-ebay-kleinanzeigen-search

browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-geckoview-ebay-kleinanzeigen-search

browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis

browsertime-tp6m-refbrow-ebay-kleinanzeigen-search

espn

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-espn.manifest

  • playback version: 8.1.1

  • test url: http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-fenix-espn-nofis

browsertime-tp6m-essential-geckoview-espn-nofis

browsertime-tp6m-live-fenix-espn-nofis

browsertime-tp6m-live-geckoview-espn-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-chrome-m-espn-nofis

browsertime-tp6m-essential-fenix-espn-nofis

browsertime-tp6m-essential-geckoview-espn-nofis

browsertime-tp6m-live-chrome-m-espn-nofis

browsertime-tp6m-live-fenix-espn-nofis

browsertime-tp6m-live-geckoview-espn-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-espn

browsertime-tp6-firefox-espn

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-espn

browsertime-tp6-firefox-espn

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-espn

browsertime-tp6-firefox-espn

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-espn

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-espn

browsertime-tp6-firefox-espn

facebook

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • login: true

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-g5-fenix-facebook.manifest

  • playback version: 8.1.1

  • test url: https://m.facebook.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-fenix-facebook-nofis

browsertime-tp6m-live-geckoview-facebook-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-live-chrome-m-facebook-nofis

browsertime-tp6m-live-fenix-facebook-nofis

browsertime-tp6m-live-geckoview-facebook-nofis

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-facebook

browsertime-tp6-firefox-facebook

browsertime-tp6-live-chrome-facebook

browsertime-tp6-live-firefox-facebook

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-facebook

browsertime-tp6-firefox-facebook

browsertime-tp6-live-chrome-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-facebook

browsertime-tp6-firefox-facebook

browsertime-tp6-live-chrome-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-facebook

browsertime-tp6-live-firefox-facebook

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-facebook

browsertime-tp6-firefox-facebook

browsertime-tp6-live-chrome-facebook

browsertime-tp6-live-firefox-facebook

facebook-cristiano

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-facebook-cristiano.manifest

  • playback version: 8.1.1

  • test url: https://m.facebook.com/Cristiano

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-facebook-cristiano

browsertime-tp6m-fenix-facebook-cristiano-nofis

browsertime-tp6m-geckoview-facebook-cristiano

browsertime-tp6m-geckoview-facebook-cristiano-nofis

browsertime-tp6m-live-fenix-facebook-cristiano-nofis

browsertime-tp6m-live-geckoview-facebook-cristiano-nofis

browsertime-tp6m-refbrow-facebook-cristiano

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-facebook-cristiano

browsertime-tp6m-chrome-m-facebook-cristiano-nofis

browsertime-tp6m-fenix-facebook-cristiano

browsertime-tp6m-fenix-facebook-cristiano-nofis

browsertime-tp6m-geckoview-facebook-cristiano

browsertime-tp6m-geckoview-facebook-cristiano-nofis

browsertime-tp6m-live-chrome-m-facebook-cristiano-nofis

browsertime-tp6m-live-fenix-facebook-cristiano-nofis

browsertime-tp6m-live-geckoview-facebook-cristiano-nofis

browsertime-tp6m-refbrow-facebook-cristiano

google

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • login: true

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-g5-fenix-google.manifest

  • playback version: 8.1.1

  • test url: https://www.google.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-fenix-google-nofis

browsertime-tp6m-essential-geckoview-google-nofis

browsertime-tp6m-live-fenix-google-nofis

browsertime-tp6m-live-geckoview-google-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-chrome-m-google-nofis

browsertime-tp6m-essential-fenix-google-nofis

browsertime-tp6m-essential-geckoview-google-nofis

browsertime-tp6m-live-chrome-m-google-nofis

browsertime-tp6m-live-fenix-google-nofis

browsertime-tp6m-live-geckoview-google-nofis

google-maps

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-google-maps.manifest

  • playback version: 8.1.1

  • test url: https://www.google.com/maps?force=pwa

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-google-maps

browsertime-tp6m-fenix-google-maps-nofis

browsertime-tp6m-geckoview-google-maps

browsertime-tp6m-geckoview-google-maps-nofis

browsertime-tp6m-live-fenix-google-maps-nofis

browsertime-tp6m-live-geckoview-google-maps-nofis

browsertime-tp6m-refbrow-google-maps

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-google-maps

browsertime-tp6m-chrome-m-google-maps-nofis

browsertime-tp6m-fenix-google-maps

browsertime-tp6m-fenix-google-maps-nofis

browsertime-tp6m-geckoview-google-maps

browsertime-tp6m-geckoview-google-maps-nofis

browsertime-tp6m-live-chrome-m-google-maps-nofis

browsertime-tp6m-live-fenix-google-maps-nofis

browsertime-tp6m-live-geckoview-google-maps-nofis

browsertime-tp6m-refbrow-google-maps

google-search-restaurants

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • login: true

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-g5-fenix-google-search-restaurants.manifest

  • playback version: 8.1.1

  • test url: https://www.google.com/search?q=restaurants+near+me

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-google-search-restaurants

browsertime-tp6m-fenix-google-search-restaurants-nofis

browsertime-tp6m-geckoview-google-search-restaurants

browsertime-tp6m-geckoview-google-search-restaurants-nofis

browsertime-tp6m-live-fenix-google-search-restaurants-nofis

browsertime-tp6m-live-geckoview-google-search-restaurants-nofis

browsertime-tp6m-refbrow-google-search-restaurants

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-google-search-restaurants

browsertime-tp6m-chrome-m-google-search-restaurants-nofis

browsertime-tp6m-fenix-google-search-restaurants

browsertime-tp6m-fenix-google-search-restaurants-nofis

browsertime-tp6m-geckoview-google-search-restaurants

browsertime-tp6m-geckoview-google-search-restaurants-nofis

browsertime-tp6m-live-chrome-m-google-search-restaurants-nofis

browsertime-tp6m-live-fenix-google-search-restaurants-nofis

browsertime-tp6m-live-geckoview-google-search-restaurants-nofis

browsertime-tp6m-refbrow-google-search-restaurants

imdb

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-imdb.manifest

  • playback version: 8.1.1

  • test url: https://m.imdb.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-imdb

browsertime-tp6m-fenix-imdb-nofis

browsertime-tp6m-geckoview-imdb

browsertime-tp6m-geckoview-imdb-nofis

browsertime-tp6m-live-fenix-imdb-nofis

browsertime-tp6m-live-geckoview-imdb-nofis

browsertime-tp6m-refbrow-imdb

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-imdb

browsertime-tp6m-chrome-m-imdb-nofis

browsertime-tp6m-fenix-imdb

browsertime-tp6m-fenix-imdb-nofis

browsertime-tp6m-geckoview-imdb

browsertime-tp6m-geckoview-imdb-nofis

browsertime-tp6m-live-chrome-m-imdb-nofis

browsertime-tp6m-live-fenix-imdb-nofis

browsertime-tp6m-live-geckoview-imdb-nofis

browsertime-tp6m-refbrow-imdb

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imdb

browsertime-tp6-firefox-imdb

browsertime-tp6-live-chrome-imdb

browsertime-tp6-live-firefox-imdb

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imdb

browsertime-tp6-firefox-imdb

browsertime-tp6-live-chrome-imdb

browsertime-tp6-live-firefox-imdb

browsertime-tp6-live-safari-imdb

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imdb

browsertime-tp6-firefox-imdb

browsertime-tp6-live-chrome-imdb

browsertime-tp6-live-firefox-imdb

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-imdb

browsertime-tp6-live-firefox-imdb

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-imdb

browsertime-tp6-firefox-imdb

browsertime-tp6-live-chrome-imdb

browsertime-tp6-live-firefox-imdb

instagram

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • login: true

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm8-android-gve-instagram.manifest

  • playback version: 8.1.1

  • test url: https://www.instagram.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-instagram

browsertime-tp6m-fenix-instagram-nofis

browsertime-tp6m-geckoview-instagram

browsertime-tp6m-geckoview-instagram-nofis

browsertime-tp6m-live-fenix-instagram-nofis

browsertime-tp6m-live-geckoview-instagram-nofis

browsertime-tp6m-refbrow-instagram

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-instagram

browsertime-tp6m-chrome-m-instagram-nofis

browsertime-tp6m-fenix-instagram

browsertime-tp6m-fenix-instagram-nofis

browsertime-tp6m-geckoview-instagram

browsertime-tp6m-geckoview-instagram-nofis

browsertime-tp6m-live-chrome-m-instagram-nofis

browsertime-tp6m-live-fenix-instagram-nofis

browsertime-tp6m-live-geckoview-instagram-nofis

browsertime-tp6m-refbrow-instagram

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-chrome-instagram

browsertime-tp6-essential-custom-car-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-chrome-instagram

browsertime-tp6-live-firefox-instagram

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-chrome-instagram

browsertime-tp6-essential-custom-car-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-chrome-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-chrome-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-chrome-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-firefox-instagram

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-instagram

browsertime-tp6-essential-chrome-instagram

browsertime-tp6-essential-custom-car-instagram

browsertime-tp6-essential-firefox-instagram

browsertime-tp6-live-chrome-instagram

browsertime-tp6-live-firefox-instagram

microsoft-support

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-microsoft-support.manifest

  • playback version: 8.1.1

  • test url: https://support.microsoft.com/en-us

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-fenix-microsoft-support-nofis

browsertime-tp6m-essential-geckoview-microsoft-support-nofis

browsertime-tp6m-live-fenix-microsoft-support-nofis

browsertime-tp6m-live-geckoview-microsoft-support-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-chrome-m-microsoft-support-nofis

browsertime-tp6m-essential-fenix-microsoft-support-nofis

browsertime-tp6m-essential-geckoview-microsoft-support-nofis

browsertime-tp6m-live-chrome-m-microsoft-support-nofis

browsertime-tp6m-live-fenix-microsoft-support-nofis

browsertime-tp6m-live-geckoview-microsoft-support-nofis

reddit

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-reddit.manifest

  • playback version: 8.1.1

  • test url: https://www.reddit.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-reddit

browsertime-tp6m-fenix-reddit-nofis

browsertime-tp6m-geckoview-reddit

browsertime-tp6m-geckoview-reddit-nofis

browsertime-tp6m-live-fenix-reddit-nofis

browsertime-tp6m-live-geckoview-reddit-nofis

browsertime-tp6m-refbrow-reddit

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-reddit

browsertime-tp6m-chrome-m-reddit-nofis

browsertime-tp6m-fenix-reddit

browsertime-tp6m-fenix-reddit-nofis

browsertime-tp6m-geckoview-reddit

browsertime-tp6m-geckoview-reddit-nofis

browsertime-tp6m-live-chrome-m-reddit-nofis

browsertime-tp6m-live-fenix-reddit-nofis

browsertime-tp6m-live-geckoview-reddit-nofis

browsertime-tp6m-refbrow-reddit

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-reddit

browsertime-tp6-firefox-reddit

browsertime-tp6-live-chrome-reddit

browsertime-tp6-live-firefox-reddit

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-reddit

browsertime-tp6-firefox-reddit

browsertime-tp6-live-chrome-reddit

browsertime-tp6-live-firefox-reddit

browsertime-tp6-live-safari-reddit

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-reddit

browsertime-tp6-firefox-reddit

browsertime-tp6-live-chrome-reddit

browsertime-tp6-live-firefox-reddit

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-reddit

browsertime-tp6-live-firefox-reddit

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-reddit

browsertime-tp6-firefox-reddit

browsertime-tp6-live-chrome-reddit

browsertime-tp6-live-firefox-reddit

sina

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm8-android-fenix-sina.manifest

  • playback version: 8.1.1

  • test url: https://www.sina.com.cn/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-sina

browsertime-tp6m-fenix-sina-nofis

browsertime-tp6m-geckoview-sina

browsertime-tp6m-geckoview-sina-nofis

browsertime-tp6m-refbrow-sina

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-sina

browsertime-tp6m-chrome-m-sina-nofis

browsertime-tp6m-fenix-sina

browsertime-tp6m-fenix-sina-nofis

browsertime-tp6m-geckoview-sina

browsertime-tp6m-geckoview-sina-nofis

browsertime-tp6m-refbrow-sina

stackoverflow

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-stackoverflow.manifest

  • playback version: 8.1.1

  • test url: https://stackoverflow.com/

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-stackoverflow

browsertime-tp6m-fenix-stackoverflow-nofis

browsertime-tp6m-geckoview-stackoverflow

browsertime-tp6m-geckoview-stackoverflow-nofis

browsertime-tp6m-live-fenix-stackoverflow-nofis

browsertime-tp6m-live-geckoview-stackoverflow-nofis

browsertime-tp6m-refbrow-stackoverflow

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-stackoverflow

browsertime-tp6m-chrome-m-stackoverflow-nofis

browsertime-tp6m-fenix-stackoverflow

browsertime-tp6m-fenix-stackoverflow-nofis

browsertime-tp6m-geckoview-stackoverflow

browsertime-tp6m-geckoview-stackoverflow-nofis

browsertime-tp6m-live-chrome-m-stackoverflow-nofis

browsertime-tp6m-live-fenix-stackoverflow-nofis

browsertime-tp6m-live-geckoview-stackoverflow-nofis

browsertime-tp6m-refbrow-stackoverflow

wikipedia

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-wikipedia.manifest

  • playback version: 8.1.1

  • test url: https://en.m.wikipedia.org/wiki/Main_Page

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-wikipedia

browsertime-tp6m-fenix-wikipedia-nofis

browsertime-tp6m-geckoview-wikipedia

browsertime-tp6m-geckoview-wikipedia-nofis

browsertime-tp6m-live-fenix-wikipedia-nofis

browsertime-tp6m-live-geckoview-wikipedia-nofis

browsertime-tp6m-refbrow-wikipedia

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-wikipedia

browsertime-tp6m-chrome-m-wikipedia-nofis

browsertime-tp6m-fenix-wikipedia

browsertime-tp6m-fenix-wikipedia-nofis

browsertime-tp6m-geckoview-wikipedia

browsertime-tp6m-geckoview-wikipedia-nofis

browsertime-tp6m-live-chrome-m-wikipedia-nofis

browsertime-tp6m-live-fenix-wikipedia-nofis

browsertime-tp6m-live-geckoview-wikipedia-nofis

browsertime-tp6m-refbrow-wikipedia

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-chrome-wikipedia

browsertime-tp6-essential-custom-car-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-chrome-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-chrome-wikipedia

browsertime-tp6-essential-custom-car-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-chrome-wikipedia

browsertime-tp6-live-firefox-wikipedia

browsertime-tp6-live-safari-wikipedia

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-chrome-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-chrome-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-firefox-wikipedia

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-bytecode-firefox-wikipedia

browsertime-tp6-essential-chrome-wikipedia

browsertime-tp6-essential-custom-car-wikipedia

browsertime-tp6-essential-firefox-wikipedia

browsertime-tp6-live-chrome-wikipedia

browsertime-tp6-live-firefox-wikipedia

youtube

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-youtube.manifest

  • playback version: 8.1.1

  • test url: https://m.youtube.com

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-fenix-youtube

browsertime-tp6m-fenix-youtube-nofis

browsertime-tp6m-geckoview-youtube

browsertime-tp6m-geckoview-youtube-nofis

browsertime-tp6m-live-fenix-youtube-nofis

browsertime-tp6m-live-geckoview-youtube-nofis

browsertime-tp6m-refbrow-youtube

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-chrome-m-youtube

browsertime-tp6m-chrome-m-youtube-nofis

browsertime-tp6m-fenix-youtube

browsertime-tp6m-fenix-youtube-nofis

browsertime-tp6m-geckoview-youtube

browsertime-tp6m-geckoview-youtube-nofis

browsertime-tp6m-live-chrome-m-youtube-nofis

browsertime-tp6m-live-fenix-youtube-nofis

browsertime-tp6m-live-geckoview-youtube-nofis

browsertime-tp6m-refbrow-youtube

test-linux1804-64-clang-trunk-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-linux1804-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-linux1804-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-linux1804-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-youtube

browsertime-tp6-firefox-youtube

browsertime-tp6-live-chrome-youtube

browsertime-tp6-live-firefox-youtube

test-macosx1015-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-macosx1015-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-macosx1015-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-youtube

browsertime-tp6-firefox-youtube

browsertime-tp6-live-chrome-youtube

browsertime-tp6-live-firefox-youtube

browsertime-tp6-live-safari-youtube

test-windows10-32-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-windows10-32-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-youtube

browsertime-tp6-firefox-youtube

browsertime-tp6-live-chrome-youtube

browsertime-tp6-live-firefox-youtube

test-windows10-64-nightlyasrelease-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-windows10-64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-firefox-youtube

browsertime-tp6-live-firefox-youtube

test-windows10-64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6-chrome-youtube

browsertime-tp6-firefox-youtube

browsertime-tp6-live-chrome-youtube

browsertime-tp6-live-firefox-youtube

youtube-watch

Owner: PerfTest Team

  • alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint

  • alert threshold: 2.0

  • apps: geckoview, fenix, refbrow, chrome-m

  • benchmark page: true

  • browser cycles: 15

  • expected: pass

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy-android

  • playback pageset manifest: mitm6-android-fenix-youtube-watch.manifest

  • playback version: 8.1.1

  • test url: https://www.youtube.com/watch?v=COU5T-Wafa4

  • type: pageload

  • unit: ms

  • use live sites: false

  • Test Task:

test-android-hw-a51-11-0-aarch64-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-fenix-youtube-watch-nofis

browsertime-tp6m-essential-geckoview-youtube-watch-nofis

browsertime-tp6m-live-fenix-youtube-watch-nofis

browsertime-tp6m-live-geckoview-youtube-watch-nofis

test-android-hw-a51-11-0-aarch64-shippable-qr/opt

Test Name

mozilla-central

autoland

mozilla-release

mozilla-beta

browsertime-tp6m-essential-chrome-m-youtube-watch-nofis

browsertime-tp6m-essential-fenix-youtube-watch-nofis

browsertime-tp6m-essential-geckoview-youtube-watch-nofis

browsertime-tp6m-live-chrome-m-youtube-watch-nofis

browsertime-tp6m-live-fenix-youtube-watch-nofis

browsertime-tp6m-live-geckoview-youtube-watch-nofis

Scenario

Tests that perform a specific action (a scenario), i.e. idle application, idle application in background, etc.

idle

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: fenix, geckoview, refbrow

  • expected: pass

  • lower is better: true

  • measure: fakeMeasure

  • page cycles: 1

  • page timeout: 1320000

  • scenario time: 1200000

  • test url: about:blank

  • type: scenario

  • unit: scenarioComplete

idle-bg

Owner: PerfTest Team

  • alert threshold: 2.0

  • apps: fenix, geckoview, refbrow

  • browsertime args: –browsertime.scenario_time=60000 –browsertime.background_app=false

  • expected: pass

  • lower is better: true

  • measure: fakeMeasure

  • page cycles: 1

  • page timeout: 1320000

  • scenario time: 1200000

  • test url: about:blank

  • type: scenario

  • unit: scenarioComplete

Unittests

These tests aren’t used in standard testing, they are only used in the Raptor unit tests (they are similar to raptor-tp6 tests though).

test-page-1

Owner: PerfTest Team

  • alert on: fcp, loadtime

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • gecko profile entries: 14000000

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-test-page-1.manifest

  • playback version: 8.1.1

  • test url: https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1

  • type: pageload

  • unit: ms

test-page-2

Owner: PerfTest Team

  • alert on: fcp, loadtime

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • gecko profile entries: 14000000

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-test-page-2.manifest

  • playback version: 8.1.1

  • test url: https://www.facebook.com

  • type: pageload

  • unit: ms

test-page-3

Owner: PerfTest Team

  • alert on: fcp, loadtime

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • gecko profile entries: 14000000

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-test-page-3.manifest

  • playback version: 8.1.1

  • test url: https://www.google.com/search?hl=en&q=barack+obama&cad=h

  • type: pageload

  • unit: ms

test-page-4

Owner: PerfTest Team

  • alert on: fcp, loadtime

  • alert threshold: 2.0

  • apps: firefox

  • expected: pass

  • gecko profile entries: 14000000

  • gecko profile interval: 1

  • lower is better: true

  • page cycles: 25

  • page timeout: 60000

  • playback: mitmproxy

  • playback pageset manifest: mitm7-linux-firefox-test-page-4.manifest

  • playback version: 8.1.1

  • test url: https://www.youtube.com

  • type: pageload

  • unit: ms