Raptor¶

Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, and Chrome.

Contact: Dave Hunt [:davehunt]
Source code: https://searchfox.org/mozilla-central/source/testing/raptor
Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor

Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) “scenario”-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).

Locally, Raptor can be invoked with the following command:

./mach raptor

Raptor tests
- Benchmarks
- Custom
- Desktop
- Interactive
- Live
- Mobile
- Scenario
- Unittests

Raptor tests ¶

The following documents all testing we have for Raptor.

Benchmarks ¶

Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see Updating Benchmark Tests.

ares6

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 4
page timeout: 270000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/ARES-6/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	✅	✅
browsertime-benchmark-safari-ares6	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	✅	✅

assorted-dom

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 2000000
gecko profile interval: 1
lower is better: true
page cycles: 1
page timeout: 60000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/assorted-dom
repository revision: 61332db584026b73e37066d717a162825408c36b
screen capture: true
test url: http://<host>:<port>/assorted/driver.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	✅	✅
browsertime-benchmark-safari-assorted-dom	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	✅	✅

jetstream2

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 4
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/JetStream2
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: false
subtest unit: score
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	✅	✅
browsertime-benchmark-safari-jetstream2	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	✅	✅

matrix-react-bench

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
expose gecko profiler: true
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 30
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/matrix-react-bench
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/matrix_demo.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	✅	✅

motionmark-animometer

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 1
page timeout: 600000
test url: http://<host>:<port>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=Animometer&raptor=true&oskey={platform}
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	✅	✅	✅	✅
browsertime-benchmark-safari-motionmark-animometer	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	✅	✅	✅	✅

motionmark-htmlsuite

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 600000
test url: http://<host>:<port>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=HTMLsuite&raptor=true&oskey={platform}
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	✅	✅	✅	✅
browsertime-benchmark-safari-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	✅	✅	✅	✅

speedometer

Owner: SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
expected: pass
expose gecko profiler: true
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 600000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅
browsertime-benchmark-safari-speedometer	❌	❌	❌	❌

**test-macosx1300-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

Owner: SpiderMonkey Team

alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅
browsertime-benchmark-safari-speedometer	❌	❌	❌	❌

**test-macosx1300-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

speedometer3

Owner: Performance Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browsertime args: –browsertime.speedometer_iterations=5
custom data: true
expected: pass
expose gecko profiler: true
gecko profile entries: 14000000
gecko profile interval: 1
host from parent: false
lower is better: false
page cycles: 5
page timeout: 600000
repository: https://github.com/WebKit/Speedometer
repository revision: 36712deb57d45879f56dd2136f8a6ed8a22d964b
submetric summary method: median
subtest lower is better: true
subtest name filters: tests/,s3/
subtest unit: ms
test script: speedometer3.js
test summary: flatten
test url: http://<host>:<port>/InteractiveRunner.html
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	✅	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	✅	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

**test-macosx1300-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	✅	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

Owner: Performance Team

alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m
browsertime args: –browsertime.speedometer_iterations=5
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
host from parent: false
lower is better: false
page cycles: 5
page timeout: 420000
repository: https://github.com/WebKit/Speedometer
repository revision: 36712deb57d45879f56dd2136f8a6ed8a22d964b
submetric summary method: median
subtest lower is better: true
subtest name filters: tests/,s3/
subtest unit: ms
test script: speedometer3.js
test summary: flatten
test url: http://<host>:<port>/InteractiveRunner.html
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	✅	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	✅	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

**test-macosx1300-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	✅	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

stylebench

Owner: :emelio and Layout Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 140000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/StyleBench/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	✅	✅
browsertime-benchmark-safari-stylebench	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	✅	✅

sunspider

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 55000
test url: http://<host>:<port>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	✅	✅
browsertime-benchmark-safari-sunspider	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	✅	✅

twitch-animation

Owner: :jrmuizel

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 1
page timeout: 2000000
perfstats: true
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/twitch-animation
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	✅	✅	✅	✅

unity-webgl

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: geckoview, refbrow, fenix, chrome-m
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 1
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-unity-webgl-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌
browsertime-benchmark-safari-unity-webgl	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-unity-webgl-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌
browsertime-benchmark-safari-unity-webgl	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

wasm-godot

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	✅	❌
browsertime-benchmark-wasm-safari-wasm-godot	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	✅	❌

wasm-godot-baseline

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	✅	❌

wasm-godot-optimizing

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	✅	❌

wasm-misc

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
expose gecko profiler: true
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	✅	❌

wasm-misc-baseline

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	✅	❌

wasm-misc-optimizing

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	✅	❌

webaudio

Owner: :padenot and Media Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
expose gecko profiler: true
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 360000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
test url: http://<host>:<port>/webaudio/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	✅	✅
browsertime-benchmark-safari-webaudio	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	✅	✅

youtube-playback-av1-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose gecko profiler: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-av1-sfr	✅	❌	✅	❌

youtube-playback-h264-1080p30

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gather cpuTime: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

youtube-playback-h264-1080p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gather cpuTime: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

youtube-playback-h264-full-1080p30

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gather cpuTime: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

youtube-playback-h264-full-1080p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gather cpuTime: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

youtube-playback-h264-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose gecko profiler: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis	✅	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	✅	❌

youtube-playback-hfr

Owner: PerfTest Team

alert on: H2641080p60fps@1X_dropped_frames, H264720p60fps@1X_dropped_frames
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose gecko profiler: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-nofis	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-nofis	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-nofis	✅	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	✅	❌

youtube-playback-v9-1080p30

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gather cpuTime: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

youtube-playback-v9-1080p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gather cpuTime: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

youtube-playback-v9-full-1080p30

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gather cpuTime: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

youtube-playback-v9-full-1080p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose gecko profiler: true
gather cpuTime: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

youtube-playback-vp9-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose gecko profiler: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	✅	❌

youtube-playback-widevine-h264-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose gecko profiler: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	✅	❌

youtube-playback-widevine-hfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose gecko profiler: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	✅	❌

youtube-playback-widevine-vp9-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose gecko profiler: true
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	✅	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	✅	❌

Custom ¶

Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.

connect

Owner: Network Team

alert change type: absolute
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange
alert threshold: 10.0
apps: firefox
browser cycles: 3
cold: true
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 1
page timeout: 60000
test script: speculative-connect.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	✅	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	✅	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	✅	❌	❌

constant-regression

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari, geckoview, fenix
browser cycles: 1
browsertime args: –browsertime.constant_value=1500
custom data: true
expected: pass
fore window: 1
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
max back window: 3
min back window: 2
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest unit: ms
test script: constant_regression_test.js
test summary: flatten
test url: None
type: pageload
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-regression-tests-firefox-constant-regression	❌	✅	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-regression-tests-firefox-constant-regression	❌	✅	❌	❌

process-switch

Owner: PerfTest Team

accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
browsertime args: –pageCompleteWaitTime=1000 –pageCompleteCheckInactivity=true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-proc-switch.manifest
playback version: 5.1.1
test script: process_switch.js
test url: https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

throttled

Owner: Network Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange
alert threshold: 2.0
apps: firefox
browser cycles: 10
cold: true
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 1
page timeout: 60000
test script: throttled_pageload.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

upload

Owner: Network Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 1
browsertime args: –browsertime.upload_iterations=10 –firefox.preference=network.http.http3.enable:false –chrome.args disable-quic
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
test script: upload.js
test url: None
type: pageload
unit: mbps
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload	❌	❌	❌	❌
browsertime-upload-chromium-upload	❌	❌	❌	❌
browsertime-upload-firefox-upload	✅	✅	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload	❌	❌	❌	❌
browsertime-upload-chromium-upload	❌	❌	❌	❌
browsertime-upload-firefox-upload	✅	✅	❌	❌
browsertime-upload-safari-upload	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload	❌	❌	❌	❌
browsertime-upload-chromium-upload	❌	❌	❌	❌
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload	❌	❌	❌	❌
browsertime-upload-chromium-upload	❌	❌	❌	❌
browsertime-upload-firefox-upload	✅	✅	❌	❌

upload-h3

Owner: Network Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 1
browsertime args: –browsertime.upload_iterations=10 –firefox.preference=network.http.http3.enable:true
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
test script: upload.js
test url: None
type: pageload
unit: mbps
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload-h3	❌	❌	❌	❌
browsertime-upload-chromium-upload-h3	❌	❌	❌	❌
browsertime-upload-firefox-upload-h3	✅	✅	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload-h3	❌	❌	❌	❌
browsertime-upload-chromium-upload-h3	❌	❌	❌	❌
browsertime-upload-firefox-upload-h3	✅	✅	❌	❌
browsertime-upload-safari-upload-h3	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload-h3	❌	❌	❌	❌
browsertime-upload-chromium-upload-h3	❌	❌	❌	❌
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload-h3	❌	❌	❌	❌
browsertime-upload-chromium-upload-h3	❌	❌	❌	❌
browsertime-upload-firefox-upload-h3	✅	✅	❌	❌

welcome

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-welcome.manifest
playback version: 8.1.1
test script: welcome.js
test url: about:welcome
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

Desktop ¶

Tests for page-load performance. The links direct to the actual websites that are being tested.

amazon

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-amazon.manifest
playback version: 8.1.1
secondary url: https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3
test url: https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-chrome-m-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon	✅	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-safari-amazon	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

bing-search

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-bing-search.manifest
playback version: 8.1.1
test url: https://www.bing.com/search?q=barack+obama
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-safari-bing-search	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

buzzfeed

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-buzzfeed.manifest
playback version: 8.1.1
secondary url: https://www.buzzfeed.com/quizzes
test url: https://www.buzzfeed.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	✅	✅

cnn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-cnn.manifest
playback version: 8.1.1
secondary url: https://www.cnn.com/weather
test url: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-chrome-m-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

ebay

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-ebay.manifest
playback version: 8.1.1
secondary url: https://www.ebay.com/deals
test url: https://www.ebay.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	✅	✅
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	✅	✅
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-safari-ebay	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	✅	✅
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

espn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-espn.manifest
playback version: 8.1.1
secondary url: https://www.espn.com/nba/draft/news
test url: http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	✅	✅

expedia

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-expedia.manifest
playback version: 8.1.1
secondary url: https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1
test url: https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-expedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-expedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-expedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	✅	✅

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	✅	✅

facebook

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-facebook.manifest
playback version: 8.1.1
secondary url: https://www.facebook.com/marketplace/?ref=bookmark
test url: https://www.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	✅	✅
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	✅	✅
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	✅	✅
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

fandom

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-fandom.manifest
playback version: 8.1.1
test url: https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-safari-fandom	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

google-docs

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page complete wait time: 8000
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-google-docs.manifest
playback version: 8.1.1
secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview
test url: https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-safari-google-docs	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

google-mail

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, custom-car
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-google-mail.manifest
playback version: 8.1.1
test url: https://mail.google.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-macosx1015-64-nightlyasrelease-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-macosx1015-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

Raptor¶

Raptor tests¶

Benchmarks¶

Custom¶

Desktop¶

Raptor tests ¶

Benchmarks ¶

Custom ¶

Desktop ¶