Raptor¶

Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, and Chrome.

Contact: Dave Hunt [:davehunt]
Source code: https://searchfox.org/mozilla-central/source/testing/raptor
Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor

Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) “scenario”-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).

Locally, Raptor can be invoked with the following command:

./mach raptor

We’re in the process of migrating away from webextension to browsertime. Currently, raptor supports both of them, but at the end of the migration, the support for webextension will be removed.

Raptor tests
- Benchmarks
- Custom
- Desktop
- Interactive
- Live
- Mobile
- Scenario
- Unittests

Raptor tests ¶

The following documents all testing we have for Raptor.

Benchmarks ¶

Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI.

ares6

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 4
page timeout: 270000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/ARES-6/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	✅	✅

assorted-dom

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
fetch task: assorted-dom
gecko profile entries: 2000000
gecko profile interval: 1
lower is better: true
page cycles: 1
page timeout: 60000
screen capture: true
test url: http://<host>:<port>/assorted-dom/assorted/driver.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	✅	✅

jetstream2

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
fetch task: jetstream2
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 4
page timeout: 2000000
subtest lower is better: false
subtest unit: score
test url: http://<host>:<port>/JetStream2/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	✅	✅

matrix-react-bench

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
fetch task: matrix-react-bench
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 30
page timeout: 2000000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/matrix-react-bench/matrix_demo.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	✅	✅

motionmark-animometer

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 1
page timeout: 600000
test url: http://<host>:<port>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=Animometer&raptor=true&oskey={platform}
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	✅	✅	✅	✅

motionmark-htmlsuite

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 600000
test url: http://<host>:<port>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=HTMLsuite&raptor=true&oskey={platform}
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	✅	✅	✅	✅

speedometer

Owner: SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 180000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	✅	✅	✅	✅

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m	✅	❌	✅	❌
browsertime-speedometer-mobile-fenix	✅	❌	✅	❌
browsertime-speedometer-mobile-geckoview	✅	✅	✅	✅

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

Owner: SpiderMonkey Team

alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	✅	✅	✅	✅

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m	✅	❌	✅	❌
browsertime-speedometer-mobile-fenix	✅	❌	✅	❌
browsertime-speedometer-mobile-geckoview	✅	✅	✅	✅

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer	❌	❌	❌	❌
browsertime-power-geckoview-speedometer	❌	❌	❌	❌
browsertime-power-refbrow-speedometer	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

stylebench

Owner: :emelio and Layout Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 120000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/StyleBench/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	✅	✅

sunspider

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 55000
test url: http://<host>:<port>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	✅	✅

unity-webgl

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: geckoview, refbrow, fenix, chrome-m
expected: pass
fetch task: unity-webgl
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 1
page timeout: 420000
test url: http://<host>:<port>/unity-webgl/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	✅	✅	✅	✅
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m	✅	❌	✅	❌
browsertime-unity-webgl-mobile-fenix	✅	❌	✅	❌
browsertime-unity-webgl-mobile-geckoview	✅	✅	✅	✅
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
fetch task: unity-webgl
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
test url: http://<host>:<port>/unity-webgl/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	✅	✅	✅	✅
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m	✅	❌	✅	❌
browsertime-unity-webgl-mobile-fenix	✅	❌	✅	❌
browsertime-unity-webgl-mobile-geckoview	✅	✅	✅	✅
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

wasm-godot

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	✅	❌

wasm-godot-baseline

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	✅	❌

wasm-godot-optimizing

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	✅	❌

wasm-misc

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
fetch task: wasm-misc
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
test url: http://<host>:<port>/wasm-misc/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	✅	❌

wasm-misc-baseline

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
fetch task: wasm-misc
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}
test url: http://<host>:<port>/wasm-misc/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	✅	❌

wasm-misc-optimizing

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
fetch task: wasm-misc
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}
test url: http://<host>:<port>/wasm-misc/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	✅	❌

webaudio

Owner: :padenot and Media Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 360000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
test url: http://<host>:<port>/webaudio/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	✅	✅

youtube-playback-av1-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-av1-sfr	✅	❌	✅	❌

youtube-playback-h264-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr	✅	❌	✅	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr	✅	❌	✅	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	✅	❌

youtube-playback-hfr

Owner: PerfTest Team

alert on: H2641080p60fps@1X_dropped_frames, H264720p60fps@1X_dropped_frames
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr	✅	❌	✅	❌
browsertime-mobile-refbrow-youtube-playback-hfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr	✅	❌	✅	❌
browsertime-mobile-refbrow-youtube-playback-hfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	✅	❌

youtube-playback-vp9-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-vp9-sfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-vp9-sfr	✅	❌	✅	❌
browsertime-mobile-refbrow-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-vp9-sfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-vp9-sfr	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	✅	❌

youtube-playback-widevine-h264-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	✅	❌

youtube-playback-widevine-hfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	✅	❌

youtube-playback-widevine-vp9-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	✅	❌

Custom ¶

Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.

process-switch

Owner: PerfTest Team

accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
browsertime args: –pageCompleteWaitTime=1000 –pageCompleteCheckInactivity=true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-proc-switch.manifest
playback version: 5.1.1
test script: process_switch.js
test url: https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

welcome

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-welcome.manifest
playback version: 5.1.1
test script: welcome.js
test url: about:welcome
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

Desktop ¶

Tests for page-load performance. The links direct to the actual websites that are being tested.

amazon

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-amazon.manifest
playback version: 7.0.4
secondary url: https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3
test url: https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	✅	✅	✅	✅
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	✅	✅	✅	✅
browsertime-tp6m-live-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-profiling-geckoview-amazon	✅	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon	✅	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

bing-search

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-bing-search.manifest
playback version: 5.1.1
test url: https://www.bing.com/search?q=barack+obama
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

buzzfeed

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-buzzfeed.manifest
playback version: 7.0.4
secondary url: https://www.buzzfeed.com/quizzes
test url: https://www.buzzfeed.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	✅	✅

cnn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-cnn.manifest
playback version: 7.0.4
secondary url: https://www.cnn.com/weather
test url: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	✅	✅	✅	✅
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	✅	✅	✅	✅
browsertime-tp6m-live-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

ebay

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-ebay.manifest
playback version: 7.0.4
secondary url: https://www.ebay.com/deals
test url: https://www.ebay.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	✅	✅
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	✅	✅
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	✅	✅
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

espn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-espn.manifest
playback version: 7.0.4
secondary url: https://www.espn.com/nba/draft/news
test url: http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn	✅	✅	✅	✅
browsertime-tp6m-essential-refbrow-espn	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-espn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn	✅	✅	✅	✅
browsertime-tp6m-essential-refbrow-espn	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-espn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-espn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	✅	✅

expedia

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-expedia.manifest
playback version: 7.0.4
secondary url: https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1
test url: https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-expedia	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-expedia	❌	❌	❌	❌
browsertime-tp6m-live-fenix-expedia	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-expedia	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-expedia	❌	❌	❌	❌
browsertime-tp6m-live-fenix-expedia	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-expedia	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-expedia	❌	❌	❌	❌
browsertime-tp6m-live-fenix-expedia	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	✅	✅

facebook

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-facebook.manifest
playback version: 6.0.2
secondary url: https://www.facebook.com/marketplace/?ref=bookmark
test url: https://www.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook	✅	✅	✅	✅
browsertime-tp6m-essential-refbrow-facebook	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-facebook	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook	✅	✅	✅	✅
browsertime-tp6m-essential-refbrow-facebook	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-facebook	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-facebook	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	✅	✅
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	✅	✅
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	✅	✅
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

fandom

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-fandom.manifest
playback version: 5.1.1
test url: https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

google-docs

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page complete wait time: 8000
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-google-docs.manifest
playback version: 7.0.4
secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview
test url: https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

google-docs-canvas

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-google-docs-canvas.manifest
playback version: 6.0.2
test url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-canvas	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-canvas	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-canvas	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-canvas	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-canvas	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-canvas	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-canvas	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-canvas	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-canvas	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-canvas	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-canvas	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-canvas	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas	✅	✅	✅	✅

google-mail

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-google-mail.manifest
playback version: 5.1.1
test url: https://mail.google.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

google-search

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-google-search.manifest
playback version: 5.1.1
test url: https://www.google.com/search?hl=en&q=barack+obama&cad=h
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

google-slides

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-google-slides.manifest
playback version: 6.0.2
secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview
test url: https://docs.google.com/presentation/d/1Ici0ceWwpFvmIb3EmKeWSq_vAQdmmdFcWqaiLqUkJng/edit?usp=sharing
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

imdb

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-imdb.manifest
playback version: 7.0.4
secondary url: https://www.imdb.com/title/tt0084967/episodes/?ref_=tt_ov_epl
test url: https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb	✅	✅	✅	✅
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-g5-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-g5-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-g5-refbrow-imdb	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-g5-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-g5-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-g5-geckoview-imdb	✅	✅	✅	✅
browsertime-tp6m-g5-refbrow-imdb	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb	✅	✅	✅	✅
browsertime-tp6m-live-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	✅	✅	✅	✅
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	✅	✅	✅	✅
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	✅	✅	✅	✅
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

imgur

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-imgur.manifest
playback version: 7.0.4
preferences: {“media.autoplay.default”: 5, “media.autoplay.ask-permission”: true, “media.autoplay.blocking_policy”: 1, “media.autoplay.block-webaudio”: true, “media.allowed-to-play.enabled”: false, “media.block-autoplay-until-in-foreground”: true}
secondary url: https://imgur.com/gallery/L13Ci
test url: https://imgur.com/gallery/m5tYJL6
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	✅	✅	✅	✅
browsertime-tp6-live-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	✅	✅	✅	✅
browsertime-tp6-live-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	✅	✅	✅	✅
browsertime-tp6-live-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

instagram

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-instagram.manifest
playback version: 6.0.2
secondary url: https://www.instagram.com/nobelprize_org/
test url: https://www.instagram.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram	✅	✅	✅	✅
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-g5-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-g5-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-g5-refbrow-instagram	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-g5-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-g5-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-g5-geckoview-instagram	✅	✅	✅	✅
browsertime-tp6m-g5-refbrow-instagram	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram	✅	✅	✅	✅
browsertime-tp6m-live-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	✅	✅	✅	✅

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-linkedin.manifest
playback version: 6.0.2
secondary url: https://www.linkedin.com/in/thommy-harris-hk-385723106/
test url: https://www.linkedin.com/feed/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	✅	✅	✅	✅
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	✅	✅	✅	✅
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	✅	✅	✅	✅
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

microsoft

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-microsoft.manifest
playback version: 7.0.4
secondary url: https://support.microsoft.com/en-us
test url: https://www.microsoft.com/en-us/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	✅	✅	✅	✅
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	✅	✅	✅	✅
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	✅	✅	✅	✅
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

netflix

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-netflix.manifest
playback version: 6.0.2
secondary url: https://www.netflix.com/title/699257
test url: https://www.netflix.com/title/80117263
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	✅	✅	✅	✅
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	✅	✅	✅	✅
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

nytimes

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-nytimes.manifest
playback version: 7.0.4
secondary url: https://www.nytimes.com/section/opinion/columnists
test url: https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-nytimes	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-nytimes	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-nytimes	❌	❌	❌	❌
browsertime-tp6m-live-fenix-nytimes	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-nytimes	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-nytimes	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-nytimes	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-nytimes	❌	❌	❌	❌
browsertime-tp6m-live-fenix-nytimes	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-nytimes	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-nytimes	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-nytimes	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-nytimes	❌	❌	❌	❌
browsertime-tp6m-live-fenix-nytimes	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-nytimes	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-chromium-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-chromium-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-chromium-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-chromium-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	✅	✅	✅	✅

office

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-office.manifest
playback version: 7.0.4
secondary url: https://www.office.com/
test url: https://www.office.com/launch/powerpoint?auth=1
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-chromium-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-chromium-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-chromium-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-chromium-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	✅	✅	✅	✅

outlook

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-live.manifest
playback version: 5.1.1
test url: https://outlook.live.com/mail/inbox
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	✅	✅	✅	✅
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	✅	✅	✅	✅
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	✅	✅	✅	✅
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

paypal

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-paypal.manifest
playback version: 5.1.1
test url: https://www.paypal.com/myaccount/summary/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	✅	✅	✅	✅
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	✅	✅	✅	✅
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	✅	✅	✅	✅
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-pinterest.manifest
playback version: 6.0.2
secondary url: https://www.pinterest.com/today/best/halloween-costumes-for-your-furry-friends/75787/
test url: https://pinterest.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	✅	✅	✅	✅
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	✅	✅	✅	✅
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	✅	✅	✅	✅
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-reddit.manifest
playback version: 6.0.2
secondary url: https://www.reddit.com/r/technology/
test url: https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit	✅	✅	✅	✅
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-g5-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-g5-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-g5-refbrow-reddit	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit	❌	❌	❌	❌

**test-android-hw-g5-7-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-g5-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-g5-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-g5-geckoview-reddit	✅	✅	✅	✅
browsertime-tp6m-g5-refbrow-reddit	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

**test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit	✅	✅	✅	✅
browsertime-tp6m-live-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

**test-android-hw-p2-8-0-arm7-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	✅	✅	✅	✅
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	✅	✅	✅	✅
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	✅	✅	✅	✅
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

tumblr

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-tumblr.manifest
playback version: 6.0.2
secondary url: https://www.tumblr.com/tagged/funny+cats?sort=top
test url: https://www.tumblr.com/dashboard
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-firefox-tumblr	✅	✅	✅	✅
browsertime-tp6-live-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-live-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-firefox-tumblr	✅	✅	✅	✅
browsertime-tp6-live-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-live-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-chromium-tumblr

Raptor¶

Raptor tests¶

Benchmarks¶

Custom¶

Desktop¶

Raptor tests ¶

Benchmarks ¶

Custom ¶

Desktop ¶