Raptor¶

Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, and Chrome.

Contact: Dave Hunt [:davehunt]
Source code: https://searchfox.org/mozilla-central/source/testing/raptor
Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor

Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) “scenario”-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).

Locally, Raptor can be invoked with the following command:

./mach raptor

We’re in the process of migrating away from webextension to browsertime. Currently, raptor supports both of them, but at the end of the migration, the support for webextension will be removed.

Raptor tests
- Benchmarks
- Custom
- Desktop
- Interactive
- Live
- Mobile
- Scenario
- Unittests

Raptor tests ¶

The following documents all testing we have for Raptor.

Benchmarks ¶

Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see Updating Benchmark Tests.

ares6

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 4
page timeout: 270000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/ARES-6/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	✅	✅
browsertime-benchmark-safari-ares6	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	✅	✅

assorted-dom

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 2000000
gecko profile interval: 1
lower is better: true
page cycles: 1
page timeout: 60000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/assorted-dom
repository revision: 61332db584026b73e37066d717a162825408c36b
screen capture: true
test url: http://<host>:<port>/assorted/driver.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	✅	✅
browsertime-benchmark-safari-assorted-dom	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	✅	✅

jetstream2

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 4
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/JetStream2
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: false
subtest unit: score
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	✅	✅
browsertime-benchmark-safari-jetstream2	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	✅	✅

matrix-react-bench

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 30
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/matrix-react-bench
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/matrix_demo.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-chromium-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	✅	✅

motionmark-animometer

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 1
page timeout: 600000
test url: http://<host>:<port>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=Animometer&raptor=true&oskey={platform}
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	✅	✅	✅	✅
browsertime-benchmark-safari-motionmark-animometer	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer	✅	✅	✅	✅

motionmark-htmlsuite

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 600000
test url: http://<host>:<port>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=HTMLsuite&raptor=true&oskey={platform}
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	✅	✅	✅	✅
browsertime-benchmark-safari-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite	✅	✅	✅	✅

speedometer

Owner: SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 180000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅
browsertime-benchmark-safari-speedometer	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

Owner: SpiderMonkey Team

alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅
browsertime-benchmark-safari-speedometer	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	✅	✅

speedometer3

Owner: Performance Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browsertime args: –browsertime.speedometer_iterations=5
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 180000
repository: https://github.com/WebKit/Speedometer
repository revision: f16557016d2a0bd8f512611c34cc6538afdde121
submetric summary method: median
subtest lower is better: true
subtest name filters: tests/,s3/
subtest unit: ms
test script: speedometer3.js
test summary: flatten
test url: http://<host>:<port>/InteractiveRunner.html
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer3-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-speedometer3-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌
browsertime-benchmark-safari-speedometer3	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

Owner: Performance Team

alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m
browsertime args: –browsertime.speedometer_iterations=5
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
repository: https://github.com/WebKit/Speedometer
repository revision: f16557016d2a0bd8f512611c34cc6538afdde121
submetric summary method: median
subtest lower is better: true
subtest name filters: tests/,s3/
subtest unit: ms
test script: speedometer3.js
test summary: flatten
test url: http://<host>:<port>/InteractiveRunner.html
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer3-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-speedometer3-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌
browsertime-benchmark-safari-speedometer3	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	✅	❌

stylebench

Owner: :emelio and Layout Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 120000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/StyleBench/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	✅	✅
browsertime-benchmark-safari-stylebench	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	✅	✅

sunspider

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 55000
test url: http://<host>:<port>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	✅	✅
browsertime-benchmark-safari-sunspider	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	✅	✅

twitch-animation

Owner: :jrmuizel

alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 1
page timeout: 2000000
perfstats: true
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/twitch-animation
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	✅	✅	✅	✅

unity-webgl

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: geckoview, refbrow, fenix, chrome-m
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 1
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌
browsertime-benchmark-safari-unity-webgl	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-nofis	✅	✅	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌
browsertime-benchmark-safari-unity-webgl	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	✅	✅	❌

wasm-godot

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	✅	❌

wasm-godot-baseline

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	✅	❌

wasm-godot-optimizing

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	✅	❌

wasm-misc

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	✅	❌

wasm-misc-baseline

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	✅	❌

wasm-misc-optimizing

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	✅	❌

webaudio

Owner: :padenot and Media Team

alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 360000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
test url: http://<host>:<port>/webaudio/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	✅	✅

youtube-playback-av1-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-av1-sfr	✅	❌	✅	❌

youtube-playback-h264-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis	✅	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	✅	❌

youtube-playback-hfr

Owner: PerfTest Team

alert on: H2641080p60fps@1X_dropped_frames, H264720p60fps@1X_dropped_frames
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-nofis	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-nofis	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-nofis	✅	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	✅	❌

youtube-playback-vp9-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	✅	❌

youtube-playback-widevine-h264-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	✅	❌

youtube-playback-widevine-hfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	✅	❌

youtube-playback-widevine-vp9-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	✅	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	✅	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	✅	❌

Custom ¶

Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.

constant-regression

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari, geckoview, fenix
browser cycles: 1
browsertime args: –browsertime.constant_value=1000
custom data: true
expected: pass
fore window: 1
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
max back window: 3
min back window: 2
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest unit: ms
test script: constant_regression_test.js
test summary: flatten
test url: None
type: pageload
unit: score
use live sites: true
Test Task:

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-regression-tests-firefox-constant-regression	❌	✅	❌	❌

grandprix

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 1
browsertime args: –browsertime.grandprix_iterations=25
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest name filters: tests/,iterations/
subtest unit: ms
test script: grandprix.js
test summary: flatten
test url: None
type: pageload
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-grandprix-firefox-grandprix	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-grandprix-firefox-grandprix	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-grandprix-chrome-grandprix	❌	❌	❌	❌
browsertime-grandprix-chromium-grandprix	❌	❌	❌	❌
browsertime-grandprix-firefox-grandprix	✅	✅	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-grandprix-chrome-grandprix	❌	❌	❌	❌
browsertime-grandprix-chromium-grandprix	❌	❌	❌	❌
browsertime-grandprix-firefox-grandprix	✅	✅	❌	❌
browsertime-grandprix-safari-grandprix	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-grandprix-firefox-grandprix	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-grandprix-chrome-grandprix	❌	❌	❌	❌
browsertime-grandprix-chromium-grandprix	❌	❌	❌	❌
browsertime-grandprix-firefox-grandprix	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-grandprix-firefox-grandprix	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-grandprix-chrome-grandprix	❌	❌	❌	❌
browsertime-grandprix-chromium-grandprix	❌	❌	❌	❌
browsertime-grandprix-firefox-grandprix	✅	✅	❌	❌

process-switch

Owner: PerfTest Team

accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
browsertime args: –pageCompleteWaitTime=1000 –pageCompleteCheckInactivity=true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-proc-switch.manifest
playback version: 5.1.1
test script: process_switch.js
test url: https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

welcome

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-welcome.manifest
playback version: 8.1.1
test script: welcome.js
test url: about:welcome
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

Desktop ¶

Tests for page-load performance. The links direct to the actual websites that are being tested.

amazon

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-amazon.manifest
playback version: 8.1.1
secondary url: https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3
test url: https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-chrome-m-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon	✅	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-safari-amazon	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon	✅	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	✅	✅
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌

bing-search

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-bing-search.manifest
playback version: 8.1.1
test url: https://www.bing.com/search?q=barack+obama
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-safari-bing-search	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

buzzfeed

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-buzzfeed.manifest
playback version: 8.1.1
secondary url: https://www.buzzfeed.com/quizzes
test url: https://www.buzzfeed.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	✅	✅

cnn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-cnn.manifest
playback version: 8.1.1
secondary url: https://www.cnn.com/weather
test url: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-chrome-m-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	✅	✅
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

ebay

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-ebay.manifest
playback version: 8.1.1
secondary url: https://www.ebay.com/deals
test url: https://www.ebay.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	✅	✅
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	✅	✅
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-safari-ebay	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	✅	✅
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

espn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-espn.manifest
playback version: 8.1.1
secondary url: https://www.espn.com/nba/draft/news
test url: http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-chromium-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	✅	✅

expedia

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-expedia.manifest
playback version: 8.1.1
secondary url: https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1
test url: https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-expedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-expedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-expedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-chromium-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	✅	✅

facebook

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-facebook.manifest
playback version: 8.1.1
secondary url: https://www.facebook.com/marketplace/?ref=bookmark
test url: https://www.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	✅	✅
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	✅	✅
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-safari-facebook	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	✅	✅
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

fandom

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-fandom.manifest
playback version: 8.1.1
test url: https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	✅	✅
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

google-docs

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page complete wait time: 8000
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-google-docs.manifest
playback version: 8.1.1
secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview
test url: https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-safari-google-docs	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

google-mail

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-google-mail.manifest
playback version: 8.1.1
test url: https://mail.google.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

google-search

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-google-search.manifest
playback version: 8.1.1
test url: https://www.google.com/search?hl=en&q=barack+obama&cad=h
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-safari-google-search	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

google-slides

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-google-slides.manifest
playback version: 6.0.2
secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview
test url: https://docs.google.com/presentation/d/1Ici0ceWwpFvmIb3EmKeWSq_vAQdmmdFcWqaiLqUkJng/edit?usp=sharing
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	✅	✅	✅	✅
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	✅	✅	✅	✅
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-safari-google-slides	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	✅	✅	✅	✅
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	✅	✅	✅	✅
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

imdb

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-imdb.manifest
playback version: 8.1.1
secondary url: https://www.imdb.com/title/tt0084967/episodes/?ref_=tt_ov_epl
test url: https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-chrome-m-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	✅	✅	✅	✅
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	✅	✅	✅	✅
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-safari-imdb	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	✅	✅	✅	✅
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

imgur

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-imgur.manifest
playback version: 8.1.1
preferences: {“media.autoplay.default”: 5, “media.autoplay.ask-permission”: true, “media.autoplay.blocking_policy”: 1, “media.autoplay.block-webaudio”: true, “media.allowed-to-play.enabled”: false, “media.block-autoplay-until-in-foreground”: true}
secondary url: https://imgur.com/gallery/rCXZUil
test url: https://imgur.com/gallery/m5tYJL6
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	✅	✅	✅	✅
browsertime-tp6-live-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	✅	✅	✅	✅
browsertime-tp6-live-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	✅	✅	✅	✅
browsertime-tp6-live-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

instagram

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-instagram.manifest
playback version: 8.1.1
secondary url: https://www.instagram.com/nobelprize_org/
test url: https://www.instagram.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-chrome-m-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	✅	✅	✅	✅
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	✅	✅	✅	✅
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	✅	✅	✅	✅
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	✅	✅	✅	✅

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-linkedin.manifest
playback version: 8.1.1
secondary url: https://www.linkedin.com/in/thommy-harris-hk-385723106/
test url: https://www.linkedin.com/feed/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	✅	✅	✅	✅
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	✅	✅	✅	✅
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-safari-linkedin	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	✅	✅	✅	✅
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

microsoft

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-microsoft.manifest
playback version: 8.1.1
secondary url: https://support.microsoft.com/en-us
test url: https://www.microsoft.com/en-us/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	✅	✅	✅	✅
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	✅	✅	✅	✅
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-safari-microsoft	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	✅	✅	✅	✅
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

netflix

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-netflix.manifest
playback version: 8.1.1
secondary url: https://www.netflix.com/title/699257
test url: https://www.netflix.com/title/80117263
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	✅	✅	✅	✅
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	✅	✅	✅	✅
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-chromium-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

nytimes

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-nytimes.manifest
playback version: 8.1.1
secondary url: https://www.nytimes.com/section/opinion/columnists
test url: https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-nytimes-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-nytimes-nofis	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-nytimes-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-nytimes-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-nytimes-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-chromium-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-chromium-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-chromium-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-chromium-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	✅	✅	✅	✅

office

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-office.manifest
playback version: 8.1.1
secondary url: https://www.office.com/
test url: https://www.office.com/launch/powerpoint?auth=1
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-chromium-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-chromium-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-chromium-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-chromium-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	✅	✅	✅	✅

outlook

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-live.manifest
playback version: 8.1.1
test url: https://outlook.live.com/mail/inbox
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	✅	✅	✅	✅
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	✅	✅	✅	✅
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-safari-outlook	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	✅	✅	✅	✅
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-chromium-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

paypal

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-paypal.manifest
playback version: 8.1.1
test url: https://www.paypal.com/myaccount/summary/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	✅	✅	✅	✅
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	✅	✅	✅	✅
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-safari-paypal	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	✅	✅	✅	✅
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-chromium-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-pinterest.manifest
playback version: 8.1.1
secondary url: https://www.pinterest.com/today/best/halloween-costumes-for-your-furry-friends/75787/
test url: https://pinterest.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	✅	✅	✅	✅
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	✅	✅	✅	✅
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-safari-pinterest	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	✅	✅	✅	✅
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-chromium-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-reddit.manifest
playback version: 8.1.1
secondary url: https://www.reddit.com/r/technology/
test url: https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-fenix-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-chrome-m-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-fenix-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	✅	✅	✅	✅
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	✅	✅	✅	✅
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-safari-reddit	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	✅	✅	✅	✅
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-chromium-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

tumblr

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-tumblr.manifest
playback version: 8.1.1
secondary url: https://www.tumblr.com/tagged/funny+cats?sort=top
test url: https://www.tumblr.com/dashboard
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-firefox-tumblr	✅	✅	✅	✅
browsertime-tp6-live-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-live-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-firefox-tumblr	✅	✅	✅	✅
browsertime-tp6-live-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-live-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-safari-tumblr	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-live-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-firefox-tumblr	✅	✅	✅	✅
browsertime-tp6-live-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-live-chromium-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

twitch

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-twitch.manifest
playback version: 8.1.1
preferences: {“media.autoplay.default”: 5, “media.autoplay.ask-permission”: true, “media.autoplay.blocking_policy”: 1, “media.autoplay.block-webaudio”: true, “media.allowed-to-play.enabled”: false, “media.block-autoplay-until-in-foreground”: true}
secondary url: https://www.twitch.tv/gmashley
test url: https://www.twitch.tv/videos/894226211
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-chromium-twitch	❌	❌	❌	❌
browsertime-tp6-firefox-twitch	✅	✅	✅	✅
browsertime-tp6-live-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-live-chromium-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-chromium-twitch	❌	❌	❌	❌
browsertime-tp6-firefox-twitch	✅	✅	✅	✅
browsertime-tp6-live-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-live-chromium-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-safari-twitch	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-chromium-twitch	❌	❌	❌	❌
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-live-chromium-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-chromium-twitch	❌	❌	❌	❌
browsertime-tp6-firefox-twitch	✅	✅	✅	✅
browsertime-tp6-live-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-live-chromium-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

twitter

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-twitter.manifest
playback version: 8.1.1
test url: https://twitter.com/BarackObama
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	✅	✅	✅	✅
browsertime-tp6-essential-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-essential-chromium-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	✅	✅	✅	✅
browsertime-tp6-live-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-live-chromium-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	✅	✅	✅	✅
browsertime-tp6-essential-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-essential-chromium-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	✅	✅	✅	✅
browsertime-tp6-live-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-live-chromium-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-safari-twitter	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-essential-chromium-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-live-chromium-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	✅	✅	✅	✅
browsertime-tp6-essential-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-essential-chromium-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	✅	✅	✅	✅
browsertime-tp6-live-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-live-chromium-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

wikia

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-wikia.manifest
playback version: 8.1.1
secondary url: https://marvel.fandom.com/wiki/Celestials
test url: https://marvel.fandom.com/wiki/Black_Panther
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-wikia	❌	❌	❌	❌
browsertime-tp6-chromium-wikia	❌	❌	❌	❌
browsertime-tp6-firefox-wikia	✅	✅	✅	✅

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-wikia	❌	❌	❌	❌
browsertime-tp6-chromium-wikia	❌	❌	❌	❌
browsertime-tp6-firefox-wikia	✅	✅	✅	✅

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-wikia	❌	❌	❌	❌
browsertime-tp6-chromium-wikia	❌	❌	❌	❌
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-wikia	❌	❌	❌	❌
browsertime-tp6-chromium-wikia	❌	❌	❌	❌
browsertime-tp6-firefox-wikia	✅	✅	✅	✅

wikipedia

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-wikipedia.manifest
playback version: 8.1.1
secondary url: https://en.wikipedia.org/wiki/Joe_Biden
test url: https://en.wikipedia.org/wiki/Barack_Obama
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a51-11-0-aarch64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-wikipedia	❌	❌	❌	❌
browsertime-tp6m-fenix-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-wikipedia	❌	❌	❌	❌
browsertime-tp6m-geckoview-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-wikipedia	❌	❌	❌	❌

**test-android-hw-a51-11-0-aarch64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-wikipedia	❌	❌	❌	❌
browsertime-tp6m-chrome-m-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-wikipedia	❌	❌	❌	❌
browsertime-tp6m-fenix-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-wikipedia	❌	❌	❌	❌
browsertime-tp6m-geckoview-wikipedia-nofis	✅	✅	❌	❌
browsertime-tp6m-live-chrome-m-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-wikipedia	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-linux1804-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	✅	✅	✅	✅
browsertime-tp6-essential-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-chromium-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	✅	✅	✅	✅
browsertime-tp6-live-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-chromium-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-macosx1015-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	✅	✅	✅	✅
browsertime-tp6-essential-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-chromium-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	✅	✅	✅	✅
browsertime-tp6-live-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-chromium-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-safari-wikipedia	❌	❌	❌	❌

**test-windows10-32-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-windows10-32-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-chromium-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-chromium-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-windows10-64-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-windows10-64-shippable-qr/opt**¶
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta

Raptor¶

Raptor tests¶

Benchmarks¶

Custom¶

Desktop¶

Raptor tests ¶

Benchmarks ¶

Custom ¶

Desktop ¶