Raptor

Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, Chrome, Chrome for Android, Safari, and Safari Technology Preview.

Contact: Dave Hunt [:davehunt]
Source code: https://searchfox.org/mozilla-central/source/testing/raptor
Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor

Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) “scenario”-based tests, such as power, CPU, and memory-usage measurements on Android and Desktop.

Locally, Raptor can be invoked with the following command:

./mach raptor

Raptor tests 

The following documents all testing we have for Raptor.

Benchmarks 

Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see Updating Benchmark Tests.

ares6

Command to Run Locally

./mach raptor -t ares6

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/ares6.toml#16
lower is better: true
page cycles: 4
page timeout: 270000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/ARES-6/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	❌	❌
browsertime-benchmark-safari-ares6	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6	❌	❌	❌	❌

assorted-dom

Command to Run Locally

./mach raptor -t assorted-dom

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/assorted-dom.toml#15
lower is better: true
page cycles: 1
page timeout: 60000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/assorted-dom
repository revision: 61332db584026b73e37066d717a162825408c36b
screen capture: true
test url: http://<host>:<port>/assorted/driver.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	❌	❌
browsertime-benchmark-safari-assorted-dom	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom	❌	❌	❌	❌

jetstream2

Command to Run Locally

./mach raptor -t jetstream2

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: fenix, geckoview, chrome-m, cstm-car-m
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2-mobile.toml#16
lower is better: false
page cycles: 4
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/JetStream2
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: false
subtest unit: score
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-jetstream2-chrome-m-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream2-cstm-car-m-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream2-fenix-jetstream2	✅	❌	❌	❌
browsertime-benchmark-jetstream2-fenix-jetstream2-nofis	✅	❌	❌	❌
browsertime-benchmark-jetstream2-geckoview-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-jetstream2-fenix-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-fenix-jetstream2-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream2-geckoview-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2.toml#16
lower is better: false
page cycles: 4
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/JetStream2
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: false
subtest unit: score
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-jetstream2-chrome-m-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream2-cstm-car-m-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream2-fenix-jetstream2	✅	❌	❌	❌
browsertime-benchmark-jetstream2-fenix-jetstream2-nofis	✅	❌	❌	❌
browsertime-benchmark-jetstream2-geckoview-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-jetstream2-fenix-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-fenix-jetstream2-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream2-geckoview-jetstream2	❌	❌	❌	❌
browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2	❌	❌	❌	❌

jetstream3

Command to Run Locally

./mach raptor -t jetstream3

Owner: :jandem and spidermonkey team

alert threshold: 2.0
apps: firefox, chrome, safari, safari-tp, custom-car
expected: pass
expose browser profiler: true
expose chrome trace: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream3-desktop.toml#16
lower is better: false
page cycles: 1
page timeout: 2000000
repository: https://github.com/webkit/jetstream
repository revision: 6947a460f6b55ef5613c36263049ecf74c5ec1cd
subtest lower is better: true
subtest unit: ms
suite name: JetStream3.0
support class: jetstream3.py
test script: jetstream3.js
test url: http://<host>:<port>/
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-jetstream3-chrome-m-jetstream3	❌	❌	❌	❌
browsertime-benchmark-jetstream3-chrome-m-jetstream3-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream3-cstm-car-m-jetstream3	❌	❌	❌	❌
browsertime-benchmark-jetstream3-cstm-car-m-jetstream3-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream3-fenix-jetstream3	✅	✅	❌	❌
browsertime-benchmark-jetstream3-fenix-jetstream3-nofis	✅	✅	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-jetstream3-fenix-jetstream3	❌	❌	❌	❌
browsertime-benchmark-jetstream3-fenix-jetstream3-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream3	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream3	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream3	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream3	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream3	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream3	✅	✅	❌	❌
browsertime-benchmark-safari-jetstream3	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream3	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream3	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream3	✅	✅	❌	❌
browsertime-benchmark-safari-jetstream3	❌	❌	❌	❌
browsertime-benchmark-safari-tp-jetstream3	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream3	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream3	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream3	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

Owner: :jandem and spidermonkey team

alert threshold: 2.0
apps: chrome-m, cstm-car-m, fenix
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream3-mobile.toml#21
lower is better: false
page cycles: 1
page timeout: 2000000
preferences: dom.max_script_run_time=0
repository: https://github.com/webkit/jetstream
repository revision: 6947a460f6b55ef5613c36263049ecf74c5ec1cd
subtest lower is better: true
subtest unit: ms
suite name: JetStream3.0
support class: jetstream3.py
test script: jetstream3.js
test url: http://<host>:<port>/
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-jetstream3-chrome-m-jetstream3	❌	❌	❌	❌
browsertime-benchmark-jetstream3-chrome-m-jetstream3-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream3-cstm-car-m-jetstream3	❌	❌	❌	❌
browsertime-benchmark-jetstream3-cstm-car-m-jetstream3-nofis	❌	❌	❌	❌
browsertime-benchmark-jetstream3-fenix-jetstream3	✅	✅	❌	❌
browsertime-benchmark-jetstream3-fenix-jetstream3-nofis	✅	✅	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-jetstream3-fenix-jetstream3	❌	❌	❌	❌
browsertime-benchmark-jetstream3-fenix-jetstream3-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream3	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream3	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream3	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream3	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream3	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream3	✅	✅	❌	❌
browsertime-benchmark-safari-jetstream3	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream3	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream3	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream3	✅	✅	❌	❌
browsertime-benchmark-safari-jetstream3	❌	❌	❌	❌
browsertime-benchmark-safari-tp-jetstream3	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream3	❌	❌	❌	❌
browsertime-benchmark-custom-car-jetstream3	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream3	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream3	❌	❌	❌	❌

matrix-react-bench

Command to Run Locally

./mach raptor -t matrix-react-bench

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/matrix-react-bench.toml#16
lower is better: true
page cycles: 30
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/matrix-react-bench
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/matrix_demo.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-matrix-react-bench	❌	❌	❌	❌
browsertime-benchmark-firefox-matrix-react-bench	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-matrix-react-bench	❌	❌	❌	❌

motionmark-1-3

Command to Run Locally

./mach raptor -t motionmark-1-3

Owner: Graphics Team

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
browser cycles: 1
cold: true
expected: pass
expose browser profiler: true
expose chrome trace: true
gecko profile features: stackwalk,js,cpu,java,processcpu,memory
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#13
lower is better: false
page cycles: 1
page timeout: 600000
repository: https://github.com/webkit/motionmark
repository revision: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
subtest lower is better: false
subtest unit: score
suite name: MotionMark
support class: motionmark-1-3.py
test script: motionmark-1-3.js
test url: http://<host>:<port>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-1-3	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-1-3	✅	✅	❌	❌
browsertime-benchmark-safari-motionmark-1-3	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-1-3	✅	❌	❌	❌
browsertime-benchmark-safari-motionmark-1-3	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-1-3	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

Owner: Graphics Team

alert threshold: 2.0
apps: fenix, geckoview, chrome-m, cstm-car-m
browser cycles: 1
cold: true
expected: pass
expose browser profiler: true
gecko profile features: stackwalk,js,cpu,java,processcpu,memory
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#12
lower is better: false
page cycles: 1
page timeout: 600000
repository: https://github.com/webkit/motionmark
repository revision: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
subtest lower is better: false
subtest unit: score
suite name: MotionMark
support class: motionmark-1-3.py
test script: motionmark-1-3.js
test url: http://<host>:<port>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-1-3	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-1-3	✅	✅	❌	❌
browsertime-benchmark-safari-motionmark-1-3	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-1-3	✅	❌	❌	❌
browsertime-benchmark-safari-motionmark-1-3	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-1-3	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-1-3	❌	❌	❌	❌

motionmark-htmlsuite-1-3

Command to Run Locally

./mach raptor -t motionmark-htmlsuite-1-3

Owner: Graphics Team

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
browser cycles: 1
cold: true
expected: pass
expose browser profiler: true
expose chrome trace: true
gecko profile features: stackwalk,js,cpu,java,processcpu,memory
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#29
lower is better: false
page cycles: 1
page timeout: 600000
repository: https://github.com/webkit/motionmark
repository revision: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
subtest lower is better: false
subtest unit: score
suite name: HTML suite
support class: motionmark-1-3.py
test script: motionmark-1-3.js
test url: http://<host>:<port>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	✅	✅	❌	❌
browsertime-benchmark-safari-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	✅	❌	❌	❌
browsertime-benchmark-safari-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

Owner: Graphics Team

alert threshold: 2.0
apps: fenix, geckoview, chrome-m, cstm-car-m
browser cycles: 1
cold: true
expected: pass
expose browser profiler: true
gecko profile features: stackwalk,js,cpu,java,processcpu,memory
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#28
lower is better: false
page cycles: 1
page timeout: 600000
repository: https://github.com/webkit/motionmark
repository revision: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
subtest lower is better: false
subtest unit: score
suite name: HTML suite
support class: motionmark-1-3.py
test script: motionmark-1-3.js
test url: http://<host>:<port>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis	✅	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	✅	✅	❌	❌
browsertime-benchmark-safari-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	✅	❌	❌	❌
browsertime-benchmark-safari-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3	❌	❌	❌	❌

speedometer

Command to Run Locally

./mach raptor -t speedometer

Owner: SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, safari, safari-tp, custom-car
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile features: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,TaskController,StyleThread
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#19
lower is better: false
page cycles: 5
page timeout: 600000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m	✅	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix	✅	✅	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	✅	✅	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-p6-13-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-s24-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	❌	❌
browsertime-benchmark-safari-speedometer	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	❌	❌
browsertime-benchmark-safari-speedometer	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

Owner: SpiderMonkey Team

alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m, cstm-car-m
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile features: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,TaskController,StyleThread
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#19
lower is better: false
page cycles: 5
page timeout: 420000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m	✅	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix	✅	✅	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	✅	✅	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-p6-13-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-s24-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer-mobile-chrome-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer-mobile-geckoview-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	❌	❌
browsertime-benchmark-safari-speedometer	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	❌	❌
browsertime-benchmark-safari-speedometer	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer	❌	❌	❌	❌

speedometer3

Command to Run Locally

./mach raptor -t speedometer3

Owner: Performance Team

alert threshold: 2.0
apps: firefox, chrome, safari, safari-tp, custom-car
browser cycles: 5
cold: true
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile features: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,TaskController,StyleThread
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#21
lower is better: false
page cycles: 5
page timeout: 600000
subtest lower is better: true
subtest unit: ms
support class: speedometer3.py
test script: speedometer3.js
test url: http://<host>:<port>/Speedometer3/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-chrome-m	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix	✅	✅	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	✅	✅	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-p6-13-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-chrome-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-s24-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-chrome-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌
browsertime-benchmark-safari-speedometer3	❌	❌	❌	❌
browsertime-benchmark-safari-tp-speedometer3	✅	❌	❌	❌

**test-windows10-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	❌	❌	❌

**test-windows11-64-24h2-hw-ref-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	❌	❌	❌

**test-windows11-64-24h2-hw-ref/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

Owner: Performance Team

alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m, cstm-car-m
browser cycles: 5
cold: true
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile features: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,TaskController,StyleThread
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#21
lower is better: false
page cycles: 5
page timeout: 420000
subtest lower is better: true
subtest unit: ms
support class: speedometer3.py
test script: speedometer3.js
test url: http://<host>:<port>/Speedometer3/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-chrome-m	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix	✅	✅	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	✅	✅	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-p6-13-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-chrome-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-android-hw-s24-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-speedometer3-mobile-chrome-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-speedometer3-mobile-geckoview-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-macosx1500-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌
browsertime-benchmark-safari-speedometer3	❌	❌	❌	❌
browsertime-benchmark-safari-tp-speedometer3	✅	❌	❌	❌

**test-windows10-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	❌	❌	❌

**test-windows11-64-24h2-hw-ref-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	❌	❌	❌

**test-windows11-64-24h2-hw-ref/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer3	❌	❌	❌	❌
browsertime-benchmark-custom-car-speedometer3	✅	❌	❌	❌
browsertime-benchmark-firefox-speedometer3	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer3	❌	❌	❌	❌

stylebench

Command to Run Locally

./mach raptor -t stylebench

Owner: :emilio and Layout Team

alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/stylebench.toml#16
lower is better: false
page cycles: 5
page timeout: 140000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/StyleBench/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	❌	❌
browsertime-benchmark-safari-stylebench	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench	❌	❌	❌	❌

sunspider

Command to Run Locally

./mach raptor -t sunspider

Owner: :jandem and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/sunspider.toml#10
lower is better: true
page cycles: 5
page timeout: 55000
test url: http://<host>:<port>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	❌	❌
browsertime-benchmark-safari-sunspider	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider	❌	❌	❌	❌

twitch-animation

Command to Run Locally

./mach raptor -t twitch-animation

Owner: :jrmuizel

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/twitch-animation.toml#15
lower is better: true
page cycles: 1
page timeout: 2000000
perfstats: false
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/twitch-animation
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-twitch-animation	❌	❌	❌	❌

unity-webgl

Command to Run Locally

./mach raptor -t unity-webgl

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: firefox, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/unity-webgl-desktop.toml#14
lower is better: false
page cycles: 5
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-unity-webgl-mobile-chrome-m	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-fenix	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

Owner: :jgilbert and Graphics(gfx) Team

alert threshold: 2.0
apps: geckoview, refbrow, fenix, chrome-m
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/unity-webgl-mobile.toml#14
lower is better: false
page cycles: 1
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-unity-webgl-mobile-chrome-m	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-fenix	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-fenix-nofis	✅	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-unity-webgl-mobile-fenix	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-fenix-nofis	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis	❌	❌	❌	❌
browsertime-benchmark-unity-webgl-mobile-refbrow	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl	❌	❌	❌	❌

wasm-godot

Command to Run Locally

./mach raptor -t wasm-godot

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot.toml#11
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	❌	❌
browsertime-benchmark-wasm-safari-wasm-godot	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot	❌	❌	❌	❌

wasm-godot-baseline

Command to Run Locally

./mach raptor -t wasm-godot-baseline

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot-baseline.toml#14
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline	❌	❌	❌	❌

wasm-godot-optimizing

Command to Run Locally

./mach raptor -t wasm-godot-optimizing

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot-optimizing.toml#14
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true
test url: http://localhost:<port>/wasm-godot/index.html
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing	❌	❌	❌	❌

wasm-misc

Command to Run Locally

./mach raptor -t wasm-misc

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc.toml#14
lower is better: true
page cycles: 5
page timeout: 1200000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc	❌	❌	❌	❌

wasm-misc-baseline

Command to Run Locally

./mach raptor -t wasm-misc-baseline

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc-baseline.toml#13
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline	❌	❌	❌	❌

wasm-misc-optimizing

Command to Run Locally

./mach raptor -t wasm-misc-optimizing

Owner: :lth and SpiderMonkey Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc-optimizing.toml#13
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing	❌	❌	❌	❌

webaudio

Command to Run Locally

./mach raptor -t webaudio

Owner: :padenot and Media Team

alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/webaudio.toml#10
lower is better: true
page cycles: 5
page timeout: 360000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
test url: http://<host>:<port>/webaudio/index.html?raptor
type: benchmark
unit: score
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	❌	❌
browsertime-benchmark-safari-webaudio	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio	❌	❌	❌	❌

youtube-playback-av1-sfr

Command to Run Locally

./mach raptor -t youtube-playback-av1-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#24
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-av1-sfr	✅	❌	❌	❌
browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis	✅	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-av1-sfr	❌	❌	❌	❌
browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-av1-sfr	✅	❌	❌	❌

youtube-playback-h264-1080p30

Command to Run Locally

./mach raptor -t youtube-playback-h264-1080p30

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#28
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p30	❌	❌	❌	❌

youtube-playback-h264-1080p60

Command to Run Locally

./mach raptor -t youtube-playback-h264-1080p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#34
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-1080p60	❌	❌	❌	❌

youtube-playback-h264-720p60

Command to Run Locally

./mach raptor -t youtube-playback-h264-720p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, chrome, geckoview, fenix, refbrow, chrome-m
browsertime args: –pageCompleteWaitTime=10 –pageCompleteCheckPollTimeout=10 –browsertime.benchmark_wait_time=500
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#82
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
support class: browsertime_benchmark.py
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&tests=38&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-h264-720p60	✅	✅	❌	❌
browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis	✅	✅	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-mobile-fenix-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌

**test-android-hw-p6-13-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌

**test-android-hw-s24-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis	❌	❌	❌	❌

youtube-playback-h264-full-1080p30

Command to Run Locally

./mach raptor -t youtube-playback-h264-full-1080p30

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#40
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p30	❌	❌	❌	❌

youtube-playback-h264-full-1080p60

Command to Run Locally

./mach raptor -t youtube-playback-h264-full-1080p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#55
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-h264-full-1080p60	❌	❌	❌	❌

youtube-playback-h264-sfr

Command to Run Locally

./mach raptor -t youtube-playback-h264-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#70
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-geckoview-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-geckoview-youtube-playback-h264-sfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr	❌	❌	❌	❌

youtube-playback-hfr

Command to Run Locally

./mach raptor -t youtube-playback-hfr

Owner: PerfTest Team

alert on: H2641080p60fps@1X_dropped_frames, H264720p60fps@1X_dropped_frames
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#74
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr	✅	❌	❌	❌
browsertime-mobile-fenix-youtube-playback-hfr-nofis	✅	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-nofis	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-fenix-youtube-playback-hfr-nofis	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-nofis	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr	❌	❌	❌	❌

youtube-playback-v9-1080p30

Command to Run Locally

./mach raptor -t youtube-playback-v9-1080p30

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#96
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p30	❌	❌	❌	❌

youtube-playback-v9-1080p60

Command to Run Locally

./mach raptor -t youtube-playback-v9-1080p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#102
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-1080p60	❌	❌	❌	❌

youtube-playback-v9-full-1080p30

Command to Run Locally

./mach raptor -t youtube-playback-v9-full-1080p30

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#108
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p30	❌	❌	❌	❌

youtube-playback-v9-full-1080p60

Command to Run Locally

./mach raptor -t youtube-playback-v9-full-1080p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#123
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-firefox-youtube-playback-v9-full-1080p60	❌	❌	❌	❌

youtube-playback-vp9-720p60

Command to Run Locally

./mach raptor -t youtube-playback-vp9-720p60

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, chrome, geckoview, fenix, refbrow, chrome-m
browsertime args: –pageCompleteWaitTime=10 –pageCompleteCheckPollTimeout=10 –browsertime.benchmark_wait_time=500
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#89
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
support class: browsertime_benchmark.py
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&tests=6&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60	✅	✅	❌	❌
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis	✅	✅	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌

**test-android-hw-p6-13-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌

**test-android-hw-s24-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60	❌	❌	❌	❌
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis	❌	❌	❌	❌

youtube-playback-vp9-sfr

Command to Run Locally

./mach raptor -t youtube-playback-vp9-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#138
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr	✅	❌	❌	❌
browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis	✅	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr	❌	❌	❌	❌
browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis	❌	❌	❌	❌

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr	❌	❌	❌	❌

youtube-playback-widevine-h264-sfr

Command to Run Locally

./mach raptor -t youtube-playback-widevine-h264-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#142
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr	❌	❌	❌	❌

youtube-playback-widevine-hfr

Command to Run Locally

./mach raptor -t youtube-playback-widevine-hfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#156
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr	❌	❌	❌	❌

youtube-playback-widevine-vp9-sfr

Command to Run Locally

./mach raptor -t youtube-playback-widevine-vp9-sfr

Owner: PerfTest Team

alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#170
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
subtest lower is better: true
subtest unit: score
test url: https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run
type: benchmark
unit: score
use live sites: true
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr	❌	❌	❌	❌

Custom 

Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.

addMab1

Command to Run Locally

./mach raptor -t addMab1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small ArrayBuffers to IndexedDB in one transaction

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#50
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMab1	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMab1	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMab1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMab1	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMab1	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMab1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMab1	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMab1	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMab1	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMab1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMab1	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMab1	❌	❌	❌	❌

addMabN

Command to Run Locally

./mach raptor -t addMabN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small ArrayBuffers to IndexedDB independently

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#54
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMabN	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMabN	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMabN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMabN	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMabN	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMabN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMabN	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMabN	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMabN	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMabN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMabN	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMabN	❌	❌	❌	❌

addMar1

Command to Run Locally

./mach raptor -t addMar1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small Arrays to IndexedDB in one transaction

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Array –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#58
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMar1	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMar1	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMar1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMar1	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMar1	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMar1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMar1	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMar1	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMar1	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMar1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMar1	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMar1	❌	❌	❌	❌

addMarN

Command to Run Locally

./mach raptor -t addMarN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small Arrays to IndexedDB independently

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Array –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#62
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMarN	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMarN	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMarN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMarN	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMarN	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMarN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMarN	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMarN	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMarN	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMarN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMarN	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMarN	❌	❌	❌	❌

addMbl1

Command to Run Locally

./mach raptor -t addMbl1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small Blobs to IndexedDB in one transaction

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Blob –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#66
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMbl1	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMbl1	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMbl1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMbl1	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMbl1	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMbl1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMbl1	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMbl1	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMbl1	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMbl1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMbl1	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMbl1	❌	❌	❌	❌

addMblN

Command to Run Locally

./mach raptor -t addMblN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send many small Blobs to IndexedDB independently

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Blob –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#70
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMblN	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMblN	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMblN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMblN	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMblN	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMblN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMblN	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMblN	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMblN	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addMblN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addMblN	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addMblN	❌	❌	❌	❌

addkAB1

Command to Run Locally

./mach raptor -t addkAB1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large ArrayBuffers to IndexedDB in one transaction

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#74
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAB1	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAB1	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkAB1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkAB1	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAB1	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkAB1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkAB1	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAB1	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAB1	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkAB1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkAB1	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAB1	❌	❌	❌	❌

addkABN

Command to Run Locally

./mach raptor -t addkABN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large ArrayBuffers to IndexedDB independently

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#78
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkABN	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkABN	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkABN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkABN	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkABN	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkABN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkABN	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkABN	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkABN	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkABN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkABN	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkABN	❌	❌	❌	❌

addkAR1

Command to Run Locally

./mach raptor -t addkAR1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large JS Arrays to IndexedDB in one transaction

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Array –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#82
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAR1	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAR1	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkAR1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkAR1	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAR1	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkAR1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkAR1	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAR1	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAR1	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkAR1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkAR1	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkAR1	❌	❌	❌	❌

addkARN

Command to Run Locally

./mach raptor -t addkARN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large JS Arrays to IndexedDB independently

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Array –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#86
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkARN	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkARN	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkARN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkARN	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkARN	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkARN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkARN	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkARN	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkARN	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkARN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkARN	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkARN	❌	❌	❌	❌

addkBL1

Command to Run Locally

./mach raptor -t addkBL1

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large Blobs to IndexedDB in one transaction

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Blob –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#90
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBL1	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBL1	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkBL1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkBL1	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBL1	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkBL1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkBL1	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBL1	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBL1	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkBL1	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkBL1	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBL1	❌	❌	❌	❌

addkBLN

Command to Run Locally

./mach raptor -t addkBLN

Owner: DOM Lifecycle, Workers and Storage Team

Description: Use add API to send a couple of large Blobs to IndexedDB independently

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Blob –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#94
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBLN	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBLN	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkBLN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkBLN	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBLN	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkBLN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkBLN	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBLN	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBLN	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-addkBLN	❌	❌	❌	❌
browsertime-indexeddb-firefox-addkBLN	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-addkBLN	❌	❌	❌	❌

connect

Command to Run Locally

./mach raptor -t connect

Owner: Network Team

Description: Verifies that connection time on a pageload is zero when a speculative connection has first been made

alert change type: absolute
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange
alert threshold: 10.0
apps: firefox
browser cycles: 3
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-speculative.toml#18
lower is better: true
page cycles: 1
page timeout: 60000
test script: speculative-connect.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speculative-firefox-connect	❌	❌	❌	❌

constant-regression

Command to Run Locally

./mach raptor -t constant-regression

Owner: PerfTest Team

Description: Generates a constant value that can be changed to induce a regression.

alert threshold: 2.0
apps: firefox, chrome, safari, geckoview, fenix
browser cycles: 1
browsertime args: –browsertime.constant_value=1500
custom data: true
expected: pass
fore window: 1
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-regression-test.toml#23
lower is better: true
max back window: 3
min back window: 2
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest unit: ms
test script: constant_regression_test.js
test summary: flatten
test url: None
type: pageload
unit: score
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-regression-tests-firefox-constant-regression	❌	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-regression-tests-firefox-constant-regression	❌	✅	❌	❌

getkeyrng

Command to Run Locally

./mach raptor -t getkeyrng

Owner: DOM Lifecycle, Workers and Storage Team

Description: Measures the speed of key-range based reads of IndexedDB

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#98
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
support class: browsertime_pageload.py
test script: indexeddb_getkeyrange.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-getkeyrng	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-getkeyrng	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-getkeyrng	❌	❌	❌	❌
browsertime-indexeddb-firefox-getkeyrng	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-getkeyrng	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-getkeyrng	❌	❌	❌	❌
browsertime-indexeddb-firefox-getkeyrng	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-getkeyrng	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-getkeyrng	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-getkeyrng	❌	❌	❌	❌
browsertime-indexeddb-firefox-getkeyrng	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-getkeyrng	❌	❌	❌	❌

h2-download

Command to Run Locally

./mach raptor -t h2-download

Owner: Network Team

Description: Measures HTTP/2 download throughput with a local server

alert threshold: 2.0
apps: firefox, chrome, custom-car
browser cycles: 1
browsertime args: –browsertime.test_type=h2_download –browsertime.iterations=10 –firefox.preference=network.http.http3.enable:false
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#38
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
support class: network_bench.py
test script: network_bench.js
test url: None
type: pageload
unit: mbps
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_80ms-0	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_80ms-0	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h2-download	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-download-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-download-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-download-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-download-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-download-300M_80ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-download	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-300M_80ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-download	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-download-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-download-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-download-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_80ms-0	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_80ms-0	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h2-download	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_80ms-0	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h2-download	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-download-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-download-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-download-300M_80ms-0	❌	❌	❌	❌

h2-upload

Command to Run Locally

./mach raptor -t h2-upload

Owner: Network Team

Description: Measures HTTP/2 file upload throughput with a local server

alert threshold: 2.0
apps: firefox, chrome, custom-car
browser cycles: 1
browsertime args: –browsertime.test_type=h2_upload –browsertime.iterations=10 –firefox.preference=network.http.http3.enable:false
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#34
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
support class: network_bench.py
test script: network_bench.js
test url: None
type: pageload
unit: mbps
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_80ms-0	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_80ms-0	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h2-upload	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-300M_80ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-300M_80ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-upload	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_80ms-0	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_80ms-0	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h2-upload	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_80ms-0	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h2-upload	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h2-upload-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h2-upload-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h2-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h2-upload-300M_80ms-0	❌	❌	❌	❌

h3-download

Command to Run Locally

./mach raptor -t h3-download

Owner: Network Team

Description: Measures HTTP/3 download throughput with a local server

alert threshold: 2.0
apps: firefox, chrome, custom-car
browser cycles: 1
browsertime args: –browsertime.test_type=h3_download –browsertime.iterations=10 –firefox.preference=network.http.http3.enable:true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#28
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
support class: network_bench.py
test script: network_bench.js
test url: None
type: pageload
unit: mbps
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_80ms-0	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_80ms-0	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h3-download	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-download-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-download-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-download-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-download-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-download-300M_80ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-download	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-300M_80ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-download	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-download-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-download-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-download-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_80ms-0	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_80ms-0	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h3-download	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_80ms-0	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h3-download	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-download-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-download-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-download	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-download-300M_80ms-0	❌	❌	❌	❌

h3-upload

Command to Run Locally

./mach raptor -t h3-upload

Owner: Network Team

Description: Measures HTTP/3 file upload throughput with a local server

alert threshold: 2.0
apps: firefox, chrome, custom-car
browser cycles: 1
browsertime args: –browsertime.test_type=h3_upload –browsertime.iterations=10 –firefox.preference=network.http.http3.enable:true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#24
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
support class: network_bench.py
test script: network_bench.js
test url: None
type: pageload
unit: mbps
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_80ms-0	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_80ms-0	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h3-upload	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-300M_80ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-upload	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-100M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-10M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-1M_400ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_40ms-0	✅	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_80ms-0	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_80ms-0	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h3-upload	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_80ms-0	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-chrome-h3-upload	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-chrome-h3-upload-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_80ms-0	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-network-bench-firefox-h3-upload	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-100M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-10M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-1M_400ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_40ms-0	❌	❌	❌	❌
browsertime-network-bench-firefox-h3-upload-300M_80ms-0	❌	❌	❌	❌

idb-open-few-par

Command to Run Locally

./mach raptor -t idb-open-few-par

Owner: DOM Lifecycle, Workers and Storage Team

Description: Measures opening a few IndexedDB databases in parallel

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=1000 –browsertime.parallel=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#36
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_open.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-par	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-par	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-few-par	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-few-par	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-par	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-few-par	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-few-par	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-par	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-par	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-few-par	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-few-par	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-par	❌	❌	❌	❌

idb-open-few-seq

Command to Run Locally

./mach raptor -t idb-open-few-seq

Owner: DOM Lifecycle, Workers and Storage Team

Description: Measures opening a few IndexedDB databases in sequence

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=1000 –browsertime.parallel=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#40
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_open.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-seq	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-seq	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-few-seq	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-few-seq	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-seq	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-few-seq	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-few-seq	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-seq	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-seq	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-few-seq	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-few-seq	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-few-seq	❌	❌	❌	❌

idb-open-many-par

Command to Run Locally

./mach raptor -t idb-open-many-par

Owner: DOM Lifecycle, Workers and Storage Team

Description: Measures opening many IndexedDB databases in parallel

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=10000 –browsertime.parallel=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#28
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_open.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-par	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-par	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-many-par	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-many-par	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-par	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-many-par	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-many-par	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-par	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-par	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-many-par	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-many-par	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-par	❌	❌	❌	❌

idb-open-many-seq

Command to Run Locally

./mach raptor -t idb-open-many-seq

Owner: DOM Lifecycle, Workers and Storage Team

Description: Measures opening many IndexedDB databases in sequence

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=10000 –browsertime.parallel=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#32
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_open.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-seq	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-seq	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-many-seq	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-many-seq	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-seq	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-many-seq	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-many-seq	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-seq	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-seq	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-chrome-idb-open-many-seq	❌	❌	❌	❌
browsertime-indexeddb-firefox-idb-open-many-seq	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-indexeddb-firefox-idb-open-many-seq	❌	❌	❌	❌

process-switch

Command to Run Locally

./mach raptor -t process-switch

Owner: PerfTest Team

Description: Measures process switch time

accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome
browser cycles: 25
browsertime args: –pageCompleteWaitTime=1000 –pageCompleteCheckInactivity=true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-process-switch.toml#20
lower is better: true
measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-proc-switch.manifest
playback version: 5.1.1
support class: browsertime_pageload.py
test script: process_switch.js
test url: https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch	❌	❌	❌	❌

throttled

Command to Run Locally

./mach raptor -t throttled

Owner: Network Team

Description: Pageload test using a throttled network environment

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange
alert threshold: 2.0
apps: firefox
browser cycles: 3
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-throttled-pageload.toml#17
lower is better: true
page cycles: 1
page timeout: 60000
test script: throttled_pageload.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-throttled-firefox-throttled	❌	❌	❌	❌

tp6-bench

Command to Run Locally

./mach raptor -t tp6-bench

Owner: PerfTest Team

Description: A pageload benchmark test that quickly runs through a selection of the pages available to produce a single overall metric for fcp, lcp, and loadtime. The metrics from all pages get summarized with the geomean, and mean.

alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 1
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-tp6-bench.toml#19
lower is better: true
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: None
playback version: 8.1.1
subtest unit: ms
support class: browsertime_tp6_bench.py
test script: browsertime_tp6_bench.js
test summary: flatten
test url: None
type: pageload
unit: ms
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-pageload-benchmark-firefox-tp6-bench	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-pageload-benchmark-firefox-tp6-bench	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-pageload-benchmark-firefox-tp6-bench	❌	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-pageload-benchmark-firefox-tp6-bench	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-pageload-benchmark-firefox-tp6-bench	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-pageload-benchmark-firefox-tp6-bench	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-pageload-benchmark-firefox-tp6-bench	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-pageload-benchmark-firefox-tp6-bench	❌	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-pageload-benchmark-firefox-tp6-bench	❌	❌	❌	❌

trr-cira

Command to Run Locally

./mach raptor -t trr-cira

Owner: Network Team

Description: Tests DNS lookup time on a CIRA TRR server.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=browser_idle –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://private.canadianshield.cira.ca/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#23
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cira	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cira	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cira	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cira	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cira	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cira	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cira	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cira	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cira	❌	❌	❌	❌

trr-clou-m

Command to Run Locally

./mach raptor -t trr-clou-m

Owner: Network Team

Description: Tests DNS lookup time on a Cloudflare TRR server, mobile.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=trr_warm –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#79
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-clou-m	✅	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-clou-m-nofis	✅	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-clou-m	❌	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-clou-m-nofis	❌	❌	❌	❌

trr-cloudf

Command to Run Locally

./mach raptor -t trr-cloudf

Owner: Network Team

Description: Tests DNS lookup time on a Cloudflare TRR server.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=browser_idle –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#16
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cloudf	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cloudf	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cloudf	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cloudf	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cloudf	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cloudf	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cloudf	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cloudf	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-cloudf	❌	❌	❌	❌

trr-comcas

Command to Run Locally

./mach raptor -t trr-comcas

Owner: Network Team

Description: Tests DNS lookup time on a Comcast TRR server.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=browser_idle –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://doh.xfinity.com/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#30
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-comcas	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-comcas	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-comcas	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-comcas	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-comcas	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-comcas	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-comcas	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-comcas	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-comcas	❌	❌	❌	❌

trr-native

Command to Run Locally

./mach raptor -t trr-native

Owner: Network Team

Description: Tests DNS lookup time via native DNS.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=browser_idle –firefox.preference network.trr.mode:0
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#44
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-native	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-native	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-native	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-native	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-native	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-native	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-native	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-native	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-native	❌	❌	❌	❌

trr-natv-m

Command to Run Locally

./mach raptor -t trr-natv-m

Owner: Network Team

Description: Tests DNS lookup time via native DNS, mobile.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=browser_idle –firefox.preference network.trr.mode:0
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#93
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-natv-m	✅	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-natv-m-nofis	✅	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-natv-m	❌	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-natv-m-nofis	❌	❌	❌	❌

trr-next

Command to Run Locally

./mach raptor -t trr-next

Owner: Network Team

Description: Tests DNS lookup time on a NextDNS TRR server.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=browser_idle –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#37
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-next	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-next	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-next	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-next	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-next	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-next	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-next	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-next	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-next	❌	❌	❌	❌

trr-next-m

Command to Run Locally

./mach raptor -t trr-next-m

Owner: Network Team

Description: Tests DNS lookup time on a NextDNS TRR server, mobile.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=browser_idle –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#86
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-next-m	✅	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-next-m-nofis	✅	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-next-m	❌	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-next-m-nofis	❌	❌	❌	❌

trr-w-cira

Command to Run Locally

./mach raptor -t trr-w-cira

Owner: Network Team

Description: Tests DNS lookup time on a CIRA TRR server, with the TRR connection warmed up.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=trr_warm –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://private.canadianshield.cira.ca/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#58
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-cira	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-cira	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-cira	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-cira	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-cira	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-cira	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-cira	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-cira	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-cira	❌	❌	❌	❌

trr-w-cl-m

Command to Run Locally

./mach raptor -t trr-w-cl-m

Owner: Network Team

Description: Tests DNS lookup time on a Cloudflare TRR server, with the TRR connection warmed up, mobile.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=trr_warm –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#100
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-w-cl-m	✅	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-w-cl-m-nofis	✅	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-w-cl-m	❌	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-w-cl-m-nofis	❌	❌	❌	❌

trr-w-clou

Command to Run Locally

./mach raptor -t trr-w-clou

Owner: Network Team

Description: Tests DNS lookup time on a Cloudflare TRR server, with the TRR connection warmed up.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=trr_warm –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#51
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-clou	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-clou	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-clou	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-clou	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-clou	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-clou	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-clou	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-clou	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-clou	❌	❌	❌	❌

trr-w-comc

Command to Run Locally

./mach raptor -t trr-w-comc

Owner: Network Team

Description: Tests DNS lookup time on a Comcast TRR server, with the TRR connection warmed up.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=trr_warm –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://doh.xfinity.com/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#65
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-comc	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-comc	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-comc	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-comc	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-comc	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-comc	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-comc	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-comc	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-comc	❌	❌	❌	❌

trr-w-ne-m

Command to Run Locally

./mach raptor -t trr-w-ne-m

Owner: Network Team

Description: Tests DNS lookup time on a NextDNS TRR server, with the TRR connection warmed up, mobile.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=trr_warm –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#107
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-w-ne-m	✅	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-w-ne-m-nofis	✅	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-m-fenix-trr-w-ne-m	❌	❌	❌	❌
browsertime-trr-performance-m-fenix-trr-w-ne-m-nofis	❌	❌	❌	❌

trr-w-next

Command to Run Locally

./mach raptor -t trr-w-next

Owner: Network Team

Description: Tests DNS lookup time on a NextDNS TRR server, with the TRR connection warmed up.

alert threshold: 2.0
apps: firefox,fenix
browser cycles: 3
browsertime args: –browsertime.test_type=trr_warm –firefox.preference network.trr.mode:3 –firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#72
lower is better: true
page cycles: 1
page timeout: 60000
test script: trr_performance.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-next	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-next	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-next	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-next	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-next	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-next	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-next	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-next	✅	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-trr-performance-firefox-trr-w-next	❌	❌	❌	❌

upload

Command to Run Locally

./mach raptor -t upload

Owner: Network Team

Description: Measures HTTP/2 file upload throughput with a remote server

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.test_type=h2_upload –browsertime.iterations=10 –browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com –firefox.preference=network.http.http3.enable:false –chrome.args disable-quic
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-upload.toml#16
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
test script: network_bench.js
test url: None
type: pageload
unit: mbps
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload	❌	❌	❌	❌
browsertime-upload-firefox-upload	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload	❌	❌	❌	❌
browsertime-upload-firefox-upload	✅	✅	❌	❌
browsertime-upload-safari-upload	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload	❌	❌	❌	❌
browsertime-upload-firefox-upload	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload	❌	❌	❌	❌

upload-h3

Command to Run Locally

./mach raptor -t upload-h3

Owner: Network Team

Description: Measures HTTP/3 file upload throughput with a remote server

alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.test_type=h3_upload –browsertime.iterations=10 –browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com –firefox.preference=network.http.http3.enable:true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-upload.toml#31
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
test script: network_bench.js
test url: None
type: pageload
unit: mbps
use live sites: true
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload-h3	❌	❌	❌	❌
browsertime-upload-firefox-upload-h3	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload-h3	❌	❌	❌	❌
browsertime-upload-firefox-upload-h3	✅	✅	❌	❌
browsertime-upload-safari-upload-h3	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-chrome-upload-h3	❌	❌	❌	❌
browsertime-upload-firefox-upload-h3	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-upload-firefox-upload-h3	❌	❌	❌	❌

ve-av1-q

Command to Run Locally

./mach raptor -t ve-av1-q

Owner: :chunmin and Media Team

Description: Measures AV1 encoding performance for 1080p video in quality mode.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#21
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=quality&width=1920&height=1080&framerate=30
type: benchmark
unit: score
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-q	✅	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-q	✅	✅	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-av1-q	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-av1-q	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-av1-q	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-q	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-av1-q	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-av1-q	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-av1-q	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-av1-q	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-q	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-q	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-av1-q	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-av1-q	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-av1-q	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-q	✅	✅	❌	❌

ve-av1-rt

Command to Run Locally

./mach raptor -t ve-av1-rt

Owner: :chunmin and Media Team

Description: Measures AV1 encoding performance for 1080p video in real-time mode.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#18
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=realtime&width=1920&height=1080&framerate=30
type: benchmark
unit: score
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-rt	✅	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-rt	✅	✅	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-av1-rt	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-av1-rt	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-av1-rt	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-rt	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-av1-rt	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-av1-rt	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-av1-rt	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-av1-rt	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-rt	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-rt	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-av1-rt	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-av1-rt	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-av1-rt	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-av1-rt	✅	✅	❌	❌

ve-h264-q

Command to Run Locally

./mach raptor -t ve-h264-q

Owner: :chunmin and Media Team

Description: Measures H264-baseline encoding performance for 1080p video in quality mode using AVC format.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#27
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=1920&height=1080&framerate=30
type: benchmark
unit: score
Test Task:

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-h264-q	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q	✅	✅	❌	❌

ve-h264-q-sd

Command to Run Locally

./mach raptor -t ve-h264-q-sd

Owner: :chunmin and Media Team

Description: Measures H264-baseline encoding performance for 480p video in quality mode using AVC format.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#33
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=640&height=480&framerate=30
type: benchmark
unit: score
Test Task:

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q-sd	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-h264-q-sd	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-h264-q-sd	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-h264-q-sd	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-h264-q-sd	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q-sd	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q-sd	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-h264-q-sd	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-h264-q-sd	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-h264-q-sd	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-q-sd	✅	✅	❌	❌

ve-h264-rt

Command to Run Locally

./mach raptor -t ve-h264-rt

Owner: :chunmin and Media Team

Description: Measures H264-baseline encoding performance for 1080p video in real-time mode using Annex B format.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#24
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=avc1.42001E:annexb&latencyModes=realtime&width=1920&height=1080&framerate=30
type: benchmark
unit: score
Test Task:

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-h264-rt	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt	✅	✅	❌	❌

ve-h264-rt-sd

Command to Run Locally

./mach raptor -t ve-h264-rt-sd

Owner: :chunmin and Media Team

Description: Measures H264-baseline encoding performance for 480p video in real-time mode using Annex B format.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#30
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=avc1.42001E:annexb&latencyModes=realtime&width=640&height=480&framerate=30
type: benchmark
unit: score
Test Task:

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt-sd	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-h264-rt-sd	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-h264-rt-sd	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-h264-rt-sd	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-h264-rt-sd	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt-sd	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt-sd	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-h264-rt-sd	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-h264-rt-sd	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-h264-rt-sd	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-h264-rt-sd	✅	✅	❌	❌

ve-vp8-q

Command to Run Locally

./mach raptor -t ve-vp8-q

Owner: :chunmin and Media Team

Description: Measures VP8 encoding performance for 1080p video in quality mode.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#39
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=vp8&latencyModes=quality&width=1920&height=1080&framerate=30
type: benchmark
unit: score
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-q	✅	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-q	✅	✅	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp8-q	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp8-q	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp8-q	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-q	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp8-q	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp8-q	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp8-q	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-vp8-q	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-q	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-q	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp8-q	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp8-q	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp8-q	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-q	✅	✅	❌	❌

ve-vp8-rt

Command to Run Locally

./mach raptor -t ve-vp8-rt

Owner: :chunmin and Media Team

Description: Measures VP8 encoding performance for 1080p video in real-time mode.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#36
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=vp8&latencyModes=realtime&width=1920&height=1080&framerate=30
type: benchmark
unit: score
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-rt	✅	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-rt	✅	✅	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp8-rt	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp8-rt	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp8-rt	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-rt	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp8-rt	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp8-rt	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp8-rt	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-vp8-rt	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-rt	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-rt	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp8-rt	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp8-rt	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp8-rt	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp8-rt	✅	✅	❌	❌

ve-vp9-q

Command to Run Locally

./mach raptor -t ve-vp9-q

Owner: :chunmin and Media Team

Description: Measures VP9 encoding performance for 1080p video in quality mode.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#45
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=vp09.00.10.08&latencyModes=quality&width=1920&height=1080&framerate=30
type: benchmark
unit: score
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-q	✅	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-q	✅	✅	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp9-q	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp9-q	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp9-q	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-q	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp9-q	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp9-q	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp9-q	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-vp9-q	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-q	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-q	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp9-q	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp9-q	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp9-q	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-q	✅	✅	❌	❌

ve-vp9-rt

Command to Run Locally

./mach raptor -t ve-vp9-rt

Owner: :chunmin and Media Team

Description: Measures VP9 encoding performance for 1080p video in real-time mode.

alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#42
lower is better: true
page cycles: 3
page timeout: 360000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/webcodecs
repository revision: d34775ba6b6cef6068005c05b570d6c79eb0f7d8
support class: browsertime_benchmark.py
test url: http://<host>:<port>/index.html?raptor&codecs=vp09.00.10.08&latencyModes=realtime&width=1920&height=1080&framerate=30
type: benchmark
unit: score
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-rt	✅	✅	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-rt	✅	✅	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp9-rt	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp9-rt	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp9-rt	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-rt	✅	✅	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp9-rt	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp9-rt	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp9-rt	✅	✅	❌	❌
browsertime-webcodecs-safari-ve-vp9-rt	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-rt	✅	✅	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-rt	✅	✅	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-chrome-ve-vp9-rt	❌	❌	❌	❌
browsertime-webcodecs-custom-car-ve-vp9-rt	❌	❌	❌	❌
browsertime-webcodecs-firefox-ve-vp9-rt	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-webcodecs-firefox-ve-vp9-rt	✅	✅	❌	❌

vpl-av1

Command to Run Locally

./mach raptor -t vpl-av1

Owner: :aosmond and the Media Team

Description: Measures AV1 1080p video playback latency.

alert on: estimatedFirstFrameLatency, estimatedAnyFrameLatency
alert threshold: 2.0
apps: chrome, chrome-m, geckoview, fenix, firefox, safari
benchmark webserver: true
browser cycles: 20
expected: pass
gecko profile features: stackwalk,js,cpu,java,processcpu,screenshots,memory
gecko profile interval: 1
gecko profile threads: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#36
lower is better: true
measure: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency
newtab per cycle: true
page cycles: 20
page timeout: 20000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/video-playback-latency
repository revision: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd
support class: video_playback_latency.py
test url: http://<host>:<port>/av1_1080p.html
type: pageload
unit: ms
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-mobile-chrome-m-vpl-av1	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-chrome-m-vpl-av1-nofis	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-fenix-vpl-av1	✅	✅	❌	❌
browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis	✅	✅	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-av1	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-mobile-fenix-vpl-av1	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-av1	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-av1	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-av1	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-av1	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-av1	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-av1	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-av1	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-av1	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-av1	❌	❌	❌	❌

**test-windows11-64-24h2-hw-ref-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-av1	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-av1	❌	❌	❌	❌

**test-windows11-64-24h2-hw-ref/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-av1	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-av1	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-av1	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-av1	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-av1	❌	❌	❌	❌

vpl-h264

Command to Run Locally

./mach raptor -t vpl-h264

Owner: :aosmond and the Media Team

Description: Measures H264 1080p video playback latency.

alert on: estimatedFirstFrameLatency, estimatedAnyFrameLatency
alert threshold: 2.0
apps: chrome, chrome-m, geckoview, fenix, firefox, safari
benchmark webserver: true
browser cycles: 20
expected: pass
gecko profile features: stackwalk,js,cpu,java,processcpu,screenshots,memory
gecko profile interval: 1
gecko profile threads: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#30
lower is better: true
measure: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency
newtab per cycle: true
page cycles: 20
page timeout: 20000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/video-playback-latency
repository revision: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd
support class: video_playback_latency.py
test url: http://<host>:<port>/h264_1080p.html
type: pageload
unit: ms
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-mobile-chrome-m-vpl-h264	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-chrome-m-vpl-h264-nofis	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-fenix-vpl-h264	✅	✅	❌	❌
browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis	✅	✅	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-h264	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-mobile-fenix-vpl-h264	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-h264	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-h264	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-h264	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-h264	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-h264	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-h264	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-h264	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-h264	✅	✅	❌	❌
browsertime-video-playback-latency-safari-vpl-h264	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-h264	❌	❌	❌	❌

**test-windows11-64-24h2-hw-ref-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-h264	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-h264	❌	❌	❌	❌

**test-windows11-64-24h2-hw-ref/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-h264	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-h264	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-h264	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-h264	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-h264	❌	❌	❌	❌

vpl-vp9

Command to Run Locally

./mach raptor -t vpl-vp9

Owner: :aosmond and the Media Team

Description: Measures VP9 1080p video playback latency.

alert on: estimatedFirstFrameLatency, estimatedAnyFrameLatency
alert threshold: 2.0
apps: chrome, chrome-m, geckoview, fenix, firefox, safari
benchmark webserver: true
browser cycles: 20
expected: pass
gecko profile features: stackwalk,js,cpu,java,processcpu,screenshots,memory
gecko profile interval: 1
gecko profile threads: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#33
lower is better: true
measure: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency
newtab per cycle: true
page cycles: 20
page timeout: 20000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/video-playback-latency
repository revision: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd
support class: video_playback_latency.py
test url: http://<host>:<port>/vp9_1080p.html
type: pageload
unit: ms
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-mobile-chrome-m-vpl-vp9	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-chrome-m-vpl-vp9-nofis	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-fenix-vpl-vp9	✅	✅	❌	❌
browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis	✅	✅	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-vp9	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-mobile-fenix-vpl-vp9	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-vp9	❌	❌	❌	❌
browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-vp9	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-vp9	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-vp9	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-vp9	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-vp9	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-vp9	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-vp9	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-vp9	❌	❌	❌	❌

**test-windows11-64-24h2-hw-ref-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-vp9	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-vp9	❌	❌	❌	❌

**test-windows11-64-24h2-hw-ref/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-vp9	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-vp9	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-chrome-vpl-vp9	❌	❌	❌	❌
browsertime-video-playback-latency-firefox-vpl-vp9	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-video-playback-latency-firefox-vpl-vp9	❌	❌	❌	❌

welcome

Command to Run Locally

./mach raptor -t welcome

Owner: PerfTest Team

Description: Measures pageload metrics for the first-install about:welcome page

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-welcome.toml#18
lower is better: true
measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-welcome.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test script: welcome.js
test url: about:welcome
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome	❌	❌	❌	❌

Desktop 

Tests for page-load performance. The links direct to the actual websites that are being tested.

amazon

Command to Run Locally

./mach raptor -t amazon

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#22
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-amazon.manifest
playback pageset manifest backup: mitm8-linux-firefox-amazon.manifest
playback version: 11.0.0
secondary url: https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3
support class: browsertime_pageload.py
test url: https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	✅	✅	❌	❌
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	❌	❌
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon	✅	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	✅	✅	❌	❌
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	❌	❌
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-safari-amazon	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon	✅	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	✅	✅	❌	❌
browsertime-tp6-essential-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	✅	✅	❌	❌
browsertime-tp6-live-chrome-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon	❌	❌	❌	❌
browsertime-tp6-webextensions-firefox-amazon	❌	❌	❌	❌

bing-search

Command to Run Locally

./mach raptor -t bing-search

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#29
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-darwin-firefox-bing-search.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.bing.com/search?q=barack+obama
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	✅	✅	❌	❌
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	❌	❌
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	✅	✅	❌	❌
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	❌	❌
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-safari-bing-search	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	✅	✅	❌	❌
browsertime-tp6-essential-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	✅	✅	❌	❌
browsertime-tp6-live-chrome-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search	❌	❌	❌	❌

buzzfeed

Command to Run Locally

./mach raptor -t buzzfeed

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#33
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-buzzfeed.manifest
playback pageset manifest backup: mitm7-linux-firefox-buzzfeed.manifest
playback version: 11.0.0
secondary url: https://www.buzzfeed.com/quizzes
support class: browsertime_pageload.py
test url: https://www.buzzfeed.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-custom-car-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-custom-car-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed	❌	❌	❌	❌
browsertime-tp6-custom-car-buzzfeed	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed	❌	❌	❌	❌

cnn

Command to Run Locally

./mach raptor -t cnn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#40
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-cnn.manifest
playback pageset manifest backup: mitm8-linux-firefox-cnn.manifest
playback version: 11.0.0
secondary url: https://www.cnn.com/weather
support class: browsertime_pageload.py
test url: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	✅	✅	❌	❌
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	✅	✅	❌	❌
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	✅	✅	❌	❌
browsertime-tp6-essential-chrome-cnn	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	✅	✅	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn	❌	❌	❌	❌

docomo

Command to Run Locally

./mach raptor -t docomo

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#23
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-docomo.manifest
playback version: 11.0.0
secondary url: https://www.docomo.ne.jp/iphone/?icid=CRP_menu_to_CRP_IPH
support class: browsertime_pageload.py
test url: https://www.docomo.ne.jp/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-docomo	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-docomo	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-docomo	❌	❌	❌	❌
browsertime-tp7-firefox-docomo	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-docomo	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-docomo	❌	❌	❌	❌
browsertime-tp7-firefox-docomo	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-docomo	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-docomo	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-docomo	❌	❌	❌	❌
browsertime-tp7-firefox-docomo	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-docomo	❌	❌	❌	❌

ebay

Command to Run Locally

./mach raptor -t ebay

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#46
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-ebay.manifest
playback pageset manifest backup: mitm8-linux-firefox-ebay.manifest
playback version: 11.0.0
secondary url: https://www.ebay.com/deals
support class: browsertime_pageload.py
test url: https://www.ebay.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-custom-car-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	❌	❌
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-custom-car-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	❌	❌
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-safari-ebay	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-custom-car-ebay	❌	❌	❌	❌
browsertime-tp6-firefox-ebay	✅	✅	❌	❌
browsertime-tp6-live-chrome-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay	❌	❌	❌	❌

espn

Command to Run Locally

./mach raptor -t espn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#52
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-espn.manifest
playback pageset manifest backup: mitm8-linux-firefox-espn.manifest
playback version: 11.0.0
secondary url: https://www.espn.com/nba/draft/news
support class: browsertime_pageload.py
test url: https://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-custom-car-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-custom-car-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn	❌	❌	❌	❌
browsertime-tp6-custom-car-espn	❌	❌	❌	❌
browsertime-tp6-firefox-espn	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn	❌	❌	❌	❌

expedia

Command to Run Locally

./mach raptor -t expedia

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#59
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-darwin-firefox-expedia.manifest
playback version: 11.0.0
secondary url: https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1
support class: browsertime_pageload.py
test url: https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-custom-car-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-custom-car-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia	❌	❌	❌	❌
browsertime-tp6-custom-car-expedia	❌	❌	❌	❌
browsertime-tp6-firefox-expedia	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia	❌	❌	❌	❌

facebook

Command to Run Locally

./mach raptor -t facebook

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#64
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-facebook.manifest
playback pageset manifest backup: mitm6-linux-firefox-facebook.manifest
playback version: 11.0.0
secondary url: https://www.facebook.com/marketplace/?ref=bookmark
support class: browsertime_pageload.py
test url: https://www.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-custom-car-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	❌	❌
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-custom-car-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	❌	❌
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-custom-car-facebook	❌	❌	❌	❌
browsertime-tp6-firefox-facebook	✅	✅	❌	❌
browsertime-tp6-live-chrome-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook	❌	❌	❌	❌

fandom

Command to Run Locally

./mach raptor -t fandom

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#71
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-fandom.manifest
playback pageset manifest backup: mitm5-linux-firefox-fandom.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	✅	✅	❌	❌
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	❌	❌
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	✅	✅	❌	❌
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	❌	❌
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-safari-fandom	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	✅	✅	❌	❌
browsertime-tp6-essential-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	✅	✅	❌	❌
browsertime-tp6-live-chrome-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom	❌	❌	❌	❌

google-docs

Command to Run Locally

./mach raptor -t google-docs

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#77
lower is better: true
page complete wait time: 8000
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-google-docs.manifest
playback pageset manifest backup: mitm8-linux-firefox-google-docs.manifest
playback version: 11.0.0
secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview
support class: browsertime_pageload.py
test url: https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-custom-car-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-custom-car-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-safari-google-docs	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-custom-car-google-docs	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs	❌	❌	❌	❌

google-mail

Command to Run Locally

./mach raptor -t google-mail

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#84
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-google-mail.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://mail.google.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-custom-car-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-custom-car-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-safari-google-mail	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-custom-car-google-mail	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail	❌	❌	❌	❌

google-search

Command to Run Locally

./mach raptor -t google-search

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#89
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-google-search.manifest
playback pageset manifest backup: mitm8-linux-firefox-google-search.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.google.com/search?hl=en&q=barack+obama&cad=h
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-custom-car-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-custom-car-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-safari-google-search	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-custom-car-google-search	❌	❌	❌	❌
browsertime-tp6-firefox-google-search	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search	❌	❌	❌	❌

google-slides

Command to Run Locally

./mach raptor -t google-slides

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#94
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-google-slides.manifest
playback version: 11.0.0
secondary url: https://docs.google.com/presentation/d/e/2PACX-1vRWwPQQFMDkSR4RtYc7HSAGm-hoprespfemIk5SatJxd2o8yrFfrMeAAUkjdfalC5PpjJ9ZKgfsuQ1T/pub?start=false&loop=false&delayms=3000
support class: browsertime_pageload.py
test url: https://docs.google.com/presentation/d/1Ici0ceWwpFvmIb3EmKeWSq_vAQdmmdFcWqaiLqUkJng/edit?usp=sharing
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	✅	✅	❌	❌
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	✅	✅	❌	❌
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-safari-google-slides	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	✅	✅	❌	❌
browsertime-tp6-essential-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	✅	✅	❌	❌
browsertime-tp6-live-chrome-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides	❌	❌	❌	❌

imdb

Command to Run Locally

./mach raptor -t imdb

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#100
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-imdb.manifest
playback pageset manifest backup: mitm8-linux-firefox-imdb.manifest
playback version: 11.0.0
secondary url: https://www.imdb.com/title/tt0084967/episodes/?ref_=tt_ov_epl
support class: browsertime_pageload.py
test url: https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-custom-car-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	✅	✅	❌	❌
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-custom-car-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	✅	✅	❌	❌
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-safari-imdb	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-custom-car-imdb	❌	❌	❌	❌
browsertime-tp6-firefox-imdb	✅	✅	❌	❌
browsertime-tp6-live-chrome-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb	❌	❌	❌	❌

imgur

Command to Run Locally

./mach raptor -t imgur

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#106
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-imgur.manifest
playback pageset manifest backup: mitm8-linux-firefox-imgur.manifest
playback version: 11.0.0
preferences: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true
secondary url: https://imgur.com/gallery/firefox-logo-w8fgXyY
support class: browsertime_pageload.py
test url: https://imgur.com/gallery/mozilla-performance-testing-logo-sNUtC19
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-custom-car-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	✅	✅	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-custom-car-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	✅	✅	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-safari-imgur	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur	❌	❌	❌	❌
browsertime-tp6-custom-car-imgur	❌	❌	❌	❌
browsertime-tp6-firefox-imgur	✅	✅	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur	❌	❌	❌	❌

instagram

Command to Run Locally

./mach raptor -t instagram

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#119
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-darwin-firefox-instagram.manifest
playback version: 11.0.0
secondary url: https://www.instagram.com/nobelprize_org/
support class: browsertime_pageload.py
test url: https://www.instagram.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	✅	✅	❌	❌
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	✅	✅	❌	❌
browsertime-tp6-live-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	✅	✅	❌	❌
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	✅	✅	❌	❌
browsertime-tp6-live-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	✅	✅	❌	❌
browsertime-tp6-essential-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	✅	✅	❌	❌
browsertime-tp6-live-chrome-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram	❌	❌	❌	❌
browsertime-tp6-live-firefox-instagram	❌	❌	❌	❌

Command to Run Locally

./mach raptor -t linkedin

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#124
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-linkedin.manifest
playback version: 8.1.1
secondary url: https://www.linkedin.com/in/thommy-harris-hk-385723106/
support class: browsertime_pageload.py
test url: https://www.linkedin.com/feed/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-custom-car-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	✅	✅	❌	❌
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-custom-car-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	✅	✅	❌	❌
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-safari-linkedin	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-custom-car-linkedin	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin	✅	✅	❌	❌
browsertime-tp6-live-chrome-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin	❌	❌	❌	❌

microsoft

Command to Run Locally

./mach raptor -t microsoft

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#130
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-microsoft.manifest
playback version: 11.0.0
secondary url: https://support.microsoft.com/en-us
support class: browsertime_pageload.py
test url: https://www.microsoft.com/en-us/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-custom-car-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	✅	✅	❌	❌
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-custom-car-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	✅	✅	❌	❌
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-safari-microsoft	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-custom-car-microsoft	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft	✅	✅	❌	❌
browsertime-tp6-live-chrome-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft	❌	❌	❌	❌

netflix

Command to Run Locally

./mach raptor -t netflix

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#135
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-netflix.manifest
playback version: 8.1.1
secondary url: https://www.netflix.com/title/699257
support class: browsertime_pageload.py
test url: https://www.netflix.com/title/80117263
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-custom-car-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	✅	✅	❌	❌
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-custom-car-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	✅	✅	❌	❌
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-custom-car-netflix	❌	❌	❌	❌
browsertime-tp6-firefox-netflix	✅	✅	❌	❌
browsertime-tp6-live-chrome-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix	❌	❌	❌	❌

nytimes

Command to Run Locally

./mach raptor -t nytimes

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#141
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-nytimes.manifest
playback version: 11.0.0
secondary url: https://www.nytimes.com/section/opinion/columnists
support class: browsertime_pageload.py
test url: https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-custom-car-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-custom-car-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-nytimes	❌	❌	❌	❌
browsertime-tp6-custom-car-nytimes	❌	❌	❌	❌
browsertime-tp6-firefox-nytimes	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-nytimes	❌	❌	❌	❌

office

Command to Run Locally

./mach raptor -t office

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#145
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-office.manifest
playback version: 11.0.0
secondary url: https://www.office.com/
support class: browsertime_pageload.py
test url: https://www.office.com/launch/powerpoint?auth=1
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-custom-car-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-custom-car-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-office	❌	❌	❌	❌
browsertime-tp6-custom-car-office	❌	❌	❌	❌
browsertime-tp6-firefox-office	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-office	❌	❌	❌	❌

openai

Command to Run Locally

./mach raptor -t openai

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#27
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-openai.manifest
playback version: 11.0.0
secondary url: https://openai.com/blog
support class: browsertime_pageload.py
test url: https://openai.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-openai	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-openai	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-openai	❌	❌	❌	❌
browsertime-tp7-firefox-openai	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-openai	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-openai	❌	❌	❌	❌
browsertime-tp7-firefox-openai	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-openai	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-openai	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-openai	❌	❌	❌	❌
browsertime-tp7-firefox-openai	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-openai	❌	❌	❌	❌

outlook

Command to Run Locally

./mach raptor -t outlook

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#149
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-live.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://outlook.live.com/mail/inbox
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-custom-car-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	✅	✅	❌	❌
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-custom-car-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	✅	✅	❌	❌
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-custom-car-outlook	❌	❌	❌	❌
browsertime-tp6-firefox-outlook	✅	✅	❌	❌
browsertime-tp6-live-chrome-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-outlook	❌	❌	❌	❌
browsertime-tp6-live-firefox-outlook	❌	❌	❌	❌

paypal

Command to Run Locally

./mach raptor -t paypal

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#153
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-paypal.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.paypal.com/myaccount/summary/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-custom-car-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	✅	✅	❌	❌
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-custom-car-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	✅	✅	❌	❌
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-safari-paypal	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-custom-car-paypal	❌	❌	❌	❌
browsertime-tp6-firefox-paypal	✅	✅	❌	❌
browsertime-tp6-live-chrome-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-paypal	❌	❌	❌	❌
browsertime-tp6-live-firefox-paypal	❌	❌	❌	❌

Command to Run Locally

./mach raptor -t pinterest

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#157
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-pinterest.manifest
playback version: 8.1.1
secondary url: https://www.pinterest.com/today/best/halloween-costumes-for-your-furry-friends/75787/
support class: browsertime_pageload.py
test url: https://pinterest.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-custom-car-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	✅	✅	❌	❌
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-custom-car-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	✅	✅	❌	❌
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-safari-pinterest	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-custom-car-pinterest	❌	❌	❌	❌
browsertime-tp6-firefox-pinterest	✅	✅	❌	❌
browsertime-tp6-live-chrome-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-pinterest	❌	❌	❌	❌
browsertime-tp6-live-firefox-pinterest	❌	❌	❌	❌

Command to Run Locally

./mach raptor -t reddit

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#164
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-reddit.manifest
playback pageset manifest backup: mitm8-linux-firefox-reddit.manifest
playback version: 11.0.0
secondary url: https://www.reddit.com/r/technology/
support class: browsertime_pageload.py
test url: https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-custom-car-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	✅	✅	❌	❌
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-custom-car-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	✅	✅	❌	❌
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-safari-reddit	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-custom-car-reddit	❌	❌	❌	❌
browsertime-tp6-firefox-reddit	✅	✅	❌	❌
browsertime-tp6-live-chrome-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-reddit	❌	❌	❌	❌
browsertime-tp6-live-firefox-reddit	❌	❌	❌	❌

samsung

Command to Run Locally

./mach raptor -t samsung

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#32
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-samsung.manifest
playback version: 11.0.0
secondary url: https://www.samsung.com/us/mobile
support class: browsertime_pageload.py
test url: https://www.samsung.com/us
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-samsung	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-samsung	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-samsung	❌	❌	❌	❌
browsertime-tp7-firefox-samsung	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-samsung	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-samsung	❌	❌	❌	❌
browsertime-tp7-firefox-samsung	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-samsung	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-samsung	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-samsung	❌	❌	❌	❌
browsertime-tp7-firefox-samsung	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-samsung	❌	❌	❌	❌

tiktok

Command to Run Locally

./mach raptor -t tiktok

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#28
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-tiktok.manifest
playback version: 11.0.0
secondary url: https://www.tiktok.com/explore
support class: browsertime_pageload.py
test url: https://www.tiktok.com/en
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-tiktok	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-tiktok	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-tiktok	❌	❌	❌	❌
browsertime-tp7-firefox-tiktok	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-tiktok	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-tiktok	❌	❌	❌	❌
browsertime-tp7-firefox-tiktok	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-tiktok	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-tiktok	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-tiktok	❌	❌	❌	❌
browsertime-tp7-firefox-tiktok	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-tiktok	❌	❌	❌	❌

tumblr

Command to Run Locally

./mach raptor -t tumblr

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#171
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-tumblr.manifest
playback version: 8.1.1
secondary url: https://www.tumblr.com/tagged/funny+cats?sort=top
support class: browsertime_pageload.py
test url: https://www.tumblr.com/dashboard
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-custom-car-tumblr	❌	❌	❌	❌
browsertime-tp6-firefox-tumblr	✅	✅	❌	❌
browsertime-tp6-live-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-custom-car-tumblr	❌	❌	❌	❌
browsertime-tp6-firefox-tumblr	✅	✅	❌	❌
browsertime-tp6-live-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-safari-tumblr	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-custom-car-tumblr	❌	❌	❌	❌
browsertime-tp6-firefox-tumblr	✅	✅	❌	❌
browsertime-tp6-live-chrome-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-tumblr	❌	❌	❌	❌
browsertime-tp6-live-firefox-tumblr	❌	❌	❌	❌

twitch

Command to Run Locally

./mach raptor -t twitch

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#177
lower is better: true
measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-twitch.manifest
playback version: 11.0.0
preferences: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true
secondary url: https://www.twitch.tv/gmashley
support class: browsertime_pageload.py
test url: https://www.twitch.tv/videos/894226211
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-custom-car-twitch	❌	❌	❌	❌
browsertime-tp6-firefox-twitch	✅	✅	❌	❌
browsertime-tp6-live-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-custom-car-twitch	❌	❌	❌	❌
browsertime-tp6-firefox-twitch	✅	✅	❌	❌
browsertime-tp6-live-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-safari-twitch	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-custom-car-twitch	❌	❌	❌	❌
browsertime-tp6-firefox-twitch	✅	✅	❌	❌
browsertime-tp6-live-chrome-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-twitch	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitch	❌	❌	❌	❌

twitter

Command to Run Locally

./mach raptor -t twitter

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#190
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-twitter.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://twitter.com/BarackObama
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	✅	✅	❌	❌
browsertime-tp6-essential-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	✅	✅	❌	❌
browsertime-tp6-live-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	✅	✅	❌	❌
browsertime-tp6-essential-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	✅	✅	❌	❌
browsertime-tp6-live-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	✅	✅	❌	❌
browsertime-tp6-essential-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	✅	✅	❌	❌
browsertime-tp6-live-chrome-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-essential-firefox-twitter	❌	❌	❌	❌
browsertime-tp6-live-firefox-twitter	❌	❌	❌	❌

weather

Command to Run Locally

./mach raptor -t weather

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#41
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-weather.manifest
playback version: 11.0.0
secondary url: https://weather.com/en-CA/weather/monthly/l/43.67%2C-79.42
support class: browsertime_pageload.py
test url: https://weather.com/en-CA/weather/today/l/43.67%2C-79.42
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-weather	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-weather	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-weather	❌	❌	❌	❌
browsertime-tp7-firefox-weather	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-weather	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-weather	❌	❌	❌	❌
browsertime-tp7-firefox-weather	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-weather	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-weather	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-chrome-weather	❌	❌	❌	❌
browsertime-tp7-firefox-weather	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp7-firefox-weather	❌	❌	❌	❌

wikia

Command to Run Locally

./mach raptor -t wikia

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#195
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-wikia.manifest
playback version: 11.0.0
secondary url: https://marvel.fandom.com/wiki/Celestials
support class: browsertime_pageload.py
test url: https://marvel.fandom.com/wiki/Black_Panther
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-wikia	❌	❌	❌	❌
browsertime-tp6-custom-car-wikia	❌	❌	❌	❌
browsertime-tp6-firefox-wikia	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-wikia	❌	❌	❌	❌
browsertime-tp6-custom-car-wikia	❌	❌	❌	❌
browsertime-tp6-firefox-wikia	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-wikia	❌	❌	❌	❌
browsertime-tp6-custom-car-wikia	❌	❌	❌	❌
browsertime-tp6-firefox-wikia	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-wikia	❌	❌	❌	❌

wikipedia

Command to Run Locally

./mach raptor -t wikipedia

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#200
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-wikipedia.manifest
playback pageset manifest backup: mitm7-linux-firefox-wikipedia.manifest
playback version: 11.0.0
secondary url: https://en.wikipedia.org/wiki/Joe_Biden
support class: browsertime_pageload.py
test url: https://en.wikipedia.org/wiki/Barack_Obama
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	✅	✅	❌	❌
browsertime-tp6-essential-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	✅	✅	❌	❌
browsertime-tp6-live-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	✅	✅	❌	❌
browsertime-tp6-essential-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	✅	✅	❌	❌
browsertime-tp6-live-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-safari-wikipedia	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	✅	✅	❌	❌
browsertime-tp6-essential-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	✅	✅	❌	❌
browsertime-tp6-live-chrome-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-essential-firefox-wikipedia	❌	❌	❌	❌
browsertime-tp6-live-firefox-wikipedia	❌	❌	❌	❌

yahoo-mail

Command to Run Locally

./mach raptor -t yahoo-mail

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#206
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-yahoo-mail.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://mail.yahoo.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	✅	✅	❌	❌
browsertime-tp6-essential-chrome-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	✅	✅	❌	❌
browsertime-tp6-live-chrome-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	✅	✅	❌	❌
browsertime-tp6-essential-chrome-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	✅	✅	❌	❌
browsertime-tp6-live-chrome-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-safari-yahoo-mail	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	✅	✅	❌	❌
browsertime-tp6-essential-chrome-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-custom-car-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	✅	✅	❌	❌
browsertime-tp6-live-chrome-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-bytecode-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-essential-firefox-yahoo-mail	❌	❌	❌	❌
browsertime-tp6-live-firefox-yahoo-mail	❌	❌	❌	❌

youtube

Command to Run Locally

./mach raptor -t youtube

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#211
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-youtube.manifest
playback pageset manifest backup: mitm7-linux-firefox-youtube.manifest
playback version: 11.0.0
secondary url: https://www.youtube.com/watch?v=JrdEMERq8MA
support class: browsertime_pageload.py
test url: https://www.youtube.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-youtube	❌	❌	❌	❌
browsertime-tp6-custom-car-youtube	❌	❌	❌	❌
browsertime-tp6-firefox-youtube	✅	✅	❌	❌
browsertime-tp6-live-chrome-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-youtube	❌	❌	❌	❌
browsertime-tp6-custom-car-youtube	❌	❌	❌	❌
browsertime-tp6-firefox-youtube	✅	✅	❌	❌
browsertime-tp6-live-chrome-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌
browsertime-tp6-live-safari-youtube	❌	❌	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-youtube	❌	❌	❌	❌
browsertime-tp6-custom-car-youtube	❌	❌	❌	❌
browsertime-tp6-firefox-youtube	✅	✅	❌	❌
browsertime-tp6-live-chrome-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-youtube	❌	❌	❌	❌
browsertime-tp6-live-firefox-youtube	❌	❌	❌	❌

Interactive 

Browsertime tests that interact with the webpage. Includes responsiveness tests as they make use of this support for navigation. This type of test allows the specification of browsertime commands through the test manifest.

cnn-nav

Command to Run Locally

./mach raptor -t cnn-nav

Owner: PerfTest Team

Description: Navigates to cnn main page, then to the world sub-page.

accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#25
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-cnn-nav.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘landing’] [‘navigate’, ‘https://www.cnn.com’] [‘wait.byTime’, ‘4000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘world’] [‘click.byXpathAndWait’, ‘/html/body/div[5]/div/div/header/div/div[1]/div/div[2]/nav/ul/li[2]/a’] [‘wait.byTime’, ‘1000’] [‘measure.stop’, ‘’]
test url: https://www.cnn.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-cnn-nav	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-cnn-nav	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-cnn-nav	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-cnn-nav	❌	❌	❌	❌
browsertime-responsiveness-firefox-cnn-nav	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-cnn-nav	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-cnn-nav	❌	❌	❌	❌
browsertime-responsiveness-firefox-cnn-nav	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-cnn-nav	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-cnn-nav	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-cnn-nav	❌	❌	❌	❌
browsertime-responsiveness-firefox-cnn-nav	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-cnn-nav	❌	❌	❌	❌

facebook-nav

Command to Run Locally

./mach raptor -t facebook-nav

Owner: PerfTest Team

Description: Navigates to facebook, then the sub-pages friends, marketplace, groups.

accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#40
lower is better: true
page cycles: 25
page timeout: 90000
playback: mitmproxy
playback pageset manifest: mitm11-windows-firefox-facebook-nav.manifest
playback pageset manifest backup: mitm6-windows-firefox-facebook-nav.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘landing’] [‘navigate’, ‘https://www.facebook.com/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘marketplace’] [‘navigate’, ‘https://www.facebook.com/marketplace’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘groups’] [‘navigate’, ‘https://www.facebook.com/groups/discover/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘friends’] [‘navigate’, ‘https://www.facebook.com/friends/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’]
test url: https://www.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-facebook-nav	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-facebook-nav	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-facebook-nav	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-facebook-nav	❌	❌	❌	❌
browsertime-responsiveness-firefox-facebook-nav	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-facebook-nav	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-facebook-nav	❌	❌	❌	❌
browsertime-responsiveness-firefox-facebook-nav	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-facebook-nav	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-facebook-nav	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-facebook-nav	❌	❌	❌	❌
browsertime-responsiveness-firefox-facebook-nav	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-facebook-nav	❌	❌	❌	❌

reddit-billgates-ama

Command to Run Locally

./mach raptor -t reddit-billgates-ama

Owner: PerfTest Team

Description: Navigates from the Bill Gates AMA to the Reddit members section.

accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#65
lower is better: true
page cycles: 25
page timeout: 240000
playback: mitmproxy
playback pageset manifest: mitm6-windows-firefox-reddit-billgates-ama.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘billg-ama’] [‘navigate’, ‘https://www.reddit.com/r/IAmA/comments/m8n4vt/im_bill_gates_cochair_of_the_bill_and_melinda/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘members’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div[3]/div[2]/div/div[1]/div/div[4]/div[1]/div’] [‘wait.byTime’, ‘1000’] [‘measure.stop’, ‘’]
test url: https://www.reddit.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-ama	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-ama	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-ama	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-reddit-billgates-ama	❌	❌	❌	❌
browsertime-responsiveness-firefox-reddit-billgates-ama	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-ama	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-reddit-billgates-ama	❌	❌	❌	❌
browsertime-responsiveness-firefox-reddit-billgates-ama	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-ama	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-ama	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-reddit-billgates-ama	❌	❌	❌	❌
browsertime-responsiveness-firefox-reddit-billgates-ama	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-ama	❌	❌	❌	❌

reddit-billgates-post-1

Command to Run Locally

./mach raptor -t reddit-billgates-post-1

Owner: PerfTest Team

Description: Navigates the thisisbillgates user starting at the main user page, then to the posts, comments, hot, and top sections.

accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#82
lower is better: true
page cycles: 25
page timeout: 90000
playback: mitmproxy
playback pageset manifest: mitm6-windows-firefox-reddit-billgates-post.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘billg’] [‘navigate’, ‘https://www.reddit.com/user/thisisbillgates/’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘measure.start’, ‘posts’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[2]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘measure.start’, ‘comments’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘wait.byTime’, ‘500’]
test url: https://www.reddit.com/user/thisisbillgates/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-1	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-1	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-1	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-reddit-billgates-post-1	❌	❌	❌	❌
browsertime-responsiveness-firefox-reddit-billgates-post-1	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-1	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-reddit-billgates-post-1	❌	❌	❌	❌
browsertime-responsiveness-firefox-reddit-billgates-post-1	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-1	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-1	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-reddit-billgates-post-1	❌	❌	❌	❌
browsertime-responsiveness-firefox-reddit-billgates-post-1	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-1	❌	❌	❌	❌

reddit-billgates-post-2

Command to Run Locally

./mach raptor -t reddit-billgates-post-2

Owner: PerfTest Team

Description: Navigates the thisisbillgates user starting at the main user page, then to the posts, comments, hot, and top sections.

accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#104
lower is better: true
page cycles: 25
page timeout: 90000
playback: mitmproxy
playback pageset manifest: mitm6-windows-firefox-reddit-billgates-post.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘billg’] [‘navigate’, ‘https://www.reddit.com/user/thisisbillgates/’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]’] [‘wait.byTime’, ‘500’] [‘measure.start’, ‘hot’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[2]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘measure.start’, ‘top’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[3]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘wait.byTime’, ‘500’]
test url: https://www.reddit.com/user/thisisbillgates/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-linux1804-64-clang-trunk-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-2	❌	❌	❌	❌

**test-linux1804-64-nightlyasrelease-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-2	❌	❌	❌	❌

**test-linux1804-64-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-2	❌	❌	❌	❌

**test-linux1804-64-shippable-qr/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-reddit-billgates-post-2	❌	❌	❌	❌
browsertime-responsiveness-firefox-reddit-billgates-post-2	✅	✅	❌	❌

**test-macosx1470-64-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-2	❌	❌	❌	❌

**test-macosx1470-64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-reddit-billgates-post-2	❌	❌	❌	❌
browsertime-responsiveness-firefox-reddit-billgates-post-2	✅	✅	❌	❌

**test-macosx1470-64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-2	❌	❌	❌	❌

**test-windows11-64-24h2-nightlyasrelease/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-2	❌	❌	❌	❌

**test-windows11-64-24h2-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-chrome-reddit-billgates-post-2	❌	❌	❌	❌
browsertime-responsiveness-firefox-reddit-billgates-post-2	✅	✅	❌	❌

**test-windows11-64-24h2/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-responsiveness-firefox-reddit-billgates-post-2	❌	❌	❌	❌

Live 

A set of test pages that are run as live sites instead of recorded versions. These tests are available on all browsers, on all platforms.

booking-sf

Command to Run Locally

./mach raptor -t booking-sf

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#17
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://www.booking.com/hotel/us/edwardian-san-francisco.html
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-booking-sf	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-booking-sf-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-booking-sf	❌	❌	❌	❌
browsertime-tp6m-live-fenix-booking-sf-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-booking-sf	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-booking-sf-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-booking-sf	❌	❌	❌	❌
browsertime-tp6m-live-fenix-booking-sf-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-booking-sf	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-booking-sf-nofis	❌	❌	❌	❌

discord

Command to Run Locally

./mach raptor -t discord

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#20
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://discordapp.com/
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-discord	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-discord-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-discord	❌	❌	❌	❌
browsertime-tp6m-live-fenix-discord-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-discord	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-discord-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-discord	❌	❌	❌	❌
browsertime-tp6m-live-fenix-discord-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-discord	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-discord-nofis	❌	❌	❌	❌

fashionbeans

Command to Run Locally

./mach raptor -t fashionbeans

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#23
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://fashionbeans.com/article/coolest-menswear-stores-in-the-world
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-fashionbeans	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-fashionbeans-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-fashionbeans	❌	❌	❌	❌
browsertime-tp6m-live-fenix-fashionbeans-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-fashionbeans	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-fashionbeans-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-fashionbeans	❌	❌	❌	❌
browsertime-tp6m-live-fenix-fashionbeans-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-fashionbeans	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-fashionbeans-nofis	❌	❌	❌	❌

google-accounts

Command to Run Locally

./mach raptor -t google-accounts

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#26
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://accounts.google.com
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-google-accounts	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-google-accounts-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-accounts	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-accounts-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-accounts	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-accounts-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-google-accounts	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-accounts-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-accounts	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-accounts-nofis	❌	❌	❌	❌

imdb-firefox

Command to Run Locally

./mach raptor -t imdb-firefox

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#29
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://m.imdb.com/title/tt0083943/
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-imdb-firefox	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-imdb-firefox-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-firefox	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-firefox-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-firefox	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-firefox-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-imdb-firefox	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-firefox-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-firefox	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-firefox-nofis	❌	❌	❌	❌

medium-article

Command to Run Locally

./mach raptor -t medium-article

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#32
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://medium.com/s/coincidences-are-a-lie/could-america-have-also-been-the-birthplace-of-impressionism-cb3d31a2e22d
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-medium-article	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-medium-article-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-medium-article	❌	❌	❌	❌
browsertime-tp6m-live-fenix-medium-article-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-medium-article	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-medium-article-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-medium-article	❌	❌	❌	❌
browsertime-tp6m-live-fenix-medium-article-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-medium-article	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-medium-article-nofis	❌	❌	❌	❌

people-article

Command to Run Locally

./mach raptor -t people-article

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#35
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://people.com/amp-stories/royal-a-to-z/
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-people-article	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-people-article-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-people-article	❌	❌	❌	❌
browsertime-tp6m-live-fenix-people-article-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-people-article	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-people-article-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-people-article	❌	❌	❌	❌
browsertime-tp6m-live-fenix-people-article-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-people-article	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-people-article-nofis	❌	❌	❌	❌

reddit-thread

Command to Run Locally

./mach raptor -t reddit-thread

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#38
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://www.reddit.com/r/firefox/comments/7dkq03/its_been_a_while/
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-reddit-thread	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-reddit-thread-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit-thread	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit-thread-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit-thread	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit-thread-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-reddit-thread	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit-thread-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit-thread	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit-thread-nofis	❌	❌	❌	❌

rumble-fox

Command to Run Locally

./mach raptor -t rumble-fox

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#41
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://rumble.com/v3c44t-foxes-jumping-on-my-trampoline.html
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-rumble-fox	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-rumble-fox-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-rumble-fox	❌	❌	❌	❌
browsertime-tp6m-live-fenix-rumble-fox-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-rumble-fox	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-rumble-fox-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-rumble-fox	❌	❌	❌	❌
browsertime-tp6m-live-fenix-rumble-fox-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-rumble-fox	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-rumble-fox-nofis	❌	❌	❌	❌

stackoverflow-question

Command to Run Locally

./mach raptor -t stackoverflow-question

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#44
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://stackoverflow.com/questions/927358/how-do-i-undo-the-most-recent-commits-in-git
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-stackoverflow-question	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-stackoverflow-question-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-stackoverflow-question	❌	❌	❌	❌
browsertime-tp6m-live-fenix-stackoverflow-question-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-stackoverflow-question	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-stackoverflow-question-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-stackoverflow-question	❌	❌	❌	❌
browsertime-tp6m-live-fenix-stackoverflow-question-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-stackoverflow-question	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-stackoverflow-question-nofis	❌	❌	❌	❌

urbandictionary-define

Command to Run Locally

./mach raptor -t urbandictionary-define

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#47
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://urbandictionary.com/define.php?term=awesome%20sauce
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-urbandictionary-define	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-urbandictionary-define-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-urbandictionary-define	❌	❌	❌	❌
browsertime-tp6m-live-fenix-urbandictionary-define-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-urbandictionary-define	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-urbandictionary-define-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-urbandictionary-define	❌	❌	❌	❌
browsertime-tp6m-live-fenix-urbandictionary-define-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-urbandictionary-define	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-urbandictionary-define-nofis	❌	❌	❌	❌

wikia-marvel

Command to Run Locally

./mach raptor -t wikia-marvel

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#50
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://marvel.wikia.com/wiki/Black_Panther
type: pageload
unit: ms
use live sites: true
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-wikia-marvel	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-wikia-marvel-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-wikia-marvel	❌	❌	❌	❌
browsertime-tp6m-live-fenix-wikia-marvel-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikia-marvel	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikia-marvel-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-wikia-marvel	❌	❌	❌	❌
browsertime-tp6m-live-fenix-wikia-marvel-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikia-marvel	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikia-marvel-nofis	❌	❌	❌	❌

Mobile 

Page-load performance test suite on Android. The links direct to the actual websites that are being tested.

allrecipes

Command to Run Locally

./mach raptor -t allrecipes

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#22
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm8-android-gve-allrecipes.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.allrecipes.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-allrecipes	❌	❌	❌	❌
browsertime-tp6m-essential-chrome-m-allrecipes-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-allrecipes	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-allrecipes-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-allrecipes	✅	✅	❌	❌
browsertime-tp6m-essential-fenix-allrecipes-nofis	✅	✅	❌	❌
browsertime-tp6m-essential-geckoview-allrecipes	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-allrecipes-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-allrecipes	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-allrecipes	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-allrecipes-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-allrecipes	❌	❌	❌	❌
browsertime-tp6m-live-fenix-allrecipes-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-allrecipes	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-allrecipes-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-allrecipes	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-allrecipes-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-allrecipes	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-allrecipes-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-allrecipes	❌	❌	❌	❌
browsertime-tp6m-live-fenix-allrecipes	❌	❌	❌	❌
browsertime-tp6m-live-fenix-allrecipes-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-allrecipes	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-allrecipes-nofis	❌	❌	❌	❌

amazon

Command to Run Locally

./mach raptor -t amazon

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#27
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-amazon.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.amazon.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-chrome-m-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-amazon	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon	✅	❌	❌	❌
browsertime-tp6m-fenix-amazon-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-amazon	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon	✅	❌	❌	❌
browsertime-tp6m-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon	❌	❌	❌	❌

amazon-search

Command to Run Locally

./mach raptor -t amazon-search

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#30
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-amazon-search.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-amazon-search	❌	❌	❌	❌
browsertime-tp6m-essential-chrome-m-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-amazon-search	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-amazon-search	✅	✅	❌	❌
browsertime-tp6m-essential-fenix-amazon-search-nofis	✅	✅	❌	❌
browsertime-tp6m-essential-geckoview-amazon-search	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-amazon-search	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-amazon-search	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-search	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-search	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-webextensions-fenix-amazon-search	✅	❌	❌	❌
browsertime-tp6m-webextensions-fenix-amazon-search-nofis	✅	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-amazon-search	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-amazon-search	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-amazon-search	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-search	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-search	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-search-nofis	❌	❌	❌	❌
browsertime-tp6m-webextensions-fenix-amazon-search	❌	❌	❌	❌
browsertime-tp6m-webextensions-fenix-amazon-search-nofis	❌	❌	❌	❌

bild-de

Command to Run Locally

./mach raptor -t bild-de

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#33
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm8-android-fenix-bild-de.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.bild.de/sport/american-football/nfl/super-bowl-rekordquote-fuer-die-nfl-87139668.bild.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-bild-de	❌	❌	❌	❌
browsertime-tp6m-chrome-m-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-bild-de	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-bild-de	✅	❌	❌	❌
browsertime-tp6m-fenix-bild-de-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-bild-de	❌	❌	❌	❌
browsertime-tp6m-geckoview-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-bild-de	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bild-de	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bild-de	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-bild-de	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-bild-de	✅	❌	❌	❌
browsertime-tp6m-fenix-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-bild-de	❌	❌	❌	❌
browsertime-tp6m-geckoview-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bild-de	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bild-de	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bild-de-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-bild-de	❌	❌	❌	❌

bing

Command to Run Locally

./mach raptor -t bing

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#38
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-bing.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.bing.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-bing	❌	❌	❌	❌
browsertime-tp6m-chrome-m-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-bing	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-bing	✅	❌	❌	❌
browsertime-tp6m-fenix-bing-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-bing	❌	❌	❌	❌
browsertime-tp6m-geckoview-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-bing	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bing	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bing	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-bing	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-bing	✅	❌	❌	❌
browsertime-tp6m-fenix-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-bing	❌	❌	❌	❌
browsertime-tp6m-geckoview-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bing	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bing	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bing-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-bing	❌	❌	❌	❌

bing-search-restaurants

Command to Run Locally

./mach raptor -t bing-search-restaurants

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#41
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-bing-search-restaurants.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.bing.com/search?q=restaurants+in+exton+pa+19341
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-bing-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-chrome-m-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-bing-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-bing-search-restaurants	✅	❌	❌	❌
browsertime-tp6m-fenix-bing-search-restaurants-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-bing-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-geckoview-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-bing-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bing-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bing-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-bing-search-restaurants	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-bing-search-restaurants	✅	❌	❌	❌
browsertime-tp6m-fenix-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-bing-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-geckoview-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bing-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-fenix-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bing-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-bing-search-restaurants	❌	❌	❌	❌

booking

Command to Run Locally

./mach raptor -t booking

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#44
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-booking.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.booking.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-booking	❌	❌	❌	❌
browsertime-tp6m-chrome-m-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-booking	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-booking	✅	❌	❌	❌
browsertime-tp6m-fenix-booking-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-booking	❌	❌	❌	❌
browsertime-tp6m-geckoview-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-booking	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-booking	❌	❌	❌	❌
browsertime-tp6m-live-fenix-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-booking	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-booking	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-booking	✅	❌	❌	❌
browsertime-tp6m-fenix-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-booking	❌	❌	❌	❌
browsertime-tp6m-geckoview-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-booking	❌	❌	❌	❌
browsertime-tp6m-live-fenix-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-booking	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-booking-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-booking	❌	❌	❌	❌

cnn

Command to Run Locally

./mach raptor -t cnn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#47
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-cnn.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://cnn.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-chrome-m-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-cnn	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn	✅	❌	❌	❌
browsertime-tp6m-fenix-cnn-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-cnn	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn	✅	❌	❌	❌
browsertime-tp6m-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn	❌	❌	❌	❌

cnn-ampstories

Command to Run Locally

./mach raptor -t cnn-ampstories

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#50
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-cnn-ampstories.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn-ampstories	❌	❌	❌	❌
browsertime-tp6m-chrome-m-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-cnn-ampstories	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn-ampstories	✅	❌	❌	❌
browsertime-tp6m-fenix-cnn-ampstories-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-cnn-ampstories	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-cnn-ampstories	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-ampstories	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-ampstories	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-ampstories	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn-ampstories	✅	❌	❌	❌
browsertime-tp6m-fenix-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-ampstories	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-ampstories	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-ampstories	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-ampstories-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-ampstories	❌	❌	❌	❌

dailymail

Command to Run Locally

./mach raptor -t dailymail

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#53
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-dailymail.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.dailymail.co.uk/sciencetech/article-9749081/Experts-say-Hubble-repair-despite-NASA-insisting-multiple-options-fix.html
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-dailymail	❌	❌	❌	❌
browsertime-tp6m-chrome-m-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-dailymail	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-dailymail	✅	❌	❌	❌
browsertime-tp6m-fenix-dailymail-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-dailymail	❌	❌	❌	❌
browsertime-tp6m-geckoview-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-dailymail	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-dailymail	❌	❌	❌	❌
browsertime-tp6m-live-fenix-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-dailymail	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-dailymail	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-dailymail	✅	❌	❌	❌
browsertime-tp6m-fenix-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-dailymail	❌	❌	❌	❌
browsertime-tp6m-geckoview-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-dailymail	❌	❌	❌	❌
browsertime-tp6m-live-fenix-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-dailymail	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-dailymail-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-dailymail	❌	❌	❌	❌

ebay-kleinanzeigen

Command to Run Locally

./mach raptor -t ebay-kleinanzeigen

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#56
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-ebay-kleinanzeigen.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.ebay-kleinanzeigen.de
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-ebay-kleinanzeigen	❌	❌	❌	❌
browsertime-tp6m-chrome-m-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-ebay-kleinanzeigen	✅	❌	❌	❌
browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-ebay-kleinanzeigen	❌	❌	❌	❌
browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-ebay-kleinanzeigen	❌	❌	❌	❌
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-ebay-kleinanzeigen	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-ebay-kleinanzeigen	✅	❌	❌	❌
browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-ebay-kleinanzeigen	❌	❌	❌	❌
browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-ebay-kleinanzeigen	❌	❌	❌	❌
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-ebay-kleinanzeigen	❌	❌	❌	❌

ebay-kleinanzeigen-search

Command to Run Locally

./mach raptor -t ebay-kleinanzeigen-search

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#59
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-ebay-kleinanzeigen-search.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.ebay-kleinanzeigen.de/s-anzeigen/auf-zeit-wg-berlin/zimmer/c199-l3331
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search	❌	❌	❌	❌
browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-search	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-ebay-kleinanzeigen-search	✅	❌	❌	❌
browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-ebay-kleinanzeigen-search	❌	❌	❌	❌
browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search	❌	❌	❌	❌
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-ebay-kleinanzeigen-search	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-ebay-kleinanzeigen-search	✅	❌	❌	❌
browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-ebay-kleinanzeigen-search	❌	❌	❌	❌
browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search	❌	❌	❌	❌
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-ebay-kleinanzeigen-search	❌	❌	❌	❌

espn

Command to Run Locally

./mach raptor -t espn

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#62
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-espn.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn	❌	❌	❌	❌
browsertime-tp6m-essential-chrome-m-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-espn	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn	✅	✅	❌	❌
browsertime-tp6m-essential-fenix-espn-nofis	✅	✅	❌	❌
browsertime-tp6m-essential-geckoview-espn	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-espn	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-nofis	❌	❌	❌	❌

facebook

Command to Run Locally

./mach raptor -t facebook

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#65
login: true
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-g5-fenix-facebook.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-facebook	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-facebook	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-nofis	❌	❌	❌	❌

facebook-cristiano

Command to Run Locally

./mach raptor -t facebook-cristiano

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#70
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-facebook-cristiano.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.facebook.com/Cristiano
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-facebook-cristiano	❌	❌	❌	❌
browsertime-tp6m-chrome-m-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-facebook-cristiano	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-facebook-cristiano	✅	❌	❌	❌
browsertime-tp6m-fenix-facebook-cristiano-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-facebook-cristiano	❌	❌	❌	❌
browsertime-tp6m-geckoview-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-facebook-cristiano	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-cristiano	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-cristiano	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-facebook-cristiano	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-facebook-cristiano	✅	❌	❌	❌
browsertime-tp6m-fenix-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-facebook-cristiano	❌	❌	❌	❌
browsertime-tp6m-geckoview-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-cristiano	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-cristiano	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-cristiano-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-facebook-cristiano	❌	❌	❌	❌

google

Command to Run Locally

./mach raptor -t google

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#73
login: true
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-g5-fenix-google.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.google.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-google	❌	❌	❌	❌
browsertime-tp6m-essential-chrome-m-google-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-google	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-google-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-google	✅	✅	❌	❌
browsertime-tp6m-essential-fenix-google-nofis	✅	✅	❌	❌
browsertime-tp6m-essential-geckoview-google	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-google-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-google	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-google	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-google-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-google	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-google-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-google	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-google-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-google	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-nofis	❌	❌	❌	❌

google-maps

Command to Run Locally

./mach raptor -t google-maps

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#78
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-google-maps.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.google.com/maps?force=pwa
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-google-maps	❌	❌	❌	❌
browsertime-tp6m-chrome-m-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-google-maps	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-google-maps	✅	❌	❌	❌
browsertime-tp6m-fenix-google-maps-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-google-maps	❌	❌	❌	❌
browsertime-tp6m-geckoview-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-google-maps	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-maps	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-maps	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-google-maps	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-google-maps	✅	❌	❌	❌
browsertime-tp6m-fenix-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-google-maps	❌	❌	❌	❌
browsertime-tp6m-geckoview-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-maps	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-maps	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-maps-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-google-maps	❌	❌	❌	❌

google-search-restaurants

Command to Run Locally

./mach raptor -t google-search-restaurants

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#81
login: true
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-g5-fenix-google-search-restaurants.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.google.com/search?q=restaurants+near+me
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-google-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-chrome-m-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-google-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-google-search-restaurants	✅	❌	❌	❌
browsertime-tp6m-fenix-google-search-restaurants-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-google-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-geckoview-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-google-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-google-search-restaurants	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-google-search-restaurants	✅	❌	❌	❌
browsertime-tp6m-fenix-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-google-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-geckoview-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-fenix-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-search-restaurants	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-google-search-restaurants-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-google-search-restaurants	❌	❌	❌	❌

imdb

Command to Run Locally

./mach raptor -t imdb

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#86
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-imdb.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.imdb.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-chrome-m-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-imdb	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb	✅	❌	❌	❌
browsertime-tp6m-fenix-imdb-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-imdb	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-imdb	✅	❌	❌	❌
browsertime-tp6m-fenix-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb	❌	❌	❌	❌

instagram

Command to Run Locally

./mach raptor -t instagram

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#89
login: true
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm8-android-gve-instagram.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.instagram.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-chrome-m-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-instagram	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram	✅	❌	❌	❌
browsertime-tp6m-fenix-instagram-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-instagram	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-instagram	✅	❌	❌	❌
browsertime-tp6m-fenix-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram	❌	❌	❌	❌

microsoft-support

Command to Run Locally

./mach raptor -t microsoft-support

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#95
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-microsoft-support.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://support.microsoft.com/en-us
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-essential-chrome-m-microsoft-support-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-microsoft-support-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-microsoft-support	✅	✅	❌	❌
browsertime-tp6m-essential-fenix-microsoft-support-nofis	✅	✅	❌	❌
browsertime-tp6m-essential-geckoview-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-microsoft-support-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-microsoft-support-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-live-fenix-microsoft-support-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-microsoft-support-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-microsoft-support-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-microsoft-support-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-live-fenix-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-live-fenix-microsoft-support-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-microsoft-support	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-microsoft-support-nofis	❌	❌	❌	❌

Command to Run Locally

./mach raptor -t reddit

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#98
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-reddit.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.reddit.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-chrome-m-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-reddit	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-reddit	✅	❌	❌	❌
browsertime-tp6m-fenix-reddit-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-reddit	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-reddit	✅	❌	❌	❌
browsertime-tp6m-fenix-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-geckoview-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit	❌	❌	❌	❌
browsertime-tp6m-live-fenix-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-reddit-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-reddit	❌	❌	❌	❌

sina

Command to Run Locally

./mach raptor -t sina

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#101
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm8-android-fenix-sina.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.sina.com.cn/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-sina	❌	❌	❌	❌
browsertime-tp6m-chrome-m-sina-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-sina	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-sina-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-sina	✅	❌	❌	❌
browsertime-tp6m-fenix-sina-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-sina	❌	❌	❌	❌
browsertime-tp6m-geckoview-sina-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-sina	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-sina	✅	❌	❌	❌
browsertime-tp6m-fenix-sina-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-sina	❌	❌	❌	❌
browsertime-tp6m-geckoview-sina-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-sina	❌	❌	❌	❌

stackoverflow

Command to Run Locally

./mach raptor -t stackoverflow

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#106
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-stackoverflow.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://stackoverflow.com/
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-stackoverflow	❌	❌	❌	❌
browsertime-tp6m-chrome-m-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-stackoverflow	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-stackoverflow	✅	❌	❌	❌
browsertime-tp6m-fenix-stackoverflow-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-stackoverflow	❌	❌	❌	❌
browsertime-tp6m-geckoview-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-stackoverflow	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-stackoverflow	❌	❌	❌	❌
browsertime-tp6m-live-fenix-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-stackoverflow	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-stackoverflow	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-stackoverflow	✅	❌	❌	❌
browsertime-tp6m-fenix-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-stackoverflow	❌	❌	❌	❌
browsertime-tp6m-geckoview-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-stackoverflow	❌	❌	❌	❌
browsertime-tp6m-live-fenix-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-stackoverflow	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-stackoverflow-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-stackoverflow	❌	❌	❌	❌

wikipedia

Command to Run Locally

./mach raptor -t wikipedia

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#109
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-wikipedia.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://en.m.wikipedia.org/wiki/Main_Page
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-wikipedia	❌	❌	❌	❌
browsertime-tp6m-chrome-m-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-wikipedia	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-wikipedia	✅	❌	❌	❌
browsertime-tp6m-fenix-wikipedia-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-wikipedia	❌	❌	❌	❌
browsertime-tp6m-geckoview-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-wikipedia	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-wikipedia	❌	❌	❌	❌
browsertime-tp6m-live-fenix-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikipedia	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-wikipedia	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-wikipedia	✅	❌	❌	❌
browsertime-tp6m-fenix-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-wikipedia	❌	❌	❌	❌
browsertime-tp6m-geckoview-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-wikipedia	❌	❌	❌	❌
browsertime-tp6m-live-fenix-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikipedia	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-wikipedia-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-wikipedia	❌	❌	❌	❌

youtube

Command to Run Locally

./mach raptor -t youtube

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#112
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-youtube.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.youtube.com
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-youtube	❌	❌	❌	❌
browsertime-tp6m-chrome-m-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-youtube	❌	❌	❌	❌
browsertime-tp6m-cstm-car-m-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-fenix-youtube	✅	❌	❌	❌
browsertime-tp6m-fenix-youtube-nofis	✅	✅	❌	❌
browsertime-tp6m-geckoview-youtube	❌	❌	❌	❌
browsertime-tp6m-geckoview-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-youtube	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-youtube	❌	❌	❌	❌
browsertime-tp6m-live-fenix-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-youtube	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-youtube	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-youtube	✅	❌	❌	❌
browsertime-tp6m-fenix-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-geckoview-youtube	❌	❌	❌	❌
browsertime-tp6m-geckoview-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-youtube	❌	❌	❌	❌
browsertime-tp6m-live-fenix-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-youtube	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-youtube-nofis	❌	❌	❌	❌
browsertime-tp6m-refbrow-youtube	❌	❌	❌	❌

youtube-watch

Command to Run Locally

./mach raptor -t youtube-watch

Owner: PerfTest Team

alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#115
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-youtube-watch.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.youtube.com/watch?v=COU5T-Wafa4
type: pageload
unit: ms
use live sites: false
Test Task:

**test-android-hw-a55-14-0-aarch64-shippable/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-essential-chrome-m-youtube-watch-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-essential-cstm-car-m-youtube-watch-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-youtube-watch	✅	✅	❌	❌
browsertime-tp6m-essential-fenix-youtube-watch-nofis	✅	✅	❌	❌
browsertime-tp6m-essential-geckoview-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-youtube-watch-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-youtube-watch-nofis	❌	❌	❌	❌
browsertime-tp6m-live-fenix-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-live-fenix-youtube-watch-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-youtube-watch-nofis	❌	❌	❌	❌

**test-android-hw-a55-14-0-aarch64/opt**
Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-youtube-watch-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-youtube-watch-nofis	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-live-fenix-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-live-fenix-youtube-watch-nofis	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-youtube-watch	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-youtube-watch-nofis	❌	❌	❌	❌

Scenario 

Tests that perform a specific action (a scenario), i.e. idle application, idle application in background, etc.

Unittests 

These tests aren’t used in standard testing, they are only used in the Raptor unit tests (they are similar to raptor-tp6 tests).