Raptor

Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, and Chrome.

• Contact: Dave Hunt [:davehunt]

• Source code: https://searchfox.org/mozilla-central/source/testing/raptor

• Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor

Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) “scenario”-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).

Locally, Raptor can be invoked with the following command:

./mach raptor

We’re in the process of migrating away from webextension to browsertime. Currently, raptor supports both of them, but at the end of the migration, the support for webextension will be removed.

• Raptor Browsertime
• Raptor WebExtension
• Debugging
• Contributing
• Raptor Test List

Raptor tests

The following documents all testing we have for Raptor.

Benchmarks

Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI.

ares6

Owner: :jandem and SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• page cycles: 4

• page timeout: 270000

• subtest lower is better: true

• subtest unit: ms

• test url: http://<host>:<port>/ARES-6/index.html?raptor

• type: benchmark

• unit: ms

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-ares6-fis-e10s	✅	✅	❌	✅

assorted-dom

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• fetch task: assorted-dom

• gecko profile entries: 2000000

• gecko profile interval: 1

• lower is better: true

• page cycles: 1

• page timeout: 60000

• screen capture: true

• test url: http://<host>:<port>/assorted-dom/assorted/driver.html?raptor

• type: benchmark

• unit: ms

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-assorted-dom-fis-e10s	✅	✅	❌	✅

jetstream2

Owner: :jandem and SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• fetch task: jetstream2

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: false

• page cycles: 4

• page timeout: 2000000

• subtest lower is better: false

• subtest unit: score

• test url: http://<host>:<port>/JetStream2/index.html?raptor

• type: benchmark

• unit: score

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-jetstream2-fis-e10s	✅	✅	❌	✅

motionmark-animometer

Owner: :jgilbert and Graphics(gfx) Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• gecko profile entries: 8000000

• gecko profile interval: 1

• lower is better: false

• page cycles: 1

• page timeout: 600000

• test url: http://<host>:<port>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=Animometer&raptor=true&oskey={platform}

• type: benchmark

• unit: score

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-animometer-fis-e10s	✅	✅	❌	✅

motionmark-htmlsuite

Owner: :jgilbert and Graphics(gfx) Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• gecko profile entries: 8000000

• gecko profile interval: 1

• lower is better: false

• page cycles: 5

• page timeout: 600000

• test url: http://<host>:<port>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=HTMLsuite&raptor=true&oskey={platform}

• type: benchmark

• unit: score

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s	✅	✅	❌	✅

raptor-speedometer-geckoview

Owner: SpiderMonkey Team

• alert threshold: 2.0

• apps: geckoview

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: false

• page cycles: 1

• page timeout: 420000

• subtest lower is better: true

• subtest unit: ms

• test url: http://<host>:<port>/Speedometer/index.html?raptor

• type: benchmark

• unit: score

raptor-youtube-playback-h264-1080p30-firefox

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• lower is better: true

• page cycles: 20

• page timeout: 2700000

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

raptor-youtube-playback-h264-1080p60-firefox

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• lower is better: true

• page cycles: 20

• page timeout: 2700000

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

raptor-youtube-playback-h264-full-1080p30-firefox

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• lower is better: true

• page cycles: 20

• page timeout: 2700000

• preferences: {“full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

raptor-youtube-playback-h264-full-1080p60-firefox

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• lower is better: true

• page cycles: 20

• page timeout: 2700000

• preferences: {“full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

raptor-youtube-playback-v9-1080p30-firefox

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• lower is better: true

• page cycles: 20

• page timeout: 2700000

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

raptor-youtube-playback-v9-1080p60-firefox

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• lower is better: true

• page cycles: 20

• page timeout: 2700000

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

raptor-youtube-playback-v9-full-1080p30-firefox

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• lower is better: true

• page cycles: 20

• page timeout: 2700000

• preferences: {“full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

raptor-youtube-playback-v9-full-1080p60-firefox

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• lower is better: true

• page cycles: 20

• page timeout: 2700000

• preferences: {“full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

speedometer

Owner: SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: false

• page cycles: 5

• page timeout: 180000

• subtest lower is better: true

• subtest unit: ms

• test url: http://<host>:<port>/Speedometer/index.html?raptor

• type: benchmark

• unit: score

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	✅	✅	❌	✅

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m-e10s	✅	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	✅	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	✅	✅	❌	✅

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	✅	✅	❌	✅

Owner: SpiderMonkey Team

• alert threshold: 2.0

• apps: fenix, geckoview, refbrow, chrome-m

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: false

• page cycles: 1

• page timeout: 420000

• subtest lower is better: true

• subtest unit: ms

• test url: http://<host>:<port>/Speedometer/index.html?raptor

• type: benchmark

• unit: score

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	✅	✅	❌	✅

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m-e10s	✅	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	✅	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	✅	✅	❌	✅

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-power-fenix-speedometer-e10s	❌	❌	❌	❌
browsertime-power-geckoview-speedometer-e10s	❌	❌	❌	❌
browsertime-power-refbrow-speedometer-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-speedometer-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-speedometer-mobile-geckoview-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-speedometer-fis-e10s	✅	✅	❌	✅

stylebench

Owner: :emelio and Layout Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• gecko profile entries: 8000000

• gecko profile interval: 1

• lower is better: false

• page cycles: 5

• page timeout: 120000

• subtest lower is better: true

• subtest unit: ms

• test url: http://<host>:<port>/StyleBench/index.html?raptor

• type: benchmark

• unit: score

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-stylebench-fis-e10s	✅	✅	❌	✅

sunspider

Owner: :jandem and SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• gecko profile entries: 8000000

• gecko profile interval: 1

• lower is better: true

• page cycles: 5

• page timeout: 55000

• test url: http://<host>:<port>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor

• type: benchmark

• unit: ms

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-sunspider-fis-e10s	✅	✅	❌	✅

unity-webgl

Owner: :jgilbert and Graphics(gfx) Team

• alert threshold: 2.0

• apps: geckoview, refbrow, fenix, chrome-m

• expected: pass

• fetch task: unity-webgl

• gecko profile entries: 8000000

• gecko profile interval: 1

• lower is better: false

• page cycles: 1

• page timeout: 420000

• test url: http://<host>:<port>/unity-webgl/index.html?raptor

• type: benchmark

• unit: score

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	✅	✅	❌	✅
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-e10s	✅	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-e10s	✅	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	✅	✅	❌	✅
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	✅	✅	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	✅	✅	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	✅	✅	❌	❌

Owner: :jgilbert and Graphics(gfx) Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• fetch task: unity-webgl

• gecko profile entries: 8000000

• gecko profile interval: 1

• lower is better: false

• page cycles: 5

• page timeout: 420000

• test url: http://<host>:<port>/unity-webgl/index.html?raptor

• type: benchmark

• unit: score

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	✅	✅	❌	✅
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-e10s	✅	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-e10s	✅	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	✅	✅	❌	✅
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-unity-webgl-mobile-chrome-m-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-fenix-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-geckoview-e10s	❌	❌	❌	❌
browsertime-unity-webgl-mobile-refbrow-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	✅	✅	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	✅	✅	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-unity-webgl-fis-e10s	✅	✅	❌	❌

wasm-godot

Owner: :lth and SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• gecko profile entries: 8000000

• gecko profile interval: 1

• lower is better: true

• newtab per cycle: true

• page cycles: 5

• page timeout: 120000

• test url: http://localhost:<port>/wasm-godot/index.html

• type: benchmark

• unit: ms

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s	✅	❌	❌	❌

wasm-godot-baseline

Owner: :lth and SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 8000000

• gecko profile interval: 1

• lower is better: true

• newtab per cycle: true

• page cycles: 5

• page timeout: 120000

• preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}

• test url: http://localhost:<port>/wasm-godot/index.html

• type: benchmark

• unit: ms

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s	✅	❌	❌	❌

wasm-godot-optimizing

Owner: :lth and SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 8000000

• gecko profile interval: 1

• lower is better: true

• newtab per cycle: true

• page cycles: 5

• page timeout: 120000

• preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}

• test url: http://localhost:<port>/wasm-godot/index.html

• type: benchmark

• unit: ms

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s	✅	❌	❌	❌

wasm-misc

Owner: :lth and SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• fetch task: wasm-misc

• gecko profile entries: 4000000

• gecko profile interval: 1

• lower is better: true

• page cycles: 5

• page timeout: 1200000

• test url: http://<host>:<port>/wasm-misc/index.html?raptor

• type: benchmark

• unit: ms

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-chrome-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-chromium-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s	✅	❌	❌	❌

wasm-misc-baseline

Owner: :lth and SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• fetch task: wasm-misc

• gecko profile entries: 4000000

• gecko profile interval: 1

• lower is better: true

• page cycles: 5

• page timeout: 1200000

• preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}

• test url: http://<host>:<port>/wasm-misc/index.html?raptor

• type: benchmark

• unit: ms

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s	✅	❌	❌	❌

wasm-misc-optimizing

Owner: :lth and SpiderMonkey Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• fetch task: wasm-misc

• gecko profile entries: 4000000

• gecko profile interval: 1

• lower is better: true

• page cycles: 5

• page timeout: 1200000

• preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}

• test url: http://<host>:<port>/wasm-misc/index.html?raptor

• type: benchmark

• unit: ms

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s	❌	❌	❌	❌
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s	✅	❌	❌	❌

webaudio

Owner: :padenot and Media Team

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• expected: pass

• gecko profile entries: 4000000

• gecko profile interval: 1

• lower is better: true

• page cycles: 5

• page timeout: 360000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• test url: http://<host>:<port>/webaudio/index.html?raptor

• type: benchmark

• unit: score

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-firefox-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-benchmark-chrome-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-chromium-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-e10s	❌	❌	❌	❌
browsertime-benchmark-firefox-webaudio-fis-e10s	✅	✅	❌	✅

youtube-playback

Owner: PerfTest Team

• alert on: H264.1080p30@1X_dropped_frames, H264.1080p60@1X_dropped_frames, H264.1440p30@1X_dropped_frames, H264.144p15@1X_dropped_frames, H264.2160p30@1X_dropped_frames, H264.240p30@1X_dropped_frames, H264.360p30@1X_dropped_frames, H264.480p30@1X_dropped_frames, H264.720p30@1X_dropped_frames, H264.720p60@1X_dropped_frames, VP9.1080p30@1X_dropped_frames, VP9.1080p60@1X_dropped_frames, VP9.1440p30@1X_dropped_frames, VP9.1440p60@1X_dropped_frames, VP9.144p30@1X_dropped_frames, VP9.2160p30@1X_dropped_frames, VP9.2160p60@1X_dropped_frames, VP9.240p30@1X_dropped_frames, VP9.360p30@1X_dropped_frames, VP9.480p30@1X_dropped_frames, VP9.720p30@1X_dropped_frames, VP9.720p60@1X_dropped_frames

• alert threshold: 2.0

• apps: firefox, geckoview, fenix,refbrow, chrome

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• subtest lower is better: true

• subtest unit: score

• test url: http://yttest.prod.mozaws.net/2019/main.html?test_type=playbackperf-test&raptor=true&command=run&exclude=1,2&muted=true

• type: benchmark

• unit: score

• use live sites: true

youtube-playback-av1-sfr

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox, geckoview, fenix, refbrow, chrome

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run

• type: benchmark

• unit: score

• use live sites: true

• Test Task:

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-av1-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-av1-sfr-fis-e10s	✅	❌	❌	❌

youtube-playback-h264-1080p30

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

youtube-playback-h264-1080p60

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

youtube-playback-h264-full-1080p30

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

youtube-playback-h264-full-1080p60

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

youtube-playback-h264-sfr

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox, geckoview, fenix, refbrow, chrome

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run

• type: benchmark

• unit: score

• use live sites: true

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s	✅	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s	✅	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-h264-sfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-h264-sfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-h264-sfr-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-h264-sfr-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-h264-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-h264-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-h264-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-h264-sfr-fis-e10s	✅	❌	❌	❌

youtube-playback-hfr

Owner: PerfTest Team

• alert on: H2641080p60fps@1X_dropped_frames, H264720p60fps@1X_dropped_frames

• alert threshold: 2.0

• apps: firefox, geckoview, fenix, refbrow, chrome

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run

• type: benchmark

• unit: score

• use live sites: true

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-e10s	✅	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-e10s	✅	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-hfr-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-hfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-hfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-hfr-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-hfr-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-hfr-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-hfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-hfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-hfr-fis-e10s	✅	❌	❌	❌

youtube-playback-v9-1080p30

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

youtube-playback-v9-1080p60

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

youtube-playback-v9-full-1080p30

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

youtube-playback-v9-full-1080p60

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2

• type: benchmark

• unit: score

• use live sites: true

youtube-playback-vp9-sfr

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox, geckoview, fenix, refbrow, chrome

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run

• type: benchmark

• unit: score

• use live sites: true

• Test Task:

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-vp9-sfr-e10s	✅	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-mobile-fenix-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-geckoview-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-mobile-refbrow-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s	✅	❌	❌	❌

youtube-playback-widevine-h264-sfr

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox, geckoview, fenix, refbrow, chrome

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run

• type: benchmark

• unit: score

• use live sites: true

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s	✅	❌	❌	❌

youtube-playback-widevine-hfr

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox, geckoview, fenix, refbrow, chrome

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run

• type: benchmark

• unit: score

• use live sites: true

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-hfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s	✅	❌	❌	❌

youtube-playback-widevine-vp9-sfr

Owner: PerfTest Team

• alert threshold: 2.0

• apps: firefox, geckoview, fenix, refbrow, chrome

• expected: pass

• gecko profile entries: 50000000

• gecko profile interval: 1000

• gecko profile threads: MediaPlayback

• lower is better: true

• page cycles: 1

• page timeout: 2700000

• preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}

• subtest lower is better: true

• subtest unit: score

• test url: https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run

• type: benchmark

• unit: score

• use live sites: true

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s	❌	❌	❌	❌
browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s	✅	❌	❌	❌

Custom

Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.

process-switch

Owner: PerfTest Team

• accept zero vismet: true

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• browsertime args: –pageCompleteWaitTime=1000 –pageCompleteCheckInactivity=true

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm5-linux-firefox-proc-switch.manifest

• playback version: 5.1.1

• test script: process_switch.js

• test url: https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch-e10s	❌	❌	❌	❌
browsertime-custom-firefox-process-switch-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch-e10s	❌	❌	❌	❌
browsertime-custom-firefox-process-switch-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch-e10s	❌	❌	❌	❌
browsertime-custom-firefox-process-switch-fis-e10s	✅	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch-e10s	❌	❌	❌	❌
browsertime-custom-firefox-process-switch-fis-e10s	✅	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch-e10s	❌	❌	❌	❌
browsertime-custom-firefox-process-switch-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch-e10s	❌	❌	❌	❌
browsertime-custom-firefox-process-switch-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch-e10s	❌	❌	❌	❌
browsertime-custom-firefox-process-switch-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-custom-firefox-process-switch-e10s	❌	❌	❌	❌
browsertime-custom-firefox-process-switch-fis-e10s	✅	❌	❌	❌

welcome

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm5-linux-firefox-welcome.manifest

• playback version: 5.1.1

• test script: welcome.js

• test url: about:welcome

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome-e10s	❌	❌	❌	❌
browsertime-first-install-firefox-welcome-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome-e10s	❌	❌	❌	❌
browsertime-first-install-firefox-welcome-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome-e10s	❌	❌	❌	❌
browsertime-first-install-firefox-welcome-fis-e10s	✅	✅	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome-e10s	❌	❌	❌	❌
browsertime-first-install-firefox-welcome-fis-e10s	✅	✅	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome-e10s	❌	❌	❌	❌
browsertime-first-install-firefox-welcome-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome-e10s	❌	❌	❌	❌
browsertime-first-install-firefox-welcome-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome-e10s	❌	❌	❌	❌
browsertime-first-install-firefox-welcome-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-first-install-firefox-welcome-e10s	❌	❌	❌	❌
browsertime-first-install-firefox-welcome-fis-e10s	✅	✅	❌	❌

Desktop

Tests for page-load performance. The links direct to the actual websites that are being tested.

amazon

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm7-linux-firefox-amazon.manifest

• playback version: 7.0.4

• secondary url: https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3

• test url: https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-e10s	✅	✅	❌	✅
browsertime-tp6m-live-chrome-m-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-e10s	✅	✅	❌	✅
browsertime-tp6m-live-chrome-m-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-profiling-geckoview-amazon-e10s	✅	❌	❌	❌
browsertime-tp6m-refbrow-amazon-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-amazon-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-amazon-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-fis-e10s	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon-e10s	✅	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-fis-e10s	❌	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon-e10s	✅	❌	❌	❌
browsertime-tp6-profiling-firefox-amazon-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-amazon-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-amazon-fis-e10s	❌	❌	❌	❌

bing-search

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm5-linux-firefox-bing-search.manifest

• playback version: 5.1.1

• test url: https://www.bing.com/search?q=barack+obama

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-bing-search-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-bing-search-fis-e10s	❌	❌	❌	❌

buzzfeed

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm7-linux-firefox-buzzfeed.manifest

• playback version: 7.0.4

• secondary url: https://www.buzzfeed.com/quizzes

• test url: https://www.buzzfeed.com/

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-buzzfeed-fis-e10s	✅	✅	❌	✅

cnn

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm7-linux-firefox-cnn.manifest

• playback version: 7.0.4

• secondary url: https://www.cnn.com/weather

• test url: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-e10s	✅	✅	❌	✅
browsertime-tp6m-live-chrome-m-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-e10s	✅	✅	❌	✅
browsertime-tp6m-live-chrome-m-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-cnn-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-cnn-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-sheriffed-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-sheriffed-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-cnn-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-sheriffed-firefox-cnn-e10s	❌	❌	❌	❌
browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s	❌	❌	❌	❌

ebay

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm7-linux-firefox-ebay.manifest

• playback version: 7.0.4

• secondary url: https://www.ebay.com/deals

• test url: https://www.ebay.com/

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-ebay-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-ebay-fis-e10s	❌	❌	❌	❌

espn

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm5-linux-firefox-espn.manifest

• playback version: 5.1.1

• test url: http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-e10s	✅	✅	❌	✅
browsertime-tp6m-essential-refbrow-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-e10s	✅	✅	❌	✅
browsertime-tp6m-essential-refbrow-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-espn-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-espn-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-espn-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-espn-fis-e10s	✅	✅	❌	✅

expedia

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm6-linux-firefox-expedia.manifest

• playback version: 6.0.2

• secondary url: https://www.expedia.com/Activities

• test url: https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-fenix-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-live-chrome-m-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-expedia-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-expedia-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-expedia-fis-e10s	✅	✅	❌	✅

facebook

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm6-linux-firefox-facebook.manifest

• playback version: 6.0.2

• secondary url: https://www.facebook.com/marketplace/?ref=bookmark

• test url: https://www.facebook.com

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-e10s	✅	✅	❌	✅
browsertime-tp6m-essential-refbrow-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-e10s	✅	✅	❌	✅
browsertime-tp6m-essential-refbrow-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-essential-chrome-m-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-geckoview-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-essential-refbrow-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-facebook-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-facebook-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-facebook-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-facebook-fis-e10s	❌	❌	❌	❌

fandom

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm5-linux-firefox-fandom.manifest

• playback version: 5.1.1

• test url: https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-fandom-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-fandom-fis-e10s	❌	❌	❌	❌

google-docs

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page complete wait time: 8000

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm6-linux-firefox-google-docs.manifest

• playback version: 6.0.2

• secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview

• test url: https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-docs-fis-e10s	❌	❌	❌	❌

google-docs-canvas

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm6-linux-firefox-google-docs-canvas.manifest

• playback version: 6.0.2

• test url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-docs-canvas-fis-e10s	✅	✅	❌	✅

google-mail

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm5-linux-firefox-google-mail.manifest

• playback version: 5.1.1

• test url: https://mail.google.com/

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-mail-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-mail-fis-e10s	❌	❌	❌	❌

google-search

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm5-linux-firefox-google-search.manifest

• playback version: 5.1.1

• test url: https://www.google.com/search?hl=en&q=barack+obama&cad=h

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-google-search-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-search-fis-e10s	❌	❌	❌	❌

google-slides

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm6-linux-firefox-google-slides.manifest

• playback version: 6.0.2

• secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview

• test url: https://docs.google.com/presentation/d/1Ici0ceWwpFvmIb3EmKeWSq_vAQdmmdFcWqaiLqUkJng/edit?usp=sharing

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-google-slides-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-google-slides-fis-e10s	❌	❌	❌	❌

imdb

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm5-linux-firefox-imdb.manifest

• playback version: 5.1.1

• test url: https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-e10s	✅	✅	❌	✅
browsertime-tp6m-live-chrome-m-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-e10s	✅	✅	❌	✅
browsertime-tp6m-live-chrome-m-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-imdb-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-imdb-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imdb-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imdb-fis-e10s	❌	❌	❌	❌

imgur

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm5-linux-firefox-imgur.manifest

• playback version: 5.1.1

• test url: https://imgur.com/gallery/m5tYJL6

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-imgur-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-imgur-fis-e10s	❌	❌	❌	❌

instagram

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm6-linux-firefox-instagram.manifest

• playback version: 6.0.2

• secondary url: https://www.instagram.com/nobelprize_org/

• test url: https://www.instagram.com/

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-android-hw-g5-7-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram-e10s	❌	❌	❌	❌

test-android-hw-g5-7-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-e10s	✅	✅	❌	✅
browsertime-tp6m-live-chrome-m-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-e10s	✅	✅	❌	✅
browsertime-tp6m-live-chrome-m-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram-e10s	❌	❌	❌	❌

test-android-hw-p2-8-0-arm7-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram-e10s	❌	❌	❌	❌

test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6m-chrome-m-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-chrome-m-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-fenix-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-live-geckoview-instagram-e10s	❌	❌	❌	❌
browsertime-tp6m-refbrow-instagram-e10s	❌	❌	❌	❌

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-fis-e10s	✅	✅	❌	✅

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-fis-e10s	✅	✅	❌	✅

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-firefox-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-essential-chrome-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-chromium-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-e10s	❌	❌	❌	❌
browsertime-tp6-essential-firefox-instagram-fis-e10s	✅	✅	❌	✅

linkedin

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm6-linux-firefox-linkedin.manifest

• playback version: 6.0.2

• secondary url: https://www.linkedin.com/in/thommy-harris-hk-385723106/

• test url: https://www.linkedin.com/feed/

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-linkedin-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-linkedin-fis-e10s	❌	❌	❌	❌

microsoft

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm7-linux-firefox-microsoft.manifest

• playback version: 7.0.4

• secondary url: https://support.microsoft.com/en-us

• test url: https://www.microsoft.com/en-us/

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-fis-e10s	❌	❌	❌	❌

test-linux1804-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-fis-e10s	❌	❌	❌	❌

test-linux1804-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-fis-e10s	❌	❌	❌	❌

test-macosx1015-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-fis-e10s	❌	❌	❌	❌

test-windows10-32-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-fis-e10s	❌	❌	❌	❌

test-windows10-32-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-chrome-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-fis-e10s	❌	❌	❌	❌

test-windows10-64-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-fis-e10s	❌	❌	❌	❌

test-windows10-64-shippable-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-chrome-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-chromium-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-microsoft-fis-e10s	✅	✅	❌	✅
browsertime-tp6-live-chrome-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-chromium-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-microsoft-fis-e10s	❌	❌	❌	❌

netflix

Owner: PerfTest Team

• alert on: fcp, loadtime

• alert threshold: 2.0

• apps: firefox, chrome, chromium

• browser cycles: 25

• expected: pass

• gecko profile entries: 14000000

• gecko profile interval: 1

• lower is better: true

• measure: fnbpaint, fcp, dcf, loadtime

• page cycles: 25

• page timeout: 60000

• playback: mitmproxy

• playback pageset manifest: mitm6-linux-firefox-netflix.manifest

• playback version: 6.0.2

• secondary url: https://www.netflix.com/title/699257

• test url: https://www.netflix.com/title/80117263

• type: pageload

• unit: ms

• use live sites: false

• Test Task:

test-linux1804-64-clang-trunk-qr/opt

Test Name	mozilla-central	autoland	mozilla-release	mozilla-beta
browsertime-tp6-firefox-netflix-e10s	❌	❌	❌	❌
browsertime-tp6-firefox-netflix-fis-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix-e10s	❌	❌	❌	❌
browsertime-tp6-live-firefox-netflix-fis-e10s	❌	❌	❌	❌