Raptor
Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, Chrome, Chrome for Android, Safari, and Safari Technology Preview.
Contact: Dave Hunt [:davehunt]
Source code: https://searchfox.org/mozilla-central/source/testing/raptor
Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor
Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) “scenario”-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).
Locally, Raptor can be invoked with the following command:
./mach raptor
Raptor tests
The following documents all testing we have for Raptor.
Benchmarks
Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see Updating Benchmark Tests.
ares6
Command to Run Locally
./mach raptor -t ares6
Owner: :jandem and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/ares6.toml#16
lower is better: true
page cycles: 4
page timeout: 270000
subtest lower is better: true
subtest unit: ms
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-ares6 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-ares6 |
✅ |
✅ |
❌ |
❌ |
assorted-dom
Command to Run Locally
./mach raptor -t assorted-dom
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/assorted-dom.toml#15
lower is better: true
page cycles: 1
page timeout: 60000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/assorted-dom
repository revision: 61332db584026b73e37066d717a162825408c36b
screen capture: true
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-assorted-dom |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-assorted-dom |
✅ |
✅ |
❌ |
❌ |
jetstream2
Command to Run Locally
./mach raptor -t jetstream2
Owner: :jandem and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2.toml#16
lower is better: false
page cycles: 4
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/JetStream2
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: false
subtest unit: score
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-jetstream2-chrome-m-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-cstm-car-m-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-fenix-jetstream2 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-fenix-jetstream2-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-geckoview-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-jetstream2-fenix-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-fenix-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-geckoview-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
Owner: :jandem and SpiderMonkey Team
alert threshold: 2.0
apps: fenix, geckoview, chrome-m, cstm-car-m
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2-mobile.toml#16
lower is better: false
page cycles: 4
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/JetStream2
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: false
subtest unit: score
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-jetstream2-chrome-m-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-cstm-car-m-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-fenix-jetstream2 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-fenix-jetstream2-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-geckoview-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-jetstream2-fenix-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-fenix-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-geckoview-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
❌ |
❌ |
matrix-react-bench
Command to Run Locally
./mach raptor -t matrix-react-bench
Owner: :jandem and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/matrix-react-bench.toml#16
lower is better: true
page cycles: 30
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/matrix-react-bench
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/matrix_demo.html
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-matrix-react-bench |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-matrix-react-bench |
✅ |
✅ |
❌ |
❌ |
motionmark-1-3
Command to Run Locally
./mach raptor -t motionmark-1-3
Owner: Graphics Team
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
browser cycles: 1
cold: true
expected: pass
expose browser profiler: true
expose chrome trace: true
gecko profile features: stackwalk,js,cpu,java,processcpu,memory
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#12
lower is better: false
page cycles: 1
page timeout: 600000
repository: https://github.com/webkit/motionmark
repository revision: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
suite name: MotionMark
support class: motionmark-1-3.py
test script: motionmark-1-3.js
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
Owner: Graphics Team
alert threshold: 2.0
apps: fenix, geckoview, chrome-m, cstm-car-m
browser cycles: 1
cold: true
expected: pass
expose browser profiler: true
gecko profile features: stackwalk,js,cpu,java,processcpu,memory
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#11
lower is better: false
page cycles: 1
page timeout: 600000
repository: https://github.com/webkit/motionmark
repository revision: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
suite name: MotionMark
support class: motionmark-1-3.py
test script: motionmark-1-3.js
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-1-3 |
✅ |
✅ |
❌ |
❌ |
motionmark-htmlsuite-1-3
Command to Run Locally
./mach raptor -t motionmark-htmlsuite-1-3
Owner: Graphics Team
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
browser cycles: 1
cold: true
expected: pass
expose browser profiler: true
expose chrome trace: true
gecko profile features: stackwalk,js,cpu,java,processcpu,memory
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#27
lower is better: false
page cycles: 1
page timeout: 600000
repository: https://github.com/webkit/motionmark
repository revision: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
suite name: HTML suite
support class: motionmark-1-3.py
test script: motionmark-1-3.js
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
Owner: Graphics Team
alert threshold: 2.0
apps: fenix, geckoview, chrome-m, cstm-car-m
browser cycles: 1
cold: true
expected: pass
expose browser profiler: true
gecko profile features: stackwalk,js,cpu,java,processcpu,memory
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#26
lower is better: false
page cycles: 1
page timeout: 600000
repository: https://github.com/webkit/motionmark
repository revision: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb
suite name: HTML suite
support class: motionmark-1-3.py
test script: motionmark-1-3.js
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite-1-3 |
✅ |
✅ |
❌ |
❌ |
speedometer
Command to Run Locally
./mach raptor -t speedometer
Owner: SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, safari, safari-tp, custom-car
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile features: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,TaskController,StyleThread
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#19
lower is better: false
page cycles: 5
page timeout: 600000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer-mobile-chrome-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer-mobile-chrome-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer-mobile-chrome-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
Owner: SpiderMonkey Team
alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m, cstm-car-m
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile features: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,TaskController,StyleThread
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#19
lower is better: false
page cycles: 5
page timeout: 420000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer-mobile-chrome-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer-mobile-chrome-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer-mobile-chrome-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
❌ |
❌ |
speedometer3
Command to Run Locally
./mach raptor -t speedometer3
Owner: Performance Team
alert threshold: 2.0
apps: firefox, chrome, safari, safari-tp, custom-car
browser cycles: 5
cold: true
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile features: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,TaskController,StyleThread
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#21
lower is better: false
page cycles: 5
page timeout: 600000
subtest lower is better: true
subtest unit: ms
support class: speedometer3.py
test script: speedometer3.js
test url: http://<host>:<port>/Speedometer3/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer3-mobile-chrome-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer3-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer3-mobile-chrome-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer3-mobile-chrome-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-safari-tp-speedometer3 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Owner: Performance Team
alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m, cstm-car-m
browser cycles: 5
cold: true
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile features: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks
gecko profile interval: 1
gecko profile threads: GeckoMain,Compositor,Renderer,TaskController,StyleThread
host from parent: false
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#21
lower is better: false
page cycles: 5
page timeout: 420000
repository: https://github.com/WebKit/Speedometer
repository revision: 8d67f28d0281ac4330f283495b7f48286654ad7d
subtest lower is better: true
subtest unit: ms
support class: speedometer3.py
test script: speedometer3.js
test url: http://<host>:<port>/index.html
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer3-mobile-chrome-m |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer3-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer3-mobile-chrome-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-speedometer3-mobile-chrome-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-chrome-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-fenix-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-safari-tp-speedometer3 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-custom-car-speedometer3 |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
❌ |
❌ |
stylebench
Command to Run Locally
./mach raptor -t stylebench
Owner: :emelio and Layout Team
alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/stylebench.toml#16
lower is better: false
page cycles: 5
page timeout: 140000
subtest lower is better: true
subtest unit: ms
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-stylebench |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-stylebench |
✅ |
✅ |
❌ |
❌ |
sunspider
Command to Run Locally
./mach raptor -t sunspider
Owner: :jandem and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/sunspider.toml#10
lower is better: true
page cycles: 5
page timeout: 55000
test url: http://<host>:<port>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-sunspider |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-sunspider |
✅ |
✅ |
❌ |
❌ |
twitch-animation
Command to Run Locally
./mach raptor -t twitch-animation
Owner: :jrmuizel
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/twitch-animation.toml#17
lower is better: true
page cycles: 1
page timeout: 2000000
perfstats: true
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/twitch-animation
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/index.html
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
✅ |
✅ |
❌ |
❌ |
unity-webgl
Command to Run Locally
./mach raptor -t unity-webgl
Owner: :jgilbert and Graphics(gfx) Team
alert threshold: 2.0
apps: firefox, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/unity-webgl-desktop.toml#14
lower is better: false
page cycles: 5
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-unity-webgl-mobile-chrome-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-fenix |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-fenix-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-refbrow |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-unity-webgl-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-refbrow |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
❌ |
❌ |
❌ |
Owner: :jgilbert and Graphics(gfx) Team
alert threshold: 2.0
apps: geckoview, refbrow, fenix, chrome-m
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/unity-webgl-mobile.toml#14
lower is better: false
page cycles: 1
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-unity-webgl-mobile-chrome-m |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-fenix |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-fenix-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-refbrow |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-unity-webgl-mobile-fenix |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-geckoview |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-unity-webgl-mobile-refbrow |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
❌ |
❌ |
❌ |
wasm-godot
Command to Run Locally
./mach raptor -t wasm-godot
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot.toml#11
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-godot |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-safari-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
✅ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-safari-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-godot |
✅ |
❌ |
❌ |
❌ |
wasm-godot-baseline
Command to Run Locally
./mach raptor -t wasm-godot-baseline
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot-baseline.toml#14
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
✅ |
❌ |
❌ |
❌ |
wasm-godot-optimizing
Command to Run Locally
./mach raptor -t wasm-godot-optimizing
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot-optimizing.toml#14
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
✅ |
❌ |
❌ |
❌ |
wasm-misc
Command to Run Locally
./mach raptor -t wasm-misc
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc.toml#14
lower is better: true
page cycles: 5
page timeout: 1200000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-misc |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-misc |
✅ |
❌ |
❌ |
❌ |
wasm-misc-baseline
Command to Run Locally
./mach raptor -t wasm-misc-baseline
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc-baseline.toml#13
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
✅ |
❌ |
❌ |
❌ |
wasm-misc-optimizing
Command to Run Locally
./mach raptor -t wasm-misc-optimizing
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc-optimizing.toml#13
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
✅ |
❌ |
❌ |
❌ |
webaudio
Command to Run Locally
./mach raptor -t webaudio
Owner: :padenot and Media Team
alert threshold: 2.0
apps: firefox, chrome, safari
expected: pass
expose browser profiler: true
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/webaudio.toml#10
lower is better: true
page cycles: 5
page timeout: 360000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-webaudio |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
✅ |
✅ |
❌ |
❌ |
browsertime-benchmark-safari-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-webaudio |
✅ |
✅ |
❌ |
❌ |
youtube-playback-av1-sfr
Command to Run Locally
./mach raptor -t youtube-playback-av1-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#24
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-av1-sfr |
✅ |
❌ |
❌ |
❌ |
browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-av1-sfr |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-av1-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-av1-sfr |
✅ |
❌ |
❌ |
❌ |
youtube-playback-h264-1080p30
Command to Run Locally
./mach raptor -t youtube-playback-h264-1080p30
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#28
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p30 |
❌ |
❌ |
❌ |
❌ |
youtube-playback-h264-1080p60
Command to Run Locally
./mach raptor -t youtube-playback-h264-1080p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#34
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-1080p60 |
❌ |
❌ |
❌ |
❌ |
youtube-playback-h264-720p60
Command to Run Locally
./mach raptor -t youtube-playback-h264-720p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, chrome, geckoview, fenix, refbrow, chrome-m
browsertime args: –pageCompleteWaitTime=10 –pageCompleteCheckPollTimeout=10 –browsertime.benchmark_wait_time=500
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#82
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
support class: browsertime_benchmark.py
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-h264-720p60 |
✅ |
✅ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-mobile-fenix-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
youtube-playback-h264-full-1080p30
Command to Run Locally
./mach raptor -t youtube-playback-h264-full-1080p30
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#40
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
youtube-playback-h264-full-1080p60
Command to Run Locally
./mach raptor -t youtube-playback-h264-full-1080p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#55
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-h264-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
youtube-playback-h264-sfr
Command to Run Locally
./mach raptor -t youtube-playback-h264-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#70
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-geckoview-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-refbrow-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-geckoview-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-refbrow-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
✅ |
❌ |
❌ |
❌ |
youtube-playback-hfr
Command to Run Locally
./mach raptor -t youtube-playback-hfr
Owner: PerfTest Team
alert on: H2641080p60fps@1X_dropped_frames, H264720p60fps@1X_dropped_frames
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#74
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-hfr |
✅ |
❌ |
❌ |
❌ |
browsertime-mobile-fenix-youtube-playback-hfr-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-hfr-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-refbrow-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-fenix-youtube-playback-hfr-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-hfr-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-refbrow-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
✅ |
❌ |
❌ |
❌ |
youtube-playback-v9-1080p30
Command to Run Locally
./mach raptor -t youtube-playback-v9-1080p30
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#96
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p30 |
❌ |
❌ |
❌ |
❌ |
youtube-playback-v9-1080p60
Command to Run Locally
./mach raptor -t youtube-playback-v9-1080p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#102
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-1080p60 |
❌ |
❌ |
❌ |
❌ |
youtube-playback-v9-full-1080p30
Command to Run Locally
./mach raptor -t youtube-playback-v9-full-1080p30
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#108
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p30 |
❌ |
❌ |
❌ |
❌ |
youtube-playback-v9-full-1080p60
Command to Run Locally
./mach raptor -t youtube-playback-v9-full-1080p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
expose browser profiler: true
gather cpuTime: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#123
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-firefox-youtube-playback-v9-full-1080p60 |
❌ |
❌ |
❌ |
❌ |
youtube-playback-vp9-720p60
Command to Run Locally
./mach raptor -t youtube-playback-vp9-720p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, chrome, geckoview, fenix, refbrow, chrome-m
browsertime args: –pageCompleteWaitTime=10 –pageCompleteCheckPollTimeout=10 –browsertime.benchmark_wait_time=500
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#89
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
support class: browsertime_benchmark.py
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60 |
✅ |
✅ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60 |
❌ |
❌ |
❌ |
❌ |
browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis |
❌ |
❌ |
❌ |
❌ |
youtube-playback-vp9-sfr
Command to Run Locally
./mach raptor -t youtube-playback-vp9-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#138
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-vp9-sfr |
✅ |
❌ |
❌ |
❌ |
browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
✅ |
❌ |
❌ |
❌ |
youtube-playback-widevine-h264-sfr
Command to Run Locally
./mach raptor -t youtube-playback-widevine-h264-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#142
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
✅ |
❌ |
❌ |
❌ |
youtube-playback-widevine-hfr
Command to Run Locally
./mach raptor -t youtube-playback-widevine-hfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#156
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
✅ |
❌ |
❌ |
❌ |
youtube-playback-widevine-vp9-sfr
Command to Run Locally
./mach raptor -t youtube-playback-widevine-vp9-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
expose browser profiler: true
gecko profile interval: 1000
gecko profile threads: MediaPlayback
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#170
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
✅ |
❌ |
❌ |
❌ |
Custom
Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.
addMab1
Command to Run Locally
./mach raptor -t addMab1
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send many small ArrayBuffers to IndexedDB in one transaction
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#30
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMab1 |
✅ |
✅ |
❌ |
❌ |
addMabN
Command to Run Locally
./mach raptor -t addMabN
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send many small ArrayBuffers to IndexedDB independently
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#34
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMabN |
✅ |
✅ |
❌ |
❌ |
addMar1
Command to Run Locally
./mach raptor -t addMar1
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send many small Arrays to IndexedDB in one transaction
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Array –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#38
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMar1 |
✅ |
✅ |
❌ |
❌ |
addMarN
Command to Run Locally
./mach raptor -t addMarN
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send many small Arrays to IndexedDB independently
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Array –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#42
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMarN |
✅ |
✅ |
❌ |
❌ |
addMbl1
Command to Run Locally
./mach raptor -t addMbl1
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send many small Blobs to IndexedDB in one transaction
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Blob –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#46
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMbl1 |
✅ |
✅ |
❌ |
❌ |
addMblN
Command to Run Locally
./mach raptor -t addMblN
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send many small Blobs to IndexedDB independently
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=16384 –browsertime.chunk_size=1024 –browsertime.buffer_type=Blob –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#50
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addMblN |
✅ |
✅ |
❌ |
❌ |
addkAB1
Command to Run Locally
./mach raptor -t addkAB1
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send a couple of large ArrayBuffers to IndexedDB in one transaction
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#54
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAB1 |
✅ |
✅ |
❌ |
❌ |
addkABN
Command to Run Locally
./mach raptor -t addkABN
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send a couple of large ArrayBuffers to IndexedDB independently
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=ArrayBuffer –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#58
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkABN |
✅ |
✅ |
❌ |
❌ |
addkAR1
Command to Run Locally
./mach raptor -t addkAR1
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send a couple of large JS Arrays to IndexedDB in one transaction
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Array –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#62
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkAR1 |
✅ |
✅ |
❌ |
❌ |
addkARN
Command to Run Locally
./mach raptor -t addkARN
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send a couple of large JS Arrays to IndexedDB independently
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Array –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#66
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkARN |
✅ |
✅ |
❌ |
❌ |
addkBL1
Command to Run Locally
./mach raptor -t addkBL1
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send a couple of large Blobs to IndexedDB in one transaction
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Blob –browsertime.atomic=1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#70
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBL1 |
✅ |
✅ |
❌ |
❌ |
addkBLN
Command to Run Locally
./mach raptor -t addkBLN
Owner: DOM Lifecycle, Workers and Storage Team
Description: Use add API to send a couple of large Blobs to IndexedDB independently
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.iterations=128 –browsertime.chunk_size=1048576 –browsertime.buffer_type=Blob –browsertime.atomic=0
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#74
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
test script: indexeddb_write.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-addkBLN |
✅ |
✅ |
❌ |
❌ |
browsertime
Command to Run Locally
./mach raptor -t browsertime
Owner: PerfTest Team
Description: Used to run vanilla browsertime tests through raptor. For example: ./mach raptor -t browsertime –browsertime-arg url=https://www.sitespeed.io –browsertime-arg iterations=3
alert threshold: 2.0
apps: firefox
browser cycles: 1
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-custom.toml#17
lower is better: true
measure: fnbpaint, fcp, dcf, loadtime
page cycles: 1
page timeout: 60000
playback: mitmproxy
playback pageset manifest: null.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test script: None
test url: None
type: pageload
unit: ms
use live sites: true
connect
Command to Run Locally
./mach raptor -t connect
Owner: Network Team
Description: Verifies that connection time on a pageload is zero when a speculative connection has first been made
alert change type: absolute
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange
alert threshold: 10.0
apps: firefox
browser cycles: 3
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-speculative.toml#18
lower is better: true
page cycles: 1
page timeout: 60000
test script: speculative-connect.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speculative-firefox-connect |
❌ |
✅ |
❌ |
❌ |
constant-regression
Command to Run Locally
./mach raptor -t constant-regression
Owner: PerfTest Team
Description: Generates a constant value that can be changed to induce a regression.
alert threshold: 2.0
apps: firefox, chrome, safari, geckoview, fenix
browser cycles: 1
browsertime args: –browsertime.constant_value=1500
custom data: true
expected: pass
fore window: 1
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-regression-test.toml#23
lower is better: true
max back window: 3
min back window: 2
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest unit: ms
test script: constant_regression_test.js
test summary: flatten
test url: None
type: pageload
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-regression-tests-firefox-constant-regression |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-regression-tests-firefox-constant-regression |
❌ |
✅ |
❌ |
❌ |
getkeyrng
Command to Run Locally
./mach raptor -t getkeyrng
Owner: DOM Lifecycle, Workers and Storage Team
Description: Measures the speed of key-range based reads of IndexedDB
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
custom data: true
expected: pass
gecko profile entries: 131072000
gecko profile features: js,stackwalk,cpu,memory
gecko profile threads: GeckoMain,DOM Worker,IndexedDB
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#78
lower is better: true
measure: cpuTime
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-example.manifest
subtest unit: ms
support class: browsertime_pageload.py
test script: indexeddb_getkeyrange.js
test summary: flatten
test url: https://www.example.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-indexeddb-firefox-getkeyrng |
✅ |
✅ |
❌ |
❌ |
h3-download
Command to Run Locally
./mach raptor -t h3-download
Owner: Network Team
Description: Measures HTTP/3 download throughput with a local server
alert threshold: 2.0
apps: firefox, chrome, custom-car
browser cycles: 1
browsertime args: –browsertime.test_type=h3_download –browsertime.iterations=10 –firefox.preference=network.http.http3.enable:true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#28
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
support class: network_bench.py
test script: network_bench.js
test url: None
type: pageload
unit: mbps
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-chrome-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-chrome-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-download-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
h3-upload
Command to Run Locally
./mach raptor -t h3-upload
Owner: Network Team
Description: Measures HTTP/3 file upload throughput with a local server
alert threshold: 2.0
apps: firefox, chrome, custom-car
browser cycles: 1
browsertime args: –browsertime.test_type=h3_upload –browsertime.iterations=10 –firefox.preference=network.http.http3.enable:true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#24
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
support class: network_bench.py
test script: network_bench.js
test url: None
type: pageload
unit: mbps
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-chrome-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-network-bench-chrome-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-chrome-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-custom-car-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-100M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-10M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-1M_400ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_40ms-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.01 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.1 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-0.5 |
❌ |
❌ |
❌ |
❌ |
browsertime-network-bench-firefox-h3-upload-300M_80ms-1 |
❌ |
❌ |
❌ |
❌ |
process-switch
Command to Run Locally
./mach raptor -t process-switch
Owner: PerfTest Team
Description: Measures process switch time
accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome
browser cycles: 25
browsertime args: –pageCompleteWaitTime=1000 –pageCompleteCheckInactivity=true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-process-switch.toml#20
lower is better: true
measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-proc-switch.manifest
playback version: 5.1.1
support class: browsertime_pageload.py
test script: process_switch.js
test url: https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
✅ |
❌ |
❌ |
❌ |
sample-python-support
Command to Run Locally
./mach raptor -t sample-python-support
Owner: PerfTest Team
Description: A sample test that uses a python support file to modify the test command.
alert threshold: 2.0
apps: firefox
browser cycles: 1
browsertime args: –browsertime.constant_value={replace-with-constant-value}
custom data: true
expected: pass
fore window: 1
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-sample-python-support.toml#22
lower is better: true
max back window: 3
min back window: 2
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest unit: ms
support class: sample_python_support.py
test script: constant_regression_test.js
test summary: flatten
test url: None
type: pageload
unit: score
use live sites: true
throttled
Command to Run Locally
./mach raptor -t throttled
Owner: Network Team
Description: Pageload test using a throttled network environment
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange
alert threshold: 2.0
apps: firefox
browser cycles: 3
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-throttled-pageload.toml#17
lower is better: true
page cycles: 1
page timeout: 60000
test script: throttled_pageload.js
test url: None
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-throttled-firefox-throttled |
❌ |
❌ |
❌ |
❌ |
tp6-bench
Command to Run Locally
./mach raptor -t tp6-bench
Owner: PerfTest Team
Description: A pageload benchmark test that quickly runs through a selection of the pages available to produce a single overall metric for fcp, lcp, and loadtime. The metrics from all pages get summarized with the geomean, and mean.
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 1
cold: true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-tp6-bench.toml#19
lower is better: true
output timeout: 2000000
page cycles: 1
page timeout: 1800000
playback: mitmproxy
playback pageset manifest: None
playback version: 8.1.1
subtest unit: ms
support class: browsertime_tp6_bench.py
test script: browsertime_tp6_bench.js
test summary: flatten
test url: None
type: pageload
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-pageload-benchmark-firefox-tp6-bench |
❌ |
✅ |
❌ |
❌ |
upload
Command to Run Locally
./mach raptor -t upload
Owner: Network Team
Description: Measures HTTP/2 file upload throughput with a remote server
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.test_type=h2_upload –browsertime.iterations=10 –browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com –firefox.preference=network.http.http3.enable:false –chrome.args disable-quic
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-upload.toml#16
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
test script: network_bench.js
test url: None
type: pageload
unit: mbps
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-chrome-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-upload-firefox-upload |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
✅ |
✅ |
❌ |
❌ |
browsertime-upload-safari-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
✅ |
✅ |
❌ |
❌ |
browsertime-upload-safari-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-chrome-upload |
❌ |
❌ |
❌ |
❌ |
browsertime-upload-firefox-upload |
✅ |
✅ |
❌ |
❌ |
upload-h3
Command to Run Locally
./mach raptor -t upload-h3
Owner: Network Team
Description: Measures HTTP/3 file upload throughput with a remote server
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 1
browsertime args: –browsertime.test_type=h3_upload –browsertime.iterations=10 –browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com –firefox.preference=network.http.http3.enable:true
custom data: true
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-upload.toml#31
lower is better: false
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest lower is better: false
subtest name filters: tests/,iterations/
subtest unit: mbps
test script: network_bench.js
test url: None
type: pageload
unit: mbps
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-chrome-upload-h3 |
❌ |
❌ |
❌ |
❌ |
browsertime-upload-firefox-upload-h3 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
✅ |
✅ |
❌ |
❌ |
browsertime-upload-safari-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
✅ |
✅ |
❌ |
❌ |
browsertime-upload-safari-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-firefox-upload-h3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-upload-chrome-upload-h3 |
❌ |
❌ |
❌ |
❌ |
browsertime-upload-firefox-upload-h3 |
✅ |
✅ |
❌ |
❌ |
vpl-av1
Command to Run Locally
./mach raptor -t vpl-av1
Owner: :aosmond and the Media Team
Description: Measures AV1 1080p video playback latency.
alert on: estimatedFirstFrameLatency, estimatedAnyFrameLatency
alert threshold: 2.0
apps: chrome, chrome-m, geckoview, fenix, firefox, safari
benchmark webserver: true
browser cycles: 20
expected: pass
gecko profile features: stackwalk,js,cpu,java,processcpu,screenshots,memory
gecko profile interval: 1
gecko profile threads: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#36
lower is better: true
measure: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency
newtab per cycle: true
page cycles: 20
page timeout: 20000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/video-playback-latency
repository revision: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd
support class: video_playback_latency.py
test url: http://<host>:<port>/av1_1080p.html
type: pageload
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-mobile-chrome-m-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-chrome-m-vpl-av1-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-fenix-vpl-av1 |
✅ |
✅ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-mobile-fenix-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-chrome-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-firefox-vpl-av1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-chrome-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-chrome-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-firefox-vpl-av1 |
❌ |
❌ |
❌ |
❌ |
vpl-h264
Command to Run Locally
./mach raptor -t vpl-h264
Owner: :aosmond and the Media Team
Description: Measures H264 1080p video playback latency.
alert on: estimatedFirstFrameLatency, estimatedAnyFrameLatency
alert threshold: 2.0
apps: chrome, chrome-m, geckoview, fenix, firefox, safari
benchmark webserver: true
browser cycles: 20
expected: pass
gecko profile features: stackwalk,js,cpu,java,processcpu,screenshots,memory
gecko profile interval: 1
gecko profile threads: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#30
lower is better: true
measure: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency
newtab per cycle: true
page cycles: 20
page timeout: 20000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/video-playback-latency
repository revision: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd
support class: video_playback_latency.py
test url: http://<host>:<port>/h264_1080p.html
type: pageload
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-mobile-chrome-m-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-chrome-m-vpl-h264-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-fenix-vpl-h264 |
✅ |
✅ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-mobile-fenix-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-chrome-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-firefox-vpl-h264 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
✅ |
✅ |
❌ |
❌ |
browsertime-video-playback-latency-safari-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
✅ |
✅ |
❌ |
❌ |
browsertime-video-playback-latency-safari-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-chrome-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-chrome-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-firefox-vpl-h264 |
❌ |
❌ |
❌ |
❌ |
vpl-vp9
Command to Run Locally
./mach raptor -t vpl-vp9
Owner: :aosmond and the Media Team
Description: Measures VP9 1080p video playback latency.
alert on: estimatedFirstFrameLatency, estimatedAnyFrameLatency
alert threshold: 2.0
apps: chrome, chrome-m, geckoview, fenix, firefox, safari
benchmark webserver: true
browser cycles: 20
expected: pass
gecko profile features: stackwalk,js,cpu,java,processcpu,screenshots,memory
gecko profile interval: 1
gecko profile threads: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#33
lower is better: true
measure: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency
newtab per cycle: true
page cycles: 20
page timeout: 20000
preferences: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/video-playback-latency
repository revision: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd
support class: video_playback_latency.py
test url: http://<host>:<port>/vp9_1080p.html
type: pageload
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-mobile-chrome-m-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-chrome-m-vpl-vp9-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-fenix-vpl-vp9 |
✅ |
✅ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-mobile-fenix-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-chrome-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-firefox-vpl-vp9 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-chrome-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-video-playback-latency-chrome-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
browsertime-video-playback-latency-firefox-vpl-vp9 |
❌ |
❌ |
❌ |
❌ |
welcome
Command to Run Locally
./mach raptor -t welcome
Owner: PerfTest Team
Description: Measures pageload metrics for the first-install about:welcome page
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-welcome.toml#18
lower is better: true
measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-welcome.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test script: welcome.js
test url: about:welcome
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
✅ |
✅ |
❌ |
❌ |
Desktop
Tests for page-load performance. The links direct to the actual websites that are being tested.
amazon
Command to Run Locally
./mach raptor -t amazon
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#22
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-amazon.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-amazon-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-profiling-firefox-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-profiling-firefox-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-profiling-firefox-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
bing-search
Command to Run Locally
./mach raptor -t bing-search
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#28
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-darwin-firefox-bing-search.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
buzzfeed
Command to Run Locally
./mach raptor -t buzzfeed
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#32
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-buzzfeed.manifest
playback version: 11.0.0
secondary url: https://www.buzzfeed.com/quizzes
support class: browsertime_pageload.py
test url: https://www.buzzfeed.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-buzzfeed |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-buzzfeed |
✅ |
✅ |
❌ |
❌ |
cnn
Command to Run Locally
./mach raptor -t cnn
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#37
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-cnn.manifest
playback version: 11.0.0
secondary url: https://www.cnn.com/weather
support class: browsertime_pageload.py
test url: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-cnn |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
docomo
Command to Run Locally
./mach raptor -t docomo
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#23
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-docomo.manifest
playback version: 11.0.0
secondary url: https://www.docomo.ne.jp/iphone/?icid=CRP_menu_to_CRP_IPH
support class: browsertime_pageload.py
test url: https://www.docomo.ne.jp/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-docomo |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-docomo |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-docomo |
❌ |
❌ |
❌ |
❌ |
ebay
Command to Run Locally
./mach raptor -t ebay
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#42
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-ebay.manifest
playback version: 11.0.0
secondary url: https://www.ebay.com/deals
support class: browsertime_pageload.py
test url: https://www.ebay.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-ebay |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-ebay |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
espn
Command to Run Locally
./mach raptor -t espn
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#47
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-espn.manifest
playback version: 11.0.0
secondary url: https://www.espn.com/nba/draft/news
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-chrome-m-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-chrome-m-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-espn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-espn-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-fenix-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-espn |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-espn |
✅ |
✅ |
❌ |
❌ |
expedia
Command to Run Locally
./mach raptor -t expedia
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#52
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-darwin-firefox-expedia.manifest
playback version: 11.0.0
secondary url: https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-expedia |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-expedia |
✅ |
✅ |
❌ |
❌ |
facebook
Command to Run Locally
./mach raptor -t facebook
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#57
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-facebook.manifest
playback version: 8.1.1
secondary url: https://www.facebook.com/marketplace/?ref=bookmark
support class: browsertime_pageload.py
test url: https://www.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-facebook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-facebook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
fandom
Command to Run Locally
./mach raptor -t fandom
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#63
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-fandom.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
google-docs
Command to Run Locally
./mach raptor -t google-docs
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#68
lower is better: true
page complete wait time: 8000
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-google-docs.manifest
playback version: 11.0.0
secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview
support class: browsertime_pageload.py
test url: https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-docs |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-docs |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
google-mail
Command to Run Locally
./mach raptor -t google-mail
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#74
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-google-mail.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://mail.google.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
google-search
Command to Run Locally
./mach raptor -t google-search
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#79
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-google-search.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.google.com/search?hl=en&q=barack+obama&cad=h
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
imdb
Command to Run Locally
./mach raptor -t imdb
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#89
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-imdb.manifest
playback version: 11.0.0
secondary url: https://www.imdb.com/title/tt0084967/episodes/?ref_=tt_ov_epl
support class: browsertime_pageload.py
test url: https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-imdb |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-imdb-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-imdb |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imdb |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imdb |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
imgur
Command to Run Locally
./mach raptor -t imgur
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#94
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-imgur.manifest
playback version: 11.0.0
preferences: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true
secondary url: https://imgur.com/gallery/WuOobqV
support class: browsertime_pageload.py
test url: https://imgur.com/gallery/uTI7fKy
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imgur |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imgur |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
instagram
Command to Run Locally
./mach raptor -t instagram
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#106
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-darwin-firefox-instagram.manifest
playback version: 11.0.0
secondary url: https://www.instagram.com/nobelprize_org/
support class: browsertime_pageload.py
test url: https://www.instagram.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-instagram |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-instagram-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-instagram |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
linkedin
Command to Run Locally
./mach raptor -t linkedin
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#111
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-linkedin.manifest
playback version: 8.1.1
secondary url: https://www.linkedin.com/in/thommy-harris-hk-385723106/
support class: browsertime_pageload.py
test url: https://www.linkedin.com/feed/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-linkedin |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-linkedin |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
microsoft
Command to Run Locally
./mach raptor -t microsoft
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#117
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-microsoft.manifest
playback version: 11.0.0
secondary url: https://support.microsoft.com/en-us
support class: browsertime_pageload.py
test url: https://www.microsoft.com/en-us/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-microsoft |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-microsoft |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
netflix
Command to Run Locally
./mach raptor -t netflix
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#122
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-netflix.manifest
playback version: 8.1.1
secondary url: https://www.netflix.com/title/699257
support class: browsertime_pageload.py
test url: https://www.netflix.com/title/80117263
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-netflix |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-netflix |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
nytimes
Command to Run Locally
./mach raptor -t nytimes
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#128
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-nytimes.manifest
playback version: 11.0.0
secondary url: https://www.nytimes.com/section/opinion/columnists
support class: browsertime_pageload.py
test url: https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-nytimes |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-nytimes |
✅ |
✅ |
❌ |
❌ |
office
Command to Run Locally
./mach raptor -t office
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#132
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-office.manifest
playback version: 11.0.0
secondary url: https://www.office.com/
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-office |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-office |
✅ |
✅ |
❌ |
❌ |
openai
Command to Run Locally
./mach raptor -t openai
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#27
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-openai.manifest
playback version: 11.0.0
secondary url: https://openai.com/blog
support class: browsertime_pageload.py
test url: https://openai.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-openai |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-openai |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-openai |
❌ |
❌ |
❌ |
❌ |
outlook
Command to Run Locally
./mach raptor -t outlook
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#136
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-live.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://outlook.live.com/mail/inbox
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-outlook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-outlook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
paypal
Command to Run Locally
./mach raptor -t paypal
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#140
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-paypal.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-paypal |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-paypal |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
pinterest
Command to Run Locally
./mach raptor -t pinterest
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#144
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-pinterest.manifest
playback version: 8.1.1
secondary url: https://www.pinterest.com/today/best/halloween-costumes-for-your-furry-friends/75787/
support class: browsertime_pageload.py
test url: https://pinterest.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-pinterest |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-pinterest |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
reddit
Command to Run Locally
./mach raptor -t reddit
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#151
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-reddit.manifest
playback version: 11.0.0
secondary url: https://www.reddit.com/r/technology/
support class: browsertime_pageload.py
test url: https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-reddit |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-reddit-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-reddit |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-reddit |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-reddit |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
samsung
Command to Run Locally
./mach raptor -t samsung
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#32
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-samsung.manifest
playback version: 11.0.0
secondary url: https://www.samsung.com/us/mobile
support class: browsertime_pageload.py
test url: https://www.samsung.com/us
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-samsung |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-samsung |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-samsung |
❌ |
❌ |
❌ |
❌ |
tiktok
Command to Run Locally
./mach raptor -t tiktok
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#28
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-tiktok.manifest
playback version: 11.0.0
secondary url: https://www.tiktok.com/explore
support class: browsertime_pageload.py
test url: https://www.tiktok.com/en
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-tiktok |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-tiktok |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-tiktok |
❌ |
❌ |
❌ |
❌ |
tumblr
Command to Run Locally
./mach raptor -t tumblr
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#157
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-tumblr.manifest
playback version: 8.1.1
secondary url: https://www.tumblr.com/tagged/funny+cats?sort=top
support class: browsertime_pageload.py
test url: https://www.tumblr.com/dashboard
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-tumblr |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-tumblr |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
twitch
Command to Run Locally
./mach raptor -t twitch
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#163
lower is better: true
measure: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-twitch.manifest
playback version: 11.0.0
preferences: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true
secondary url: https://www.twitch.tv/gmashley
support class: browsertime_pageload.py
test url: https://www.twitch.tv/videos/894226211
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-twitch |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-twitch |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
twitter
Command to Run Locally
./mach raptor -t twitter
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#176
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-twitter.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://twitter.com/BarackObama
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
weather
Command to Run Locally
./mach raptor -t weather
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#41
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-weather.manifest
playback version: 11.0.0
secondary url: https://weather.com/en-CA/weather/monthly/l/43.67%2C-79.42
support class: browsertime_pageload.py
test url: https://weather.com/en-CA/weather/today/l/43.67%2C-79.42
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-weather |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp7-chrome-weather |
❌ |
❌ |
❌ |
❌ |
browsertime-tp7-firefox-weather |
❌ |
❌ |
❌ |
❌ |
wikia
Command to Run Locally
./mach raptor -t wikia
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#181
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-wikia.manifest
playback version: 11.0.0
secondary url: https://marvel.fandom.com/wiki/Celestials
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-wikia |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-wikia |
✅ |
✅ |
❌ |
❌ |
wikipedia
Command to Run Locally
./mach raptor -t wikipedia
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#186
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-wikipedia.manifest
playback version: 11.0.0
secondary url: https://en.wikipedia.org/wiki/Joe_Biden
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-wikipedia |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-wikipedia-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-wikipedia |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
yahoo-mail
Command to Run Locally
./mach raptor -t yahoo-mail
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: false
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#190
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-yahoo-mail.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://mail.yahoo.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-yahoo-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-yahoo-mail |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-yahoo-mail |
❌ |
❌ |
❌ |
❌ |
youtube
Command to Run Locally
./mach raptor -t youtube
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: firefox, chrome, safari, custom-car
benchmark page: true
browser cycles: 25
expected: pass
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#195
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-youtube.manifest
playback version: 11.0.0
secondary url: https://www.youtube.com/watch?v=JrdEMERq8MA
support class: browsertime_pageload.py
test url: https://www.youtube.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-youtube |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-youtube-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-youtube |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-youtube |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-youtube |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Interactive
Browsertime tests that interact with the webpage. Includes responsiveness tests as they make use of this support for navigation. These form of tests allow the specification of browsertime commands through the test manifest.
cnn-nav
Command to Run Locally
./mach raptor -t cnn-nav
Owner: PerfTest Team
Description: Navigates to cnn main page, then to the world sub-page.
accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#25
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-cnn-nav.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘landing’] [‘navigate’, ‘https://www.cnn.com’] [‘wait.byTime’, ‘4000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘world’] [‘click.byXpathAndWait’, ‘/html/body/div[5]/div/div/header/div/div[1]/div/div[2]/nav/ul/li[2]/a’] [‘wait.byTime’, ‘1000’] [‘measure.stop’, ‘’]
test url: https://www.cnn.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-cnn-nav |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-cnn-nav |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-cnn-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-cnn-nav |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-cnn-nav |
✅ |
✅ |
❌ |
❌ |
facebook-nav
Command to Run Locally
./mach raptor -t facebook-nav
Owner: PerfTest Team
Description: Navigates to facebook, then the sub-pages friends, marketplace, groups.
accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#41
lower is better: true
page cycles: 25
page timeout: 90000
playback: mitmproxy
playback pageset manifest: mitm6-windows-firefox-facebook-nav.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘landing’] [‘navigate’, ‘https://www.facebook.com/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘marketplace’] [‘navigate’, ‘https://www.facebook.com/marketplace’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘groups’] [‘navigate’, ‘https://www.facebook.com/groups/discover/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘friends’] [‘navigate’, ‘https://www.facebook.com/friends/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’]
test url: https://www.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-facebook-nav |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-facebook-nav |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-facebook-nav |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-facebook-nav |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-facebook-nav |
✅ |
✅ |
❌ |
❌ |
reddit-billgates-ama
Command to Run Locally
./mach raptor -t reddit-billgates-ama
Owner: PerfTest Team
Description: Navigates from the Bill Gates AMA to the Reddit members section.
accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#65
lower is better: true
page cycles: 25
page timeout: 240000
playback: mitmproxy
playback pageset manifest: mitm6-windows-firefox-reddit-billgates-ama.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘billg-ama’] [‘navigate’, ‘https://www.reddit.com/r/IAmA/comments/m8n4vt/im_bill_gates_cochair_of_the_bill_and_melinda/’] [‘wait.byTime’, ‘5000’] [‘measure.stop’, ‘’] [‘measure.start’, ‘members’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div[3]/div[2]/div/div[1]/div/div[4]/div[1]/div’] [‘wait.byTime’, ‘1000’] [‘measure.stop’, ‘’]
test url: https://www.reddit.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-reddit-billgates-ama |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-reddit-billgates-ama |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-reddit-billgates-ama |
✅ |
✅ |
❌ |
❌ |
reddit-billgates-post-1
Command to Run Locally
./mach raptor -t reddit-billgates-post-1
Owner: PerfTest Team
Description: Navigates the thisisbillgates user starting at the main user page, then to the posts, comments, hot, and top sections.
accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#81
lower is better: true
page cycles: 25
page timeout: 90000
playback: mitmproxy
playback pageset manifest: mitm6-windows-firefox-reddit-billgates-post.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘billg’] [‘navigate’, ‘https://www.reddit.com/user/thisisbillgates/’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘measure.start’, ‘posts’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[2]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘measure.start’, ‘comments’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘wait.byTime’, ‘500’]
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-reddit-billgates-post-1 |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-reddit-billgates-post-1 |
✅ |
✅ |
❌ |
❌ |
reddit-billgates-post-2
Command to Run Locally
./mach raptor -t reddit-billgates-post-2
Owner: PerfTest Team
Description: Navigates the thisisbillgates user starting at the main user page, then to the posts, comments, hot, and top sections.
accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, safari
browser cycles: 10
expected: pass
gecko profile interval: 1
interactive: true
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#102
lower is better: true
page cycles: 25
page timeout: 90000
playback: mitmproxy
playback pageset manifest: mitm6-windows-firefox-reddit-billgates-post.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test cmds: [‘measure.start’, ‘billg’] [‘navigate’, ‘https://www.reddit.com/user/thisisbillgates/’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]’] [‘wait.byTime’, ‘500’] [‘measure.start’, ‘hot’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[2]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘measure.start’, ‘top’] [‘click.byXpathAndWait’, ‘/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[3]’] [‘wait.byTime’, ‘500’] [‘measure.stop’, ‘’] [‘wait.byTime’, ‘500’]
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-responsiveness-chrome-reddit-billgates-post-2 |
❌ |
❌ |
❌ |
❌ |
browsertime-responsiveness-firefox-reddit-billgates-post-2 |
✅ |
✅ |
❌ |
❌ |
Live
A set of test pages that are run as live sites instead of recorded versions. These tests are available on all browsers, on all platforms.
booking-sf
Command to Run Locally
./mach raptor -t booking-sf
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#17
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://www.booking.com/hotel/us/edwardian-san-francisco.html
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-booking-sf |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-booking-sf-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-booking-sf |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-booking-sf-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-booking-sf |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-booking-sf-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-booking-sf |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-booking-sf-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-booking-sf |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-booking-sf-nofis |
❌ |
❌ |
❌ |
❌ |
discord
Command to Run Locally
./mach raptor -t discord
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#20
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://discordapp.com/
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-discord |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-discord-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-discord |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-discord-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-discord |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-discord-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-discord |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-discord-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-discord |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-discord-nofis |
❌ |
❌ |
❌ |
❌ |
fashionbeans
Command to Run Locally
./mach raptor -t fashionbeans
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#23
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://fashionbeans.com/article/coolest-menswear-stores-in-the-world
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-fashionbeans |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-fashionbeans-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-fashionbeans |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-fashionbeans-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-fashionbeans |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-fashionbeans-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-fashionbeans |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-fashionbeans-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-fashionbeans |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-fashionbeans-nofis |
❌ |
❌ |
❌ |
❌ |
google-accounts
Command to Run Locally
./mach raptor -t google-accounts
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#26
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://accounts.google.com
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-google-accounts |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-google-accounts-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-accounts |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-accounts-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-accounts |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-accounts-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-google-accounts |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-accounts-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-accounts |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-accounts-nofis |
❌ |
❌ |
❌ |
❌ |
imdb-firefox
Command to Run Locally
./mach raptor -t imdb-firefox
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#29
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://m.imdb.com/title/tt0083943/
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-imdb-firefox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-imdb-firefox-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb-firefox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb-firefox-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-firefox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-firefox-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-imdb-firefox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb-firefox-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-firefox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-firefox-nofis |
❌ |
❌ |
❌ |
❌ |
medium-article
Command to Run Locally
./mach raptor -t medium-article
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#32
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-medium-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-medium-article-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-medium-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-medium-article-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-medium-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-medium-article-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-medium-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-medium-article-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-medium-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-medium-article-nofis |
❌ |
❌ |
❌ |
❌ |
people-article
Command to Run Locally
./mach raptor -t people-article
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#35
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-people-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-people-article-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-people-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-people-article-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-people-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-people-article-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-people-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-people-article-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-people-article |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-people-article-nofis |
❌ |
❌ |
❌ |
❌ |
reddit-thread
Command to Run Locally
./mach raptor -t reddit-thread
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#38
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://www.reddit.com/r/firefox/comments/7dkq03/its_been_a_while/
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-reddit-thread |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-reddit-thread-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit-thread |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit-thread-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-thread |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-thread-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-reddit-thread |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit-thread-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-thread |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-thread-nofis |
❌ |
❌ |
❌ |
❌ |
rumble-fox
Command to Run Locally
./mach raptor -t rumble-fox
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#41
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://rumble.com/v3c44t-foxes-jumping-on-my-trampoline.html
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-rumble-fox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-rumble-fox-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-rumble-fox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-rumble-fox-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-rumble-fox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-rumble-fox-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-rumble-fox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-rumble-fox-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-rumble-fox |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-rumble-fox-nofis |
❌ |
❌ |
❌ |
❌ |
stackoverflow-question
Command to Run Locally
./mach raptor -t stackoverflow-question
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#44
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://stackoverflow.com/questions/927358/how-do-i-undo-the-most-recent-commits-in-git
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-stackoverflow-question |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-stackoverflow-question-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-stackoverflow-question |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-stackoverflow-question-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-stackoverflow-question |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-stackoverflow-question-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-stackoverflow-question |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-stackoverflow-question-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-stackoverflow-question |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-stackoverflow-question-nofis |
❌ |
❌ |
❌ |
❌ |
urbandictionary-define
Command to Run Locally
./mach raptor -t urbandictionary-define
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#47
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
test url: https://urbandictionary.com/define.php?term=awesome%20sauce
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-urbandictionary-define |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-urbandictionary-define-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-urbandictionary-define |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-urbandictionary-define-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-urbandictionary-define |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-urbandictionary-define-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-urbandictionary-define |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-urbandictionary-define-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-urbandictionary-define |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-urbandictionary-define-nofis |
❌ |
❌ |
❌ |
❌ |
wikia-marvel
Command to Run Locally
./mach raptor -t wikia-marvel
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, firefox, chrome
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#50
lower is better: true
page cycles: 25
page timeout: 60000
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-wikia-marvel |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-wikia-marvel-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikia-marvel |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikia-marvel-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikia-marvel |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikia-marvel-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-wikia-marvel |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikia-marvel-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikia-marvel |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikia-marvel-nofis |
❌ |
❌ |
❌ |
❌ |
Mobile
Page-load performance test suite on Android. The links direct to the actual websites that are being tested.
allrecipes
Command to Run Locally
./mach raptor -t allrecipes
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#22
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm8-android-gve-allrecipes.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.allrecipes.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-chrome-m-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-chrome-m-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-allrecipes |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-allrecipes-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-fenix-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-allrecipes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-allrecipes-nofis |
❌ |
❌ |
❌ |
❌ |
amazon
Command to Run Locally
./mach raptor -t amazon
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#27
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-amazon.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.amazon.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-amazon-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-profiling-firefox-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-profiling-firefox-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-profiling-firefox-amazon |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-webextensions-firefox-amazon |
✅ |
✅ |
❌ |
❌ |
amazon-search
Command to Run Locally
./mach raptor -t amazon-search
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#30
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-amazon-search.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-chrome-m-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-chrome-m-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-amazon-search |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-amazon-search-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-webextensions-fenix-amazon-search |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-webextensions-fenix-amazon-search-nofis |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-fenix-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-webextensions-fenix-amazon-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-webextensions-fenix-amazon-search-nofis |
❌ |
❌ |
❌ |
❌ |
bild-de
Command to Run Locally
./mach raptor -t bild-de
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#33
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm8-android-fenix-bild-de.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-bild-de |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-bild-de |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-bild-de |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-bild-de-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-bild-de |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-bild-de |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bild-de |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bild-de |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-bild-de |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-bild-de |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-bild-de |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bild-de |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bild-de |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bild-de-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-bild-de |
❌ |
❌ |
❌ |
❌ |
bing
Command to Run Locally
./mach raptor -t bing
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#38
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-bing.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.bing.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-bing |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-bing |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-bing |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-bing-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-bing |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-bing |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bing |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bing |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-bing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-bing |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-bing |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bing |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bing |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bing-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-bing |
❌ |
❌ |
❌ |
❌ |
bing-search-restaurants
Command to Run Locally
./mach raptor -t bing-search-restaurants
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#41
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-bing-search-restaurants.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.bing.com/search?q=restaurants+in+exton+pa+19341
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-bing-search-restaurants |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-bing-search-restaurants-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-bing-search-restaurants |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-bing-search-restaurants |
❌ |
❌ |
❌ |
❌ |
booking
Command to Run Locally
./mach raptor -t booking
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#44
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-booking.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.booking.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-booking |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-booking |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-booking |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-booking-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-booking |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-booking |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-booking |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-booking |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-booking |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-booking |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-booking |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-booking |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-booking |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-booking-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-booking |
❌ |
❌ |
❌ |
❌ |
cnn
Command to Run Locally
./mach raptor -t cnn
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#47
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-cnn.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://cnn.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-cnn |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
cnn-ampstories
Command to Run Locally
./mach raptor -t cnn-ampstories
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#50
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-cnn-ampstories.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn-ampstories |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn-ampstories-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-cnn-ampstories |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-ampstories-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-cnn-ampstories |
❌ |
❌ |
❌ |
❌ |
dailymail
Command to Run Locally
./mach raptor -t dailymail
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#53
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-dailymail.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-dailymail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-dailymail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-dailymail |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-dailymail-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-dailymail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-dailymail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-dailymail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-dailymail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-dailymail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-dailymail |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-dailymail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-dailymail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-dailymail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-dailymail-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-dailymail |
❌ |
❌ |
❌ |
❌ |
ebay-kleinanzeigen
Command to Run Locally
./mach raptor -t ebay-kleinanzeigen
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#56
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-ebay-kleinanzeigen.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.ebay-kleinanzeigen.de
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-ebay-kleinanzeigen |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-ebay-kleinanzeigen |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-ebay-kleinanzeigen |
❌ |
❌ |
❌ |
❌ |
ebay-kleinanzeigen-search
Command to Run Locally
./mach raptor -t ebay-kleinanzeigen-search
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#59
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-ebay-kleinanzeigen-search.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.ebay-kleinanzeigen.de/s-anzeigen/auf-zeit-wg-berlin/zimmer/c199-l3331
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-ebay-kleinanzeigen-search |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-ebay-kleinanzeigen-search |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-ebay-kleinanzeigen-search |
❌ |
❌ |
❌ |
❌ |
espn
Command to Run Locally
./mach raptor -t espn
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#62
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-espn.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-chrome-m-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-chrome-m-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-espn |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-espn-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-fenix-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-espn |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-espn |
✅ |
✅ |
❌ |
❌ |
facebook
Command to Run Locally
./mach raptor -t facebook
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#65
login: true
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-g5-fenix-facebook.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-facebook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-facebook |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
facebook-cristiano
Command to Run Locally
./mach raptor -t facebook-cristiano
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#70
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-facebook-cristiano.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.facebook.com/Cristiano
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-facebook-cristiano |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-facebook-cristiano-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-facebook-cristiano |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-cristiano-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-facebook-cristiano |
❌ |
❌ |
❌ |
❌ |
google
Command to Run Locally
./mach raptor -t google
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#73
login: true
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-g5-fenix-google.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.google.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-chrome-m-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-chrome-m-google-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-google-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-google |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-google-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-google-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-google-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-fenix-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-google-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-google-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-nofis |
❌ |
❌ |
❌ |
❌ |
google-maps
Command to Run Locally
./mach raptor -t google-maps
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#78
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-google-maps.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.google.com/maps?force=pwa
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-google-maps |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-google-maps |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-google-maps |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-google-maps-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-google-maps |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-google-maps |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-maps |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-maps |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-google-maps |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-google-maps |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-google-maps |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-maps |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-maps |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-maps-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-google-maps |
❌ |
❌ |
❌ |
❌ |
google-search-restaurants
Command to Run Locally
./mach raptor -t google-search-restaurants
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#81
login: true
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-g5-fenix-google-search-restaurants.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.google.com/search?q=restaurants+near+me
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-google-search-restaurants |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-google-search-restaurants-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-google-search-restaurants |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-google-search-restaurants-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-google-search-restaurants |
❌ |
❌ |
❌ |
❌ |
imdb
Command to Run Locally
./mach raptor -t imdb
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#86
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-imdb.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.imdb.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-imdb |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-imdb-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-imdb |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imdb |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imdb |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
instagram
Command to Run Locally
./mach raptor -t instagram
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#89
login: true
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm8-android-gve-instagram.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.instagram.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-instagram |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-instagram-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-instagram |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
microsoft-support
Command to Run Locally
./mach raptor -t microsoft-support
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#95
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-microsoft-support.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://support.microsoft.com/en-us
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-chrome-m-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-chrome-m-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-microsoft-support |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-microsoft-support-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-fenix-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-microsoft-support |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-microsoft-support-nofis |
❌ |
❌ |
❌ |
❌ |
reddit
Command to Run Locally
./mach raptor -t reddit
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#98
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-reddit.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://www.reddit.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-reddit |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-reddit-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-reddit |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-reddit |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-reddit |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
sina
Command to Run Locally
./mach raptor -t sina
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#101
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm8-android-fenix-sina.manifest
playback version: 11.0.0
support class: browsertime_pageload.py
test url: https://www.sina.com.cn/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-sina |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-sina-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-sina |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-sina-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-sina |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-sina-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-sina |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-sina-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-sina |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-sina |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-sina-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-sina |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-sina-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-sina |
❌ |
❌ |
❌ |
❌ |
stackoverflow
Command to Run Locally
./mach raptor -t stackoverflow
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#106
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-stackoverflow.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://stackoverflow.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-stackoverflow |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-stackoverflow |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-stackoverflow |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-stackoverflow-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-stackoverflow |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-stackoverflow |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-stackoverflow |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-stackoverflow |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-stackoverflow |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-stackoverflow |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-stackoverflow |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-stackoverflow |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-stackoverflow |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-stackoverflow-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-stackoverflow |
❌ |
❌ |
❌ |
❌ |
wikipedia
Command to Run Locally
./mach raptor -t wikipedia
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#109
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-wikipedia.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-wikipedia |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-wikipedia-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-wikipedia |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-essential-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-custom-car-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
youtube
Command to Run Locally
./mach raptor -t youtube
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#112
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-youtube.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
test url: https://m.youtube.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-cstm-car-m-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-youtube |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-youtube-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-geckoview-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-youtube |
✅ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-youtube |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-custom-car-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-youtube |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6-live-chrome-youtube |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-youtube |
❌ |
❌ |
❌ |
❌ |
youtube-watch
Command to Run Locally
./mach raptor -t youtube-watch
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange, largestContentfulPaint
alert threshold: 2.0
apps: geckoview, fenix, refbrow, chrome-m, cstm-car-m
benchmark page: true
browser cycles: 15
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#115
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy-android
playback pageset manifest: mitm6-android-fenix-youtube-watch.manifest
playback version: 8.1.1
support class: browsertime_pageload.py
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-chrome-m-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-chrome-m-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-cstm-car-m-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-youtube-watch |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-youtube-watch-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-fenix-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-refbrow-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube-watch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-youtube-watch-nofis |
❌ |
❌ |
❌ |
❌ |
Scenario
Tests that perform a specific action (a scenario), i.e. idle application, idle application in background, etc.
idle
Command to Run Locally
./mach raptor -t idle
Owner: PerfTest Team
alert threshold: 2.0
apps: fenix, geckoview, refbrow
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/scenario/idle.toml#15
lower is better: true
measure: fakeMeasure
page cycles: 1
page timeout: 1320000
scenario time: 1200000
support class: browsertime_pageload.py
test url: about:blank
type: scenario
unit: scenarioComplete
idle-bg
Command to Run Locally
./mach raptor -t idle-bg
Owner: PerfTest Team
alert threshold: 2.0
apps: fenix, geckoview, refbrow
browsertime args: –browsertime.scenario_time=60000 –browsertime.background_app=false
expected: pass
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/scenario/idle.toml#17
lower is better: true
measure: fakeMeasure
page cycles: 1
page timeout: 1320000
scenario time: 1200000
support class: browsertime_pageload.py
test url: about:blank
type: scenario
unit: scenarioComplete
Unittests
These tests aren’t used in standard testing, they are only used in the Raptor unit tests (they are similar to raptor-tp6 tests though).
test-page-1
Command to Run Locally
./mach raptor -t test-page-1
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/unittests/browsertime-tp6-unittest.toml#17
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-test-page-1.manifest
playback version: 11.0.0
test url: https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1
type: pageload
unit: ms
test-page-2
Command to Run Locally
./mach raptor -t test-page-2
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/unittests/browsertime-tp6-unittest.toml#20
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-test-page-2.manifest
playback version: 11.0.0
test url: https://www.facebook.com
type: pageload
unit: ms
test-page-3
Command to Run Locally
./mach raptor -t test-page-3
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/unittests/browsertime-tp6-unittest.toml#23
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-test-page-3.manifest
playback version: 11.0.0
test url: https://www.google.com/search?hl=en&q=barack+obama&cad=h
type: pageload
unit: ms
test-page-4
Command to Run Locally
./mach raptor -t test-page-4
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
link searchfox: https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/unittests/browsertime-tp6-unittest.toml#26
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-test-page-4.manifest
playback version: 11.0.0
test url: https://www.youtube.com
type: pageload
unit: ms