Raptor¶
Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, and Chrome.
Contact: Dave Hunt [:davehunt]
Source code: https://searchfox.org/mozilla-central/source/testing/raptor
Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor
Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) “scenario”-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).
Locally, Raptor can be invoked with the following command:
./mach raptor
We’re in the process of migrating away from webextension to browsertime. Currently, raptor supports both of them, but at the end of the migration, the support for webextension will be removed.
Raptor tests¶
The following documents all testing we have for Raptor.
Benchmarks¶
Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see Updating Benchmark Tests.
ares6
Owner: :jandem and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 4
page timeout: 270000
subtest lower is better: true
subtest unit: ms
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-ares6 |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-ares6 |
✅ |
✅ |
✅ |
✅ |
browsertime-benchmark-safari-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-ares6 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-ares6 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-ares6 |
✅ |
✅ |
✅ |
✅ |
assorted-dom
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 2000000
gecko profile interval: 1
lower is better: true
page cycles: 1
page timeout: 60000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/assorted-dom
repository revision: 61332db584026b73e37066d717a162825408c36b
screen capture: true
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-assorted-dom |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-assorted-dom |
✅ |
✅ |
✅ |
✅ |
browsertime-benchmark-safari-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-assorted-dom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-assorted-dom |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-assorted-dom |
✅ |
✅ |
✅ |
✅ |
jetstream2
Owner: :jandem and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 4
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/JetStream2
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: false
subtest unit: score
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
✅ |
✅ |
browsertime-benchmark-safari-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-jetstream2 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-jetstream2 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-jetstream2 |
✅ |
✅ |
✅ |
✅ |
matrix-react-bench
Owner: :jandem and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 30
page timeout: 2000000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/matrix-react-bench
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/matrix_demo.html
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-matrix-react-bench |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-matrix-react-bench |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-matrix-react-bench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-matrix-react-bench |
✅ |
✅ |
✅ |
✅ |
motionmark-animometer
Owner: :jgilbert and Graphics(gfx) Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 1
page timeout: 600000
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-animometer |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-animometer |
✅ |
✅ |
✅ |
✅ |
browsertime-benchmark-safari-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-motionmark-animometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-animometer |
✅ |
✅ |
✅ |
✅ |
motionmark-htmlsuite
Owner: :jgilbert and Graphics(gfx) Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 600000
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite |
✅ |
✅ |
✅ |
✅ |
browsertime-benchmark-safari-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-motionmark-htmlsuite |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-motionmark-htmlsuite |
✅ |
✅ |
✅ |
✅ |
raptor-speedometer-geckoview
Owner: SpiderMonkey Team
alert threshold: 2.0
apps: geckoview
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 1
page timeout: 420000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
raptor-youtube-playback-h264-1080p30-firefox
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
raptor-youtube-playback-h264-1080p60-firefox
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
raptor-youtube-playback-h264-full-1080p30-firefox
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
raptor-youtube-playback-h264-full-1080p60-firefox
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
raptor-youtube-playback-v9-1080p30-firefox
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
raptor-youtube-playback-v9-1080p60-firefox
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
raptor-youtube-playback-v9-full-1080p30-firefox
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
raptor-youtube-playback-v9-full-1080p60-firefox
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
lower is better: true
page cycles: 20
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
speedometer
Owner: SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 180000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speedometer-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer-mobile-geckoview-nofis |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
✅ |
✅ |
browsertime-benchmark-safari-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
✅ |
✅ |
Owner: SpiderMonkey Team
alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/Speedometer/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speedometer-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer-mobile-geckoview-nofis |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
✅ |
✅ |
browsertime-benchmark-safari-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer |
✅ |
✅ |
✅ |
✅ |
speedometer3
Owner: Performance Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browsertime args: –browsertime.speedometer_iterations=5
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 180000
repository: https://github.com/WebKit/Speedometer
repository revision: f16557016d2a0bd8f512611c34cc6538afdde121
submetric summary method: median
subtest lower is better: true
subtest name filters: tests/,s3/
subtest unit: ms
test script: speedometer3.js
test summary: flatten
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speedometer3-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speedometer3-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer3-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer3-mobile-geckoview-nofis |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
✅ |
❌ |
browsertime-benchmark-safari-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
✅ |
❌ |
Owner: Performance Team
alert threshold: 2.0
apps: fenix, geckoview, refbrow, chrome-m
browsertime args: –browsertime.speedometer_iterations=5
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
repository: https://github.com/WebKit/Speedometer
repository revision: f16557016d2a0bd8f512611c34cc6538afdde121
submetric summary method: median
subtest lower is better: true
subtest name filters: tests/,s3/
subtest unit: ms
test script: speedometer3.js
test summary: flatten
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speedometer3-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer3-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-speedometer3-mobile-chrome-m-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer3-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-speedometer3-mobile-geckoview-nofis |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
✅ |
❌ |
browsertime-benchmark-safari-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-speedometer3 |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-speedometer3 |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-speedometer3 |
✅ |
✅ |
✅ |
❌ |
stylebench
Owner: :emelio and Layout Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 120000
subtest lower is better: true
subtest unit: ms
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-stylebench |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-stylebench |
✅ |
✅ |
✅ |
✅ |
browsertime-benchmark-safari-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-stylebench |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-stylebench |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-stylebench |
✅ |
✅ |
✅ |
✅ |
sunspider
Owner: :jandem and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 55000
test url: http://<host>:<port>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-sunspider |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-sunspider |
✅ |
✅ |
✅ |
✅ |
browsertime-benchmark-safari-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-sunspider |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-sunspider |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-sunspider |
✅ |
✅ |
✅ |
✅ |
twitch-animation
Owner: :jrmuizel
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 1
page timeout: 2000000
perfstats: true
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/twitch-animation
repository revision: 61332db584026b73e37066d717a162825408c36b
subtest lower is better: true
subtest unit: ms
test url: http://<host>:<port>/index.html
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-twitch-animation |
✅ |
✅ |
✅ |
✅ |
unity-webgl
Owner: :jgilbert and Graphics(gfx) Team
alert threshold: 2.0
apps: geckoview, refbrow, fenix, chrome-m
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 1
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-unity-webgl-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-unity-webgl-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-unity-webgl-mobile-chrome-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-unity-webgl-mobile-fenix-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-unity-webgl-mobile-geckoview-nofis |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
✅ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
✅ |
✅ |
❌ |
browsertime-benchmark-safari-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
✅ |
✅ |
❌ |
Owner: :jgilbert and Graphics(gfx) Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: false
page cycles: 5
page timeout: 420000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/unity-webgl
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-unity-webgl-mobile-fenix-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-unity-webgl-mobile-geckoview-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-unity-webgl-mobile-chrome-m-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-unity-webgl-mobile-fenix-nofis |
✅ |
❌ |
❌ |
❌ |
browsertime-unity-webgl-mobile-geckoview-nofis |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
✅ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
✅ |
✅ |
❌ |
browsertime-benchmark-safari-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-unity-webgl |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-unity-webgl |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-unity-webgl |
✅ |
✅ |
✅ |
❌ |
wasm-godot
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-chromium-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-godot |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-chromium-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-godot |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-chromium-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-chromium-wasm-godot |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-godot |
✅ |
❌ |
✅ |
❌ |
wasm-godot-baseline
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-baseline |
✅ |
❌ |
✅ |
❌ |
wasm-godot-optimizing
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 8000000
gecko profile interval: 1
lower is better: true
newtab per cycle: true
page cycles: 5
page timeout: 120000
preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-godot-optimizing |
✅ |
❌ |
✅ |
❌ |
wasm-misc
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-chromium-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-misc |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-chromium-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-misc |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-chromium-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-chrome-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-chromium-wasm-misc |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-wasm-firefox-wasm-misc |
✅ |
❌ |
✅ |
❌ |
wasm-misc-baseline
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: {“javascript.options.wasm_baselinejit”: true, “javascript.options.wasm_optimizingjit”: false}
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-baseline |
✅ |
❌ |
✅ |
❌ |
wasm-misc-optimizing
Owner: :lth and SpiderMonkey Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 1200000
preferences: {“javascript.options.wasm_baselinejit”: false, “javascript.options.wasm_optimizingjit”: true}
repository: https://github.com/mozilla/perf-automation
repository path: benchmarks/wasm-misc
repository revision: 61332db584026b73e37066d717a162825408c36b
test url: http://<host>:<port>/index.html?raptor
type: benchmark
unit: ms
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-wasm-firefox-wasm-misc-optimizing |
✅ |
❌ |
✅ |
❌ |
webaudio
Owner: :padenot and Media Team
alert threshold: 2.0
apps: firefox, chrome, chromium
expected: pass
gecko profile entries: 4000000
gecko profile interval: 1
lower is better: true
page cycles: 5
page timeout: 360000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
type: benchmark
unit: score
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-webaudio |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-webaudio |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-firefox-webaudio |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-benchmark-chrome-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-chromium-webaudio |
❌ |
❌ |
❌ |
❌ |
browsertime-benchmark-firefox-webaudio |
✅ |
✅ |
✅ |
✅ |
youtube-playback
Owner: PerfTest Team
alert on: H264.1080p30@1X_dropped_frames, H264.1080p60@1X_dropped_frames, H264.1440p30@1X_dropped_frames, H264.144p15@1X_dropped_frames, H264.2160p30@1X_dropped_frames, H264.240p30@1X_dropped_frames, H264.360p30@1X_dropped_frames, H264.480p30@1X_dropped_frames, H264.720p30@1X_dropped_frames, H264.720p60@1X_dropped_frames, VP9.1080p30@1X_dropped_frames, VP9.1080p60@1X_dropped_frames, VP9.1440p30@1X_dropped_frames, VP9.1440p60@1X_dropped_frames, VP9.144p30@1X_dropped_frames, VP9.2160p30@1X_dropped_frames, VP9.2160p60@1X_dropped_frames, VP9.240p30@1X_dropped_frames, VP9.360p30@1X_dropped_frames, VP9.480p30@1X_dropped_frames, VP9.720p30@1X_dropped_frames, VP9.720p60@1X_dropped_frames
alert threshold: 2.0
apps: firefox, geckoview, fenix,refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
youtube-playback-av1-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-av1-sfr |
✅ |
❌ |
✅ |
❌ |
youtube-playback-h264-1080p30
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
youtube-playback-h264-1080p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
youtube-playback-h264-full-1080p30
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
youtube-playback-h264-full-1080p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
youtube-playback-h264-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-h264-sfr-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-h264-sfr |
✅ |
❌ |
✅ |
❌ |
youtube-playback-hfr
Owner: PerfTest Team
alert on: H2641080p60fps@1X_dropped_frames, H264720p60fps@1X_dropped_frames
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-hfr-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-hfr-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-mobile-fenix-youtube-playback-hfr-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-mobile-geckoview-youtube-playback-hfr-nofis |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-hfr |
✅ |
❌ |
✅ |
❌ |
youtube-playback-v9-1080p30
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
youtube-playback-v9-1080p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
youtube-playback-v9-full-1080p30
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
youtube-playback-v9-full-1080p60
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “full-screen-api.allow-trusted-requests-only”: false, “full-screen-api.warning.timeout”: 0}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
youtube-playback-vp9-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-vp9-sfr |
✅ |
❌ |
✅ |
❌ |
youtube-playback-widevine-h264-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-h264-sfr |
✅ |
❌ |
✅ |
❌ |
youtube-playback-widevine-hfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-hfr |
✅ |
❌ |
✅ |
❌ |
youtube-playback-widevine-vp9-sfr
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, geckoview, fenix, refbrow, chrome
expected: pass
gecko profile entries: 50000000
gecko profile interval: 1000
gecko profile threads: MediaPlayback
lower is better: true
page cycles: 1
page timeout: 2700000
preferences: {“media.autoplay.default”: 0, “media.autoplay.ask-permission”: false, “media.autoplay.blocking_policy”: 0, “media.autoplay.block-webaudio”: false, “media.allowed-to-play.enabled”: true, “media.block-autoplay-until-in-foreground”: false, “media.eme.enabled”: true, “media.gmp-manager.updateEnabled”: true, “media.eme.require-app-approval”: false}
subtest lower is better: true
subtest unit: score
type: benchmark
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
✅ |
❌ |
✅ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-firefox-youtube-playback-widevine-vp9-sfr |
✅ |
❌ |
✅ |
❌ |
Custom¶
Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.
browsertime
Owner: PerfTest Team
alert on: fcp, loadtime
alert threshold: 2.0
apps: firefox
browser cycles: 1
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
measure: fnbpaint, fcp, dcf, loadtime
page cycles: 1
page timeout: 60000
playback: mitmproxy
playback pageset manifest: null.manifest
playback version: 8.1.1
test script: None
test url: None
type: pageload
unit: ms
use live sites: true
constant-regression
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari, geckoview, fenix
browser cycles: 1
browsertime args: –browsertime.constant_value=1000
custom data: true
expected: pass
fore window: 1
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
max back window: 3
min back window: 2
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest unit: ms
test script: constant_regression_test.js
test summary: flatten
test url: None
type: pageload
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-regression-tests-firefox-constant-regression |
❌ |
✅ |
❌ |
❌ |
grandprix
Owner: PerfTest Team
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 1
browsertime args: –browsertime.grandprix_iterations=25
custom data: true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
output timeout: 2000000
page cycles: 1
page timeout: 1800000
subtest name filters: tests/,iterations/
subtest unit: ms
test script: grandprix.js
test summary: flatten
test url: None
type: pageload
unit: score
use live sites: true
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-grandprix-firefox-grandprix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-grandprix-firefox-grandprix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-grandprix-chrome-grandprix |
❌ |
❌ |
❌ |
❌ |
browsertime-grandprix-chromium-grandprix |
❌ |
❌ |
❌ |
❌ |
browsertime-grandprix-firefox-grandprix |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-grandprix-chrome-grandprix |
❌ |
❌ |
❌ |
❌ |
browsertime-grandprix-chromium-grandprix |
❌ |
❌ |
❌ |
❌ |
browsertime-grandprix-firefox-grandprix |
✅ |
✅ |
❌ |
❌ |
browsertime-grandprix-safari-grandprix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-grandprix-firefox-grandprix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-grandprix-chrome-grandprix |
❌ |
❌ |
❌ |
❌ |
browsertime-grandprix-chromium-grandprix |
❌ |
❌ |
❌ |
❌ |
browsertime-grandprix-firefox-grandprix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-grandprix-firefox-grandprix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-grandprix-chrome-grandprix |
❌ |
❌ |
❌ |
❌ |
browsertime-grandprix-chromium-grandprix |
❌ |
❌ |
❌ |
❌ |
browsertime-grandprix-firefox-grandprix |
✅ |
✅ |
❌ |
❌ |
process-switch
Owner: PerfTest Team
accept zero vismet: true
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium
browser cycles: 25
browsertime args: –pageCompleteWaitTime=1000 –pageCompleteCheckInactivity=true
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-proc-switch.manifest
playback version: 5.1.1
test script: process_switch.js
test url: https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-custom-firefox-process-switch |
✅ |
❌ |
❌ |
❌ |
welcome
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-welcome.manifest
playback version: 8.1.1
test script: welcome.js
test url: about:welcome
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
✅ |
✅ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-first-install-firefox-welcome |
✅ |
✅ |
❌ |
❌ |
Desktop¶
Tests for page-load performance. The links direct to the actual websites that are being tested.
amazon
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-amazon.manifest
playback version: 8.1.1
test url: https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-amazon-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-amazon-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-profiling-firefox-amazon |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-profiling-firefox-amazon |
✅ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-amazon |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-amazon |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-amazon |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-amazon |
❌ |
❌ |
❌ |
❌ |
bing-search
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-bing-search.manifest
playback version: 8.1.1
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-bing-search |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-bing-search |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-bing-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-bing-search |
❌ |
❌ |
❌ |
❌ |
buzzfeed
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-buzzfeed.manifest
playback version: 8.1.1
secondary url: https://www.buzzfeed.com/quizzes
test url: https://www.buzzfeed.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-buzzfeed |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-buzzfeed |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-buzzfeed |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-buzzfeed |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-buzzfeed |
✅ |
✅ |
✅ |
✅ |
cnn
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-cnn.manifest
playback version: 8.1.1
secondary url: https://www.cnn.com/weather
test url: https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-cnn-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-cnn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chrome-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-cnn |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-cnn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-cnn |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-sheriffed-firefox-cnn |
❌ |
❌ |
❌ |
❌ |
ebay
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-ebay.manifest
playback version: 8.1.1
secondary url: https://www.ebay.com/deals
test url: https://www.ebay.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-ebay |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-ebay |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-ebay |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-ebay |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-ebay |
❌ |
❌ |
❌ |
❌ |
espn
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-espn.manifest
playback version: 8.1.1
secondary url: https://www.espn.com/nba/draft/news
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-chrome-m-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-espn-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-espn-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-espn-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-espn |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-espn |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-espn |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-espn |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-espn |
✅ |
✅ |
✅ |
✅ |
expedia
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-expedia.manifest
playback version: 8.1.1
secondary url: https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-expedia-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-expedia |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-expedia |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-expedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-expedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-expedia |
✅ |
✅ |
✅ |
✅ |
facebook
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-facebook.manifest
playback version: 8.1.1
secondary url: https://www.facebook.com/marketplace/?ref=bookmark
test url: https://www.facebook.com
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-fenix-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-essential-chrome-m-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-fenix-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-essential-geckoview-facebook-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-facebook-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-facebook |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-facebook |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-facebook |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-facebook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-facebook |
❌ |
❌ |
❌ |
❌ |
fandom
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-fandom.manifest
playback version: 8.1.1
test url: https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-fandom |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-fandom |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-fandom |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-fandom |
❌ |
❌ |
❌ |
❌ |
google-docs
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page complete wait time: 8000
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-google-docs.manifest
playback version: 8.1.1
secondary url: https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview
test url: https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-docs |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-docs |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-docs |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-docs |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-docs |
❌ |
❌ |
❌ |
❌ |
google-mail
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-google-mail.manifest
playback version: 8.1.1
test url: https://mail.google.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-mail |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-mail |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-mail |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-mail |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-mail |
❌ |
❌ |
❌ |
❌ |
google-search
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-google-search.manifest
playback version: 8.1.1
test url: https://www.google.com/search?hl=en&q=barack+obama&cad=h
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-search |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-search |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-google-search |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-google-search |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-google-search |
❌ |
❌ |
❌ |
❌ |
imdb
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-imdb.manifest
playback version: 8.1.1
secondary url: https://www.imdb.com/title/tt0084967/episodes/?ref_=tt_ov_epl
test url: https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-imdb-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-imdb-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imdb |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imdb |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imdb |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-imdb |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imdb |
❌ |
❌ |
❌ |
❌ |
imgur
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm8-linux-firefox-imgur.manifest
playback version: 8.1.1
preferences: {“media.autoplay.default”: 5, “media.autoplay.ask-permission”: true, “media.autoplay.blocking_policy”: 1, “media.autoplay.block-webaudio”: true, “media.allowed-to-play.enabled”: false, “media.block-autoplay-until-in-foreground”: true}
secondary url: https://imgur.com/gallery/rCXZUil
test url: https://imgur.com/gallery/m5tYJL6
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imgur |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imgur |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-imgur |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-imgur |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-imgur |
❌ |
❌ |
❌ |
❌ |
instagram
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-instagram.manifest
playback version: 8.1.1
secondary url: https://www.instagram.com/nobelprize_org/
test url: https://www.instagram.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-instagram-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-instagram-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-instagram |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-instagram |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-instagram |
✅ |
✅ |
✅ |
✅ |
linkedin
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-linkedin.manifest
playback version: 8.1.1
secondary url: https://www.linkedin.com/in/thommy-harris-hk-385723106/
test url: https://www.linkedin.com/feed/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-linkedin |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-linkedin |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-linkedin |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-linkedin |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-linkedin |
❌ |
❌ |
❌ |
❌ |
microsoft
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-microsoft.manifest
playback version: 8.1.1
secondary url: https://support.microsoft.com/en-us
test url: https://www.microsoft.com/en-us/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-microsoft |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-microsoft |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-microsoft |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-microsoft |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-microsoft |
❌ |
❌ |
❌ |
❌ |
netflix
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-netflix.manifest
playback version: 8.1.1
secondary url: https://www.netflix.com/title/699257
test url: https://www.netflix.com/title/80117263
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-netflix |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-netflix |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-netflix |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-netflix |
❌ |
❌ |
❌ |
❌ |
nytimes
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-nytimes.manifest
playback version: 8.1.1
secondary url: https://www.nytimes.com/section/opinion/columnists
test url: https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-fenix-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-live-chrome-m-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-nytimes-nofis |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-nytimes |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-nytimes |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-nytimes |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-nytimes |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-nytimes |
✅ |
✅ |
✅ |
✅ |
office
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-office.manifest
playback version: 8.1.1
secondary url: https://www.office.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-office |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-office |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-office |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-office |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-office |
✅ |
✅ |
✅ |
✅ |
outlook
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-live.manifest
playback version: 8.1.1
test url: https://outlook.live.com/mail/inbox
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-outlook |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-outlook |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-outlook |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-outlook |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-outlook |
❌ |
❌ |
❌ |
❌ |
paypal
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-paypal.manifest
playback version: 8.1.1
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-paypal |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-paypal |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-paypal |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-paypal |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-paypal |
❌ |
❌ |
❌ |
❌ |
pinterest
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-pinterest.manifest
playback version: 8.1.1
secondary url: https://www.pinterest.com/today/best/halloween-costumes-for-your-furry-friends/75787/
test url: https://pinterest.com/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-pinterest |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-pinterest |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-pinterest |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-pinterest |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-pinterest |
❌ |
❌ |
❌ |
❌ |
reddit
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-reddit.manifest
playback version: 8.1.1
secondary url: https://www.reddit.com/r/technology/
test url: https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-reddit-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-reddit-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-reddit |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-reddit |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-reddit |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-reddit |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-reddit |
❌ |
❌ |
❌ |
❌ |
tumblr
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm6-linux-firefox-tumblr.manifest
playback version: 8.1.1
secondary url: https://www.tumblr.com/tagged/funny+cats?sort=top
test url: https://www.tumblr.com/dashboard
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-tumblr |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-tumblr |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-tumblr |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-tumblr |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-tumblr |
❌ |
❌ |
❌ |
❌ |
twitch
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-twitch.manifest
playback version: 8.1.1
preferences: {“media.autoplay.default”: 5, “media.autoplay.ask-permission”: true, “media.autoplay.blocking_policy”: 1, “media.autoplay.block-webaudio”: true, “media.allowed-to-play.enabled”: false, “media.block-autoplay-until-in-foreground”: true}
secondary url: https://www.twitch.tv/gmashley
test url: https://www.twitch.tv/videos/894226211
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-twitch |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-twitch |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-twitch |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-twitch |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitch |
❌ |
❌ |
❌ |
❌ |
twitter
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm5-linux-firefox-twitter.manifest
playback version: 8.1.1
test url: https://twitter.com/BarackObama
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-twitter |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-twitter |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-twitter |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-twitter |
❌ |
❌ |
❌ |
❌ |
wikia
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-wikia.manifest
playback version: 8.1.1
secondary url: https://marvel.fandom.com/wiki/Celestials
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-wikia |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-wikia |
✅ |
✅ |
✅ |
✅ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-firefox-wikia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-chrome-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-chromium-wikia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-firefox-wikia |
✅ |
✅ |
✅ |
✅ |
wikipedia
Owner: PerfTest Team
alert on: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange
alert threshold: 2.0
apps: firefox, chrome, chromium, safari
browser cycles: 25
expected: pass
gecko profile entries: 14000000
gecko profile interval: 1
lower is better: true
page cycles: 25
page timeout: 60000
playback: mitmproxy
playback pageset manifest: mitm7-linux-firefox-wikipedia.manifest
playback version: 8.1.1
secondary url: https://en.wikipedia.org/wiki/Joe_Biden
type: pageload
unit: ms
use live sites: false
Test Task:
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-fenix-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6m-chrome-m-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-chrome-m-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-geckoview-wikipedia-nofis |
✅ |
✅ |
❌ |
❌ |
browsertime-tp6m-live-chrome-m-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-fenix-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-live-geckoview-wikipedia-nofis |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6m-refbrow-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-essential-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
✅ |
✅ |
✅ |
✅ |
browsertime-tp6-live-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-safari-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-chromium-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chrome-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-chromium-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|---|---|---|---|
browsertime-tp6-bytecode-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-essential-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
browsertime-tp6-live-firefox-wikipedia |
❌ |
❌ |
❌ |
❌ |
Test Name |
mozilla-central |
autoland |
mozilla-release |
mozilla-beta |
---|