###### Raptor ###### Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, Chrome, Chrome for Android, Safari, and Safari Technology Preview. - Contact: Dave Hunt [:davehunt] - Source code: https://searchfox.org/mozilla-central/source/testing/raptor - Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) "scenario"-based tests, such as power, CPU, and memory-usage measurements on Android and Desktop. Locally, Raptor can be invoked with the following command: :: ./mach raptor .. toctree:: :titlesonly: browsertime debugging contributing raptor-metrics .. contents:: :depth: 2 :local: Raptor tests ************ The following documents all testing we have for Raptor. Benchmarks ---------- Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see `Updating Benchmark Tests `_. .. dropdown:: ares6 :class-container: anchor-id-ares6-b * Command to Run Locally .. code-block:: ./mach raptor -t ares6 **Owner**: :jandem and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 4 * **page timeout**: 270000 * **subtest lower is better**: true * **subtest unit**: ms * **test url**: `:\/ARES-6/index.html?raptor>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-ares6** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-ares6** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-ares6** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-ares6** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-ares6** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-ares6** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-ares6** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-ares6** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-ares6** - ❌ - ❌ - ❌ - ❌ .. dropdown:: assorted-dom :class-container: anchor-id-assorted-dom-b * Command to Run Locally .. code-block:: ./mach raptor -t assorted-dom **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/assorted-dom * **repository revision**: 61332db584026b73e37066d717a162825408c36b * **screen capture**: true * **sparse checkout**: true * **test url**: `:\/assorted/driver.html?raptor>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-assorted-dom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-assorted-dom** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-assorted-dom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-assorted-dom** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-assorted-dom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-assorted-dom** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-assorted-dom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-assorted-dom** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-assorted-dom** - ❌ - ❌ - ❌ - ❌ .. dropdown:: jetstream2 :class-container: anchor-id-jetstream2-b * Command to Run Locally .. code-block:: ./mach raptor -t jetstream2 **Owner**: :jandem and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: fenix, geckoview, chrome-m, cstm-car-m * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 4 * **page timeout**: 2000000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/JetStream2 * **repository revision**: 61332db584026b73e37066d717a162825408c36b * **sparse checkout**: true * **subtest lower is better**: false * **subtest unit**: score * **test url**: `:\/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-fenix-jetstream2** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-geckoview-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-jetstream2-fenix-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-geckoview-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ **Owner**: :jandem and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 4 * **page timeout**: 2000000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/JetStream2 * **repository revision**: 6acd3f58f12dbd71cf4743666cad305862681630 * **sparse checkout**: true * **subtest lower is better**: false * **subtest unit**: score * **test url**: `:\/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-fenix-jetstream2** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-geckoview-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-jetstream2-fenix-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-geckoview-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream2** - ❌ - ❌ - ❌ - ❌ .. dropdown:: jetstream3 :class-container: anchor-id-jetstream3-b * Command to Run Locally .. code-block:: ./mach raptor -t jetstream3 **Owner**: :jandem and spidermonkey team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, safari-tp, custom-car * **expected**: pass * **expose browser profiler**: true * **expose chrome trace**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 1 * **page timeout**: 2000000 * **repository**: https://github.com/webkit/jetstream * **repository revision**: a3f5c45465f5271bed385321a0587bd4202682d6 * **subtest alert threshold**: 5.0 * **subtest lower is better**: true * **subtest unit**: ms * **suite name**: JetStream3.0 * **support class**: jetstream3.py * **test script**: jetstream3.js * **test url**: `:\/>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-jetstream3-chrome-m-jetstream3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream3-cstm-car-m-jetstream3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream3-fenix-jetstream3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-jetstream3-fenix-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-tp-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ **Owner**: :jandem and spidermonkey team * **alert threshold**: 2.0 * **apps**: chrome-m, cstm-car-m, fenix * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 1 * **page timeout**: 2000000 * **preferences**: dom.max_script_run_time=0 * **repository**: https://github.com/webkit/jetstream * **repository revision**: a3f5c45465f5271bed385321a0587bd4202682d6 * **subtest alert threshold**: 5.0 * **subtest lower is better**: true * **subtest unit**: ms * **suite name**: JetStream3.0 * **support class**: jetstream3.py * **test script**: jetstream3.js * **test url**: `:\/>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-jetstream3-chrome-m-jetstream3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream3-cstm-car-m-jetstream3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream3-fenix-jetstream3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-jetstream3-fenix-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-tp-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-jetstream3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-jetstream3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-jetstream3** - ❌ - ❌ - ❌ - ❌ .. dropdown:: matrix-react-bench :class-container: anchor-id-matrix-react-bench-b * Command to Run Locally .. code-block:: ./mach raptor -t matrix-react-bench **Owner**: :jandem and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 30 * **page timeout**: 2000000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/matrix-react-bench * **repository revision**: 61332db584026b73e37066d717a162825408c36b * **sparse checkout**: true * **subtest lower is better**: true * **subtest unit**: ms * **test url**: `:\/matrix_demo.html>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-matrix-react-bench** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-matrix-react-bench** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-matrix-react-bench** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-matrix-react-bench** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-matrix-react-bench** - ❌ - ❌ - ❌ - ❌ .. dropdown:: motionmark-1-3 :class-container: anchor-id-motionmark-1-3-b * Command to Run Locally .. code-block:: ./mach raptor -t motionmark-1-3 **Owner**: Graphics Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **browser cycles**: 1 * **cold**: true * **expected**: pass * **expose browser profiler**: true * **expose chrome trace**: true * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory * **gecko profile interval**: 1 * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate * **host from parent**: false * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 1 * **page timeout**: 600000 * **repository**: https://github.com/webkit/motionmark * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb * **subtest lower is better**: false * **subtest unit**: score * **suite name**: MotionMark * **support class**: motionmark-1-3.py * **test script**: motionmark-1-3.js * **test url**: `:\/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ **Owner**: Graphics Team * **alert threshold**: 2.0 * **apps**: fenix, geckoview, chrome-m, cstm-car-m * **browser cycles**: 1 * **cold**: true * **expected**: pass * **expose browser profiler**: true * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory * **gecko profile interval**: 1 * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate * **host from parent**: false * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 1 * **page timeout**: 600000 * **repository**: https://github.com/webkit/motionmark * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb * **subtest lower is better**: false * **subtest unit**: score * **suite name**: MotionMark * **support class**: motionmark-1-3.py * **test script**: motionmark-1-3.js * **test url**: `:\/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-1-3** - ❌ - ❌ - ❌ - ❌ .. dropdown:: motionmark-htmlsuite-1-3 :class-container: anchor-id-motionmark-htmlsuite-1-3-b * Command to Run Locally .. code-block:: ./mach raptor -t motionmark-htmlsuite-1-3 **Owner**: Graphics Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **browser cycles**: 1 * **cold**: true * **expected**: pass * **expose browser profiler**: true * **expose chrome trace**: true * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory * **gecko profile interval**: 1 * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate * **host from parent**: false * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 1 * **page timeout**: 600000 * **repository**: https://github.com/webkit/motionmark * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb * **subtest lower is better**: false * **subtest unit**: score * **suite name**: HTML suite * **support class**: motionmark-1-3.py * **test script**: motionmark-1-3.js * **test url**: `:\/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ **Owner**: Graphics Team * **alert threshold**: 2.0 * **apps**: fenix, geckoview, chrome-m, cstm-car-m * **browser cycles**: 1 * **cold**: true * **expected**: pass * **expose browser profiler**: true * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory * **gecko profile interval**: 1 * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate * **host from parent**: false * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 1 * **page timeout**: 600000 * **repository**: https://github.com/webkit/motionmark * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb * **subtest lower is better**: false * **subtest unit**: score * **suite name**: HTML suite * **support class**: motionmark-1-3.py * **test script**: motionmark-1-3.js * **test url**: `:\/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** - ❌ - ❌ - ❌ - ❌ .. dropdown:: speedometer2 :class-container: anchor-id-speedometer2-b * Command to Run Locally .. code-block:: ./mach raptor -t speedometer2 **Owner**: SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, safari-tp, custom-car * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks * **gecko profile interval**: 1 * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 5 * **page timeout**: 600000 * **subtest lower is better**: true * **subtest unit**: ms * **test url**: `:\/Speedometer/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer2-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ **Owner**: SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: fenix, geckoview, refbrow, chrome-m, cstm-car-m * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks * **gecko profile interval**: 1 * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 5 * **page timeout**: 420000 * **subtest lower is better**: true * **subtest unit**: ms * **test url**: `:\/Speedometer/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer2-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer2-mobile-chrome-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer2-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer2** - ❌ - ❌ - ❌ - ❌ .. dropdown:: speedometer3 :class-container: anchor-id-speedometer3-b * Command to Run Locally .. code-block:: ./mach raptor -t speedometer3 **Owner**: Performance Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, safari-tp, custom-car * **browser cycles**: 5 * **cold**: true * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks * **gecko profile interval**: 1 * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread * **host from parent**: false * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 5 * **page timeout**: 600000 * **subtest lower is better**: true * **subtest unit**: ms * **support class**: speedometer3.py * **test script**: speedometer3.js * **test url**: `:\/Speedometer3/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer3-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-tp-speedometer3** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ **Owner**: Performance Team * **alert threshold**: 2.0 * **apps**: fenix, geckoview, refbrow, chrome-m, cstm-car-m * **browser cycles**: 5 * **cold**: true * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks * **gecko profile interval**: 1 * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread * **host from parent**: false * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 5 * **page timeout**: 420000 * **subtest lower is better**: true * **subtest unit**: ms * **support class**: speedometer3.py * **test script**: speedometer3.js * **test url**: `:\/Speedometer3/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer3-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1500-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-safari-tp-speedometer3** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-custom-car-speedometer3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-speedometer3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-speedometer3** - ❌ - ❌ - ❌ - ❌ .. dropdown:: stylebench :class-container: anchor-id-stylebench-b * Command to Run Locally .. code-block:: ./mach raptor -t stylebench **Owner**: :emilio and Layout Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 5 * **page timeout**: 140000 * **subtest lower is better**: true * **subtest unit**: ms * **test url**: `:\/StyleBench/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-stylebench** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-stylebench** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-stylebench** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-stylebench** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-stylebench** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-stylebench** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-stylebench** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-stylebench** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-stylebench** - ❌ - ❌ - ❌ - ❌ .. dropdown:: sunspider :class-container: anchor-id-sunspider-b * Command to Run Locally .. code-block:: ./mach raptor -t sunspider **Owner**: :jandem and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 5 * **page timeout**: 55000 * **test url**: `:\/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-sunspider** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-sunspider** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-sunspider** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-sunspider** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-sunspider** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-sunspider** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-sunspider** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-sunspider** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-sunspider** - ❌ - ❌ - ❌ - ❌ .. dropdown:: twitch-animation :class-container: anchor-id-twitch-animation-b * Command to Run Locally .. code-block:: ./mach raptor -t twitch-animation **Owner**: :jrmuizel * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 2000000 * **perfstats**: false * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/twitch-animation * **repository revision**: 61332db584026b73e37066d717a162825408c36b * **sparse checkout**: true * **subtest lower is better**: true * **subtest unit**: ms * **test url**: `:\/index.html>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-twitch-animation** - ❌ - ❌ - ❌ - ❌ .. dropdown:: unity-webgl :class-container: anchor-id-unity-webgl-b * Command to Run Locally .. code-block:: ./mach raptor -t unity-webgl **Owner**: :jgilbert and Graphics(gfx) Team * **alert threshold**: 2.0 * **apps**: firefox, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 5 * **page timeout**: 420000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/unity-webgl * **repository revision**: 61332db584026b73e37066d717a162825408c36b * **sparse checkout**: true * **test url**: `:\/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-fenix** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-refbrow** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-unity-webgl-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-refbrow** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-unity-webgl** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-unity-webgl** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-unity-webgl** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-unity-webgl** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-unity-webgl** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-unity-webgl** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-unity-webgl** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-unity-webgl** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ **Owner**: :jgilbert and Graphics(gfx) Team * **alert threshold**: 2.0 * **apps**: geckoview, refbrow, fenix, chrome-m * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **page cycles**: 1 * **page timeout**: 420000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/unity-webgl * **repository revision**: 61332db584026b73e37066d717a162825408c36b * **test url**: `:\/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-fenix** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-refbrow** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-unity-webgl-mobile-fenix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-geckoview** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-unity-webgl-mobile-refbrow** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-unity-webgl** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-unity-webgl** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-unity-webgl** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-unity-webgl** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-unity-webgl** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-unity-webgl** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-unity-webgl** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-unity-webgl** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-unity-webgl** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wasm-godot :class-container: anchor-id-wasm-godot-b * Command to Run Locally .. code-block:: ./mach raptor -t wasm-godot **Owner**: :lth and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **newtab per cycle**: true * **page cycles**: 5 * **page timeout**: 120000 * **test url**: `/wasm-godot/index.html>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-chrome-wasm-godot** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-chrome-wasm-godot** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ✅ - ❌ - ❌ - ❌ * - **browsertime-benchmark-wasm-safari-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-chrome-wasm-godot** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wasm-godot-baseline :class-container: anchor-id-wasm-godot-baseline-b * Command to Run Locally .. code-block:: ./mach raptor -t wasm-godot-baseline **Owner**: :lth and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **newtab per cycle**: true * **page cycles**: 5 * **page timeout**: 120000 * **preferences**: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false * **test url**: `/wasm-godot/index.html>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wasm-godot-optimizing :class-container: anchor-id-wasm-godot-optimizing-b * Command to Run Locally .. code-block:: ./mach raptor -t wasm-godot-optimizing **Owner**: :lth and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **newtab per cycle**: true * **page cycles**: 5 * **page timeout**: 120000 * **preferences**: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true * **test url**: `/wasm-godot/index.html>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wasm-misc :class-container: anchor-id-wasm-misc-b * Command to Run Locally .. code-block:: ./mach raptor -t wasm-misc **Owner**: :lth and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 5 * **page timeout**: 1200000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/wasm-misc * **repository revision**: 61332db584026b73e37066d717a162825408c36b * **sparse checkout**: true * **test url**: `:\/index.html?raptor>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-chrome-wasm-misc** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-chrome-wasm-misc** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-chrome-wasm-misc** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-chrome-wasm-misc** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wasm-misc-baseline :class-container: anchor-id-wasm-misc-baseline-b * Command to Run Locally .. code-block:: ./mach raptor -t wasm-misc-baseline **Owner**: :lth and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 5 * **page timeout**: 1200000 * **preferences**: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/wasm-misc * **repository revision**: 61332db584026b73e37066d717a162825408c36b * **sparse checkout**: true * **test url**: `:\/index.html?raptor>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wasm-misc-optimizing :class-container: anchor-id-wasm-misc-optimizing-b * Command to Run Locally .. code-block:: ./mach raptor -t wasm-misc-optimizing **Owner**: :lth and SpiderMonkey Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 5 * **page timeout**: 1200000 * **preferences**: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/wasm-misc * **repository revision**: 61332db584026b73e37066d717a162825408c36b * **sparse checkout**: true * **test url**: `:\/index.html?raptor>`__ * **type**: benchmark * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** - ❌ - ❌ - ❌ - ❌ .. dropdown:: webaudio :class-container: anchor-id-webaudio-b * Command to Run Locally .. code-block:: ./mach raptor -t webaudio **Owner**: :padenot and Media Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 5 * **page timeout**: 360000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **test url**: `:\/webaudio/index.html?raptor>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-webaudio** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-webaudio** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-webaudio** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-webaudio** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-webaudio** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-webaudio** - ✅ - ✅ - ❌ - ❌ * - **browsertime-benchmark-safari-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-chrome-webaudio** - ❌ - ❌ - ❌ - ❌ * - **browsertime-benchmark-firefox-webaudio** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-benchmark-firefox-webaudio** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-av1-sfr :class-container: anchor-id-youtube-playback-av1-sfr-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-av1-sfr **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox, geckoview, fenix, refbrow, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-mobile-fenix-youtube-playback-av1-sfr** - ✅ - ❌ - ❌ - ❌ * - **browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-mobile-fenix-youtube-playback-av1-sfr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-av1-sfr** - ✅ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-h264-1080p30 :class-container: anchor-id-youtube-playback-h264-1080p30-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-h264-1080p30 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p30** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-h264-1080p60 :class-container: anchor-id-youtube-playback-h264-1080p60-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-h264-1080p60 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-1080p60** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-h264-720p60 :class-container: anchor-id-youtube-playback-h264-720p60-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-h264-720p60 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, geckoview, fenix, refbrow, chrome-m * **browsertime args**: --pageCompleteWaitTime=10 --pageCompleteCheckPollTimeout=10 --browsertime.benchmark_wait_time=500 * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **support class**: browsertime_benchmark.py * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60** - ✅ - ✅ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-h264-full-1080p30 :class-container: anchor-id-youtube-playback-h264-full-1080p30-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-h264-full-1080p30 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0 * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-h264-full-1080p60 :class-container: anchor-id-youtube-playback-h264-full-1080p60-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-h264-full-1080p60 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0 * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-h264-sfr :class-container: anchor-id-youtube-playback-h264-sfr-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-h264-sfr **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox, geckoview, fenix, refbrow, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-hfr :class-container: anchor-id-youtube-playback-hfr-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-hfr **Owner**: PerfTest Team * **alert on**: `H2641080p60fps@1X_dropped_frames `__, `H264720p60fps@1X_dropped_frames `__ * **alert threshold**: 2.0 * **apps**: firefox, geckoview, fenix, refbrow, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-mobile-fenix-youtube-playback-hfr** - ✅ - ❌ - ❌ - ❌ * - **browsertime-mobile-fenix-youtube-playback-hfr-nofis** - ✅ - ❌ - ❌ - ❌ * - **browsertime-mobile-geckoview-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-refbrow-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-mobile-fenix-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-fenix-youtube-playback-hfr-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-geckoview-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-refbrow-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-hfr** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-v9-1080p30 :class-container: anchor-id-youtube-playback-v9-1080p30-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-v9-1080p30 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p30** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-v9-1080p60 :class-container: anchor-id-youtube-playback-v9-1080p60-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-v9-1080p60 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-1080p60** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-v9-full-1080p30 :class-container: anchor-id-youtube-playback-v9-full-1080p30-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-v9-full-1080p30 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0 * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-v9-full-1080p60 :class-container: anchor-id-youtube-playback-v9-full-1080p60-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-v9-full-1080p60 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **expose browser profiler**: true * **gather cpuTime**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0 * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-vp9-720p60 :class-container: anchor-id-youtube-playback-vp9-720p60-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-vp9-720p60 **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox, chrome, geckoview, fenix, refbrow, chrome-m * **browsertime args**: --pageCompleteWaitTime=10 --pageCompleteCheckPollTimeout=10 --browsertime.benchmark_wait_time=500 * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 20 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **support class**: browsertime_benchmark.py * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60** - ✅ - ✅ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60** - ❌ - ❌ - ❌ - ❌ * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-vp9-sfr :class-container: anchor-id-youtube-playback-vp9-sfr-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-vp9-sfr **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox, geckoview, fenix, refbrow, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr** - ✅ - ❌ - ❌ - ❌ * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-widevine-h264-sfr :class-container: anchor-id-youtube-playback-widevine-h264-sfr-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-widevine-h264-sfr **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox, geckoview, fenix, refbrow, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-widevine-hfr :class-container: anchor-id-youtube-playback-widevine-hfr-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-widevine-hfr **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox, geckoview, fenix, refbrow, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-hfr** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-playback-widevine-vp9-sfr :class-container: anchor-id-youtube-playback-widevine-vp9-sfr-b * Command to Run Locally .. code-block:: ./mach raptor -t youtube-playback-widevine-vp9-sfr **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: firefox, geckoview, fenix, refbrow, chrome * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1000 * **gecko profile threads**: MediaPlayback * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 2700000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false * **subtest lower is better**: true * **subtest unit**: score * **test url**: ``__ * **type**: benchmark * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** - ❌ - ❌ - ❌ - ❌ Custom ------ Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions. .. dropdown:: addMab1 :class-container: anchor-id-addMab1-c * Command to Run Locally .. code-block:: ./mach raptor -t addMab1 **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send many small ArrayBuffers to IndexedDB in one transaction * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=1 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMab1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMab1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMab1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMab1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMab1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMab1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMab1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMab1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMab1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMab1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMab1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMab1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMab1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMab1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMab1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMab1** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addMabN :class-container: anchor-id-addMabN-c * Command to Run Locally .. code-block:: ./mach raptor -t addMabN **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send many small ArrayBuffers to IndexedDB independently * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=0 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMabN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMabN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMabN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMabN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMabN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMabN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMabN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMabN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMabN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMabN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMabN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMabN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMabN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMabN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMabN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMabN** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addMar1 :class-container: anchor-id-addMar1-c * Command to Run Locally .. code-block:: ./mach raptor -t addMar1 **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send many small Arrays to IndexedDB in one transaction * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Array --browsertime.atomic=1 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMar1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMar1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMar1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMar1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMar1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMar1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMar1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMar1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMar1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMar1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMar1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMar1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMar1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMar1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMar1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMar1** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addMarN :class-container: anchor-id-addMarN-c * Command to Run Locally .. code-block:: ./mach raptor -t addMarN **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send many small Arrays to IndexedDB independently * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Array --browsertime.atomic=0 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMarN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMarN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMarN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMarN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMarN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMarN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMarN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMarN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMarN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMarN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMarN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMarN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMarN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMarN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMarN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMarN** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addMbl1 :class-container: anchor-id-addMbl1-c * Command to Run Locally .. code-block:: ./mach raptor -t addMbl1 **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send many small Blobs to IndexedDB in one transaction * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Blob --browsertime.atomic=1 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMbl1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMbl1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMbl1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMbl1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMbl1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMbl1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMbl1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMbl1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMbl1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMbl1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMbl1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMbl1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMbl1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMbl1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMbl1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMbl1** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addMblN :class-container: anchor-id-addMblN-c * Command to Run Locally .. code-block:: ./mach raptor -t addMblN **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send many small Blobs to IndexedDB independently * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Blob --browsertime.atomic=0 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMblN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMblN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMblN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMblN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMblN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMblN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMblN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMblN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMblN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMblN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMblN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMblN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMblN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addMblN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addMblN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addMblN** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addkAB1 :class-container: anchor-id-addkAB1-c * Command to Run Locally .. code-block:: ./mach raptor -t addkAB1 **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send a couple of large ArrayBuffers to IndexedDB in one transaction * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=1 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAB1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAB1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkAB1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkAB1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAB1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkAB1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkAB1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAB1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAB1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkAB1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkAB1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAB1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAB1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkAB1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkAB1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAB1** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addkABN :class-container: anchor-id-addkABN-c * Command to Run Locally .. code-block:: ./mach raptor -t addkABN **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send a couple of large ArrayBuffers to IndexedDB independently * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=0 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkABN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkABN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkABN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkABN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkABN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkABN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkABN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkABN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkABN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkABN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkABN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkABN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkABN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkABN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkABN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkABN** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addkAR1 :class-container: anchor-id-addkAR1-c * Command to Run Locally .. code-block:: ./mach raptor -t addkAR1 **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send a couple of large JS Arrays to IndexedDB in one transaction * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Array --browsertime.atomic=1 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAR1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAR1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkAR1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkAR1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAR1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkAR1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkAR1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAR1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAR1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkAR1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkAR1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAR1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAR1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkAR1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkAR1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkAR1** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addkARN :class-container: anchor-id-addkARN-c * Command to Run Locally .. code-block:: ./mach raptor -t addkARN **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send a couple of large JS Arrays to IndexedDB independently * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Array --browsertime.atomic=0 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkARN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkARN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkARN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkARN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkARN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkARN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkARN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkARN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkARN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkARN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkARN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkARN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkARN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkARN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkARN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkARN** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addkBL1 :class-container: anchor-id-addkBL1-c * Command to Run Locally .. code-block:: ./mach raptor -t addkBL1 **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send a couple of large Blobs to IndexedDB in one transaction * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Blob --browsertime.atomic=1 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBL1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBL1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkBL1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkBL1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBL1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkBL1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkBL1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBL1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBL1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkBL1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkBL1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBL1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBL1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkBL1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkBL1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBL1** - ❌ - ❌ - ❌ - ❌ .. dropdown:: addkBLN :class-container: anchor-id-addkBLN-c * Command to Run Locally .. code-block:: ./mach raptor -t addkBLN **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Use add API to send a couple of large Blobs to IndexedDB independently * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Blob --browsertime.atomic=0 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_write.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBLN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBLN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkBLN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkBLN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBLN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkBLN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkBLN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBLN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBLN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkBLN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkBLN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBLN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBLN** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-addkBLN** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-addkBLN** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-addkBLN** - ❌ - ❌ - ❌ - ❌ .. dropdown:: browsertime :class-container: anchor-id-browsertime-c * Command to Run Locally .. code-block:: ./mach raptor -t browsertime **Owner**: PerfTest Team **Description**: Used to run vanilla browsertime tests through raptor. For example: `./mach raptor -t browsertime --browsertime-arg url=https://www.sitespeed.io --browsertime-arg iterations=3` * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **browser cycles**: 1 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **measure**: fnbpaint, fcp, dcf, loadtime * **page cycles**: 1 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: null.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test script**: None * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true .. dropdown:: connect :class-container: anchor-id-connect-c * Command to Run Locally .. code-block:: ./mach raptor -t connect **Owner**: Network Team **Description**: Verifies that connection time on a pageload is zero when a speculative connection has first been made * **alert change type**: absolute * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__ * **alert threshold**: 10.0 * **apps**: firefox * **browser cycles**: 3 * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: speculative-connect.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-speculative-firefox-connect** - ❌ - ❌ - ❌ - ❌ .. dropdown:: constant-regression :class-container: anchor-id-constant-regression-c * Command to Run Locally .. code-block:: ./mach raptor -t constant-regression **Owner**: PerfTest Team **Description**: Generates a constant value that can be changed to induce a regression. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, geckoview, fenix * **browser cycles**: 1 * **browsertime args**: --browsertime.constant_value=1500 * **custom data**: true * **expected**: pass * **fore window**: 1 * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **max back window**: 3 * **min back window**: 2 * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **subtest unit**: ms * **test script**: constant_regression_test.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: score * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-regression-tests-firefox-constant-regression** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-regression-tests-firefox-constant-regression** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-regression-tests-firefox-constant-regression** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-regression-tests-firefox-constant-regression** - ❌ - ✅ - ❌ - ❌ .. dropdown:: dns-multi :class-container: anchor-id-dns-multi-c * Command to Run Locally .. code-block:: ./mach raptor -t dns-multi **Owner**: Network Team **Description**: Tests multi-domain DNS lookup and pageload performance via native DNS. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:0 * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_multi_domain_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-dns-multi** - ✅ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-dns-multi-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-dns-multi** - ❌ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-dns-multi-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-multi** - ❌ - ❌ - ❌ - ❌ .. dropdown:: dns-native :class-container: anchor-id-dns-native-c * Command to Run Locally .. code-block:: ./mach raptor -t dns-native **Owner**: Network Team **Description**: Tests DNS lookup time via native DNS. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:0 * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-dns-native** - ✅ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-dns-native-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-dns-native** - ❌ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-dns-native-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-dns-native** - ❌ - ❌ - ❌ - ❌ .. dropdown:: getkeyrng :class-container: anchor-id-getkeyrng-c * Command to Run Locally .. code-block:: ./mach raptor -t getkeyrng **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Measures the speed of key-range based reads of IndexedDB * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **support class**: browsertime_pageload.py * **test script**: indexeddb_getkeyrange.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-getkeyrng** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-getkeyrng** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-getkeyrng** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-getkeyrng** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-getkeyrng** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-getkeyrng** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-getkeyrng** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-getkeyrng** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-getkeyrng** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-getkeyrng** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-getkeyrng** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-getkeyrng** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-getkeyrng** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-getkeyrng** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-getkeyrng** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-getkeyrng** - ❌ - ❌ - ❌ - ❌ .. dropdown:: h2-download :class-container: anchor-id-h2-download-c * Command to Run Locally .. code-block:: ./mach raptor -t h2-download **Owner**: Network Team **Description**: Measures HTTP/2 download throughput with a local server * **alert threshold**: 2.0 * **apps**: firefox, chrome, custom-car * **browser cycles**: 1 * **browsertime args**: --browsertime.test_type=h2_download --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:false * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **subtest lower is better**: false * **subtest name filters**: tests/,iterations/ * **subtest unit**: mbps * **support class**: network_bench.py * **test script**: network_bench.js * **test url**: ``__ * **type**: pageload * **unit**: mbps * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h2-download** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. dropdown:: h2-upload :class-container: anchor-id-h2-upload-c * Command to Run Locally .. code-block:: ./mach raptor -t h2-upload **Owner**: Network Team **Description**: Measures HTTP/2 file upload throughput with a local server * **alert threshold**: 2.0 * **apps**: firefox, chrome, custom-car * **browser cycles**: 1 * **browsertime args**: --browsertime.test_type=h2_upload --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:false * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **subtest lower is better**: false * **subtest name filters**: tests/,iterations/ * **subtest unit**: mbps * **support class**: network_bench.py * **test script**: network_bench.js * **test url**: ``__ * **type**: pageload * **unit**: mbps * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h2-upload** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h2-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. dropdown:: h3-download :class-container: anchor-id-h3-download-c * Command to Run Locally .. code-block:: ./mach raptor -t h3-download **Owner**: Network Team **Description**: Measures HTTP/3 download throughput with a local server * **alert threshold**: 2.0 * **apps**: firefox, chrome, custom-car * **browser cycles**: 1 * **browsertime args**: --browsertime.test_type=h3_download --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **subtest lower is better**: false * **subtest name filters**: tests/,iterations/ * **subtest unit**: mbps * **support class**: network_bench.py * **test script**: network_bench.js * **test url**: ``__ * **type**: pageload * **unit**: mbps * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h3-download** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-download** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. dropdown:: h3-upload :class-container: anchor-id-h3-upload-c * Command to Run Locally .. code-block:: ./mach raptor -t h3-upload **Owner**: Network Team **Description**: Measures HTTP/3 file upload throughput with a local server * **alert threshold**: 2.0 * **apps**: firefox, chrome, custom-car * **browser cycles**: 1 * **browsertime args**: --browsertime.test_type=h3_upload --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **subtest lower is better**: false * **subtest name filters**: tests/,iterations/ * **subtest unit**: mbps * **support class**: network_bench.py * **test script**: network_bench.js * **test url**: ``__ * **type**: pageload * **unit**: mbps * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h3-upload** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ✅ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-chrome-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-network-bench-firefox-h3-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** - ❌ - ❌ - ❌ - ❌ * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** - ❌ - ❌ - ❌ - ❌ .. dropdown:: idb-open-few-par :class-container: anchor-id-idb-open-few-par-c * Command to Run Locally .. code-block:: ./mach raptor -t idb-open-few-par **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Measures opening a few IndexedDB databases in parallel * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=1000 --browsertime.parallel=1 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_open.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-few-par** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-few-par** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-few-par** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-few-par** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-par** - ❌ - ❌ - ❌ - ❌ .. dropdown:: idb-open-few-seq :class-container: anchor-id-idb-open-few-seq-c * Command to Run Locally .. code-block:: ./mach raptor -t idb-open-few-seq **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Measures opening a few IndexedDB databases in sequence * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=1000 --browsertime.parallel=0 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_open.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-few-seq** - ❌ - ❌ - ❌ - ❌ .. dropdown:: idb-open-many-par :class-container: anchor-id-idb-open-many-par-c * Command to Run Locally .. code-block:: ./mach raptor -t idb-open-many-par **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Measures opening many IndexedDB databases in parallel * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=10000 --browsertime.parallel=1 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_open.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-many-par** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-many-par** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-many-par** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-many-par** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-par** - ❌ - ❌ - ❌ - ❌ .. dropdown:: idb-open-many-seq :class-container: anchor-id-idb-open-many-seq-c * Command to Run Locally .. code-block:: ./mach raptor -t idb-open-many-seq **Owner**: DOM Lifecycle, Workers and Storage Team **Description**: Measures opening many IndexedDB databases in sequence * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.iterations=10000 --browsertime.parallel=0 * **custom data**: true * **expected**: pass * **gecko profile entries**: 131072000 * **gecko profile features**: js,stackwalk,cpu,memory * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB * **link searchfox**: ``__ * **lower is better**: true * **measure**: cpuTime * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-example.manifest * **subtest unit**: ms * **test script**: indexeddb_open.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-chrome-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-indexeddb-firefox-idb-open-many-seq** - ❌ - ❌ - ❌ - ❌ .. dropdown:: process-switch :class-container: anchor-id-process-switch-c * Command to Run Locally .. code-block:: ./mach raptor -t process-switch **Owner**: PerfTest Team **Description**: Measures process switch time * **accept zero vismet**: true * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **browser cycles**: 25 * **browsertime args**: --pageCompleteWaitTime=1000 --pageCompleteCheckInactivity=true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm5-linux-firefox-proc-switch.manifest * **playback version**: 5.1.1 * **support class**: browsertime_pageload.py * **test script**: process_switch.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-custom-firefox-process-switch** - ❌ - ❌ - ❌ - ❌ .. dropdown:: sample-python-support :class-container: anchor-id-sample-python-support-c * Command to Run Locally .. code-block:: ./mach raptor -t sample-python-support **Owner**: PerfTest Team **Description**: A sample test that uses a python support file to modify the test command. * **alert threshold**: 2.0 * **apps**: firefox * **browser cycles**: 1 * **browsertime args**: --browsertime.constant_value={replace-with-constant-value} * **custom data**: true * **expected**: pass * **fore window**: 1 * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **max back window**: 3 * **min back window**: 2 * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **subtest unit**: ms * **support class**: sample_python_support.py * **test script**: constant_regression_test.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: score * **use live sites**: true .. dropdown:: throttled :class-container: anchor-id-throttled-c * Command to Run Locally .. code-block:: ./mach raptor -t throttled **Owner**: Network Team **Description**: Pageload test using a throttled network environment * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox * **browser cycles**: 3 * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: throttled_pageload.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-throttled-firefox-throttled** - ❌ - ❌ - ❌ - ❌ .. dropdown:: tp6-bench :class-container: anchor-id-tp6-bench-c * Command to Run Locally .. code-block:: ./mach raptor -t tp6-bench **Owner**: PerfTest Team **Description**: A pageload benchmark test that quickly runs through a selection of the pages available to produce a single overall metric for fcp, lcp, and loadtime. The metrics from all pages get summarized with the geomean, and mean. * **alert threshold**: 2.0 * **apps**: firefox, chrome, chromium, safari * **browser cycles**: 1 * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **playback**: mitmproxy * **playback pageset manifest**: None * **playback version**: 8.1.1 * **subtest unit**: ms * **support class**: browsertime_tp6_bench.py * **test script**: browsertime_tp6_bench.js * **test summary**: flatten * **test url**: ``__ * **type**: pageload * **unit**: ms * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-pageload-benchmark-firefox-tp6-bench** - ❌ - ❌ - ❌ - ❌ .. dropdown:: trr-cira :class-container: anchor-id-trr-cira-c * Command to Run Locally .. code-block:: ./mach raptor -t trr-cira **Owner**: Network Team **Description**: Tests DNS lookup time on a CIRA TRR server. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://private.canadianshield.cira.ca/dns-query * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cira** - ❌ - ❌ - ❌ - ❌ .. dropdown:: trr-cloudf :class-container: anchor-id-trr-cloudf-c * Command to Run Locally .. code-block:: ./mach raptor -t trr-cloudf **Owner**: Network Team **Description**: Tests DNS lookup time on a Cloudflare TRR server. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-cloudf** - ✅ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-cloudf-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-cloudf** - ❌ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-cloudf-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-cloudf** - ❌ - ❌ - ❌ - ❌ .. dropdown:: trr-comcas :class-container: anchor-id-trr-comcas-c * Command to Run Locally .. code-block:: ./mach raptor -t trr-comcas **Owner**: Network Team **Description**: Tests DNS lookup time on a Comcast TRR server. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://doh.xfinity.com/dns-query * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-comcas** - ❌ - ❌ - ❌ - ❌ .. dropdown:: trr-multi :class-container: anchor-id-trr-multi-c * Command to Run Locally .. code-block:: ./mach raptor -t trr-multi **Owner**: Network Team **Description**: Tests multi-domain DNS lookup and pageload performance on a Cloudflare TRR server. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_multi_domain_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-multi** - ✅ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-multi-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-multi** - ❌ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-multi-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-multi** - ❌ - ❌ - ❌ - ❌ .. dropdown:: trr-next :class-container: anchor-id-trr-next-c * Command to Run Locally .. code-block:: ./mach raptor -t trr-next **Owner**: Network Team **Description**: Tests DNS lookup time on a NextDNS TRR server. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-next** - ✅ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-next-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-next** - ❌ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-next-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-next** - ❌ - ❌ - ❌ - ❌ .. dropdown:: trr-w-cira :class-container: anchor-id-trr-w-cira-c * Command to Run Locally .. code-block:: ./mach raptor -t trr-w-cira **Owner**: Network Team **Description**: Tests DNS lookup time on a CIRA TRR server, with the TRR connection warmed up. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://private.canadianshield.cira.ca/dns-query * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-cira** - ❌ - ❌ - ❌ - ❌ .. dropdown:: trr-w-clou :class-container: anchor-id-trr-w-clou-c * Command to Run Locally .. code-block:: ./mach raptor -t trr-w-clou **Owner**: Network Team **Description**: Tests DNS lookup time on a Cloudflare TRR server, with the TRR connection warmed up. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-w-clou** - ✅ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-w-clou-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-w-clou** - ❌ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-w-clou-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-clou** - ❌ - ❌ - ❌ - ❌ .. dropdown:: trr-w-comc :class-container: anchor-id-trr-w-comc-c * Command to Run Locally .. code-block:: ./mach raptor -t trr-w-comc **Owner**: Network Team **Description**: Tests DNS lookup time on a Comcast TRR server, with the TRR connection warmed up. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://doh.xfinity.com/dns-query * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-comc** - ❌ - ❌ - ❌ - ❌ .. dropdown:: trr-w-next :class-container: anchor-id-trr-w-next-c * Command to Run Locally .. code-block:: ./mach raptor -t trr-w-next **Owner**: Network Team **Description**: Tests DNS lookup time on a NextDNS TRR server, with the TRR connection warmed up. * **alert threshold**: 2.0 * **apps**: firefox,fenix * **browser cycles**: 3 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query * **cold**: true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 1 * **page timeout**: 60000 * **test script**: trr_performance.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-w-next** - ✅ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-w-next-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-m-fenix-trr-w-next** - ❌ - ❌ - ❌ - ❌ * - **browsertime-trr-performance-m-fenix-trr-w-next-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-trr-performance-firefox-trr-w-next** - ❌ - ❌ - ❌ - ❌ .. dropdown:: upload :class-container: anchor-id-upload-c * Command to Run Locally .. code-block:: ./mach raptor -t upload **Owner**: Network Team **Description**: Measures HTTP/2 file upload throughput with a remote server * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.test_type=h2_upload --browsertime.iterations=10 --browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com --firefox.preference=network.http.http3.enable:false --chrome.args disable-quic * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **subtest lower is better**: false * **subtest name filters**: tests/,iterations/ * **subtest unit**: mbps * **test script**: network_bench.js * **test url**: ``__ * **type**: pageload * **unit**: mbps * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-chrome-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-upload-firefox-upload** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-chrome-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-upload-firefox-upload** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-chrome-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-upload-firefox-upload** - ✅ - ✅ - ❌ - ❌ * - **browsertime-upload-safari-upload** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-chrome-upload** - ❌ - ❌ - ❌ - ❌ * - **browsertime-upload-firefox-upload** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload** - ❌ - ❌ - ❌ - ❌ .. dropdown:: upload-h3 :class-container: anchor-id-upload-h3-c * Command to Run Locally .. code-block:: ./mach raptor -t upload-h3 **Owner**: Network Team **Description**: Measures HTTP/3 file upload throughput with a remote server * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 1 * **browsertime args**: --browsertime.test_type=h3_upload --browsertime.iterations=10 --browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com --firefox.preference=network.http.http3.enable:true * **custom data**: true * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: false * **output timeout**: 2000000 * **page cycles**: 1 * **page timeout**: 1800000 * **subtest lower is better**: false * **subtest name filters**: tests/,iterations/ * **subtest unit**: mbps * **test script**: network_bench.js * **test url**: ``__ * **type**: pageload * **unit**: mbps * **use live sites**: true * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload-h3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload-h3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-chrome-upload-h3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-upload-firefox-upload-h3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload-h3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-chrome-upload-h3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-upload-firefox-upload-h3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload-h3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload-h3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-chrome-upload-h3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-upload-firefox-upload-h3** - ✅ - ✅ - ❌ - ❌ * - **browsertime-upload-safari-upload-h3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload-h3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload-h3** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-chrome-upload-h3** - ❌ - ❌ - ❌ - ❌ * - **browsertime-upload-firefox-upload-h3** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-upload-firefox-upload-h3** - ❌ - ❌ - ❌ - ❌ .. dropdown:: ve-av1-q :class-container: anchor-id-ve-av1-q-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-av1-q **Owner**: :chunmin and Media Team **Description**: Measures AV1 encoding performance for 1080p video in quality mode. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=av01.0.04M.08&latencyModes=quality&width=1920&height=1080&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-av1-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-av1-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-av1-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-av1-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-av1-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-av1-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-av1-q** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-av1-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-av1-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-q** - ✅ - ✅ - ❌ - ❌ .. dropdown:: ve-av1-rt :class-container: anchor-id-ve-av1-rt-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-av1-rt **Owner**: :chunmin and Media Team **Description**: Measures AV1 encoding performance for 1080p video in real-time mode. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=av01.0.04M.08&latencyModes=realtime&width=1920&height=1080&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-av1-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-av1-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-av1-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-av1-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-av1-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-av1-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-av1-rt** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-av1-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-av1-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-av1-rt** - ✅ - ✅ - ❌ - ❌ .. dropdown:: ve-h264-q :class-container: anchor-id-ve-h264-q-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-h264-q **Owner**: :chunmin and Media Team **Description**: Measures H264-baseline encoding performance for 1080p video in quality mode using AVC format. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=1920&height=1080&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-h264-q** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q** - ✅ - ✅ - ❌ - ❌ .. dropdown:: ve-h264-q-sd :class-container: anchor-id-ve-h264-q-sd-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-h264-q-sd **Owner**: :chunmin and Media Team **Description**: Measures H264-baseline encoding performance for 480p video in quality mode using AVC format. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=640&height=480&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q-sd** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-h264-q-sd** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-h264-q-sd** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-h264-q-sd** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-h264-q-sd** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q-sd** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q-sd** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-h264-q-sd** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-h264-q-sd** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-h264-q-sd** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-q-sd** - ✅ - ✅ - ❌ - ❌ .. dropdown:: ve-h264-rt :class-container: anchor-id-ve-h264-rt-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-h264-rt **Owner**: :chunmin and Media Team **Description**: Measures H264-baseline encoding performance for 1080p video in real-time mode using Annex B format. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=avc1.42001E:annexb&latencyModes=realtime&width=1920&height=1080&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-h264-rt** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt** - ✅ - ✅ - ❌ - ❌ .. dropdown:: ve-h264-rt-sd :class-container: anchor-id-ve-h264-rt-sd-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-h264-rt-sd **Owner**: :chunmin and Media Team **Description**: Measures H264-baseline encoding performance for 480p video in real-time mode using Annex B format. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=avc1.42001E:annexb&latencyModes=realtime&width=640&height=480&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-h264-rt-sd** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-h264-rt-sd** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-h264-rt-sd** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-h264-rt-sd** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-h264-rt-sd** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** - ✅ - ✅ - ❌ - ❌ .. dropdown:: ve-vp8-q :class-container: anchor-id-ve-vp8-q-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-vp8-q **Owner**: :chunmin and Media Team **Description**: Measures VP8 encoding performance for 1080p video in quality mode. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=vp8&latencyModes=quality&width=1920&height=1080&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp8-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp8-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp8-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp8-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp8-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp8-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-vp8-q** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp8-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp8-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-q** - ✅ - ✅ - ❌ - ❌ .. dropdown:: ve-vp8-rt :class-container: anchor-id-ve-vp8-rt-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-vp8-rt **Owner**: :chunmin and Media Team **Description**: Measures VP8 encoding performance for 1080p video in real-time mode. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=vp8&latencyModes=realtime&width=1920&height=1080&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp8-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp8-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp8-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp8-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp8-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp8-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-vp8-rt** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp8-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp8-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp8-rt** - ✅ - ✅ - ❌ - ❌ .. dropdown:: ve-vp9-q :class-container: anchor-id-ve-vp9-q-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-vp9-q **Owner**: :chunmin and Media Team **Description**: Measures VP9 encoding performance for 1080p video in quality mode. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=vp09.00.10.08&latencyModes=quality&width=1920&height=1080&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp9-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp9-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp9-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp9-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp9-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp9-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-vp9-q** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp9-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp9-q** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-q** - ✅ - ✅ - ❌ - ❌ .. dropdown:: ve-vp9-rt :class-container: anchor-id-ve-vp9-rt-c * Command to Run Locally .. code-block:: ./mach raptor -t ve-vp9-rt **Owner**: :chunmin and Media Team **Description**: Measures VP9 encoding performance for 1080p video in real-time mode. * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **expected**: pass * **expose browser profiler**: true * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 3 * **page timeout**: 360000 * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/webcodecs * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 * **sparse checkout**: true * **support class**: browsertime_benchmark.py * **test url**: `:\/index.html?raptor&codecs=vp09.00.10.08&latencyModes=realtime&width=1920&height=1080&framerate=30>`__ * **type**: benchmark * **unit**: score * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp9-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp9-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp9-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp9-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp9-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp9-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ * - **browsertime-webcodecs-safari-ve-vp9-rt** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-chrome-ve-vp9-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-custom-car-ve-vp9-rt** - ❌ - ❌ - ❌ - ❌ * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-webcodecs-firefox-ve-vp9-rt** - ✅ - ✅ - ❌ - ❌ .. dropdown:: vpl-av1 :class-container: anchor-id-vpl-av1-c * Command to Run Locally .. code-block:: ./mach raptor -t vpl-av1 **Owner**: :aosmond and the Media Team **Description**: Measures AV1 1080p video playback latency. * **alert on**: `estimatedFirstFrameLatency `__, `estimatedAnyFrameLatency `__ * **alert threshold**: 2.0 * **apps**: chrome, chrome-m, geckoview, fenix, firefox, safari * **benchmark webserver**: true * **browser cycles**: 20 * **expected**: pass * **gecko profile features**: stackwalk,js,cpu,java,processcpu,screenshots,memory * **gecko profile interval**: 1 * **gecko profile threads**: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld * **link searchfox**: ``__ * **lower is better**: true * **measure**: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency * **newtab per cycle**: true * **page cycles**: 20 * **page timeout**: 20000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/video-playback-latency * **repository revision**: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd * **sparse checkout**: true * **support class**: video_playback_latency.py * **test url**: `:\/av1_1080p.html>`__ * **type**: pageload * **unit**: ms * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-av1-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1** - ✅ - ✅ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-av1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-av1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-av1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-av1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-av1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-av1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-av1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-av1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-av1** - ❌ - ❌ - ❌ - ❌ .. dropdown:: vpl-h264 :class-container: anchor-id-vpl-h264-c * Command to Run Locally .. code-block:: ./mach raptor -t vpl-h264 **Owner**: :aosmond and the Media Team **Description**: Measures H264 1080p video playback latency. * **alert on**: `estimatedFirstFrameLatency `__, `estimatedAnyFrameLatency `__ * **alert threshold**: 2.0 * **apps**: chrome, chrome-m, geckoview, fenix, firefox, safari * **benchmark webserver**: true * **browser cycles**: 20 * **expected**: pass * **gecko profile features**: stackwalk,js,cpu,java,processcpu,screenshots,memory * **gecko profile interval**: 1 * **gecko profile threads**: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld * **link searchfox**: ``__ * **lower is better**: true * **measure**: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency * **newtab per cycle**: true * **page cycles**: 20 * **page timeout**: 20000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/video-playback-latency * **repository revision**: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd * **sparse checkout**: true * **support class**: video_playback_latency.py * **test url**: `:\/h264_1080p.html>`__ * **type**: pageload * **unit**: ms * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-h264-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264** - ✅ - ✅ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-h264** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-h264** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-h264** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-h264** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-h264** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-h264** - ✅ - ✅ - ❌ - ❌ * - **browsertime-video-playback-latency-safari-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-h264** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-h264** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-h264** - ❌ - ❌ - ❌ - ❌ .. dropdown:: vpl-vp9 :class-container: anchor-id-vpl-vp9-c * Command to Run Locally .. code-block:: ./mach raptor -t vpl-vp9 **Owner**: :aosmond and the Media Team **Description**: Measures VP9 1080p video playback latency. * **alert on**: `estimatedFirstFrameLatency `__, `estimatedAnyFrameLatency `__ * **alert threshold**: 2.0 * **apps**: chrome, chrome-m, geckoview, fenix, firefox, safari * **benchmark webserver**: true * **browser cycles**: 20 * **expected**: pass * **gecko profile features**: stackwalk,js,cpu,java,processcpu,screenshots,memory * **gecko profile interval**: 1 * **gecko profile threads**: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld * **link searchfox**: ``__ * **lower is better**: true * **measure**: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency * **newtab per cycle**: true * **page cycles**: 20 * **page timeout**: 20000 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false * **repository**: https://github.com/mozilla/perf-automation * **repository path**: benchmarks/video-playback-latency * **repository revision**: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd * **sparse checkout**: true * **support class**: video_playback_latency.py * **test url**: `:\/vp9_1080p.html>`__ * **type**: pageload * **unit**: ms * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-vp9-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9** - ✅ - ✅ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-vp9** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-vp9** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-vp9** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-vp9** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-hw-ref/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-chrome-vpl-vp9** - ❌ - ❌ - ❌ - ❌ * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-video-playback-latency-firefox-vpl-vp9** - ❌ - ❌ - ❌ - ❌ .. dropdown:: welcome :class-container: anchor-id-welcome-c * Command to Run Locally .. code-block:: ./mach raptor -t welcome **Owner**: PerfTest Team **Description**: Measures pageload metrics for the first-install about:welcome page * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm5-linux-firefox-welcome.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test script**: welcome.js * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-first-install-firefox-welcome** - ❌ - ❌ - ❌ - ❌ Desktop ------- Tests for page-load performance. The links direct to the actual websites that are being tested. .. dropdown:: amazon :class-container: anchor-id-amazon-d * Command to Run Locally .. code-block:: ./mach raptor -t amazon **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-amazon.manifest * **playback pageset manifest backup**: mitm8-linux-firefox-amazon.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-profiling-firefox-amazon** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-profiling-firefox-amazon** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-profiling-firefox-amazon** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-webextensions-firefox-amazon** - ❌ - ❌ - ❌ - ❌ .. dropdown:: bing-search :class-container: anchor-id-bing-search-d * Command to Run Locally .. code-block:: ./mach raptor -t bing-search **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-darwin-firefox-bing-search.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-bing-search** - ❌ - ❌ - ❌ - ❌ .. dropdown:: buzzfeed :class-container: anchor-id-buzzfeed-d * Command to Run Locally .. code-block:: ./mach raptor -t buzzfeed **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-buzzfeed.manifest * **playback pageset manifest backup**: mitm7-linux-firefox-buzzfeed.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-buzzfeed** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-buzzfeed** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-buzzfeed** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-buzzfeed** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-buzzfeed** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-buzzfeed** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-buzzfeed** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-buzzfeed** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-buzzfeed** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-buzzfeed** - ❌ - ❌ - ❌ - ❌ .. dropdown:: cnn :class-container: anchor-id-cnn-d * Command to Run Locally .. code-block:: ./mach raptor -t cnn **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-cnn.manifest * **playback pageset manifest backup**: mitm8-linux-firefox-cnn.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-sheriffed-firefox-cnn** - ❌ - ❌ - ❌ - ❌ .. dropdown:: docomo :class-container: anchor-id-docomo-d * Command to Run Locally .. code-block:: ./mach raptor -t docomo **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-docomo.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-docomo** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-docomo** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-docomo** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-docomo** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-docomo** - ❌ - ❌ - ❌ - ❌ .. dropdown:: ebay :class-container: anchor-id-ebay-d * Command to Run Locally .. code-block:: ./mach raptor -t ebay **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-ebay.manifest * **playback pageset manifest backup**: mitm8-linux-firefox-ebay.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-ebay** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-ebay** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-ebay** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-ebay** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-ebay** - ❌ - ❌ - ❌ - ❌ .. dropdown:: espn :class-container: anchor-id-espn-d * Command to Run Locally .. code-block:: ./mach raptor -t espn **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-espn.manifest * **playback pageset manifest backup**: mitm8-linux-firefox-espn.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-espn** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-espn** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-espn** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-espn** - ❌ - ❌ - ❌ - ❌ .. dropdown:: expedia :class-container: anchor-id-expedia-d * Command to Run Locally .. code-block:: ./mach raptor -t expedia **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-darwin-firefox-expedia.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-expedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-expedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-expedia** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-expedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-expedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-expedia** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-expedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-expedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-expedia** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-expedia** - ❌ - ❌ - ❌ - ❌ .. dropdown:: facebook :class-container: anchor-id-facebook-d * Command to Run Locally .. code-block:: ./mach raptor -t facebook **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-facebook.manifest * **playback pageset manifest backup**: mitm6-linux-firefox-facebook.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-facebook** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-facebook** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-facebook** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-facebook** - ❌ - ❌ - ❌ - ❌ .. dropdown:: fandom :class-container: anchor-id-fandom-d * Command to Run Locally .. code-block:: ./mach raptor -t fandom **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-fandom.manifest * **playback pageset manifest backup**: mitm5-linux-firefox-fandom.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-fandom** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-fandom** - ❌ - ❌ - ❌ - ❌ .. dropdown:: google-docs :class-container: anchor-id-google-docs-d * Command to Run Locally .. code-block:: ./mach raptor -t google-docs **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page complete wait time**: 8000 * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-google-docs.manifest * **playback pageset manifest backup**: mitm8-linux-firefox-google-docs.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-google-docs** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-google-docs** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-google-docs** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-docs** - ❌ - ❌ - ❌ - ❌ .. dropdown:: google-mail :class-container: anchor-id-google-mail-d * Command to Run Locally .. code-block:: ./mach raptor -t google-mail **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm5-linux-firefox-google-mail.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-google-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-google-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-google-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-mail** - ❌ - ❌ - ❌ - ❌ .. dropdown:: google-search :class-container: anchor-id-google-search-d * Command to Run Locally .. code-block:: ./mach raptor -t google-search **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-google-search.manifest * **playback pageset manifest backup**: mitm8-linux-firefox-google-search.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-google-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-google-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-google-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-google-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-search** - ❌ - ❌ - ❌ - ❌ .. dropdown:: google-slides :class-container: anchor-id-google-slides-d * Command to Run Locally .. code-block:: ./mach raptor -t google-slides **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-google-slides.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-google-slides** - ❌ - ❌ - ❌ - ❌ .. dropdown:: imdb :class-container: anchor-id-imdb-d * Command to Run Locally .. code-block:: ./mach raptor -t imdb **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-imdb.manifest * **playback pageset manifest backup**: mitm8-linux-firefox-imdb.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-imdb** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-imdb** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-imdb** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imdb** - ❌ - ❌ - ❌ - ❌ .. dropdown:: imgur :class-container: anchor-id-imgur-d * Command to Run Locally .. code-block:: ./mach raptor -t imgur **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-imgur.manifest * **playback pageset manifest backup**: mitm8-linux-firefox-imgur.manifest * **playback version**: 11.0.0 * **preferences**: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-imgur** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-imgur** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-imgur** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-imgur** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-imgur** - ❌ - ❌ - ❌ - ❌ .. dropdown:: instagram :class-container: anchor-id-instagram-d * Command to Run Locally .. code-block:: ./mach raptor -t instagram **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-darwin-firefox-instagram.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-instagram** - ❌ - ❌ - ❌ - ❌ .. dropdown:: linkedin :class-container: anchor-id-linkedin-d * Command to Run Locally .. code-block:: ./mach raptor -t linkedin **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm6-linux-firefox-linkedin.manifest * **playback version**: 8.1.1 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-linkedin** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-linkedin** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-linkedin** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-linkedin** - ❌ - ❌ - ❌ - ❌ .. dropdown:: microsoft :class-container: anchor-id-microsoft-d * Command to Run Locally .. code-block:: ./mach raptor -t microsoft **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-microsoft.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-microsoft** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-microsoft** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-microsoft** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-microsoft** - ❌ - ❌ - ❌ - ❌ .. dropdown:: netflix :class-container: anchor-id-netflix-d * Command to Run Locally .. code-block:: ./mach raptor -t netflix **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm6-linux-firefox-netflix.manifest * **playback version**: 8.1.1 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-netflix** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-netflix** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-netflix** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-netflix** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-netflix** - ❌ - ❌ - ❌ - ❌ .. dropdown:: nytimes :class-container: anchor-id-nytimes-d * Command to Run Locally .. code-block:: ./mach raptor -t nytimes **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm7-linux-firefox-nytimes.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-nytimes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-nytimes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-nytimes** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-nytimes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-nytimes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-nytimes** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-nytimes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-nytimes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-nytimes** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-nytimes** - ❌ - ❌ - ❌ - ❌ .. dropdown:: office :class-container: anchor-id-office-d * Command to Run Locally .. code-block:: ./mach raptor -t office **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm7-linux-firefox-office.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-office** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-office** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-office** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-office** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-office** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-office** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-office** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-office** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-office** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-office** - ❌ - ❌ - ❌ - ❌ .. dropdown:: openai :class-container: anchor-id-openai-d * Command to Run Locally .. code-block:: ./mach raptor -t openai **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-openai.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-openai** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-openai** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-openai** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-openai** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-openai** - ❌ - ❌ - ❌ - ❌ .. dropdown:: outlook :class-container: anchor-id-outlook-d * Command to Run Locally .. code-block:: ./mach raptor -t outlook **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm5-linux-firefox-live.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-outlook** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-outlook** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-outlook** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-outlook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-outlook** - ❌ - ❌ - ❌ - ❌ .. dropdown:: paypal :class-container: anchor-id-paypal-d * Command to Run Locally .. code-block:: ./mach raptor -t paypal **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm5-linux-firefox-paypal.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-paypal** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-paypal** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-paypal** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-paypal** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-paypal** - ❌ - ❌ - ❌ - ❌ .. dropdown:: pinterest :class-container: anchor-id-pinterest-d * Command to Run Locally .. code-block:: ./mach raptor -t pinterest **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm6-linux-firefox-pinterest.manifest * **playback version**: 8.1.1 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-pinterest** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-pinterest** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-pinterest** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-pinterest** - ❌ - ❌ - ❌ - ❌ .. dropdown:: reddit :class-container: anchor-id-reddit-d * Command to Run Locally .. code-block:: ./mach raptor -t reddit **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-reddit.manifest * **playback pageset manifest backup**: mitm8-linux-firefox-reddit.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-reddit** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-reddit** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-reddit** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-reddit** - ❌ - ❌ - ❌ - ❌ .. dropdown:: samsung :class-container: anchor-id-samsung-d * Command to Run Locally .. code-block:: ./mach raptor -t samsung **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-samsung.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-samsung** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-samsung** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-samsung** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-samsung** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-samsung** - ❌ - ❌ - ❌ - ❌ .. dropdown:: tiktok :class-container: anchor-id-tiktok-d * Command to Run Locally .. code-block:: ./mach raptor -t tiktok **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-tiktok.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-tiktok** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-tiktok** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-tiktok** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-tiktok** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-tiktok** - ❌ - ❌ - ❌ - ❌ .. dropdown:: tumblr :class-container: anchor-id-tumblr-d * Command to Run Locally .. code-block:: ./mach raptor -t tumblr **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm6-linux-firefox-tumblr.manifest * **playback version**: 8.1.1 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-tumblr** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-tumblr** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-tumblr** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-tumblr** - ❌ - ❌ - ❌ - ❌ .. dropdown:: twitch :class-container: anchor-id-twitch-d * Command to Run Locally .. code-block:: ./mach raptor -t twitch **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-twitch.manifest * **playback version**: 11.0.0 * **preferences**: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-twitch** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-twitch** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-twitch** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-twitch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitch** - ❌ - ❌ - ❌ - ❌ .. dropdown:: twitter :class-container: anchor-id-twitter-d * Command to Run Locally .. code-block:: ./mach raptor -t twitter **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm5-linux-firefox-twitter.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-twitter** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-twitter** - ❌ - ❌ - ❌ - ❌ .. dropdown:: weather :class-container: anchor-id-weather-d * Command to Run Locally .. code-block:: ./mach raptor -t weather **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm8-linux-firefox-weather.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-weather** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-weather** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-weather** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-chrome-weather** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp7-firefox-weather** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wikia :class-container: anchor-id-wikia-d * Command to Run Locally .. code-block:: ./mach raptor -t wikia **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm7-linux-firefox-wikia.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-wikia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-wikia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-wikia** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-wikia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-wikia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-wikia** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-wikia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-wikia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-wikia** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-wikia** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wikipedia :class-container: anchor-id-wikipedia-d * Command to Run Locally .. code-block:: ./mach raptor -t wikipedia **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-wikipedia.manifest * **playback pageset manifest backup**: mitm7-linux-firefox-wikipedia.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-wikipedia** - ❌ - ❌ - ❌ - ❌ .. dropdown:: yahoo-mail :class-container: anchor-id-yahoo-mail-d * Command to Run Locally .. code-block:: ./mach raptor -t yahoo-mail **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: false * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm5-linux-firefox-yahoo-mail.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-essential-chrome-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-custom-car-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-bytecode-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-essential-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-yahoo-mail** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube :class-container: anchor-id-youtube-d * Command to Run Locally .. code-block:: ./mach raptor -t youtube **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari, custom-car * **benchmark page**: true * **browser cycles**: 25 * **expected**: pass * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-youtube.manifest * **playback pageset manifest backup**: mitm7-linux-firefox-youtube.manifest * **playback version**: 11.0.0 * **secondary url**: ``__ * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-youtube** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-youtube** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-safari-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-chrome-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-custom-car-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-firefox-youtube** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6-live-chrome-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6-firefox-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6-live-firefox-youtube** - ❌ - ❌ - ❌ - ❌ Interactive ----------- Browsertime tests that interact with the webpage. Includes responsiveness tests as they make use of this support for navigation. This type of test allows the specification of browsertime commands through the test manifest. .. dropdown:: cnn-nav :class-container: anchor-id-cnn-nav-i * Command to Run Locally .. code-block:: ./mach raptor -t cnn-nav **Owner**: PerfTest Team **Description**: Navigates to cnn main page, then to the world sub-page. * **accept zero vismet**: true * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 * **expected**: pass * **gecko profile interval**: 1 * **interactive**: true * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm7-linux-firefox-cnn-nav.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test cmds**: ['measure.start', 'landing'] ['navigate', 'https://www.cnn.com'] ['wait.byTime', '4000'] ['measure.stop', ''] ['measure.start', 'world'] ['click.byXpathAndWait', '/html/body/div[5]/div/div/header/div/div[1]/div/div[2]/nav/ul/li[2]/a'] ['wait.byTime', '1000'] ['measure.stop', ''] * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-cnn-nav** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-cnn-nav** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-cnn-nav** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-cnn-nav** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-cnn-nav** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-cnn-nav** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-cnn-nav** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-cnn-nav** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-cnn-nav** - ❌ - ❌ - ❌ - ❌ .. dropdown:: facebook-nav :class-container: anchor-id-facebook-nav-i * Command to Run Locally .. code-block:: ./mach raptor -t facebook-nav **Owner**: PerfTest Team **Description**: Navigates to facebook, then the sub-pages friends, marketplace, groups. * **accept zero vismet**: true * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 * **expected**: pass * **gecko profile interval**: 1 * **interactive**: true * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 90000 * **playback**: mitmproxy * **playback pageset manifest**: mitm11-windows-firefox-facebook-nav.manifest * **playback pageset manifest backup**: mitm6-windows-firefox-facebook-nav.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test cmds**: ['measure.start', 'landing'] ['navigate', 'https://www.facebook.com/'] ['wait.byTime', '5000'] ['measure.stop', ''] ['measure.start', 'marketplace'] ['navigate', 'https://www.facebook.com/marketplace'] ['wait.byTime', '5000'] ['measure.stop', ''] ['measure.start', 'groups'] ['navigate', 'https://www.facebook.com/groups/discover/'] ['wait.byTime', '5000'] ['measure.stop', ''] ['measure.start', 'friends'] ['navigate', 'https://www.facebook.com/friends/'] ['wait.byTime', '5000'] ['measure.stop', ''] * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-facebook-nav** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-facebook-nav** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-facebook-nav** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-facebook-nav** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-facebook-nav** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-facebook-nav** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-facebook-nav** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-facebook-nav** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-facebook-nav** - ❌ - ❌ - ❌ - ❌ .. dropdown:: reddit-billgates-ama :class-container: anchor-id-reddit-billgates-ama-i * Command to Run Locally .. code-block:: ./mach raptor -t reddit-billgates-ama **Owner**: PerfTest Team **Description**: Navigates from the Bill Gates AMA to the Reddit members section. * **accept zero vismet**: true * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 * **expected**: pass * **gecko profile interval**: 1 * **interactive**: true * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 240000 * **playback**: mitmproxy * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-ama.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test cmds**: ['measure.start', 'billg-ama'] ['navigate', 'https://www.reddit.com/r/IAmA/comments/m8n4vt/im_bill_gates_cochair_of_the_bill_and_melinda/'] ['wait.byTime', '5000'] ['measure.stop', ''] ['measure.start', 'members'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div[3]/div[2]/div/div[1]/div/div[4]/div[1]/div'] ['wait.byTime', '1000'] ['measure.stop', ''] * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-ama** - ❌ - ❌ - ❌ - ❌ .. dropdown:: reddit-billgates-post-1 :class-container: anchor-id-reddit-billgates-post-1-i * Command to Run Locally .. code-block:: ./mach raptor -t reddit-billgates-post-1 **Owner**: PerfTest Team **Description**: Navigates the `thisisbillgates` user starting at the main user page, then to the posts, comments, hot, and top sections. * **accept zero vismet**: true * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 * **expected**: pass * **gecko profile interval**: 1 * **interactive**: true * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 90000 * **playback**: mitmproxy * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-post.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test cmds**: ['measure.start', 'billg'] ['navigate', 'https://www.reddit.com/user/thisisbillgates/'] ['wait.byTime', '500'] ['measure.stop', ''] ['measure.start', 'posts'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[2]'] ['wait.byTime', '500'] ['measure.stop', ''] ['measure.start', 'comments'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]'] ['wait.byTime', '500'] ['measure.stop', ''] ['wait.byTime', '500'] * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** - ❌ - ❌ - ❌ - ❌ .. dropdown:: reddit-billgates-post-2 :class-container: anchor-id-reddit-billgates-post-2-i * Command to Run Locally .. code-block:: ./mach raptor -t reddit-billgates-post-2 **Owner**: PerfTest Team **Description**: Navigates the `thisisbillgates` user starting at the main user page, then to the posts, comments, hot, and top sections. * **accept zero vismet**: true * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: firefox, chrome, safari * **browser cycles**: 10 * **expected**: pass * **gecko profile interval**: 1 * **interactive**: true * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 90000 * **playback**: mitmproxy * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-post.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test cmds**: ['measure.start', 'billg'] ['navigate', 'https://www.reddit.com/user/thisisbillgates/'] ['wait.byTime', '500'] ['measure.stop', ''] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]'] ['wait.byTime', '500'] ['measure.start', 'hot'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[2]'] ['wait.byTime', '500'] ['measure.stop', ''] ['measure.start', 'top'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[3]'] ['wait.byTime', '500'] ['measure.stop', ''] ['wait.byTime', '500'] * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux1804-64-shippable-qr/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64-clang-trunk/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-linux2404-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-linux2404-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-macosx1470-64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-macosx1470-64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-chrome-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ✅ - ✅ - ❌ - ❌ .. list-table:: **test-windows11-64-24h2/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** - ❌ - ❌ - ❌ - ❌ Live ---- A set of test pages that are run as live sites instead of recorded versions. These tests are available on all browsers, on all platforms. .. dropdown:: booking-sf :class-container: anchor-id-booking-sf-l * Command to Run Locally .. code-block:: ./mach raptor -t booking-sf **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-booking-sf-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-booking-sf** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-booking-sf-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-booking-sf** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-booking-sf-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-booking-sf** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-booking-sf-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-booking-sf** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-booking-sf-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: discord :class-container: anchor-id-discord-l * Command to Run Locally .. code-block:: ./mach raptor -t discord **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-discord-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-discord** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-discord-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-discord** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-discord-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-discord** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-discord-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-discord** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-discord-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: fashionbeans :class-container: anchor-id-fashionbeans-l * Command to Run Locally .. code-block:: ./mach raptor -t fashionbeans **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-fashionbeans-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-fashionbeans** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-fashionbeans-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-fashionbeans** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-fashionbeans-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-fashionbeans** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-fashionbeans-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-fashionbeans** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-fashionbeans-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: google-accounts :class-container: anchor-id-google-accounts-l * Command to Run Locally .. code-block:: ./mach raptor -t google-accounts **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-google-accounts-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-accounts** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-accounts-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-accounts** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-accounts-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-google-accounts** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-accounts-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-accounts** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-accounts-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: imdb-firefox :class-container: anchor-id-imdb-firefox-l * Command to Run Locally .. code-block:: ./mach raptor -t imdb-firefox **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-imdb-firefox-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-imdb-firefox** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-imdb-firefox-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-imdb-firefox** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-imdb-firefox-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-imdb-firefox** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-imdb-firefox-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-imdb-firefox** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-imdb-firefox-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: medium-article :class-container: anchor-id-medium-article-l * Command to Run Locally .. code-block:: ./mach raptor -t medium-article **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-medium-article-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-medium-article** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-medium-article-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-medium-article** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-medium-article-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-medium-article** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-medium-article-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-medium-article** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-medium-article-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: people-article :class-container: anchor-id-people-article-l * Command to Run Locally .. code-block:: ./mach raptor -t people-article **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-people-article-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-people-article** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-people-article-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-people-article** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-people-article-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-people-article** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-people-article-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-people-article** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-people-article-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: reddit-thread :class-container: anchor-id-reddit-thread-l * Command to Run Locally .. code-block:: ./mach raptor -t reddit-thread **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-reddit-thread-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-reddit-thread** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-reddit-thread-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-reddit-thread** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-reddit-thread-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-reddit-thread** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-reddit-thread-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-reddit-thread** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-reddit-thread-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: rumble-fox :class-container: anchor-id-rumble-fox-l * Command to Run Locally .. code-block:: ./mach raptor -t rumble-fox **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-rumble-fox-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-rumble-fox** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-rumble-fox-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-rumble-fox** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-rumble-fox-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-rumble-fox** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-rumble-fox-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-rumble-fox** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-rumble-fox-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: stackoverflow-question :class-container: anchor-id-stackoverflow-question-l * Command to Run Locally .. code-block:: ./mach raptor -t stackoverflow-question **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-stackoverflow-question-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-stackoverflow-question** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-stackoverflow-question-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-stackoverflow-question** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-stackoverflow-question-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-stackoverflow-question** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-stackoverflow-question-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-stackoverflow-question** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-stackoverflow-question-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: urbandictionary-define :class-container: anchor-id-urbandictionary-define-l * Command to Run Locally .. code-block:: ./mach raptor -t urbandictionary-define **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-urbandictionary-define-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-urbandictionary-define** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-urbandictionary-define-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-urbandictionary-define** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-urbandictionary-define-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-urbandictionary-define** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-urbandictionary-define-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-urbandictionary-define** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-urbandictionary-define-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wikia-marvel :class-container: anchor-id-wikia-marvel-l * Command to Run Locally .. code-block:: ./mach raptor -t wikia-marvel **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: true * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-wikia-marvel-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-wikia-marvel** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-wikia-marvel-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-wikia-marvel** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-wikia-marvel-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-wikia-marvel** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-wikia-marvel-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-wikia-marvel** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-wikia-marvel-nofis** - ❌ - ❌ - ❌ - ❌ Mobile ------ Page-load performance test suite on Android. The links direct to the actual websites that are being tested. .. dropdown:: allrecipes :class-container: anchor-id-allrecipes-m * Command to Run Locally .. code-block:: ./mach raptor -t allrecipes **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm8-android-gve-allrecipes.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-chrome-m-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-cstm-car-m-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-allrecipes** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-allrecipes-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-allrecipes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-allrecipes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-allrecipes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-allrecipes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-fenix-allrecipes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-allrecipes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-allrecipes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-allrecipes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-allrecipes** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-allrecipes-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: amazon :class-container: anchor-id-amazon-m * Command to Run Locally .. code-block:: ./mach raptor -t amazon **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-amazon.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-amazon** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-amazon-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-amazon** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-amazon** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-amazon** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-amazon-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-amazon** - ❌ - ❌ - ❌ - ❌ .. dropdown:: amazon-search :class-container: anchor-id-amazon-search-m * Command to Run Locally .. code-block:: ./mach raptor -t amazon-search **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-amazon-search.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-chrome-m-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-cstm-car-m-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-amazon-search** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-amazon-search-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-webextensions-fenix-amazon-search** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-webextensions-fenix-amazon-search-nofis** - ✅ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-fenix-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-webextensions-fenix-amazon-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-webextensions-fenix-amazon-search-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: bild-de :class-container: anchor-id-bild-de-m * Command to Run Locally .. code-block:: ./mach raptor -t bild-de **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm8-android-fenix-bild-de.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-bild-de** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-bild-de-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bild-de** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bild-de** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bild-de** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-bild-de** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-bild-de** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bild-de** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bild-de** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bild-de** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bild-de-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-bild-de** - ❌ - ❌ - ❌ - ❌ .. dropdown:: bing :class-container: anchor-id-bing-m * Command to Run Locally .. code-block:: ./mach raptor -t bing **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-bing.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-bing** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-bing-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bing** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bing** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bing** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-bing** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-bing** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bing** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bing** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bing** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bing-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-bing** - ❌ - ❌ - ❌ - ❌ .. dropdown:: bing-search-restaurants :class-container: anchor-id-bing-search-restaurants-m * Command to Run Locally .. code-block:: ./mach raptor -t bing-search-restaurants **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-bing-search-restaurants.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-bing-search-restaurants** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-bing-search-restaurants-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bing-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bing-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bing-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-bing-search-restaurants** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-bing-search-restaurants** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bing-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bing-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bing-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-bing-search-restaurants** - ❌ - ❌ - ❌ - ❌ .. dropdown:: booking :class-container: anchor-id-booking-m * Command to Run Locally .. code-block:: ./mach raptor -t booking **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-booking.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-booking** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-booking-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-booking** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-booking** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-booking** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-booking** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-booking** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-booking** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-booking** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-booking** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-booking-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-booking** - ❌ - ❌ - ❌ - ❌ .. dropdown:: cnn :class-container: anchor-id-cnn-m * Command to Run Locally .. code-block:: ./mach raptor -t cnn **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-cnn.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-cnn** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-cnn-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-cnn** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-cnn** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-cnn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-cnn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-cnn** - ❌ - ❌ - ❌ - ❌ .. dropdown:: cnn-ampstories :class-container: anchor-id-cnn-ampstories-m * Command to Run Locally .. code-block:: ./mach raptor -t cnn-ampstories **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-cnn-ampstories.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-cnn-ampstories** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-cnn-ampstories-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-cnn-ampstories** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-cnn-ampstories** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-cnn-ampstories** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-cnn-ampstories** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-cnn-ampstories** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-cnn-ampstories** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-cnn-ampstories** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-cnn-ampstories** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-cnn-ampstories-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-cnn-ampstories** - ❌ - ❌ - ❌ - ❌ .. dropdown:: dailymail :class-container: anchor-id-dailymail-m * Command to Run Locally .. code-block:: ./mach raptor -t dailymail **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-dailymail.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-dailymail** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-dailymail-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-dailymail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-dailymail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-dailymail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-dailymail** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-dailymail** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-dailymail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-dailymail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-dailymail** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-dailymail-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-dailymail** - ❌ - ❌ - ❌ - ❌ .. dropdown:: ebay-kleinanzeigen :class-container: anchor-id-ebay-kleinanzeigen-m * Command to Run Locally .. code-block:: ./mach raptor -t ebay-kleinanzeigen **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-ebay-kleinanzeigen.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-ebay-kleinanzeigen** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-ebay-kleinanzeigen** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen** - ❌ - ❌ - ❌ - ❌ .. dropdown:: ebay-kleinanzeigen-search :class-container: anchor-id-ebay-kleinanzeigen-search-m * Command to Run Locally .. code-block:: ./mach raptor -t ebay-kleinanzeigen-search **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-ebay-kleinanzeigen-search.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search** - ❌ - ❌ - ❌ - ❌ .. dropdown:: espn :class-container: anchor-id-espn-m * Command to Run Locally .. code-block:: ./mach raptor -t espn **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-espn.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-chrome-m-espn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-cstm-car-m-espn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-espn** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-espn-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-espn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-espn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-espn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-espn-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-fenix-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-espn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-espn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-espn-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-espn** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-espn-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: facebook :class-container: anchor-id-facebook-m * Command to Run Locally .. code-block:: ./mach raptor -t facebook **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **login**: true * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-g5-fenix-facebook.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-chrome-m-facebook-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-facebook-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-facebook-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-live-fenix-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-facebook-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-facebook** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-facebook-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: facebook-cristiano :class-container: anchor-id-facebook-cristiano-m * Command to Run Locally .. code-block:: ./mach raptor -t facebook-cristiano **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-facebook-cristiano.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-facebook-cristiano** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-facebook-cristiano-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-facebook-cristiano** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-facebook-cristiano** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-facebook-cristiano** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-facebook-cristiano** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-facebook-cristiano** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-facebook-cristiano** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-facebook-cristiano** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-facebook-cristiano** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-facebook-cristiano-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-facebook-cristiano** - ❌ - ❌ - ❌ - ❌ .. dropdown:: google :class-container: anchor-id-google-m * Command to Run Locally .. code-block:: ./mach raptor -t google **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **login**: true * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-g5-fenix-google.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-chrome-m-google-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-cstm-car-m-google-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-google** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-google-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-google** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-google-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-google** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-google-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-fenix-google** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-google-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-google** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-google-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-google** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: google-maps :class-container: anchor-id-google-maps-m * Command to Run Locally .. code-block:: ./mach raptor -t google-maps **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-google-maps.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-google-maps** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-google-maps-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-google-maps** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-maps** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-maps** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-google-maps** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-google-maps** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-google-maps** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-maps** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-maps** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-maps-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-google-maps** - ❌ - ❌ - ❌ - ❌ .. dropdown:: google-search-restaurants :class-container: anchor-id-google-search-restaurants-m * Command to Run Locally .. code-block:: ./mach raptor -t google-search-restaurants **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **login**: true * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-g5-fenix-google-search-restaurants.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-google-search-restaurants** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-google-search-restaurants-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-google-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-google-search-restaurants** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-google-search-restaurants** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-google-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-search-restaurants** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-google-search-restaurants-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-google-search-restaurants** - ❌ - ❌ - ❌ - ❌ .. dropdown:: imdb :class-container: anchor-id-imdb-m * Command to Run Locally .. code-block:: ./mach raptor -t imdb **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-imdb.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-imdb** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-imdb-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-imdb** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-imdb** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-imdb** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-imdb-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-imdb** - ❌ - ❌ - ❌ - ❌ .. dropdown:: instagram :class-container: anchor-id-instagram-m * Command to Run Locally .. code-block:: ./mach raptor -t instagram **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **login**: true * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm8-android-gve-instagram.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-instagram** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-instagram-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-instagram** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-instagram** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-instagram** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-instagram-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-instagram** - ❌ - ❌ - ❌ - ❌ .. dropdown:: microsoft-support :class-container: anchor-id-microsoft-support-m * Command to Run Locally .. code-block:: ./mach raptor -t microsoft-support **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-microsoft-support.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-chrome-m-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-cstm-car-m-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-microsoft-support** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-microsoft-support-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-microsoft-support** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-microsoft-support** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-microsoft-support** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-microsoft-support** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-fenix-microsoft-support** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-microsoft-support** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-microsoft-support** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-microsoft-support** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-microsoft-support** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-microsoft-support-nofis** - ❌ - ❌ - ❌ - ❌ .. dropdown:: reddit :class-container: anchor-id-reddit-m * Command to Run Locally .. code-block:: ./mach raptor -t reddit **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-reddit.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-reddit** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-reddit-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-reddit** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-reddit** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-reddit** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-reddit-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-reddit** - ❌ - ❌ - ❌ - ❌ .. dropdown:: sina :class-container: anchor-id-sina-m * Command to Run Locally .. code-block:: ./mach raptor -t sina **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm8-android-fenix-sina.manifest * **playback version**: 11.0.0 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-sina-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-sina-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-sina** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-sina-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-sina** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-sina-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-sina** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-sina** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-sina-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-sina** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-sina-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-sina** - ❌ - ❌ - ❌ - ❌ .. dropdown:: stackoverflow :class-container: anchor-id-stackoverflow-m * Command to Run Locally .. code-block:: ./mach raptor -t stackoverflow **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-stackoverflow.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-stackoverflow** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-stackoverflow-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-stackoverflow** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-stackoverflow** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-stackoverflow** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-stackoverflow** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-stackoverflow** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-stackoverflow** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-stackoverflow** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-stackoverflow** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-stackoverflow-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-stackoverflow** - ❌ - ❌ - ❌ - ❌ .. dropdown:: wikipedia :class-container: anchor-id-wikipedia-m * Command to Run Locally .. code-block:: ./mach raptor -t wikipedia **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-wikipedia.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-wikipedia** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-wikipedia-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-wikipedia** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-wikipedia** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-wikipedia** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-wikipedia-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-wikipedia** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube :class-container: anchor-id-youtube-m * Command to Run Locally .. code-block:: ./mach raptor -t youtube **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-youtube.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-chrome-m-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-cstm-car-m-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-youtube** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-youtube-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-geckoview-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-youtube** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-fenix-youtube** - ✅ - ❌ - ❌ - ❌ * - **browsertime-tp6m-fenix-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-geckoview-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-youtube** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-youtube-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-refbrow-youtube** - ❌ - ❌ - ❌ - ❌ .. dropdown:: youtube-watch :class-container: anchor-id-youtube-watch-m * Command to Run Locally .. code-block:: ./mach raptor -t youtube-watch **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__, `ContentfulSpeedIndex `__, `PerceptualSpeedIndex `__, `SpeedIndex `__, `FirstVisualChange `__, `LastVisualChange `__, `largestContentfulPaint `__ * **alert threshold**: 2.0 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m * **benchmark page**: true * **browser cycles**: 15 * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy-android * **playback pageset manifest**: mitm6-android-fenix-youtube-watch.manifest * **playback version**: 8.1.1 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: pageload * **unit**: ms * **use live sites**: false * **Test Task**: .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-chrome-m-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-cstm-car-m-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-youtube-watch** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-youtube-watch-nofis** - ✅ - ✅ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-youtube-watch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-youtube-watch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-chrome-m-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-youtube-watch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-youtube-watch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** :widths: 30 15 15 15 15 :header-rows: 1 * - **Test Name** - mozilla-central - autoland - mozilla-release - mozilla-beta * - **browsertime-tp6m-essential-fenix-youtube-watch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-fenix-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-youtube-watch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-geckoview-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-essential-refbrow-youtube-watch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-youtube-watch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-fenix-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-youtube-watch** - ❌ - ❌ - ❌ - ❌ * - **browsertime-tp6m-live-geckoview-youtube-watch-nofis** - ❌ - ❌ - ❌ - ❌ Scenario -------- Tests that perform a specific action (a scenario), i.e. idle application, idle application in background, etc. .. dropdown:: idle :class-container: anchor-id-idle-s * Command to Run Locally .. code-block:: ./mach raptor -t idle **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: fenix, geckoview, refbrow * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **measure**: fakeMeasure * **page cycles**: 1 * **page timeout**: 1320000 * **scenario time**: 1200000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: scenario * **unit**: scenarioComplete .. dropdown:: idle-bg :class-container: anchor-id-idle-bg-s * Command to Run Locally .. code-block:: ./mach raptor -t idle-bg **Owner**: PerfTest Team * **alert threshold**: 2.0 * **apps**: fenix, geckoview, refbrow * **browsertime args**: --browsertime.scenario_time=60000 --browsertime.background_app=false * **expected**: pass * **link searchfox**: ``__ * **lower is better**: true * **measure**: fakeMeasure * **page cycles**: 1 * **page timeout**: 1320000 * **scenario time**: 1200000 * **support class**: browsertime_pageload.py * **test url**: ``__ * **type**: scenario * **unit**: scenarioComplete Unittests --------- These tests aren't used in standard testing, they are only used in the Raptor unit tests (they are similar to raptor-tp6 tests). .. dropdown:: test-page-1 :class-container: anchor-id-test-page-1-u * Command to Run Locally .. code-block:: ./mach raptor -t test-page-1 **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **gecko profile entries**: 14000000 * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm7-linux-firefox-test-page-1.manifest * **playback version**: 11.0.0 * **test url**: ``__ * **type**: pageload * **unit**: ms .. dropdown:: test-page-2 :class-container: anchor-id-test-page-2-u * Command to Run Locally .. code-block:: ./mach raptor -t test-page-2 **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **gecko profile entries**: 14000000 * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm7-linux-firefox-test-page-2.manifest * **playback version**: 11.0.0 * **test url**: ``__ * **type**: pageload * **unit**: ms .. dropdown:: test-page-3 :class-container: anchor-id-test-page-3-u * Command to Run Locally .. code-block:: ./mach raptor -t test-page-3 **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **gecko profile entries**: 14000000 * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm7-linux-firefox-test-page-3.manifest * **playback version**: 11.0.0 * **test url**: ``__ * **type**: pageload * **unit**: ms .. dropdown:: test-page-4 :class-container: anchor-id-test-page-4-u * Command to Run Locally .. code-block:: ./mach raptor -t test-page-4 **Owner**: PerfTest Team * **alert on**: `fcp `__, `loadtime `__ * **alert threshold**: 2.0 * **apps**: firefox * **expected**: pass * **gecko profile entries**: 14000000 * **gecko profile interval**: 1 * **link searchfox**: ``__ * **lower is better**: true * **page cycles**: 25 * **page timeout**: 60000 * **playback**: mitmproxy * **playback pageset manifest**: mitm7-linux-firefox-test-page-4.manifest * **playback version**: 11.0.0 * **test url**: ``__ * **type**: pageload * **unit**: ms