Raptor

The following documents all testing we have for Raptor.

Benchmarks

Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI.

Desktop

Tests for page-load performance. (WX: WebExtension, BT: Browsertime, FF: Firefox, CH: Chrome, CU: Chromium)

  • amazon (BT)

  • apple (BT)

  • bing-search (BT)

  • ebay (BT)

  • facebook (BT)

  • facebook-redesign (BT)

  • fandom (BT)

  • google-docs (BT)

  • google-mail (BT)

  • google-search (BT)

  • google-sheets (BT)

  • google-slides (BT)

  • imdb (BT)

  • imgur (BT)

  • instagram (BT)

  • linkedin (BT)

  • microsoft (BT)

  • netflix (BT)

  • office (BT)

  • outlook (BT)

  • paypal (BT)

  • pinterest (BT)

  • raptor-tp6-amazon (WX, FF, CH, CU)

  • raptor-tp6-apple (WX, FF, CH, CU)

  • raptor-tp6-bing (WX, FF, CH, CU)

  • raptor-tp6-docs (WX, FF, CH, CU)

  • raptor-tp6-ebay (WX, FF, CH, CU)

  • raptor-tp6-facebook (WX, CH, CU)

  • raptor-tp6-fandom (WX, FF, CH, CU)

  • raptor-tp6-google (WX, FF, CH, CU)

  • raptor-tp6-google-mail (WX, FF, CH, CU)

  • raptor-tp6-imdb (WX, FF, CH, CU)

  • raptor-tp6-imgur (WX, FF, CH, CU)

  • raptor-tp6-instagram (WX, FF, CH, CU)

  • raptor-tp6-linkedin (WX, FF, CH, CU)

  • raptor-tp6-microsoft (WX, FF, CH, CU)

  • raptor-tp6-netflix (WX, FF, CH, CU)

  • raptor-tp6-office (WX, FF, CH, CU)

  • raptor-tp6-outlook (WX, FF, CH, CU)

  • raptor-tp6-paypal (WX, FF, CH, CU)

  • raptor-tp6-pinterest (WX, FF, CH, CU)

  • raptor-tp6-reddit (WX, FF, CH, CU)

  • raptor-tp6-sheets (WX, FF, CH, CU)

  • raptor-tp6-slides (WX, FF, CH, CU)

  • raptor-tp6-tumblr (WX, FF, CH, CU)

  • raptor-tp6-twitch (WX, FF, CH, CU)

  • raptor-tp6-twitter (WX, FF, CH, CU)

  • raptor-tp6-wikipedia (WX, FF, CH, CU)

  • raptor-tp6-yahoo-mail (WX, FF, CH, CU)

  • raptor-tp6-yahoo-news (WX, FF, CH, CU)

  • raptor-tp6-yandex (WX, FF, CH, CU)

  • raptor-tp6-youtube (WX, FF, CH, CU)

  • reddit (BT)

  • tumblr (BT)

  • twitch (BT)

  • twitter (BT)

  • wikipedia (BT)

  • yahoo-mail (BT)

  • yahoo-news (BT)

  • yandex (BT)

  • youtube (BT)

Live

A set of test pages that are run as live sites instead of recorded versions. These tests are available on all browsers, on all platforms.

Mobile

Page-load performance test suite on Android. (WX: WebExtension, BT: Browsertime, GV: Geckoview, RB: Refbrow, FE: Fenix, F68: Fennec68)

  • allrecipes (BT)

  • amazon (BT)

  • amazon-search (BT)

  • bbc (BT)

  • bing (BT)

  • bing-search-restaurants (BT)

  • booking (BT)

  • cnn (BT)

  • cnn-ampstories (BT)

  • ebay-kleinanzeigen (BT)

  • ebay-kleinanzeigen-search (BT)

  • espn (BT)

  • facebook (BT)

  • facebook-cristiano (BT)

  • google (BT)

  • google-maps (BT)

  • google-search-restaurants (BT)

  • imdb (BT)

  • instagram (BT)

  • jianshu (BT)

  • microsoft-support (BT)

  • raptor-tp6m-allrecipes (WX, GV, RB, FE, F68)

  • raptor-tp6m-amazon (WX, GV, RB, FE, F68)

  • raptor-tp6m-amazon-search (WX, GV, RB, FE, F68)

  • raptor-tp6m-bbc (WX, GV, RB, FE, F68)

  • raptor-tp6m-bing (WX, GV, RB, FE, F68)

  • raptor-tp6m-bing-restaurants (WX, GV, RB, FE, F68)

  • raptor-tp6m-booking (WX, GV, RB, FE, F68)

  • raptor-tp6m-cnn (WX, GV, RB, FE, F68)

  • raptor-tp6m-cnn-ampstories (WX, GV, RB, FE, F68)

  • raptor-tp6m-ebay-kleinanzeigen (WX, GV, RB, FE, F68)

  • raptor-tp6m-espn (WX, GV, RB, FE, F68)

  • raptor-tp6m-facebook (WX, GV, RB, FE, F68)

  • raptor-tp6m-facebook-cristiano (WX, GV, RB, FE, F68)

  • raptor-tp6m-google (WX, GV, RB, FE, F68)

  • raptor-tp6m-google-maps (WX, GV, RB, FE, F68)

  • raptor-tp6m-google-restaurants (WX, GV, RB, FE, F68)

  • raptor-tp6m-imdb (WX, GV, RB, FE, F68)

  • raptor-tp6m-instagram (WX, GV, RB, FE, F68)

  • raptor-tp6m-jianshu (WX, GV, RB, FE, F68)

  • raptor-tp6m-microsoft-support (WX, GV, RB, FE, F68)

  • raptor-tp6m-reddit (WX, GV, RB, FE, F68)

  • raptor-tp6m-stackoverflow (WX, GV, RB, FE, F68)

  • raptor-tp6m-web-de (WX, GV, RB, FE, F68)

  • raptor-tp6m-wikipedia (WX, GV, RB, FE, F68)

  • raptor-tp6m-youtube (WX, GV, RB, FE, F68)

  • raptor-tp6m-youtube-watch (WX, GV, RB, FE, F68)

  • reddit (BT)

  • stackoverflow (BT)

  • web-de (BT)

  • wikipedia (BT)

  • youtube (BT)

  • youtube-watch (BT)

Scenario

Tests that perform a specific action (a scenario), i.e. idle application, idle application in background, etc.

Unittests

These tests aren’t used in standard testing, they are only used in the Raptor unit tests (they are similar to raptor-tp6 tests though).

The methods for calling the tests can be found in the Raptor wiki page.