Automated performance testing and sheriffing

We have several test harnesses that test Firefox for various performance characteristics (page load time, startup time, etc.). We also generate some metrics as part of the build process (like installer size) that are interesting to track over time. Currently we aggregate this information in the Perfherder web application where performance sheriffs watch for significant regressions, filing bugs as appropriate.

Current list of automated systems we are tracking (at least to some degree):

• Talos: The main performance system, run on virtually every check-in to an integration branch

• build_metrics: A grab bag of performance metrics generated by the build system

• AreWeFastYet: A generic JavaScript and Web benchmarking system tool

• Platform microbenchmarks

• Build Metrics