This system was originally developed as part of the Virtual Machine Warmup Blows Hot and Cold paper. It analyses VM performance data and outputs various statistics (e.g. if the VM warmed up or slowed down; how long it took to warmup; what (if any) the steady state performance is).

The system can be found at the warmup_stats repository.

Running benchmarks

High quality VM benchmarking is hard to achieve: it is easy to accidentally end up measuring something other than was intended. We wrote Krun to help make reliable VM measurement easier. Krun is not suitable for all purposes, but is probably the easiest way to obtain high quality benchmarking data.

A large-scale example

The Virtual Machine Warmup Blows Hot and Cold paper also serves as an example of a large-scale VM experiment. You can find that experiment at the warmup_experiment repository.