benchy
Benchy
A tool to perform benchmarks.
Allows declaration of program to run and measurements to do (cpu time, user time, max resident set size, etc.) in a manifest .yml
file.
The measurements will already compute average and standard deviation.
It supports client/server programs to run HTTP servers against tools like ab
.
It supports runnings the program against multiple configurations.
In OSX, To run the http benchmarks you need to mind the ephemeral port-limit.
Installation
$ git clone https://github.com/manastech/benchy.git
$ cd benchy
$ shards build
Use ./bin/benchy
or copy it your somewhere in your PATH.
Usage
Read the full DOCS or run one of the samples included in ./sample
Ensure that time
and ab
are installed. $ apt-get install time apache2-utils
$ shards build
$ ./bin/benchy run -v --csv=output.csv --ndjson=output.ndjson ./sample/http-ab.yml
The ndjson file can be used with @bcardiff/benchy-viewer.
If you prefer to use wrk
, check ./sample/http-wrk.yml
.
Contributing
- Fork it (https://github.com/manastech/benchy/fork)
- Create your feature branch (
git checkout -b my-new-feature
) - Commit your changes (
git commit -am 'Add some feature'
) - Push to the branch (
git push origin my-new-feature
) - Create a new Pull Request
Contributors
- Brian J. Cardiff - creator and maintainer