This repository contains some scripts for benchmarking.
benchmark.py can measure the average execution time for cpplint-cpp and cpplint.py. It takes about two minutes for measurement.
$ python ./benchmark/benchmark.py . --cpplint_cpp="./build/cpplint-cpp"
Measuring time for cpplint-cpp: ./build/cpplint-cpp --recursive --quiet --counting=detailed .
Measuring time for cpplint.py: python cpplint.py --recursive --quiet --counting=detailed .
Execution time for cpplint-cpp: x.xxxxxx seconds
Execution time for cpplint.py: x.xxxxxx secondsmemory_usage.sh can measure memory usage for a linter against a directory.
$ sh ./benchmark/memory_usage.sh "./build/cpplint-cpp" .
Measuring memory usage: ./build/cpplint-cpp
Maximum memory usage: xx.xx MiB
$ sh ./benchmark/memory_usage.sh "python cpplint.py" .
Measuring memory usage: python cpplint.py
Maximum memory usage: xx.xx MiBYou don't need to setup environment for benchmarking.
You can use benchmark.yml in your fork to run benchmark.py and memory_usage.sh.
