Standardize Benchmarking

[aatmanvaidya]

We have previously written benchmarking scripts (src/benchmark) for each operator where we profiled them for time and memory usage.

We should move the benchmark folder to root, and this folder can grow into having benchmarking scripts for profiling and load testing .

Currently, profiling each operator for time and memory usage is of priority. It would be also nice if we only have one file that does the both things for us. We can think of using tools like asv (airspeed velocity). It is a tool for benchmarking Python packages over their lifetime. I think it builds and test’s out a python package, and it also provides test suites kind of setup to profile for time and memory (few examples - here - here). This tool is also used by popular python packages like Pandas, Numpy and Scipy for benchmarking.