ci(l2): automate flamegraph tests

[dsocolobsky]

Motivation

We want to generate flamegraphs both for ethrex and for reth on each push to main, and then be able to view them in github pages or similar.

You can see the flamegraphs at https://lambdaclass.github.io/ethrex/

Description

• Github workflow for generating the flamegraphs and deploying the .svg files to Github Pages
• The ethrex_l2CLI was modified to be able to create a default config non-interactively with ethrex_l2 config create default --default since the interactive CLI was not working in Github CI.
• ethrex_l2 test load was modified so that it now retries when it can't connect to the server instead of failing directly, this was needed to run the test in Github CI.
• test_data/genesis-load-test.json was modified to add balance to a test account, since the tests were failing sometimes otherwise.
• You can run make flamegraph locally to run the same scripts locally to generate the Ethrex flamegraphs (not the Reth ones).

Notes

• I had to run the perf record and then inferno-collapse-perf plus inferno-flamegraph separately because of a bug in perf with Github CI where it would output garbage to the stdout instead of the actual perf data to a perf.data file.

Things that we should fix/check

• The calculated elapsed time is sometimes very short, so maybe we're calculating it wrong.
• Make sure the flamegraphs are being correctly generated, that the symbols are resolved properly. We saw some weird things where some symbols were duplicated.
• We are also calling perf script with the --no-inline option, since it takes a very long time without it, maybe we're not getting the proper data because of that.

Other possible improvements

• Reth takes a long time to compile in the CI, perhaps it can be cached or uploaded/downloaded as a binary since we only use it to run the perf test.
• Check if more things can be cached.
• Output should be more quiet since the CI logs are running very long and it's hard to debug.
• Maybe the web can be improved, We can generate .png files as preview since the .svg look cropped there.
• The Slack message can be improved by including a preview.
• scripts/flamegraph.sh and .github/scripts/flamegraph_watcher.sh and very similar and they could be merged into one, however I hardcoded some CI-paths in the latter one.

[github-actions]

+--------------------------------------------------------------------------------+-------+------+
| File                                                                           | Lines | Diff |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/cmd/ef_tests/levm/report.rs                    | 835   | -13  |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/cmd/ethrex/ethrex.rs                           | 327   | -12  |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/cmd/ethrex_l2/src/commands/config.rs           | 200   | +12  |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/cmd/ethrex_l2/src/commands/info.rs             | 116   | +27  |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/cmd/ethrex_l2/src/commands/test.rs             | 168   | +21  |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/cmd/ethrex_l2/src/commands/wallet.rs           | 627   | +61  |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/cmd/ethrex_l2/src/config.rs                    | 78    | +3   |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/cmd/ethrex_l2/src/utils/config/mod.rs          | 302   | +32  |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/crates/networking/p2p/bootnode.rs              | 40    | -8   |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/crates/networking/p2p/kademlia.rs              | 431   | -41  |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/crates/networking/p2p/rlpx/connection.rs       | 727   | -9   |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/crates/networking/p2p/rlpx/eth/transactions.rs | 285   | +5   |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/crates/networking/p2p/rlpx/frame.rs            | 127   | -4   |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/crates/networking/p2p/sync.rs                  | 586   | -11  |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/crates/networking/rpc/eth/gas_price.rs         | 346   | +222 |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/crates/networking/rpc/eth/mod.rs               | 8     | -154 |
+--------------------------------------------------------------------------------+-------+------+
| /home/runner/work/ethrex/ethrex/crates/networking/rpc/rpc.rs                   | 433   | -1   |
+--------------------------------------------------------------------------------+-------+------+

Total lines changed: +636

[fborello-lambda]

I've added a command to get the balance:

ethrex/cmd/ethrex_l2/src/commands/info.rs

Line 33 in f55c741

Balance {

and i've set the datetime to GMT-3:

ethrex/.github/workflows/flamegraph_reporter.yaml

Line 180 in f55c741

sed -i "s/{{LAST_UPDATE}}/$(TZ='Etc/GMT+3' date +'%Y-%m-%dT%H:%M:%S')/g" pages/index.html