Skip to content

Commit

Permalink
Add timings for demo runs.
Browse files Browse the repository at this point in the history
  • Loading branch information
mzenk committed Jan 15, 2025
1 parent 0172e50 commit dc02abd
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 3 deletions.
5 changes: 3 additions & 2 deletions Task_1/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,8 +34,9 @@ Please ask any additional questions in our discussion pages on our github site a
10. ```pip install .```
> * _Note: if you run into ```ERROR: Failed building wheel for SimpleITK```, try running ```pip install SimpleITK --only-binary :all:``` then rerunning ```pip install .```_
10. ```python FeTS_Challenge.py```
> * _Note: if you run into ```ImportError: /home/locolinux/FETS2024/fets2024env/bin/../lib/libstdc++.so.6: version GLIBCXX_3.4.30' not found (required by /home/locolinux/FETS2024/fets2024env/lib/python3.7/site-packages/SimpleITK/_SimpleITK.so)```, try installing a previous version of SimpleITK (version 2.2.0 works)
11. All lower-level details are in the [FeTS Challenge python file](./FeTS_Challenge.py)
> * _Note_: if you run into ```ImportError: /home/locolinux/FETS2024/fets2024env/bin/../lib/libstdc++.so.6: version GLIBCXX_3.4.30' not found (required by /home/locolinux/FETS2024/fets2024env/lib/python3.7/site-packages/SimpleITK/_SimpleITK.so)```, try installing a previous version of SimpleITK (version 2.2.0 works)
> * With the default configuration (a demo that does short training on a small split subset) training will run about 6h without GPU and inference will take roughly 8h.
11. All lower-level details on how to adapt the aggregation function and other FL components in the template are in the [FeTS Challenge python file](./FeTS_Challenge.py)
12. To view intermediate results with TensorBoard during training, you can run the following command: ```tensorboard --logdir ~/.local/workspace/logs/tensorboard```
## Time to Convergence Metric (formerly "communication cost")
Expand Down
2 changes: 1 addition & 1 deletion Task_2/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ It is possible to run the official evaluation pipeline on toy test cases for san
```
medperf --log=debug --no-cleanup --platform=docker test -b 1
```
Above will run the toy model defined in this [folder](mlcubes/model/mlcube/). To use your own, local model (created using the template [over here](mlcubes/model)), please specify its path with -m:
Above will run the toy model defined in this [folder](mlcubes/model/mlcube/), which will take about 1:30min excluding download time of docker containers (about 34 GB). To use your own, local model (created using the template [over here](mlcubes/model)), please specify its path with -m:
```
MODEL_PATH=/path/to/local/mlcube/folder
medperf --log=debug --no-cleanup test -b 1 -m $MODEL_PATH
Expand Down

0 comments on commit dc02abd

Please sign in to comment.