Skip to content

Fix evaluation metric of ogbg-molpcba

Compare
Choose a tag to compare
@weihua916 weihua916 released this 12 Aug 06:36
· 342 commits to master since this release

This release is mainly for changing the evaluation metric of ogbg-molpcba from PRC-AUC to Average Precision (AP). AP is shown to be more appropriate to summarize the non-convex nature of the Precision Recall Curve [1]. The leaderboard and our paper have been updated accordingly.

We also fix an issue and add a feature:

  • Fixed an issue for saving a large library-agnostic data object. #48
  • Added automatic version check feature so that users will get notified when the package version is outdated.

[1] Jesse Davis and Mark Goadrich. The relationship between precision-recall and roc curves. InInternational Conference on Machine Learning (ICML), pp. 233–240, 2006.