Leaderboard coming Feb. 9th

We’re planning to launch the leaderboard around Feb. 9th! After we make some minor updates to the test set, we plan to open it up on EvalAI for uploading submissions.

The number of submissions per team will be limited. This is for two reasons: 1) reduce overfitting to the test set, 2) to evaluate the IS2RS task, we will be running DFT calculations, which are expensive.

We’ll be posting full directions closer to the launch date. If you have any questions, please let us know!

Open Catalyst Team

3 Likes

is there a prize-money?

Sorry, no prize money :slightly_smiling_face:

The leaderboard is to ensure fair comparisons between approaches are made (especially in academic papers). This way we can better understand their relative strengths.

Larry

1 Like