We’re planning to launch the leaderboard around Feb. 9th! After we make some minor updates to the test set, we plan to open it up on EvalAI for uploading submissions.
The number of submissions per team will be limited. This is for two reasons: 1) reduce overfitting to the test set, 2) to evaluate the IS2RS task, we will be running DFT calculations, which are expensive.
We’ll be posting full directions closer to the launch date. If you have any questions, please let us know!
Open Catalyst Team