Offline benchmark code for OC22 leaderboard

Sorry if I missed something. We’re trying to test our model in the same way that OC22 leaderboard shows. Unfortunately, I failed to find relevant tutorial, but have to upload leaderboard cite. How to run the same test, as the leaderboard, in offline?

Thanks for the support.

Hi,

To evaluate your model on the OC22 test set you need to submit you test predictions to our EvalAI server https://eval.ai/web/challenges/challenge-page/1869/overview (you can keep your submission private). Instructions on how to make the predictions files can be found here and instructions on how to submit your predictions can be found here.

One other import note is that we are currently in the process of migrating our evaluation server, so if you make a submission please reach out and let us know and we will evaluate it.

Best,
Brandon