What is the final evaluation metric?

Hi, OCP team!
Which metric will be the key to sort the final leaderboard?
Besides, you know, there are 4 subsets for evaluation, which subset will be used for leaderboard?
Thanks in advance for your reply!

Winners will be selected based off the average energy MAE of all 4 splits.

1 Like

Hi OCP-team!

Could you please specify how average MAE is calculated?

  1. Average for all 4 datasets
  2. Average of MAE of datasets

Thanks in advance for your reply!

1 Like

We’ll be computing it via (2). Since the splits are approximately equal (1) should give something similar.