What is the final evaluation metric?

1

Hi, OCP team!
Which metric will be the key to sort the final leaderboard?
Besides, you know, there are 4 subsets for evaluation, which subset will be used for leaderboard?
Thanks in advance for your reply!

2

Winners will be selected based off the average energy MAE of all 4 splits.

1 Like
3

Hi OCP-team!

Could you please specify how average MAE is calculated?

  1. Average for all 4 datasets
  2. Average of MAE of datasets
    i.e.
    mae_calc_formulas

Thanks in advance for your reply!

1 Like
4

We’ll be computing it via (2). Since the splits are approximately equal (1) should give something similar.

2 Likes