Error in Mean Position Calculation on Final Leaderboard

Error in Mean Position Calculation on Final Leaderboard  

  By: Janez on Aug. 29, 2023, 11:05 a.m.

Hi , I wanted to bring to your attention an issue I noticed on the final leaderboard regarding the calculation of the mean position.

As you can see in the attached image, there appear to be discrepancies in the calculation of the mean position. While a total of 17 metrics have been taken into account, I observed that the AR-diagnosis metric is missing from the mean position calculation. Additionally, both AP-mean(aggregate) and AR-mean(aggregate) seem to have been calculated twice.

I kindly request the organizers to review this matter and make the necessary corrections as needed. Your attention to this concern would be greatly appreciated.

Best regards,

Re: Error in Mean Position Calculation on Final Leaderboard  

  By: sezginer on Aug. 31, 2023, 9:57 a.m.

Hi @Janez,

Thank you very much for your inquiry. We are aware of that, and we will calculate the scores manually to determine the final ranking.

Best, Sezgin