Classification submission question

Classification submission question  

  By: jansauer on Aug. 18, 2023, 8:17 a.m.

Hi!

I've an idle question about the classification task. How exactly are the scores calculated? As we only submit the case label, I assumed the score is the accuracy and the AUC is being disregarded. However, the scores are far too granular for the 30 validation cases. How exactly are the scores for the classification calculated?

Cheers, Jan

Re: Classification submission question  

  By: luogongning on Aug. 19, 2023, 4:06 p.m.

Scores are based on the code in our GitHub's repository https://github.com/PerceptionComputingLab/TDSC-ABUS2023/tree/main/Metrics. While the validation phase has its metrics, the test phase might differ. We'll provide detailed submission requirements soon.