Request for Prelim Test Sample Distribution and AP Values to Identify Submission Discrepancies

Dear SurgToolLoc 2023 Organizing Committee, Can you please provide the distribution of prelim test samples for each class and confirm if all 14 classes are included? Can you also provide the AP values for each class in the test results? We have made three submissions in total. In the first submission, the mAP was 0.192 in local testing and 0.2114 in platform testing. In the second submission, the local testing resulted in 0.400 mAP, while the platform testing showed 0.3126 mAP. The third time was similar to the second time. The local and platform test results significantly differ in the second and third submission, and we would like to know the sample distribution and AP values for each class in the platform test set to identify the problem.

Hi Yaojun,

We are happy to provide some basic statistics about the preliminary testing set, but are unable to provide AP values for each class during testing runs. We will post these shortly in a new thread to make sure they are visible to all competitors.

Thanks,

SurgToolLoc Organizing Committee