Same Test Video Github and Prelim?

Is the Prelim Submission for Category 2 testing on the same video that was given as the sample in Github?

I have been getting a much lower mAP on this submission that I am getting on the sample video and other videos that I tested on, that is why I am asking.

Thanks!

Hello! Actually is it posible to get the ground truth labels for a couple of the frames in the test video? I am getting a better accuracy in my algorithm when run locally, so I want to double-check if my formatting for the box coordinates is correct,

Thanks!

Hi savigopal3,

Unfortunately it might not be possible to provide ground truth for any video frames at this time as we are nearing the end of the submission phase. There were some bugs in the evaluation container as well which were fixed and announced on the website forum - just an fyi in case you have not made a submission after those changes.

Best, SurgToolLoc 2022 Organizing Committee