Prelim Category 2 evaluation container updated and submission limit extended

Hi teams,

Prelim Category 2 evaluation container has been updated to compute the evaluation metric correctly.

The submission limit per team has been extended to 15 attempts and the time limit has been extended to Monday, Aug 29th for both Prelim Category 1 and 2.

Please note that algorithm performance in the preliminary phase is a poor indicator of performance on the full test set since less than 3% of the full test set was exposed for evaluation in the preliminary phase for both challenge categories. The purpose of the preliminary phase is to ensure that your algorithm runs without errors and generates a reasonable performance metric upon evaluation.

Please refer to the Common Issues for Participants topic (https://grand-challenge.org/forums/forum/endoscopic-surgical-tool-localization-using-tool-presence-labels-663/topic/common-issues-for-participants-1167/) to understand why your algorithm might be failing and what may be done to mitigate it.

Best,

SurgToolLoc 2022 Organizing Committee

Thank you Committee.

1. Will you rescore all the task 2 existing submissions, or should we re-submit them in order to see correct scores?
2. Deadline is Monday what time, what time zone?

Best, Bo

Dear organizers,

Would you extend the deadline of Prelim Category 2 a few more days ? We're already in the weekend and it is hard to access our computational resouces during weekend.

Regards, Satoshi

@SKJP: the deadline has been extended and an announcement has been made - hope that helps!