Submission instruction release date

Submission instruction release date  

  By: bilalUWE on July 18, 2022, 10:39 p.m.

Hi organising team,

I hope you are keeping well.

When exactly will the instruction for this competition get released? It is two weeks past the initial date, and there is still nothing on the provided competition page. Will the testing phase dates also move ahead accordingly due to this delay?

Many Thanks and Kind Regards, Bilal

 Last edited by: bilalUWE on Aug. 15, 2023, 12:56 p.m., edited 1 time in total.

Re: Submission instruction release date  

  By: NourJL on July 20, 2022, 6:47 p.m.

Dear Organisers,

How many different methods can be submitted by one team? Will we get feedback about the performance of our model once it is submitted (e.g., evaluation score on the test set)?

Best regards, NourJL

Re: Submission instruction release date  

  By: aneeqzia_isi on July 21, 2022, 12:43 a.m.

Dear bilalUWE,

We apologize for the delay in uploading submission instructions. Since we are using grand-challenge automated system for submission this time, there are a few things we were trying to figure out with grand-challenge support. The submission instructions and evaluation metrics pages have been populated now. However, the testing phase timeline stays the same. Please do note that the primary thing that teams will need to adapt to based on the instructions is just the output format. The type of outputs (classification predictions per frame for C1 and bbox predictions per frame for C2) stay the same.

Dear NourJL,

Please check out the submission instructions uploaded on the website now. Each team will only be allowed to submit one final method in the final testing phase. The preliminary testing phase is only for teams to understand the submission process and have a working algorithm container. The ground truth for the videos kept within prelimiary testing phase will be random and output metrics will not mean anything.

Best, SurgToolLoc 2022 Organizing Committee