Whether the data set annotations after the game will be made public

Whether the data set annotations after the game will be made public  

  By: chihuo on Aug. 17, 2022, 1:08 p.m.

Hello, may I ask whether the results of the test and validation sets can still be submitted for public ranking after the MICCAI competition? Just like the ANHIR competition, we hope to continue to optimize our algorithm for more people to see in the future. At the same time, could you please tell me the labeling information of HE in the verification set and test set after the competition? best, chihuo

Re: Whether the data set annotations after the game will be made public  

  By: phiewe on Aug. 18, 2022, 7:40 a.m.

Hi,

thank you for your interest in this challenge.

We plan to open a validation and test set submission system for automatic evaluation that enables algorithm testing even after the challenge end. This will become available probably some time during October. We plan to continue to allow 2 submissions per day for the validation data and will discuss at the MICCAI challenge what participants think would be a good approach for the test set.

Target image landmarks will not be made publicly available for either data set, all evaluations will have to happen through the submission system on this website in order to ensure that future results remain comparable to the challenge results. If you would like to perform some specific analysis for a publication, we are happy to help in computing additional metrics etc.

Best wishes Philippe Weitz, Masi Valkonen, Leslie Solorzano