Important Announcement: Algorithm Tuning Phase and Final Test Phase ¶
By: royakhajavi on Aug. 7, 2023, 7:34 a.m.
The final Test Phase of the LNQ challenge (Phase 3) will require participants to submit their algorithm containers. This is different from Phase 1 where the submissions were predictions. To facilitate a smooth understanding of the algorithm submission procedure, we've introduced an additional stage for Algorithm Tuning (Phase 2) which will be opened for submission starting on August 8. This stage allows participants to dockerize and submit their algorithm, ensuring its efficient operation. The data used for algorithm tuning in Phase 2 will be identical to that used in Phase 1, which includes 20 validation data cases. Each participant will be allowed a maximum of five submissions in Phase 2 to ensure their Docker-packaged algorithm is working as intended. Both Phases 1 and 2 will be kept open for submission until August 30.
The submission window for the Test Phase (Phase 3) commences on August 31 and concludes on September 20. During this phase, participants will submit their final algorithm that will be used for the final scoring. Please note that there is a limit of one submission per participant in this phase.
The code for the baseline algorithm and evaluation code for the LNQ challenge is provided here: https://github.com/LymphNodeQuantification/LNQ2023
Participants need to change and replace the content of the predict function
with their prediction code. Please make sure that the return type for this function stays as SimpleITK.Image
object.
More information on algorithm submission is available here: https://grand-challenge.org/documentation/making-a-challenge-submission/
As you might have noticed, we have updated the challenge timeline and extended the deadline for both the validation and final test phases. Please let us know if you have any questions or concerns.