Number of submissions

Is there any limit with the number of submissions for each team?

1 submission is allowed per day for each team member. Cheers, Reuben

Even in the evaluation period?

~~Once the evalualation periods starts, the validation phases ends.~~
The validation leaderboard will be closed on Wednesday, 10th August (11:59 pm Pacific Time).

Update: The validation leaderboard will be closed on Wednesday, 10th August (11:59 pm Pacific Time).

So the evaluation period starts on 11th August? The date on the info will be delayed.

Hello,

The evaluation phase has already started.

The submission deadline for the crossMoDA 2022 challenge is very soon (Monday 15th August - 11:59 pm Pacific Time).

Please check the submission instructions on how to: 1/ submit a short paper describing your method via the BrainLes CMT submission system; 2/ containerize your algorithm using Docker.

Some important remarks: - To access the evaluation phase, you must submit the short paper and your Docker container before Monday 15th August (11:59 pm Pacific Time). - root/sudo commands cannot be used at inference time. Please ensure that you prepare the locations of the folders with the correct permissions when building the Docker container (instructions). - NVIDIA base images must be used for Tensorflow or PyTorch models. - Only participants that joined the evaluation phase will have the opportunity to submit their methods as part of the BrainLes workshop proceedings distributed by LNCS. - The validation leaderboard will be closed on Wednesday, 10th August (11:59 pm Pacific Time). Note that another leaderboard will be opened after the announcements of the results to allow future researchers to benchmark their methods. - The top 3 ranked teams will be required to submit their training and testing codes in a Docker container for verification after the challenge submission deadline to ensure that the challenge rules have been respected.

Thank you, I saw the page. But there seem to be some issues in the proposed "run_inference.py". """ path_img = os.path.join(input_dir, 'crossmoda_{}_hrT2.nii.gz') """ But images in the validation set have name formats like "crossmoda2021_ldn_211_hrT2.nii.gz". So I'm not sure whether the names of images in the evaluation set are the same.

Hi,

Thank you for spotting this.

Please find here the new script: https://github.com/CrossMoDA/docker_submission/blob/master/src/run_inference.py

Cheers, Reuben

For the evaluation period, will we be allowed to have multiple submissions?

No, only one submission is allowed for the evaluation phase.