Validation and preliminary phases are now open

Validation and preliminary phases are now open  

  By: mmaspero on June 1, 2025, 7:35 p.m.

Dear participants,

Since this morning, you have been able to submit your sCT in the validation phases and your algorithms in the preliminary phases.

Please, check in https://synthrad2025.grand-challenge.org/data/ for the location of the input data for the validation, while in https://github.com/SynthRAD2025/algorithm-template, you can find instructions on how to prepare your algorithm for the test phase and try out in the preliminary phase.

Note that validation and preliminary phases will calculate only image metrics. Also, in the test phase, you will be allowed to upload only once your algorithm, so make sure you have extensively tested it in the preliminary phase.

Best of luck to you all.

If you encounter any issues with the submission, please do not hesitate to reach out. We will do our best to ensure a timely response.

Warm Regards,

Matteo On behalf of the organizers

Re: Validation and preliminary phases are now open  

  By: kgir on June 2, 2025, 2:33 p.m.

Hi, I submitted on Task1 but no score/result is shown, the status is: Succeeded, but I got this: Metrics { "results": [], "aggregates": {} }

Re: Validation and preliminary phases are now open  

  By: Valentin on June 2, 2025, 3:37 p.m.

Hi, I’m experiencing the same issue on Task2. My submission status is "Succeeded", but no score is displayed, the metrics output is: Metrics { "results": [], "aggregates": {} }

 Last edited by: Valentin on June 2, 2025, 3:37 p.m., edited 1 time in total.

Re: Validation and preliminary phases are now open  

  By: mmaspero on June 2, 2025, 7:30 p.m.

Hi both,

You have independelty provided sCT in nii.gz format. Could you please try to submit sCT in .mha format? The format and precision (voxel depth) should be the same of the input images.

N.B. I did not have tested the proposed solution myself, but the evaluation seems to stop alomost direcly before opening the first case, and this seems to support the hypothesis that something in opening the sCT is not working OK. N.N.B. previously submitted sCT in .mha went OK from our side.

The first of you two that has submitted, please answer this post.

Thanks!

Matteo

Re: Validation and preliminary phases are now open  

  By: Cedric on June 2, 2025, 8:35 p.m.

Hi Matteo,

All good, the submission with .mha files worked correctly. Thanks for the help!

Best, Cédric

 Last edited by: Cedric on June 2, 2025, 8:35 p.m., edited 1 time in total.

Re: Validation and preliminary phases are now open  

  By: mmaspero on June 2, 2025, 9:01 p.m.

Wonderful!

Thanks for the update. Case closed (for now).

Matteo