Dear participant,

Once again, we have been alerted to an error in our evaluation pipeline for calculating SSIM. To compute SSIM, we shift the image intensities so that there are no negative values, and we apply the mask (setting everything outside the mask to -1024). Then we return the SSIM map (one value per voxel) and calculate the average within the mask. The final implementation can be found here. The metrics are now final and will not be changed.

The process of re-evaluating all validation submissions has been scheduled for Monday July 17th. Note that until then, all submissions made before Friday July 14th, 11:30am CET will show the SSIM according to the previous implementation. Once the results are in, I will provide an update on the impact of the change.

Be sure to analyze your validation submissions in detail before submitting your final method to the test phase. Note that the validation phase will remain open until the test phase closes, so you will be able to resubmit to validation phase. Good luck to everyone in the next phase!

Best, Evi & SynthRAD Organizers