Predictions for Image Quality < 1

Predictions for Image Quality < 1  

  By: zs95 on July 6, 2022, 5:07 p.m.

For each slice, we get either the prediction mask for the left or the right. The algorithm will also make predictions for slices with image quality < 1, how will those predictions be treated during evaluation? Additionally, the annotation is sparse so the algorithm will also give prediction for the intermediate slices for which the annotation is missing.

Please clarify the evaluation criteria using dice score for slices with image quality < 1 or with missing annotations.

Thanks in advance.

 Last edited by: zs95 on Aug. 15, 2023, 12:56 p.m., edited 3 times in total.

Re: Predictions for Image Quality < 1  

  By: tiansong_philips on July 8, 2022, 2:58 p.m.

  • The slices with image quality < 1 will not included in the evaluation phase.
  • The annotation format of the test set is similar to that of the training set, i.e., part of the slices in the test set are labeled. During the evaluation phase, only the slices with ground-truth annotations will be used for the calculation of quantitative metrics, e.g. DSC, 95 HD. We will not specify the annotated slices in advance, therefore, participants should provide results for each slice.