I got the error when I submit my result: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.

I got the error when I submit my result: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: ylzh on Oct. 5, 2022, 11:01 p.m.

I use team name as *.zip and the images in my zip file was equal to the proposed baseline_seg.zip file, but I still got the error.

Re: I got the error when I submit my result: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: junma on Oct. 6, 2022, 11:21 p.m.

Your zip file may have a subfold after unzipping.

Re: I got the error when I submit my result: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: ylzh on Oct. 8, 2022, 8:27 p.m.

There are only 101 segmentation result images in my result archive, no subfolders.

Re: I got the error when I submit my result: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: junma on Oct. 10, 2022, 4:27 a.m.

Since all the other submissions work well on the platform, it is probably the problem with your segmentation results.

Could you please evaluate your results with the official evaluation code? (using the baseline results as the pseudo "ground truth")

Re: I got the error when I submit my result: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: ylzh on Oct. 11, 2022, 1:16 p.m.

I evaluated my results as your said way(using the baseline results as the pseudo "ground truth"). It works. There is a F1 score after evaluating. I think your submissions evalting program may have some problem.

Re: I got the error when I submit my result: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: junma on Oct. 11, 2022, 5:46 p.m.

Each segmentation mask should have several cells with the label id 1,2,3,4,...

However, many of your segmentation results are empty.

a = tif.imread('cell_00063_label.tiff')

np.max(a) 0

 Last edited by: junma on Aug. 15, 2023, 12:57 p.m., edited 1 time in total.

Re: I got the error when I submit my result: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: ylzh on Oct. 11, 2022, 5:58 p.m.

Ok, I think you are right. Because the predict restults are analysied, and I found the the same reason as you said. Thank you!