evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.

evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: junma on Aug. 22, 2022, 3:30 p.m.

Dear grand-challenge,

I got the following error during online evaluation. I'm sure that the submitted image names are the same as the ground-truth names. What are the possible resaons of this error?

08-22T14:52:41.737000+00:00 Traceback (most recent call last):
2022-08-22T14:52:41.737000+00:00 File "/usr/local/lib/python3.9/runpy.py", line 197, in runmoduleasmain
2022-08-22T14:52:41.737000+00:00 return runcode(code, mainglobals, None,
2022-08-22T14:52:41.737000+00:00 File "/usr/local/lib/python3.9/runpy.py", line 87, in _run
code
2022-08-22T14:52:41.737000+00:00 exec(code, runglobals)
2022-08-22T14:52:41.737000+00:00 File "/opt/evaluation/evaluation.py", line 224, in [HTML_REMOVED]
2022-08-22T14:52:41.737000+00:00 Cellseg22().evaluate()
2022-08-22T14:52:41.737000+00:00 File "/home/evaluator/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 413, in evaluate
2022-08-22T14:52:41.737000+00:00 self.validate()
2022-08-22T14:52:41.737000+00:00 File "/home/evaluator/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 454, in validate
2022-08-22T14:52:41.737000+00:00 self.
validatedataframe(df=self.predictionscases)
2022-08-22T14:52:41.737000+00:00 File "/home/evaluator/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 458, in validatedata_frame
2022-08-22T14:52:41.737000+00:00 validator.validate(df=df)
2022-08-22T14:52:41.737000+00:00 File "/home/evaluator/.local/lib/python3.9/site-packages/evalutils/validators.py", line 66, in validate
2022-08-22T14:52:41.737000+00:00 raise ValidationError(
2022-08-22T14:52:41.737000+00:00 evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.

Re: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: amickan on Aug. 25, 2022, 5:31 a.m.

The error suggests that you have duplicate images either in your predictions or in your ground truth.