evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.

evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: junma on Aug. 22, 2022, 3:30 p.m.

Dear grand-challenge,

I got the following error during online evaluation. I'm sure that the submitted image names are the same as the ground-truth names. What are the possible resaons of this error?

08-22T14:52:41.737000+00:00 Traceback (most recent call last): 2022-08-22T14:52:41.737000+00:00 File "/usr/local/lib/python3.9/runpy.py", line 197, in _run_module_as_main 2022-08-22T14:52:41.737000+00:00 return _run_code(code, main_globals, None, 2022-08-22T14:52:41.737000+00:00 File "/usr/local/lib/python3.9/runpy.py", line 87, in _run_code 2022-08-22T14:52:41.737000+00:00 exec(code, run_globals) 2022-08-22T14:52:41.737000+00:00 File "/opt/evaluation/evaluation.py", line 224, in 2022-08-22T14:52:41.737000+00:00 Cellseg22().evaluate() 2022-08-22T14:52:41.737000+00:00 File "/home/evaluator/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 413, in evaluate 2022-08-22T14:52:41.737000+00:00 self.validate() 2022-08-22T14:52:41.737000+00:00 File "/home/evaluator/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 454, in validate 2022-08-22T14:52:41.737000+00:00 self._validate_data_frame(df=self._predictions_cases) 2022-08-22T14:52:41.737000+00:00 File "/home/evaluator/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 458, in _validate_data_frame 2022-08-22T14:52:41.737000+00:00 validator.validate(df=df) 2022-08-22T14:52:41.737000+00:00 File "/home/evaluator/.local/lib/python3.9/site-packages/evalutils/validators.py", line 66, in validate 2022-08-22T14:52:41.737000+00:00 raise ValidationError( 2022-08-22T14:52:41.737000+00:00 evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.

Re: evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.  

  By: amickan on Aug. 25, 2022, 5:31 a.m.

The error suggests that you have duplicate images either in your predictions or in your ground truth.