evaluation failure

evaluation failure  

  By: yanwuxu on June 24, 2021, 10:42 p.m.

Hi,

I orgnized my label file as the given tree structure, but it returned the error 'Failed evalutils.exceptions.ValidationError: The images are not unique, please submit a unique image for each case.'

Is there any other detail that I ignored?

Re: evaluation failure  

  By: reubendo on June 28, 2021, 1:02 p.m.

Hi,

Before running the evaluation, tests are performed using evalutils. Specifically, the evaluation starts if the number of submitted images is correct (32 - see NumberOfCasesValidator) and the images are unique in terms of filename (see UniquePathIndicesValidator) and content (see UniqueImagesValidator).

Regards, Reuben

Re: evaluation failure  

  By: guran765965810 on July 30, 2021, 6:49 a.m.

I met the same problem, and I am sure I offering the correct images for validation, but I always encourntered the problem : ( . Shall anyone provide more details about how to solve it?

Re: evaluation failure  

  By: reubendo on July 30, 2021, 10:48 a.m.

Hi,

As outlined below, the images must be unique in terms of filename (see UniquePathIndicesValidator) and content (see UniqueImagesValidator). Please ensure that each prediction is unique. For example, please check that you don't have two "empty" predictions.

Regards, Reuben