IndexError: index -1 is out of bounds for axis 0 with size 0

I submitted a model to sanity check phase - however i got this error, despite inference stage was accomplished successfully and acquiring detection maps. I can not view logs of evaluation step. How can I check?

Hello,

I will check this error for you and let you know.

Thank you, I am looking forward to it.

It has been 2 days and 15 hours.

Hello,

We have identified the error which was a bug in the picai_eval pipeline. The bug is now fixed but unfortunately I'm currently out of office and will only be able to upload a new validation container to Grand Challenge on Tuesday. In the meantime you could try submitting to the tuning leaderboard. Since the validation set is a lot larger it's less likely this error will occur. I'm sorry for the inconvenience. Please also note that the challenge dead line has been extended to the end of November, as announced in the challenge homepage.

Thank you for understanding and please let me know if you have any other questions.

Regards,

Natália Alves

Hello,

Thank you so much both clarification and for letting me know. I am glad the challenge has been extended. 🙏

Hello,

I have tried tuning phase, but got the error: The algorithm failed on one or more cases. Is there a way to check out the logs?

Hello,

The logs show that the cases was predicted successfully but the job exceeded the time limit before it could complete. One reason for this could be using double precision instead of single precision for the output detection map.

Regards,

Natalia Alves

Hello,

I have updated the evaluation container for the Sanity Check phase and re-evaluated your submission. You can find the result in the Sanity Check Leaderboard. Please let me know if you have any other questions.

Regards,

Natália Alves