MONKEY challenge: Detection of inflammation in kidney biopsies Banner

Questions about the Debugging Leaderboard

Questions about the Debugging Leaderboard ¶

By: wildsquirrel on Oct. 24, 2024, 1:43 p.m.

Hi,

Could you clarify if FROC score is calculated for debugging leaderboard? Also I see that my algorithm was only tested with 2 images, Is this normal?

Thank you.

Last edited by: wildsquirrel on Oct. 24, 2024, 1:47 p.m., edited 1 time in total.

Re: Questions about the Debugging Leaderboard ¶

By: LindaSt on Oct. 25, 2024, 9:42 a.m.

Hi!

The debugging phase runs the inference with your container and then the evaluation on two images from the training set. It is just for you to see the logging report of the output. We cannot open the logs on the live leaderboard phase with the validation dataset, as this could cause data leakage. As soon as you have a container that successfully completes the debugging phase, submit it to the live leaderboard phase to see the results.

Hope that clears things up :)