Sanity Check Submission Failure

Sanity Check Submission Failure  

  By: AdamFarrag on May 21, 2025, 6:16 a.m.

Dear LUNA25 organizing team,

I am trying to submit an algorithm to the sanity check phase, however, it seems to be failing with the error The algorithm failed on one or more cases.. Running the inference file and the do_test_run script works fine locally, so I am unsure where the issue lies. Would it be possible to access the logs and errors only for the sanity check phase? I understand this is not possible for the open development phase, but it would be very useful for fixing bugs in order to pass the sanity check phase.

Thanks in advance!

-Adam

 Last edited by: AdamFarrag on May 21, 2025, 6:18 a.m., edited 2 times in total.

Re: Sanity Check Submission Failure  

  By: bogdanobreja on May 21, 2025, 7:50 a.m.

Dear Adam,

This is the error we are seeing on our side: "Time limit exceeded". So the runtime of your algorithm exceeds the 5 minutes time limit.

Hope this helps.

Kind Regards, Bogdan.

Re: Sanity Check Submission Failure  

  By: pvlima on May 27, 2025, 9:23 p.m.

Dear Bogdan,

The same just happened to me and I do not know exactly what the problem is. Is there an easier way to access the logs?

Best Regards, Pedro Lima

Re: Sanity Check Submission Failure  

  By: bogdanobreja on May 28, 2025, 7:52 a.m.

Dear Pedro,

This is the error that we see on our side: "Output file 'lung-nodule-malginancy-likelihoods.json' was not produced".

Hope this helps!

Kind Regards, Bogdan.