The algorithm failed on one or more cases.

The algorithm failed on one or more cases.  

  By: KonstantinosGeorgas on June 4, 2025, 10:13 a.m.

Hello, we've got this message, when tried to submit our algorithm for the Preliminary testing created June 4, 2025, 11:31 a.m.

->   Failed The algorithm failed on one or more cases.

Can you give us a feedback about the error? Thanks! BIOMED team

Re: The algorithm failed on one or more cases.  

  By: tom-julius on June 4, 2025, 10:26 a.m.

Hello BIOMED team,

of course we are happy to help you.

In general you can find the logs for your algorithm a little hidden on the Algorithm page in the sidebar under "Results". For you this would be here:

https://grand-challenge.org/algorithms/trackradalgorithm/jobs/

Clicking on the "(i)" Button brings you to the results for your specific evaluation. And this page in turn has an "Logs" entry in the sidebar, where you can find the logs.

For your case these read here as shown here: https://docs.google.com/document/d/1Np9A1Q_CaBCLkIghyK5-Kjd5owLfHAo7QSTGnxmb-xI/edit?usp=sharing

(Please let me know once you read the file, so I can delete it again.)

If you need further help you can also email me privately at tom.bloecker@campus.lmu.de and I am happy to help you adjust your code for the platform.

Sincerely, Tom

Re: The algorithm failed on one or more cases.  

  By: KonstantinosGeorgas on June 4, 2025, 12:12 p.m.

Hello Tom, Thanks for your reply, I confirm that have read the file and we solved the error. Kostas

Re: The algorithm failed on one or more cases.  

  By: tom-julius on June 4, 2025, 12:32 p.m.

Hopefully, this is not unwanted help, but I just notice a new error log.

The problem is most likely that the file written by your algorithm does not contains floating point numbers instead of integers (uint8).

I just updated the baseline to address this pitfall here:

https://github.com/LMUK-RADONC-PHYS-RES/trackrad2025/blob/6b3dea1e0f9100645f9dea14f0b03bac7dabd8d4/baseline-algorithm/inference.py#L54

But you probably want to also change your code to cast your output to uint8.

Re: The algorithm failed on one or more cases.  

  By: tom-julius on June 7, 2025, 7:46 a.m.

Hello BIOMED team,

Apologies again for the inconvenience you experienced. I am happy to report that I was able to "fix" the issue and that your algorithm submission was successful and is now part of the leaderboard.

Future uploads by you should work immediately.

The issue arose from an update the the Grand Challenge platform about two days after the start of the preliminary testing phase. This update removed the "started_at" and "completed_at" timestamps which we where using to automatically compute the runtime of each algorithm. There will be an additional forum post with more details in a minute.

Sincerely, Tom