The algorithm failed on one or more cases.

Dear organizers,

My algorithm has passed the offline test with the provided "test.sh". But it failed after I submit it. Unfortunately, I can not find any error information about it.

May I ask how to solve this problem?

P.s. I have submitted some algorithms with the same way and all of them can pass the online test.

Thanks!

Hi, as far as I see, your algorithms are running properly now, also in the online system. Is this correct?

Dear organizers,

I have exactly the same issue: my container is passing the the preliminary test but failing the final submission.

How do we get more info about failures?

Thanks, Ludovic

Hi, organizers,

"Aug. 24, 2022, 12:23 a.m. Challenge Preliminary Test Set User Mugshot qqqwwwee adp Failed The algorithm failed on one or more cases."

This container has passed the offline test. However, it failed after I submitted. Could you please help me check why only this container failed?

Sincerely, Eugene

Hi,

@ludovic: "The container ran out of memory." is the error message we receive based on your submission. Can you create a new algorithm container to which you assign more memory?

@qqqwwwee, I can only find a submission for the 23rd of August. This algorithm exceeds the time limit.

Thanks for participating Marcel

Hi organizers,

May I ask how I know the max time limit?

Or could you please cancel this limit?

Regards. Eugene

Hi, the time limit is 20 min per subject. Unfortunately we cannot increase this limit. I will investigate the shapes which lead to the timeout so you can try cropping or resampling for these few subjects .

Try resampling or cropping to a max of 550-600 axial slices if necessary.

Dear organizers,

I have the same issue too, may I know what kind of error I met? Is the algorithm exceed the time limit?

ArMo: You error is: sitk::ERROR: Source image size of [ 350, 350, 287 ] does not match this image's size of [ 400, 400, 287 ]! or sitk::ERROR: Source image size of [ 343, 343, 275 ] does not match this image's size of [ 400, 400, 275 ]!

Dear organizers,

I am wondering if there is a part of images in the final test set, which have different size with the train set images' size: [400,400,H]. As is told above, some source images have the size of [350,350,287] or [343,343,275].

May I have the information of the shape of final test set?

Thank you

Hi, all volumes differ in size. Some have only 300 axial slices and some have up to 650.

Dear organizers,

I got the same error. Could you please get back to me the details of the error info?

hi, thanks for your reply what about the size of axial slices, are they all 400 * 400 ? or they are all different?

Hi, they are all different.

@junma, you algorithm is exceeding the time limit of 20 min per subject.