Preliminary test submission failing

Hi, our algorithm is passing without error when we test using "try out algorithm" option. However, when I submit for preliminary test phase it when into "evaluating algorithm" mode and then failed. I am guessing that model execution is exceeding the time limit .I am not able to see logs to troubleshoot. i would appreciate if you can help me in this regard

Thanks

Hi!

We have reached out for the grand-challenge support and will come back to you as soon as possible.

Thanks for participating Marcel

Hi,

indeed, the submission is exceeding the time limit. Can you try removing all time-costly parts so we can verify that your submission routine works properly? (I.e return an empy segmentation)

Hi,

Thanks for your reply. I did remove most of the algorithmic parts and updated the algorithm. It is taking 10 minutes in test try out. But in challenge submission it gave "Tolerance: 1.0000000e-06" this error.

Hi, it looks like your algorithm changes the orientation of the scan. This is the error message:

RuntimeError: Exception thrown in SimpleITK LabelOverlapMeasuresImageFilter_Execute: /tmp/SimpleITK-build/ITK-prefix/include/ITK-5.2/itkImageToImageFilter.hxx:220: 2022-07-02T18:53:22.336000+00:00 ITK ERROR: LabelOverlapMeasuresImageFilter(0x55707562ed30): Inputs do not occupy the same physical space! 2022-07-02T18:53:22.336000+00:00 InputImage Origin: [-4.0669400e+02, 2.0544357e+02, -1.1545000e+03], InputImage_1 Origin: [0.0000000e+00, 0.0000000e+00, 0.0000000e+00] 2022-07-02T18:53:22.336000+00:00 Tolerance: 2.0364201e-06 2022-07-02T18:53:22.336000+00:00 InputImage Spacing: [2.0364201e+00, 2.0364201e+00, 3.0000000e+00], InputImage_1 Spacing: [1.0000000e+00, 1.0000000e+00, 1.0000000e+00] 2022-07-02T18:53:22.336000+00:00 Tolerance: 2.0364201e-06 2022-07-02T18:53:22.336000+00:00 InputImage Direction: 1.0000000e+00 0.0000000e+00 0.0000000e+00 2022-07-02T18:53:22.336000+00:00 0.0000000e+00 -1.0000000e+00 0.0000000e+00 2022-07-02T18:53:22.336000+00:00 0.0000000e+00 0.0000000e+00 1.0000000e+00 2022-07-02T18:53:22.336000+00:00 , InputImage_1 Direction: 1.0000000e+00 0.0000000e+00 0.0000000e+00 2022-07-02T18:53:22.336000+00:00 0.0000000e+00 1.0000000e+00 0.0000000e+00 2022-07-02T18:53:22.336000+00:00 0.0000000e+00 0.0000000e+00 1.0000000e+00 2022-07-02T18:53:22.336000+00:00 2022-07-02T18:53:22.336000+00:00 Tolerance: 1.0000000e-06

Hi,

Our submission is failing in final submission, which passed in preliminary test cases. Can you please let me know what is the cause of failure.

Thanks,