Steps before submitting to L1

Steps before submitting to L1  

  By: mart.vanrijthoven on March 1, 2022, 7:33 p.m.

We made the following guide to make testing your algorithm more convenient. Furthermore, it will make it easier to assist you if there are any problems with your developed algorithm.

Please follow these steps before you submit to L1.

Step 1: Test your docker locally. When using the tiger algorithm example as a skeleton (highly recommended), you can use the test.sh. If not, please create your own test script similar to the one we provided.

Step 2: Upload your algorithm to the grand-challenge platform.

Step 3: Email the organizers that you have uploaded an algorithm. Please add us as users or editors.

Step 4: This is requested by grand-challenge due to the many images that are being uploaded. Test your uploaded algorithm with this L1 test code. This way, you don't need to upload an image.

Step 5: Check on grand-challenge that you get the expected output

Step 6: Submit your algorithm to L1

If your algorithm succeeds, you will see your results on the L1 leaderboard. If there are any problems, we will contact you via the email address used in step 3.

Best wishes, Mart

 Last edited by: mart.vanrijthoven on Aug. 15, 2023, 12:55 p.m., edited 4 times in total.
Reason: remove redundant title, add us as users/editors

Re: Steps before submitting to L1  

  By: kaczmarj on March 2, 2022, 3:40 a.m.

Hi, thank you for posting test code. I tried running that code but received an error

POST request to https://grand-challenge.org/api/v1/algorithms/jobs/ failed: {'inputs': [{'image': ['Invalid hyperlink - Object does not exist.']}, {'image': ['Invalid hyperlink - Object does not exist.']}]}

i cannot access the two urls for generic-medical-image and generic-overlay
https://grand-challenge.org/api/v1/cases/images/18a9e579-34bd-43b7-ac42-61541fb35156/ https://grand-challenge.org/api/v1/cases/images/e676fdaa-719e-4050-81b7-4724fed69c52/

could that be part of the problem?

Re: Steps before submitting to L1  

  By: mart.vanrijthoven on March 2, 2022, 8:20 a.m.

Hi Jakub Kaczmarzyk,

Thanks for notifying me. It seemed that the images were still private. I have changed the settings.

Could you please try again?

Best wishes, Mart

Re: Steps before submitting to L1  

  By: kaczmarj on March 2, 2022, 3:28 p.m.

Thank you! The test code works now. Thanks for the quick fix.