Question about time limit

Question about time limit  

  By: Vison307 on June 6, 2024, 11:50 a.m.

The grand challenge documentation said the "Runtime Is Set By The Phase", I am wondering what is the time limit for the validation/test phase?

Besides, since the sanity check/validation/test phase has different number of WSIs, will an algorithm that meets the time limit in the sanity check/validation phase be overtime in the test phase?

Re: Question about time limit  

  By: Vison307 on June 8, 2024, 2:18 a.m.

I found the time limit (30min) is set for per case in sanity check. Thanks for the clarification

Re: Question about time limit  

  By: KhrystynaFaryna on June 10, 2024, 7:05 a.m.

Apologies for the late reply. You are right - the time limit is set to 30 min per case. Please reach out in case of any other questions.

Re: Question about time limit  

  By: KhrystynaFaryna on June 10, 2024, 8:13 a.m.

One more thing to mention is that during inference on the grand-challenge platform, a separate instance is launched for each case in a test/validation set. The 30 minutes is a strict maximum limit for each case separately.