Validation data

Validation data  

  By: wan77pc on June 5, 2023, 3:43 a.m.

Hello,

I didn't find a way to download the validation dataset, only validation submission phase. Can I only verify after submitting the algorithm?

Thank you

Re: Validation data  

  By: cweiwang on June 5, 2023, 6:19 a.m.

Thank you for your question.

To ensure fairness to all participants. The grand-challenge platform only required your algorithm docker image to be uploaded onto the system and will run on the cloud to infer the unseen "validation" and "testing" dataset. So, it is not necessary to download the validation and testing dataset.

We hope our answer clarifies your issue.

Re: Validation data  

  By: wan77pc on June 6, 2023, 4 a.m.

Thank you for your relpy.

I understand the validation method. If so, I want to verify the results on the training dataset. I know the evaluation criterias are Success Detection Rate (%) (<2mm) and MRE, but I'm worried the Metrics implemented by myself is different from that in the leaderboards. So could you please upload the evaluation Metrics code? Just the evaluation Metrics code is ok. I can calculate the result in the training dataset.

Thank you!

Metrics Implementation  

  By: jeremyzhang on June 16, 2023, 5:02 p.m.

Hello wan77pc,

You can refer to the metrics implementation in the official code repository I provided, which can be accessed in this link: szuboy/CL-Detection2023.