Baseline & Metric Example

Baseline & Metric Example  

  By: ZhengJintu on April 15, 2024, 6 a.m.

Is there any baseline code or metric example provided for task2?

Re: Baseline & Metric Example  

  By: YSang on April 15, 2024, 7:41 a.m.

We plan to release a sample Docker container in May, prior to the submission period. Please expect it to be a dummy method that only shows you how to handle the IO operations. For code related to encoding and decoding segmentation results, please refer to the Zenodo repository, which is available now.

Re: Baseline & Metric Example  

  By: mzenk on June 13, 2024, 7:15 a.m.

Hi, thanks for the nice challenge so far! I was wondering about the PENGWIN_3D_organizer_sanitycheck submission on the three validation set cases: Is this an official baseline that is publicly available? I guess it is not the dummy model the organizers provided here, as the metric values seem to be too good for that.

Re: Baseline & Metric Example  

  By: YSang on June 14, 2024, 1:35 a.m.

Thank you for checking with me. This submission, however, is only used to test if the metric values are reasonable. It is not a real algorithm as it merely pastes locally generated results to the platform as outputs.

But as a tip, a pre-trained model with CTPlevic1K can be a good starting point to work with. https://github.com/MIRACLE-Center/CTPelvic1K

Re: Baseline & Metric Example  

  By: mzenk on June 14, 2024, 6:59 a.m.

Ok, thanks for the clarification and the tip!