How to document?
Upload a public test case¶
An image is worth a thousand words. Hence we consider it best practice to upload at least one test case and make it public. To have a case with a result visible to the public, you should have a case with a Successful run of the last container available in your Results. To make a successful particular run visible to the public, firstly, navigate to the "View result details" by clicking on "i" icon. Secondly, click on the "Edit this Result" button. Thirdly, check the "Public" box and press "Save".
Write a documentation page¶
Good documentation will ensure proper usage of your Algorithm. So here is a small overview of the recommended documentation. We also created a documentation example further down the page.
Recommended documentation
Contact information¶
For public Algorithms, we'd like you to add contact information in case users need to get in touch:
- Email address
- Link to publication (recommended)
Description¶
For the user to make optimal use of the developed model, a description is desired. This can be done in approximately 5-10 sentences containing the following information:
- Task of the model
- The type of network the model is based on
- The input the model requires
- Target group
Mechanism¶
This section should give a precise description of the in- and output data. Optionally, a description of the model could be added.
Validation and performance¶
This section is for a description of method validation and performance. Include some metrics, and perhaps some visual results. Also, describe the ground truth/reference standard that you used to test and optimize your method.
Warnings¶
This section contains important background information to keep in mind for the user when using this algorithm.
Common errors and solutions¶
If your algorithm is prone to certain errors that are easily solvable with a small change, please provide the error and its solution so users don't have to contact the developer for common errors.
Example documentation
Contact information¶
- _Name of the model: _Segmentation of cysts in the pancreas
- _ Last edited:__ 2021-09-09_
- Email address:_ fakeemailadres@source.com_
- Associated publications: Doe John, Doe Jane, et al.. Deep learning-based cyst detection and segmentation in MRI. Transactions in Medical Image Analysis. 2022;11:11111.
Description¶
This model first detects cysts based on the probability of the presence of cysts. Above a certain threshold of probability, it segments the cysts. The model requires a DICOM MR image as input and creates a probability map and segmentation mask as output. The model is based on nnUnet.
Mechanism¶
Input:
- Datatype:_ Coronal MR image of the thorax_
- File format:_ DICOM image of size (512, 512, 3)_
- Target group:_ Patients older than 18 and younger than 95_
Output:
- Results:_ Probability between 0 and 1 stating the possibility of a cyst being present in the pancreas_
- Type of image output:_ Probability map with a heat map color-coding that indicates which regions in the image were influential to the prediction of the model: colder (blue-green) and warmer (yellow-red) colors respectively indicate low and high probability regions_
Validation and performance¶
Ground truth: Manually segmentation by experienced radiologist at the Radboudumc, Nijmegen
Validation set:
Description | Size | Source | Date | Performance metric | Performance |
---|---|---|---|---|---|
Coronal MR thorax images | 90 images | University Medical Center Utrecht, Utrecht | Between 2010-2014 | AUC | 0.96 |
Test set:
Description | Size | Source | Date | Performance metric | Performance |
---|---|---|---|---|---|
Coronal MR thorax images | 100 images | Leiden University Medical Center, Leiden | Between 2009-2012 | AUC | 0.89 |
Warnings¶
This algorithm was developed for research purposes only. Please be aware that the uploaded images and results will be visible to the owner of the algorithm. Make sure to properly anonymize your data before you consider uploading.