Type 1 challenge setup

A Type 1 challenge is where the training data (including ground truth) and testing data (excluding ground truth) are made publicly available. The ground truth files for testing data are kept secret. Participants are expected to upload predictions of the publicly available testing data, and grand challenge automatically evaluates the predictions by comparing them with the secret labels.

Type 1 is the default setup for all challenges in grand-challenge.org. The flowchart below visualizes the steps which you as an organizer need to take after your type 1 challenge has been accepted. For more information on these steps, check out our individual pages for finding a hosting platform and building an evaluation container.