Create Phases¶
Define and configure the different phases of your challenge. In the simplest setup, a challenge consists of one task and two phases:
-
Preliminary Phase
This phase allows participants to familiarize themselves with the platform and test their algorithm submissions on a small subset of data. Experience shows that participants often need several attempts to get their containerized algorithms running correctly, so we strongly recommend including this phase as a "sanity check." -
Final Test Phase
This phase evaluates the submitted algorithms on the full test set. It typically allows only a few submissions and determines the final leaderboard ranking. This phase can also serve as a final qualification round, where only teams that passed the preliminary phase can participate.
Be sure to review and configure the full phase settings, including:
- Submission start and end dates
- Submission limits per participant
- Phase visibility and scoring options
Deadline: 1 week post-challenge acceptance
Multiple Phases, Multiple Leaderboards¶
While most challenges include a preliminary and a final test phase, you can add as many phases as needed. Common use cases include:
- Splitting your challenge into different tasks (e.g., segmentation vs. classification)
- Introducing a qualification phase followed by a final phase
- Running a post-challenge evaluation or rerun
Each phase has its own submission workflow, evaluation container, and leaderboard.
To add a phase:
- Go to Admin
- Under Phases, click Add a new Phase
- Configure its settings using the available links
Be sure to:
- Define submission windows using start and end dates
- Set submission limits
- Customize scoring and leaderboard visibility
⚠️ Note: If no start or end dates are set, submissions will be accepted indefinitely as long as the submission limit is above 0.
Challenges that effectively use multiple phases include: