Create Your Own Challenge

In 2012 a team with members from five groups in medical image analysis decided to build a platform to easily set up websites for challenges in biomedical images analysis. We named our group the Consortium for Open Medical Image Computing (COMIC). We decided the platform should be developed in Python and Django, and should be open source. The code can be found on GitHub and Zenodo. If you want, you can download it and install it on your own server. is an instance of our platform. It currently runs on hardware of the Diagnostic Image Analysis Group in Radboudumc, Nijmegen, The Netherlands. More information can be found here. The tools we offer include an easy way to create a site, add and edit pages like a wiki, registration mechanisms for participants, secure ways for organizers to provide challenge data to participants and for participants to upload results, automated evaluations of uploaded results, leaderboards and ways to tabulate, sort and visualize the results.

In 2020 we will start hosting challenges where participants can upload their algorithms in the form of Docker containers, which will be applied to the test data. This way of running challenges avoids that the test data is made available to challenge participants. We have also implemented the possibility to upload algorithms that users can try out with their own data, and web-based interactive browsers that can be used for reader studies. We plan a broader roll-out of this functionality in the near future.

Host a challenge on

Host a challenge on

To host a challenge, click the link above. Most should be self-explanatory. You can also consult the docs.

You are most welcome to help us further develop and extend the grand-challenge platform. You can use the bug/issue tracker and code repository on github, and create a new issue there.

If you just want to have your challenge listed on the overview on the Challenges page and you run your challenge on your own site, mail to with the details and we'll list your challenge.