Challenge Policy & Pricing

Join a thriving community

With an active user base of over 100.000+ medical imaging researchers and professionals worldwide, and 350+ hosted Challenges, Grand Challenge is a seasoned platform, providing a reservoir of experience in orchestrating and hosting challenges.

Stop worrying about the infrastructure

Your challenge is always accessible, worldwide, 24/7

Your data is securely stored and is encrypted both at rest and in transit

Submitted algorithms are effortlessly run in a secure, fortified environment. These environments are tested and reviewed: they go well beyond relying on the container boundaries

Challenge submissions are evaluated on demand and at scale, with metrics appearing on your live leaderboard automatically, without you having to lift a finger

You provide the data and focus on the innovation!

We provide the rest:

Robust tools for user management

Including cheating detection and account verification, to ensure a fair challenge competition

Discussion forums and a direct messaging service

Stay connected with your participants

Long-term impact

Ensure lasting impact with persistent algorithm solutions. Algorithms submitted to the challenge remain easily accessible to clinicians and researchers beyond the challenge

A highly scalable compute infrastructure tailored to the needs of your challenge

Choose from a range of GPU and memory options, enforce time limits for participants' solutions and get insights into computation metrics

Automated evaluation

Bring your own code to evaluate and rank submissions to your challenge, giving you complete freedom of judging.

Real-time leaderboards

Keep participants motivated by providing timely feedback on their algorithm's performance

Setting up a challenge has never been easier!

You benefit from:

Expert guidance

Receive expert review and advice on setting up a successful challenge

Personalized onboarding

Meet with our technical team and get custom-tailored templates to get you started quickly

Dedicated support

Benefit from direct support for the duration of your challenge

Peace of mind

We guarantee that your challenge will run smoothly, with submissions evaluated promptly and securely

What do we ask in return?

Contribution in costs

At Grand Challenge, we are committed to maintaining and continuously enhancing our platform to serve the research community effectively. Therefore, we ask organizers of challenges to contribute towards both the costs associated with running the challenge as well as the open-source development of the platform.

The base contribution of 6000 Euros covers a maximum of 1000 Euros in compute and storage and is further used to fund platform maintenance, development and support to keep your challenge running both short and long-term. This base contribution will be invoiced up-front and is non-refundable.

Capacity reservation covers compute resources and storage beyond the €1,000 included in the base contribution. The required reservation is estimated and agreed with you during the challenge request review process. This reservation is used solely to define the maximum budget for your challenge and will not be invoiced in advance. After the challenge has concluded, a separate invoice will be issued for the actual compute and storage costs incurred. These additional charges are rounded up to the nearest €250. Any unused portion of the reserved capacity will not be invoiced.

The base cost covers only a single edition of a challenge. If a challenge is repeated (i.e. a subsequent edition is hosted, whether identical or with minor modifications), the base cost will apply to each edition.

We realize that a lot of our users are academics and might have limited funding available. We are open to long-term partnerships with academic institutions, research groups, and other organizations, e.g., conferences, interested in using grand-challenge.org to run challenges, to jointly further develop and maintain grand-challenge.org. Contact us to discuss the options.

Promote reproducible, transparent and secure science

To ensure that challenge results are fair, reproducible, and reliable, all challenges hosted on our platform must meet the following requirements:

Each task must include an algorithm-based final phase. Prediction-based phases alone do not provide the objective and reproducible evaluation that we aim to support.
The evaluation of algorithm results must be performed on-platform, ensuring a fair and reproducible leaderboard.

If you have concerns or questions about meeting these requirements, please contact us — we are happy to work with you to find solutions.