Challenge Policy & Pricing

Join a thriving community

With an active user base of over 100.000+ medical imaging researchers and professionals worldwide, and 350+ hosted Challenges, Grand Challenge is a seasoned platform, providing a reservoir of experience in orchestrating and hosting challenges.

Stop worrying about the infrastructure

Your challenge is always accessible, worldwide, 24/7

Your data is securely stored and is encrypted both at rest and in transit

Submitted algorithms are effortlessly run in a secure, fortified environment. These environments are tested and reviewed: they go well beyond relying on the container boundaries

Challenge submissions are evaluated on demand and at scale, with metrics appearing on your live leaderboard automatically, without you having to lift a finger

You provide the data and focus on the innovation!

We provide the rest:

Robust tools for user management

Including cheating detection and account verification, to ensure a fair challenge competition

Discussion forums and a direct messaging service

Stay connected with your participants

Long-term impact

Ensure lasting impact with persistent algorithm solutions. Algorithms submitted to the challenge remain easily accessible to clinicians and researchers beyond the challenge

A highly scalable compute infrastructure tailored to the needs of your challenge

Choose from a range of GPU and memory options, enforce time limits for participants' solutions and get insights into computation metrics

Automated evaluation

Bring your own code to evaluate and rank submissions to your challenge, giving you complete freedom of judging.

Real-time leaderboards

Keep participants motivated by providing timely feedback on their algorithm's performance

Setting up a challenge has never been easier!

You benefit from:

Expert guidance

Receive expert review and advice on setting up a successful challenge

Personalized onboarding

Meet with our technical team and get custom-tailored templates to get you started quickly

Dedicated support

Benefit from direct support for the duration of your challenge

Peace of mind

We guarantee that your challenge will run smoothly, with submissions evaluated promptly and securely

What do we ask in return?

Contribution in costs

At Grand Challenge, we are committed to maintaining and continuously enhancing our platform to serve the research community effectively. Therefore, we ask organizers of challenges to contribute towards both the costs associated with running the challenge as well as the open-source development of the platform.

The base contribution of €6,000 covers a maximum of €1,000 in compute and storage and is further used to fund platform maintenance, development and support to keep your challenge running both short and long-term. This base contribution will be invoiced up-front and is completely non-refundable.

Capacity reservation covers compute resources and storage beyond the €1,000 already included in the base contribution. The required reservation is estimated and agreed upon with you during the challenge request review process.

This capacity reservation is used solely to define the maximum budget for your challenge and will not be invoiced up front. Rather on a pre-agreed follow-up date, a separate invoice will be issued for the actual compute and storage costs incurred. Note that these additional charges will be rounded up to the nearest multiple of €250. Any unused portion of the reserved capacity beyond this multiple will not be invoiced. Any unused portion up to this multiple can be used until the budget expires. For example, if the maximum additional budget is €2,000 and the actual charge is €400, an invoice of €500 will be issued, resulting in €100 of remaining budget.

By default, all invoice budgets expire 5 years after the related invoice has been created.

The base cost covers only a single edition of a challenge. If a challenge is repeated (i.e. a subsequent edition is hosted, whether identical or with minor modifications), the base cost will apply to each edition.

We realize that a lot of our users are academics and might have limited funding available. We are open to long-term partnerships with academic institutions, research groups, and other organizations, e.g., conferences, interested in using grand-challenge.org to run challenges, to jointly further develop and maintain grand-challenge.org. Contact us to discuss the options.

Promote reproducible, transparent and secure science

To ensure that challenge results are fair, reproducible, and reliable, all challenges hosted on our platform must meet the following requirements:

Each task must include an algorithm-based final phase. Prediction-based phases alone do not provide the objective and reproducible evaluation that we aim to support.
The evaluation of algorithm results must be performed on-platform, ensuring a fair and reproducible leaderboard.

If you have concerns or questions about meeting these requirements, please contact us — we are happy to work with you to find solutions.