47 posts found

MICCAI 2024

18 Oct. 2024 by Miriam Groeneveld

As MICCAI 2024 has drawn to a close, we would like to take the opportunity to share some insights on this year's challenges hosted on our platform. Check out the blogpost if you want to know more about which challenges were presented at MICCAI 2024, how our platform was utilized and how we prepare for next year's event.

Read More

September 2024 Cycle Report

1 Oct. 2024 by Chris van Run and Miriam Groeneveld

Introducing Interactive Algorithms & Enhanced Signup Features! We are excited to announce a new, groundbreaking feature: interactive algorithms! This feature allows readers to use algorithms in the context of a reader study. By calling on these algorithms for assistance, you can enhance both the speed and accuracy of your annotations. We’ve also enhanced the signup process for challenges. You can now gather more detailed information from participants at the point of registration, making it easier to tailor your challenge to specific needs and ensure the best possible engagement. To dive deeper into how these new features can benefit you, check out the full details in the blog post.

Read More

Challenge Hosting Masterclass

30 Sept. 2024 by Anne Mickan and Chris van Run

Join us for a hands-on workshop to gain practical experience with setting up a challenge.

Read More

July 2024 Cycle Report

22 July 2024 by Paul K. Gerke, Anne Mickan, Ammar Ammar and Harm van Zeeland

In July we developed a new feature for Cirrus which allows editors to load registration data for images in the viewer. We included support displacement fields and affine transform registrations. These can be assigned to images using the view-content section in reader studies, archive items, or algorithms.

Read More

Summer newsletter 2024

5 July 2024 by Megan Schuurmans, Chris van Run, Daan Schouten, Khrystyna Faryna, Miriam Groeneveld and Vilma Bozgo

Welcome to the summer newsletter of Grand Challenge!

Read More

June 2024 Cycle Report

21 June 2024 by Miriam Groeneveld and Chris van Run

In this cycle, we introduced the capability to update containers and models separately for both Evaluation methods and Algorithms, streamlining and accelerating the process of updating your model or ground truth. For challenges utilizing multiple metrics, you now have the flexibility to exclude specific metrics from the ranking method while still displaying them. The Archive item detail page has been revamped, providing more information on the associated content and algorithm jobs. We also added a status page that displays the various components of grand-challenge.org and indicates if any component has issues. In our viewer, we implemented labeling and highlighting of annotations within the client-side viewer. If you often struggle to locate point annotations in 3D images, you can now enable a bounding box rendition around these points, enhancing their visibility from all orientations.

Read More

May 2024 Cycle Report

13 May 2024 by Miriam Groeneveld

With this release, we introduce dependent phases as part of a Challenge. This is a gate-keeping feature, where submissions to a phase are only possible following a succesful submission to a parent phase. We now provide the option to name display sets and archive items, to ease identification. We extended the functionality and squashed bugs in the client-rendered pathology viewer, making it a fully-supported feature of our platform. And last, when viewing an algorithm result in Cirrus, you can easily link back to the correct algorithm result on Grand Challenge. Read the blog for more details!

Read More

April 2024 Cycle Report

8 April 2024 by Miriam Groeneveld and Chris van Run

This cycle, the RSE team has extended the usability around images with a time component. Where before, you only had the option to select different time frames, you can now play as if the image was a video. You can set playback to once or continous, have the video loop or play in ping-pong style, and you can set the playback speed. For 3D images, we have added a configuration option that allows you to set the initial slice on which an image should be shown. A configuration option in your profile now supports instant email notifications, which is useful when you want to be notified of failed image uploads or other issues instantly, rather than once a day. We also further extended the support for annotating images in our client-side pathology viewer.

Read More

March 2024 Cycle Report

4 March 2024 by Miriam Groeneveld

The end of the March Cycle will bring you some shiny new features in both Grand Challenge and our viewer. In Reader Studies, you can now send direct messages to your readers. We added an option to Reader Study questions that allows you to verify that a user intentionally left an answer blank. We added support for viewing PDF and Vega Lite charts in dedicated view items, giving you full control over the data displayed in your Reader Stusy, Archive or Algorithm results. We also extended the support for Three-point angle annotations, added to Reader Studies last cycle, to be used in Archives and Algorithm results. Read the blog for more details!

Read More

Organizing a medical imaging challenge in 2020s: practical considerations

5 Feb. 2024 by Khrystyna Faryna

Organizing a deep learning challenge in medical imaging is a commendable initiative, as it can help drive advancements in the field and bring together researchers and practitioners to tackle important healthcare problems. However, there are several key considerations you should keep in mind to ensure the success and integrity of the challenge.

Read More

January 2024 Cycle Report

29 Jan. 2024 by Miriam Groeneveld

The RSE team started the year with exciting updates! We've shifted algorithm job and challenge evaluation execution to Amazon SageMaker Training, removing one-hour time limits for algorithms. Editing and creating display sets is now easier, reducing reliance on our API. Cirrus now supports seamless display of videos, thumbnails, and text alongside medical images. We've improved 3D image display, eliminating the need to navigate after changing orientation. In educational reader studies, we introduced an "Instant Verification" option for faster participation. Users can now set default colors for reader study questions. Check out our blog for more details on these enhancements!

Read More

December 2023 Cycle Report

3 Jan. 2024 by Miriam Groeneveld

Our latest blog post brings thrilling enhancements to boost your experience! Challenge editors can open submission logs for direct participant access. The revamped pathology viewer now supports overlays with LUT support. Algorithm pages showcase Challenge performance insights, and job limits extend beyond one hour. To ensure responsible use, algorithm editors now face restrictions. Discover the efficient 3-point angle annotation for a more user-friendly approach. Dive into the blog for a closer look at these game-changing updates!

Read More

Winter newsletter 2023

21 Dec. 2023 by Megan Schuurmans, Daan Schouten, Khrystyna Faryna, Miriam Groeneveld, Vilma Bozgo, Chris van Run, Anne Mickan and Siem de Jong

Welcome to the Winter Edition of Grand Challenge Insights!

Read More

November 2023 Cycle Report

27 Nov. 2023 by Miriam Groeneveld, Paul K. Gerke, Chris van Run, Harm van Zeeland, James Meakin and Anne Mickan

This cycle we continued our work on the client-side pathology viewer. We also implemented a first version of a Intensity-over-time chart feature. For challenge organizers, it is now possible to send messages directly to their participants! Check out the blog for these features and more!

Read More

October 2023 Cycle Report

16 Oct. 2023 by Miriam Groeneveld, Paul K. Gerke, Chris van Run, James Meakin and Harm van Zeeland

In this cycle, we worked on improving the performance of our reader studies, enabled setting the viewing depth of annotations in 3D images, and continued our work on the client-side pathology viewer. One of our team members attended Miccai 2023 to meet with challenge organizers and receive feedback. Read the blog for more details!

Read More

Autumn newsletter 2023

18 Sept. 2023 by Megan Schuurmans, Khrystyna Faryna, Daan Schouten, Chris van Run and Anindo Saha

Welcome to the Autumn Edition of Grand Challenge Insights!

Read More

September 2023 Cycle Report

12 Sept. 2023 by Miriam Groeneveld, Chris van Run, Paul K. Gerke and Harm van Zeeland

This cycle, the RSE team dedicated significant efforts to support various MICCAI 2023 challenges. Additionally, we enhanced the Cirrus viewer's usability, enabling seamless switching between different hanging protocols within the viewer. Furthermore, we addressed a prior issue, reinstating the functionality to switch between the polygon and mask editor. In the context of mask creation, we introduced a new feature allowing you to conveniently hide the annotation you're editing for accuracy verification using a straightforward keybinding. Explore our latest blog post for more details!

Read More

August 2023 Cycle Report

10 Aug. 2023 by Miriam Groeneveld, Paul K. Gerke and Chris van Run

This cycle the RSE team has started working on a new, experimental feature: Implementing a client-side viewer, for now specifically for pathology images. This should provide a faster, more responsive experience when viewing these images. Furthermore, the GitHub repository integration has been improved and bugs squashed. Challenge organizers can now combine results from different phases to create an overall leaderboard. Finally, we have added support for viewing overlapping semantic segmentations.

Read More

July 2023 Cycle Report

13 July 2023 by Miriam Groeneveld and James Meakin

This cycle we have brought some new additions to the reader study questions, check it out!

Read More

May 2023 Cycle Report

30 May 2023 by Miriam Groeneveld

This cycle, the RSE team has made improvements for pathology. It is now possible to upload DICOM-WSI files, they will be converted to tiff. Segmentations as tiff files are now supported and will be validated according to the segmentation interface. The annotation statistics plugin has had an overall make-over, with progress bar and caching improving general usability. Other features include a 3D brush for creating and editing masks, and improvements to the admin page for challenge organizers.

Read More

Spring newsletter 2023

25 May 2023 by Megan Schuurmans, Anne Mickan, Kiran Vaidhya Venkadesh, Khrystyna Faryna, Daan Schouten, Gino Jansen and Miriam Groeneveld

As the first rays of spring sunshine warm our faces and the flowers begin to bloom, we are excited to bring you the latest news on the grand challenge ahead.

Read More

April 2023 Cycle Report

26 April 2023 by Chris van Run, Paul K. Gerke and Miriam Groeneveld

Cycle report of the research-software engineers of April 2023, including constrained number inputs, browser-native history support when context switching, and editing annotation metadata

Read More

March 2023 Cycle Report

20 March 2023 by Chris van Run and Miriam Groeneveld

Cycle report of the research-software engineers of March 2023, including: more statistics on Grand Challenge, updated algorithm-job permissions on Grand Challenge, upgrade the CIRRUS backbone MeVisLab version to v3.6, added a new reader-study workflow for accepting and rejecting findings in both CIRRUS and Grand Challenge.

Read More

January 2023 Cycle Report

15 Feb. 2023 by Miriam Groeneveld

This cycle work was done to make algorithm result viewing faster by reusing Cirrus sessions. We also made it possible to select existing images for trying out an Algorithm, creating a Display Set in Reader Studies and creating Archive Items.

Read More

December 2022 Cycle Report

10 Jan. 2023 by Miriam Groeneveld and Chris van Run

In this year's first release, we added the option to reuse existing images to run an algorithm on or create an archive item or display set. Previously this was only possible with the python client. We extended our annotation types with the ellipse annotation, to be used in Reader studies or Algorithms. Under the hood, we are working on improving the viewing of pathology images, making them faster and more error-proof. To improve the reliability and ease of use of the GC-API client, we have added retries to certain requests in the client. This should reduce the number of errors that need to be handled by the user.

Read More

November 2022 Cycle Report

29 Nov. 2022 by Miriam Groeneveld

A new tool and some bug fixes for the viewer in this cycle, while most effort has gone to the development of Grand Challenge Connect, presented at RSNA! A lot of interesting and exciting developments, so make sure to check out the dedicated blogpost.

Read More

Grand Challenge at RSNA 2022

23 Nov. 2022 by James Meakin

Radboudumc will be at RSNA to present the latest developments of Grand Challenge, building on Amazon HealthLake Imaging. Visit us for a hands-on demo at the AWS Booth (6758) between 27-30 November 2022 at McCormick Place in Chicago.

Read More

October 2022 Cycle Report

1 Nov. 2022 by Miriam Groeneveld

A relatively small update as we are working hard on something new and exciting, which will be revealed next cycle!

Read More

Autumn Newsletter 2022

1 Nov. 2022 by Megan Schuurmans, Anne Mickan, Daan Schouten, Kiran Vaidhya Venkadesh, Khrystyna Faryna, Gino Jansen and Miriam Groeneveld

Hi all! With this newsletter we want to update you on all progress made for Grand Challenge: upcoming Challenges, interesting new Algorithms and Blogposts, leaderboards of finished Challenges and new features of Grand Challenge.

Read More

How to run a challenge? MICCAI webinar on Oct 25th 2022

20 Oct. 2022 by Anne Mickan, Kiran Vaidhya Venkadesh and Bram van Ginneken

The MICCAI Special Interest Group (SIG) for Challenges is hosting a webinar on How to run a challenge? on Oct 25th, 2022 at 1 pm GMT. Bram van Ginneken, Kiran Vaidhya Venkadesh, and Anindo Saha will present how to use Grand Challenge for organizing high-profile challenges. Jake Albrecht from Sage will present tips for challenge organizers on how to define a successful community challenge. Join us! Free registration is available at https://bit.ly/BIAS1025

Read More

STOIC2021 results webinar

12 Oct. 2022 by Luuk Boulogne and Bram van Ginneken

On October 18th at 3pm CEST, the winners of STOIC2021 will receive their prizes and present their solutions!

Read More

September 2022 Cycle Report

26 Sept. 2022 by Miriam Groeneveld

Highlights include the addition of an angle tool, a rotate tool for pathology images and displaying probability scores for annotations.

Read More

August 2022 Cycle Report

22 Aug. 2022 by Miriam Groeneveld

Highlights include the option to send an algorithm result to a reader study, using non-image type values in reader studies, the option to send feedback and more.

Read More

June 2022 Cycle Report

8 Aug. 2022 by Miriam Groeneveld, Chris van Run, Harm van Zeeland, James Meakin, Paul K. Gerke and Anne Mickan

Highlights include improvements in type 2 challenge submission workflow, creating non-binary masks, adding static annotations to reader studies and more.

Read More

Summer Newsletter 2022

8 July 2022 by Megan Schuurmans, Anne Mickan, Kiran Vaidhya Venkadesh, Khrystyna Faryna, Daan Schouten and Joeran Bosma

Hi all! With this newsletter, we want to update you on all progress made for Grand Challenge: upcoming Challenges, interesting new Algorithms, Blogposts, leaderboards of finished Challenges, and new features of Grand Challenge.

Read More

May 2022 Cycle Report

5 July 2022 by Miriam Groeneveld, Harm van Zeeland and Chris van Run

Highlights include viewing a reader's answers, providing default answers for questions in a reader study, starting a reader study at a specific display set and more.

Read More

AIROGS Challenge Report: AI models can be used for glaucoma screening, but do they know when they cannot?

10 May 2022 by Coen de Vente, Bram van Ginneken, Megan Schuurmans, Clarisa Sanchez and Hans Lemij

The rationale behind the Artificial Intelligence for RObust Glaucoma Screening (AIROGS) Challenge, an overview of its results and our experiences with Grand Challenge's new Type 2 challenges.

Read More

Spring Newsletter 2022

11 April 2022 by Megan Schuurmans, Anne Mickan, Joeran Bosma, Kiran Vaidhya Venkadesh, Bram van Ginneken, Khrystyna Faryna and Daan Schouten

Hi all! With this newsletter we want to update you on all progress made for Grand Challenge: new features, interesting new blogposts and algorithms, upcoming challenges and the leaderboards of finished challenges.

Read More

Can AI predict breast cancer recurrence via automated quantification of tumor-infiltrating lymphocytes?

6 March 2022 by Francesco Ciompi, Anne Mickan, Bram van Ginneken, Alexander Lemm, Roberto Salgado and Megan Schuurmans

TIGER is the first challenge on fully automated assessment of tumor-infiltrating lymphocytes (TILs) in hematoxylin and eosin (H&E) breast cancer histopathology slides. With TIGER, we released a training set of 390 whole-slide images and a total award of $13,000 in AWS Credits, which will be awarded to the winning teams. Together with its participants, we aim to find the best AI-based solutions for automating the assessment of the TILs and produce a “TILs score” that can predict the recurrence of breast cancer.

Read More

Can you predict who will develop severe COVID-19 from a chest CT scan?

16 Dec. 2021 by Bram van Ginneken, Alexander Lemm, Luuk Boulogne and Anne Mickan

Last week, we opened STOIC2021: A COVID-19 AI challenge with 10,000 CT scans. Together with its participants, we aim to find the best solution for predicting who will develop severe COVID-19 from a chest CT scan. We will make the final solution easily accessible for everyone. In total, $20,000 in AWS Credits will be awarded to the winning teams.

Read More

AI challenges, data, and algorithms

4 March 2021 by Bram van Ginneken

Presentation by Bram van Ginneken held during the European Congress of Radiology 2021 on the how and why of challenges in medical image analysis.

Read More

Why Challenges?

14 Feb. 2021 by Keelin Murphy and Bram van Ginneken

This is an updated version of blog post made years ago when we launched our platform grand-challenge.org. It makes the case for challenges and provides some advice for those interested in setting up their own challenge.

Read More

How to build a global, scalable, low-latency, and secure machine learning medical imaging analysis platform on AWS

24 Aug. 2020 by Razvan Ionasec, Bram van Ginneken and James Meakin

It is hard to imagine the future for medical imaging without machine learning (ML) as its central innovation engine. Countless researchers, developers, start-ups, and larger enterprises are engaged in building, training, and deploying machine learning solutions for medical imaging that are posed to transform today’s medical workflows and the future value of imaging in diagnosis and treatment.

Read More