July 2023 Cycle Report

Published 13 July 2023

New Reader Study Question Options

A frequently requested feature is more options for how to represent a question in reader studies. This cycle, we have introduced several new widgets that change how a question is presented to the users. At the same time, they allow for further limitations a reader-study admin can invoke on what constitutes a valid answer.


A new Text type of question is available. This type replaces the Single line text/Multiline text types; to differentiate between having a single line and an input area, the widgets Text Input and Text Area are now also available. For these widgets, new limits are available that will validate the answer during a reader study: minimum answer length, maximum answer length, and a regular expression pattern that the answer will need to match (answer match pattern).

Radio Select

A new Radio Select widget is available for the single Choice type of questions. When selected, as the name suggests, this will present a set of radio buttons to the user. Clicking a radio button twice deselects the option.


A new Number Range widget is available for the Number type of questions. When selected, the users are presented with a slider. Reader-study admins are required to provide minimum answer value, maximum answer value, and step size to properly configure this widget.

Only overlay segments present in the overlay are displayed in the overlay plugin.

In the past, overlay segments defined in the viewer configuration or component interface could sometimes refer to voxel values that were not present in the actual overlay. This discrepancy confused, as the UI elements such as color checkboxes, labels, and map icons would still be displayed in the panel, giving the impression that these segments were present. However, only upon clicking on the map icon would users discover that the voxel value did not exist in the overlay. To enhance usability and provide clarity, our latest update ensures that only UI elements for the present overlay segments are displayed. This improvement simplifies the user experience and eliminates any misleading information, allowing users to work with confidence and efficiency.

Copy and Paste Annotations

We are thrilled to unveil a powerful addition to the viewer on grand-challenge.org that streamlines your workflow and saves you precious time. With our latest update, users can now effortlessly copy and paste annotations and masks between reader study questions. Whether you need to move annotations or masks to different questions or simply duplicate them within the same study, this feature has got you covered.

To use this convenient functionality, simply click the "copy annotation" button on a single annotation or the same button on a multiple annotation type question to copy all annotations associated with that question in one go. Alternatively, you can hover over an annotation and right-click to access a context menu, where you'll find the option to click "copy annotation." This intuitive and versatile approach ensures that you have multiple pathways to achieve the desired outcome.

By empowering users with the ability to copy and paste annotations and masks across study questions, we aim to enhance your productivity and make your annotation tasks more efficient than ever before. Say goodbye to manually recreating annotations and masks, and say hello to a seamless experience that allows you to focus on the important aspects of your work. Try out this exciting new feature today and revolutionize your annotation workflow!

Improved Mask Annotation Visibility

In CIRRUS, the side views now show the edited mask while editing and afterward.

This allows one to get a better overview of where an edited mask is positioned within a 3D scan.

Failed jobs of a Challenge evaluation.

It's now very easy to find the algorithm jobs that failed for an evaluation. Just head to the evaluation detail page:

Cover photo by john labelette on Unsplash