The PANORAMA Challenge - Reading Interface and Workflow Demo

PANORAMA is an all-new grand challenge with +2000 of carefully curated abdominal CECT exams, and tools to upload, run and validate AI in a secure environment, using standardized consensus-based guidelines. The 2024 edition of PANORAMA will focus on developing AI for pancreatic ductal adenocarcinoma detection and diagnosis in CECT. PANORAMA also includes a reader study with +40 international abdominal radiologists, to estimate clinicians' diagnostic performance at this same task. Its study design has been established in conjunction with a scientific advisory board, comprising 14 multi-disciplinary experts across pancreas radiology, surgery, and AI as well as a patient representative. For more details, visit the PANORAMA study page.

The following demo workstation for the PANORAMA: Reader Study helps readers get acquainted with the reading interface and workflow. Readers are strongly advised to read the instruction manual prior start of the demo.

📣 All readers must complete the demo, before they can start the official PANORAMA: Reader Study.

Instructions ✍️

Initially, readers receive the same information as AI (abdominal CECT exams and their clinical (age, sex) variables). Readers are asked to perform the following actions per case:

👁‍🗨 Provide an overall patient-level PDAC suspicion score.

  • The score is between 0 (no-suspicion) - 100 (high-supicion) (with incremental steps of 1).

👁‍🗨 If PDAC is suspected, set a point-coordinate at the center of the suspicious area.

  • In case a 'PANC-RADS' score (see below) of 2 or higher is provided, a point-coordinate is mandatory.

👁‍🗨 Provide a corresponding 'PANC-RADS' score (ranging from 1–5) for its urgency for expert referral.

  • In the absence of large-scale multi-reader multi-case studies, there are currently no categorical scales for PDAC diagnosis on CECT. To investigate the potential for standardized reporting on PDAC diagnosis, we ask readers to classify cases into 5 different risk levels, defined in line with clinically validated RADS for other cancer diseases:
    • Category 0: No abnormality
    • Category 1: Very low PDAC suspicion (Non-PDAC diagnosis).
    • Category 2: Low PDAC suspicion
    • Category 3: Equivocal
    • Category 4: High PDAC suspicion
    • Category 5: Very high PDAC suspicion

Important remarks ⚠️

🟣 Readers cannot revisit any cases, or their individual abdominal CECT readings.

🟣 Reading time is expected to be 3-5 min per case.

🟣 Reading progress will be saved. Hence, readers can complete readings in multiple sessions.

🟣 Please be aware that your reading time will be noted as timestamps of your answers are recorded.