How to evaluate 4th surgical instrument

Dear SurgToolLoc 2023 Organizing Committee,

The annotation includes three surgical instruments, but 4th instrument appears in some video (for example, clip_016653, clip_024666). I wonder how the 4th instrument will be evaluated or the 4th instrument will be ignored at the test. If the instrument will be evaluated, which part is ground truth?

best regards, Atsushi Yamada

Dear Atsushi,

In some clips, there are laparoscopic tools used as well as the robotic tools. In these cases, there is no data directly from the robotic system about the laparoscopic tools being used, so these will not be evaluated and only the three robotic tools will be considered.

Thanks, SurgToolLoc Organizing Committee