Evaluation

It is seen that the label seems to be listed in order, i.e., from left to right. Thus,whether the prediction should be in the same order?

Hi jcwang,

Thanks for posting your question!

The prediction evaluation will not take order into account. You will be required to produce binary tool detections per frame (for category 1) and bbox predictions per frame (for category 2), none of which will have ordering in it. The exact details of the outputs required and evaluation criteria for the challenge will be uploaded in the upcoming weeks.

Please feel free to ask follow-up questions if it is unclear.

Best, SurgToolLoc 2022 Organizing Committee