Dear participants,

we thank you for your interest in participating in this challenge.

Unfortunately, we need more time than anticipated to provide the validation data set and evaluation code. We therefore hope to unlock the submission system during early June. We apologize for the inconvenience and hope that it does not impair your algorithm development unduly.

Furthermore, there will likely be a change in the ranking method versus the current description in the website - instead of ranking participants for each image pair and then assigning the mean rank as the final score, we will likely compute the mean of the 90th percentile of distances in all image pairs and rank participants on this mean. This change is necessitated by the technical details in the evaluation framework of this website. Once this change is approved, we will update the website and this thread accordingly.

With kind regards Philippe Weitz, Masi Valkonen, Leslie Solorzano