Selecting final version of the algorithm

Dear organizers,

I have a question related on selecting the final version of the algorithm. Currently, only L2 submission is allowed and we can only check if and how our algorithm works on L2. However, it is not possible to know if that (newly submitted) algorithm still works well for L1 (i.e. not affected by L2). If we select an algorithm for the final and if it fails for L1, could it be possible to choose another algorithm that suceeded in L1 previously?

Dear Sungduk Cho

Indeed, only L2 submissions are allowed now, and you can not submit anymore to L1. You will have to select one algorithm for both L1 and L2 final leaderboards if you want to submit to both of them. We expect these algorithms to work similarly for both leaderboards, with some extra postprocessing for L2 to compute the TILs score. Therefore, the part of your algorithm for L1 should not change anymore and should also not fail.

In the event that your algorithm crashes in the final leaderboards, there is an opportunity to fix it. However, the updated algorithm should produce the same results as already present on the experimental leaderboards.

Best wishes, Mart