Two kinds of evaluation ?

Dear organizers,

I submitted to the preliminary Development Phase yesterday. I had two kinds of evaluation in the "evaluation" column like: Succeeded Result Failed An unexpected error occurred The succeeded result (the first one) is shown in the leader board. But I'm wondering what the second one (Failed) is. What is the reason of the failure ? And is there any problem if the second one is failed in the final test phase ?

There is only one kind of evaluation. The reason you saw two results, a failed and successful one, is because we are experiencing some technical issues with the evaluation containers running on the platform. You should ignore the failed submissions with error message "An expected error occurred". This is a known issue for us which I resolve by re-evaluating your submission. So basically, the result of the successful evaluation is the only valid one. The method is the same as stated in the evaluation guidelines.

If this occurs in the final phase, we will take it into account as well.

I hope this answers your question!