Clarification on the Open Development & Closed Testing Phases

Clarification on the Open Development & Closed Testing Phases  

  By: capybara on June 22, 2025, 2:12 a.m.

Dear LUNA25 organizers,

Thank you for organizing this challenge. I have two questions:

  1. Does the "single AI algorithm" that will be submitted to the Closed Testing Phase have to be one of the algorithms submitted in the Open Development Phase?
  2. I started to develop my algorithm quite late, and it's almost the end of the Open Development Phase. During the Closed Testing Phase (1 month), can I still build my algorithm and see the leaderboard?

Best,

Re: Clarification on the Open Development & Closed Testing Phases  

  By: bogdanobreja on June 23, 2025, 9:01 a.m.

Dear Quan Huu Cap,

Thank you for your questions and for your interest in the LUNA25 challenge.

Regarding your first question: No, the algorithm you submit to the Closed Testing Phase does not have to be one of the algorithms submitted during the Open Development Phase. However, please note that only the first algorithm you submit to the Closed Testing Phase will be considered for the final ranking and prize eligibility if you finish in the top 5. Any subsequent submissions will not be shown on the leaderboard until the competition ends, even if they achieve better performance.

Regarding your second question: Yes, you can continue developing your algorithms and viewing the Open Development leaderboard during the Closed Testing Phase.

Hope this helps!

Best regards, LUNA25 Organizers

Re: Clarification on the Open Development & Closed Testing Phases  

  By: capybara on June 23, 2025, 11:20 a.m.

Hi Bogdan Obreja,

Thanks for your answers.

Regarding your second question: Yes, you can continue developing your algorithms and viewing the Open Development leaderboard during the Closed Testing Phase.

Does this mean that I can continue to submit my algorithm to the Open Development Phase even after July 1st?

Re: Clarification on the Open Development & Closed Testing Phases  

  By: bogdanobreja on June 23, 2025, 12:28 p.m.

Correct.

Kind Regards, Bogdan.

Re: Clarification on the Open Development & Closed Testing Phases  

  By: capybara on June 24, 2025, 2:43 a.m.

Thanks for your clarification! It's good to know we have 1 more month to test the algorithm in the Open Development Phase.

Best, Quan

Re: Clarification on the Open Development & Closed Testing Phases  

  By: agaldran on June 26, 2025, 6 a.m.

Hello,

Just to double-check here, because the official timeline says that the current validation (open development) phase closes on the 1st of July. Is this incorrect? Will the validation leaderboard remain open during July?

I am also a late participant, I am just finishing model development these days, it would be awesome to keep the possibility of submitting open, even if it is under the 2/week limit.

Cheers,

Adrian

Re: Clarification on the Open Development & Closed Testing Phases  

  By: bogdanobreja on June 26, 2025, 12:06 p.m.

Dear Adrián,

We've updated the timeline (https://luna25.grand-challenge.org/timeline/ ) to reflect that submissions for the Open Development phase will close on 31 July 2025. This means you can still submit during the Closed Testing phase, to the open development dataset.

For the Open Development set, you can still submit 2 times per week.

Hope this helps!

Best regards, Bogdan.

 Last edited by: bogdanobreja on June 26, 2025, 12:09 p.m., edited 2 times in total.