PUMA Challenge 2024 - Will the test data be released?

PUMA Challenge 2024 - Will the test data be released?  

  By: aia_wt on March 21, 2025, 8:59 a.m.

Hi everyone,

Thank you to the organizers for hosting such a great challenge! Now that the competition has ended, I would like to ask if there are any plans to release the test dataset. If so, when can we expect it to be available?

We are interested in further analyzing our model’s generalization ability and utilizing this dataset for future research. Looking forward to your response. Thanks!

Best regards, Tong

Re: PUMA Challenge 2024 - Will the test data be released?  

  By: mschuiveling on March 24, 2025, 2:56 p.m.

Dear Tong, Thank you for your kind words and for participating in the challenge! To allow other participants to continue submitting containers, we are maintaining the challenge as a rolling benchmark. Unfortunately, this means the test set will only be made publicly available five years after the challenge's launch. I hope the training set makes it still possible to perform your experiments! Kind regards, Mark