Task 06 and Task 10: KeyError: 'uid' in sanity check submission

Task 06 and Task 10: KeyError: 'uid' in sanity check submission  

  By: aditya.vartak on May 20, 2025, 6:39 a.m.

Hi,

I'm using the unicorn baseline code from here. The docker was submitted as algorithm and it was used to do sanity check run for Task 6 and 10, results for both submissions were successful, giving valid patch_neural_representation.json but still failed on the sanity check Leaderboard with this error:

KeyError: 'uid'.

Since we dont have access to what happens in downstream docker, it would be difficult to find what is the root cause of this error. If there is a way we can replicate the downstream docker functionality locally, it would be great to have a minimal modification and well documented way to simulate it. In case its not possible to share the replication of downstream docker functionality, it would be great to know what is causing this KeyError and possible solutions/tweaks for the same.

Thanks in advance

Re: Task 06 and Task 10: KeyError: 'uid' in sanity check submission  

  By: lphilipp on May 20, 2025, 12:45 p.m.

Hi,

The error occurs because the evaluation/downstream Docker container is not up to date. We're working on an update that should come before the end of the week. Let us know if this does not answer your question.

 Last edited by: clemsg on May 20, 2025, 3 p.m., edited 1 time in total.

Re: Task 06 and Task 10: KeyError: 'uid' in sanity check submission  

  By: aditya.vartak on May 23, 2025, 11:12 a.m.

Sure. Let us know once updated