Evaluation container changes

Evaluation container changes  

  By: danifranco on July 25, 2022, 1 p.m.

Dear participants,

We are changing the evaluation container these days. We will announce when it is ready again so you can evaluate your new submissions.

Thank you so much for your cooperation.

Best regards,

Dani (on behalf of MitoEM organizing team)

Re: Evaluation container changes  

  By: danifranco on July 31, 2022, 2:36 p.m.

Dear participants,

We have changed the evaluation container to now include all slices in z dimension. However, due to evaluation time restrictions each volume need to be downsampled in x and y. That is, each volume must be 500x2048x2048 (z,y,x) instead of 500x4098x4098 as the original shape is. We have created a script to downsample your input h5 files easily here:

https://github.com/donglaiw/MitoEM-challenge/blob/main/aux/h5_downsample.py If you have any problem do not hesitate to contact us.

Best regards,

 Last edited by: danifranco on Aug. 15, 2023, 12:57 p.m., edited 1 time in total.

Re: Evaluation container changes  

  By: danifranco on Aug. 10, 2022, 7:28 p.m.

Dear participants,

We have changed the evaluation container again and now there is no need to make such downsampling, i.e. submissions need to be in the original size of 500x4098x4098.

Apart from that, we have changed also the evaluation metric to F1 instead of AP-75 (more detail is the evaluation page).We are finishing the competition review paper with a complete discussion about these changes and a exhaustive analysis of the methods submited during the ISBI challenge (2021).

Will keep you posted!

If you have any problem do not hesitate to contact us.

Dani

 Last edited by: danifranco on Aug. 15, 2023, 12:57 p.m., edited 1 time in total.