More details of the baseline

More details of the baseline  

  By: haibo.nick.jin on Dec. 12, 2021, 12:53 a.m.

Hi,

I think the provided baseline model is actually quite good, and I'm curious about how you trained it. Is it possible that you can give more training details of the baseline model? Thank you.

Re: More details of the baseline  

  By: ecemsogancioglu on Dec. 13, 2021, 4:47 p.m.

Hi,

We first have oversampled the positive cases to reach the number of negative cases (so that they both are represented equally during training). Then we have trained the model for 20 epochs, and chose the model with the best AUC score on the validation set. Our validation set was randomly selected from training set and contains around ~200 images.

Let us know if you would like to know anything more about it,

Best, Ecem

Re: More details of the baseline  

  By: haibo.nick.jin on Dec. 14, 2021, 4:53 a.m.

Hi Ecem,

Thank you for the reply. Is the learning strategy the same as the baseline code (batch size=2, SGD, init lr=0.005, decay every 3 epochs)? And any other modifications such as augmentation, anchors, training image size? Thank you.

Best

Re: More details of the baseline  

  By: haibo.nick.jin on Dec. 16, 2021, 8:04 a.m.

By the way, the AUC score on validation set seems to be quite good (over 0.94) in my case. I wonder if it is the same to you? Thank you.

Re: More details of the baseline  

  By: ecemsogancioglu on Dec. 16, 2021, 10:16 p.m.

Hi,

The training strategy is the same as used in the baseline code. We did not apply any other changes.

Indeed, AUC score in the validation set also goes up to 0.95 for the baseline model, but the secret test data contains images that are a bit more difficult as they were annotated based on the CT scans. So, the baseline method achieved a lower performance there.

Best, Ecem

 Last edited by: ecemsogancioglu on Aug. 15, 2023, 12:55 p.m., edited 1 time in total.