Hello. Is there any script that calculate the C-index

Hello. Is there any script that calculate the C-index  

  By: bizhe.bai on Dec. 16, 2023, 9:45 a.m.

Hello. I asked gpt how to calculate the C-INDEX. And it tells me that C-INDEX need event occurrences (1 if the event occurred, 0 otherwise) to calculate. Would you mind using the C-INDEX used in the competition to calculate the C-INDEX? Thanks.

 Last edited by: bizhe.bai on Dec. 17, 2023, 1:14 p.m., edited 1 time in total.

Re: Hello. Is there any script that calculate the C-index  

  By: alvaroparicio on Dec. 18, 2023, 7:54 a.m.

Hi,

In order to better help you, could you please elaborate your problem and your question a little bit more?

Re: Hello. Is there any script that calculate the C-index  

  By: bizhe.bai on Dec. 18, 2023, 2:57 p.m.

Hello. I mean how to calculate the C-Index for the lung task. And do we need to predict the 'event' as well?Because I saw there are two keys in the ground_trush.json, {"survival_time_months": 43.7, "event": 0.0}

Re: Hello. Is there any script that calculate the C-index  

  By: alvaroparicio on Dec. 18, 2023, 3:35 p.m.

Hi,

We only ask that they predict survival time. You can find more info here: https://github.com/chaimeleon-eu/OpenChallenge/tree/master

 Last edited by: alvaroparicio on Dec. 18, 2023, 3:36 p.m., edited 2 times in total.

Re: Hello. Is there any script that calculate the C-index  

  By: agaldran on Dec. 19, 2023, 12:23 p.m.

hello,

Just to clarify the confusion. Think of the AUC in a binary classificaiton problem: it is a ranking metric equivalent to the following process:

  1. Sample a pair of items in the test set, one of class 0 and one of class 1.
  2. Compare their predicitions. The AUC rewards you if you assign higher probability to the class 1 item than to the class-0 item.
  3. Repeat, until you have sampled all possible pairs of (class 0, class1) in your test set.

The c-index is a metric similar to the AUC, but it will take into account when an item is right-censored, i.e. when you predict a survival of T months, but after T the subject left the study and you don't know if he/she died or not, nor when. This is the "event=0" case in the data we have. The c-index will take this into account when forming valid pairs of items in the test set, as it would be unfair to use right-censored data in some pairs.

Summing up, you do not need to predict the event (it would be rather impossible to know if someone died or left the study early), it's just that the performance metric takes that into account. On the other hand, when training your models you probably want to take into account that it's not the same having (survival=T, event=0) than (survival=T, event=1).

Cheers,

Adrian

 Last edited by: agaldran on Dec. 19, 2023, 12:27 p.m., edited 2 times in total.

Re: Hello. Is there any script that calculate the C-index  

  By: bizhe.bai on Dec. 19, 2023, 4:19 p.m.

Thanks!