hamming loss

If there is a case: Grader G3' labels exist, Grader 1 agrees with Grader 3 on the main classification, but Grader 1's 10 feature labels are different from G3. Shall we just take G3 ' labels as a ground truth? Check if my understanding of Modified Hamming loss.ipynb is correct.

Yes, the third grader (G3) overrules the other graders, so everywhere you see G3's labels, you should take the labels of G3 as ground truth.

Thanks!