Intergrader agreements between manual graders and agreements between UWF-IQA model and manual graders in the test dataset using Cohen’s weighted kappa score
Inter-grader agreements | Agreements between model and graders | |||||||
G1 vs G2 | G1 vs G3 | G2 vs G3 | Average | M vs G1 | M vs G2 | M vs G3 | Average | |
Field of view | 0.433 | 0.105 | 0.280 | 0.272 | 0.541 | 0.669 | 0.455 | 0.555 |
Details of posterior pole | 0.781 | 0.795 | 0.820 | 0.798 | 0.760 | 0.844 | 0.840 | 0.814 |
Peripheral retina visualisation | 0.599 | 0.555 | 0.754 | 0.636 | 0.683 | 0.800 | 0.786 | 0.756 |
Centering of image | 0.532 | 0.556 | 0.825 | 0.638 | 0.562 | 0.847 | 0.827 | 0.745 |
Final grading | 0.701 | 0.604 | 0.715 | 0.673 | 0.714 | 0.857 | 0.777 | 0.783 |
Average | 0.609 | 0.523 | 0.678 | 0.603 | 0.652 | 0.803 | 0.737 | 0.731 |
G, grader; IQA, image quality assessment; M, model; UWF, ultra-widefield fundus.