Research Article 
External quality assurance for image grading in the Scottish Diabetic Retinopathy Screening Programme
K. A. Goatman, S. Philip, A. D. Fleming, R. D. Harvey, K. K. Swa, C. Styles, M. Black, G. Sell, N. Lee, P. F. Sharp and J. A. Olson
Diabetic Medicine, 2012, 29(6), 776-783. DOI: 10.1111/j.1464-5491.2011.03504.x
Abstract
Aims To develop and evaluate an image grading external quality assurance system for the Scottish Diabetic Retinopathy Screening Programme.
Method A web-based image grading system was developed which closely matches the current Scottish national screening software. Two rounds of external quality assurance were run in autumn 2008 and spring 2010, each time using the same 100 images. Graders were compared with a consensus standard derived from the top-level graders' results. After the first round, the centre lead clinicians and top-level graders reviewed the results and drew up guidance notes for the second round.
Results Grader sensitivities ranged from 60.0 to 100% (median 92.5%) in 2008, and from 62.5 to 100% (median 92.5%) in 2010. Specificities ranged from 34.0 to 98.0% (median 86%) in 2008, and 54.0 to 100% (median 88%) in 2010. There was no difference in sensitivity between grader levels, but first-level graders had a significantly lower specificity than level-two and level-three graders. In 2008, one centre had a lower sensitivity but higher specificity than the majority of centres. Following the feedback from the first round, overall agreement improved in 2010 and there were no longer any significant differences between centres.
Conclusions A useful educational tool has been developed for image grading external quality assurance.
ASCI-ID: 109-1067
Similar Articles
Risk factors for diabetic retinopathy in a South Indian Type 2 diabetic population—the Chennai Urban Rural Epidemiology Study (CURES) Eye Study 4
Diabetic Medicine, 2008, 25(5), 536-542. DOI: 10.1111/j.1464-5491.2008.02423.x
Health utility values associated with diabetic retinopathyDiabetic Medicine, 2008, 25(5), 618-624. DOI: 10.1111/j.1464-5491.2008.02430.x
The Y402H variant of complement factor H is associated with age-related macular degeneration but not with diabetic retinal disease in the Go-DARTS studyDiabetic Medicine, 2009, 26(5), 460-465. DOI: 10.1111/j.1464-5491.2009.02719.x
Long-term impact of retinal screening on significant diabetes-related visual impairment in the working age populationDiabetic Medicine, 2009, 26(5), 489-492. DOI: 10.1111/j.1464-5491.2009.02718.x
Trends in yield and effects of screening intervals during 17 years of a large UK community-based diabetic retinopathy screening programmeDiabetic Medicine, 2009, 26(10), 1040-1047. DOI: 10.1111/j.1464-5491.2009.02820.x
Pregnancy-induced sight-threatening diabetic retinopathy in women with Type 1 diabetesDiabetic Medicine, 2010, 27(4), 431-435.
Is risk of diabetic retinopathy lower in Australia’s Greek-born migrants?Diabetic Medicine, 2010, 27(6), 660-665. DOI: 10.1111/j.1464-5491.2010.03005.x
Retinal microaneurysm count predicts progression and regression of diabetic retinopathy. Post-hoc results from the DIRECT ProgrammeDiabetic Medicine, 2011, 28(3), 345-351. DOI: 10.1111/j.1464-5491.2010.03210.x
Increased levels of monokine induced by interferon-γ (Mig) in the vitreous of patients with diabetic retinopathyDiabetic Medicine, 2008, 25(7), 875-877. DOI: 10.1111/j.1464-5491.2008.02466.x
Reliability of screening methods for diabetic retinopathyDiabetic Medicine, 2009, 26(8), 783-790. DOI: 10.1111/j.1464-5491.2009.02778.x
Blood pressure control and awareness among patients with diabetes and hypertension attending a tertiary ophthalmic clinicDiabetic Medicine, 2009, 26(1), 34-39. DOI: 10.1111/j.1464-5491.2008.02614.x
Diabetic retinopathy screening: a systematic review of the economic evidenceDiabetic Medicine, 2010, 27(3), 249-256. DOI: 10.1111/j.1464-5491.2009.02870.x
Socio-economic and ethnic inequalities in diabetes retinal screeningDiabetic Medicine, 2010, 27(3), 282-288. DOI: 10.1111/j.1464-5491.2010.02946.x
Association between alcohol consumption and diabetic retinopathy and visual acuity-the AdRem StudyDiabetic Medicine, 2010, 27(10), 1130-1137. DOI: 10.1111/j.1464-5491.2010.03080.x
Agreement and reasons for disagreement between photographic and hospital biomicroscopy grading of diabetic retinopathyDiabetic Medicine, 2011, 28(6), 741-746. DOI: 10.1111/j.1464-5491.2011.03273.x
Do type 2 diabetes patients without diabetic retinopathy or subjects with impaired fasting glucose have impaired colour vision? The Okubo Color Study ReportDiabetic Medicine, 2011, 28(7), 865-871. DOI: 10.1111/j.1464-5491.2011.03290.x
Preferences of people with diabetes for diabetic retinopathy screening: a discrete choice experimentDiabetic Medicine, 2012, 29(7), 869-877. DOI: 10.1111/j.1464-5491.2012.03636.x
Diabetic retinopathy screening: perspectives of people with diabetes, screening intervals and costs of attending screeningDiabetic Medicine, 2012, 29(7), 878-885. DOI: 10.1111/j.1464-5491.2012.03637.x
Prevalence of diabetic retinopathy in Type 2 diabetes in developing and developed countriesDiabetic Medicine, 2013, 30(4), 387-398. DOI: 10.1111/dme.12119
‘Educator talk’ and patient change: some insights from the DESMOND (Diabetes Education and Self Management for Ongoing and Newly Diagnosed) randomized controlled trialDiabetic Medicine, 2008, 25(9), 1117-1120. DOI: 10.1111/j.1464-5491.2008.02492.x
Long-term impact of retinal screening on significant diabetes-related visual impairment in the working age populationDiabetic Medicine, 2009, 26(5), 489-492. DOI: 10.1111/j.1464-5491.2009.02718.x
Magnetic resonance imaging retinal oximetry: a quantitative physiological biomarker for early diabetic retinopathy?Diabetic Medicine, 2012, 29(4), 501-505. DOI: 10.1111/j.1464-5491.2011.03440.x
Point-of-care testing as a tool for screening for diabetes and pre-diabetesDiabetic Medicine, 2008, 25(9), 1070-1075. DOI: 10.1111/j.1464-5491.2008.02526.x
Influence of glucocorticoids and growth hormone on insulin sensitivity in humansDiabetic Medicine, 2013, 30(6), 651-663. DOI: 10.1111/dme.12184
Point-of-care testing as a tool for screening for diabetes and pre-diabetesDiabetic Medicine, 2008, 25(9), 1070-1075. DOI: 10.1111/j.1464-5491.2008.02526.x