Research Article 
Reliability of screening methods for diabetic retinopathy
Jochanan Benbassat and Bettine C. P. Polak
Diabetic Medicine, 2009, 26(8), 783-790. DOI: 10.1111/j.1464-5491.2009.02778.x
Abstract
Aim To review studies of the reliability (reproducibility) of the commonly used methods (ophthalmoscopy and inspection of retinal images) of screening for diabetic retinopathy (DR).
Research design and methods Literature search.
Results We found six studies of the intra-examiner agreement after examining the same retinal images. Three of these found an almost perfect agreement (k > 0.8) after inspecting colour slides and digital images; three other studies reported ‘significant differences’ in microaneurysm counts and only 39-85% agreement rates between two assessments by the same examiner. The inter-examiner agreement was reported in 24 studies. Using stereoscopic photographs, one study found almost perfect agreement after examining seven fields; another study found a substantial to moderate (k = 0.4-0.8) agreement after examining five fields and a third study found a fair agreement (k = 0.2-0.4) after examining a single field. Studies using single- or two-field monoscopic photographs also have reported agreement rates that have varied between almost perfect, substantial and moderate. In four other studies using biomicroscopy, agreement levels varied between perfect and moderate.
Conclusions Relative to the large number of studies on the validity of the various methods for screening for DR, there are only few studies of their reliability, with a marked variability in their findings. We suggest that future studies of the effectiveness of the various methods for screening for DR should also include data on their reliability.
ASCI-ID: 109-631
Similar Articles
Risk factors for diabetic retinopathy in a South Indian Type 2 diabetic population—the Chennai Urban Rural Epidemiology Study (CURES) Eye Study 4
Diabetic Medicine, 2008, 25(5), 536-542. DOI: 10.1111/j.1464-5491.2008.02423.x
Health utility values associated with diabetic retinopathyDiabetic Medicine, 2008, 25(5), 618-624. DOI: 10.1111/j.1464-5491.2008.02430.x
The Y402H variant of complement factor H is associated with age-related macular degeneration but not with diabetic retinal disease in the Go-DARTS studyDiabetic Medicine, 2009, 26(5), 460-465. DOI: 10.1111/j.1464-5491.2009.02719.x
Long-term impact of retinal screening on significant diabetes-related visual impairment in the working age populationDiabetic Medicine, 2009, 26(5), 489-492. DOI: 10.1111/j.1464-5491.2009.02718.x
Trends in yield and effects of screening intervals during 17 years of a large UK community-based diabetic retinopathy screening programmeDiabetic Medicine, 2009, 26(10), 1040-1047. DOI: 10.1111/j.1464-5491.2009.02820.x
Pregnancy-induced sight-threatening diabetic retinopathy in women with Type 1 diabetesDiabetic Medicine, 2010, 27(4), 431-435.
Is risk of diabetic retinopathy lower in Australia’s Greek-born migrants?Diabetic Medicine, 2010, 27(6), 660-665. DOI: 10.1111/j.1464-5491.2010.03005.x
Retinal microaneurysm count predicts progression and regression of diabetic retinopathy. Post-hoc results from the DIRECT ProgrammeDiabetic Medicine, 2011, 28(3), 345-351. DOI: 10.1111/j.1464-5491.2010.03210.x
Increased levels of monokine induced by interferon-γ (Mig) in the vitreous of patients with diabetic retinopathyDiabetic Medicine, 2008, 25(7), 875-877. DOI: 10.1111/j.1464-5491.2008.02466.x
Blood pressure control and awareness among patients with diabetes and hypertension attending a tertiary ophthalmic clinicDiabetic Medicine, 2009, 26(1), 34-39. DOI: 10.1111/j.1464-5491.2008.02614.x
Diabetic retinopathy screening: a systematic review of the economic evidenceDiabetic Medicine, 2010, 27(3), 249-256. DOI: 10.1111/j.1464-5491.2009.02870.x
Socio-economic and ethnic inequalities in diabetes retinal screeningDiabetic Medicine, 2010, 27(3), 282-288. DOI: 10.1111/j.1464-5491.2010.02946.x
Association between alcohol consumption and diabetic retinopathy and visual acuity-the AdRem StudyDiabetic Medicine, 2010, 27(10), 1130-1137. DOI: 10.1111/j.1464-5491.2010.03080.x
Agreement and reasons for disagreement between photographic and hospital biomicroscopy grading of diabetic retinopathyDiabetic Medicine, 2011, 28(6), 741-746. DOI: 10.1111/j.1464-5491.2011.03273.x
Do type 2 diabetes patients without diabetic retinopathy or subjects with impaired fasting glucose have impaired colour vision? The Okubo Color Study ReportDiabetic Medicine, 2011, 28(7), 865-871. DOI: 10.1111/j.1464-5491.2011.03290.x
External quality assurance for image grading in the Scottish Diabetic Retinopathy Screening ProgrammeDiabetic Medicine, 2012, 29(6), 776-783. DOI: 10.1111/j.1464-5491.2011.03504.x
Preferences of people with diabetes for diabetic retinopathy screening: a discrete choice experimentDiabetic Medicine, 2012, 29(7), 869-877. DOI: 10.1111/j.1464-5491.2012.03636.x
Diabetic retinopathy screening: perspectives of people with diabetes, screening intervals and costs of attending screeningDiabetic Medicine, 2012, 29(7), 878-885. DOI: 10.1111/j.1464-5491.2012.03637.x
Prevalence of diabetic retinopathy in Type 2 diabetes in developing and developed countriesDiabetic Medicine, 2013, 30(4), 387-398. DOI: 10.1111/dme.12119
Macular oedema is not predicted by perifoveal single blot haemorrhagesDiabetic Medicine, 2008, 25(2), 129-133. DOI: 10.1111/j.1464-5491.2007.02330.x
Notification of random hyperglycaemia to general practitioners by an emergency medicine team: impact of a simple intervention planDiabetic Medicine, 2008, 25(6), 751-754. DOI: 10.1111/j.1464-5491.2008.02447.x
Socioeconomic factors related to attendance at a Type 2 diabetes screening programmeDiabetic Medicine, 2009, 26(5), 518-525. DOI: 10.1111/j.1464-5491.2009.02715.x
Trends in yield and effects of screening intervals during 17 years of a large UK community-based diabetic retinopathy screening programmeDiabetic Medicine, 2009, 26(10), 1040-1047. DOI: 10.1111/j.1464-5491.2009.02820.x
Performance of HbA1c for detecting newly diagnosed diabetes and pre-diabetes in Chinese communities living in BeijingDiabetic Medicine, 2009, 26(12), 1262-1268. DOI: 10.1111/j.1464-5491.2009.02831.x
A national survey of the current state of screening services for diabetic retinopathy: ABCD–Diabetes UK survey of specialist diabetes services 2006Diabetic Medicine, 2009, 26(12), 1301-1305. DOI: 10.1111/j.1464-5491.2009.02838.x
Performance of existing risk scores in screening for undiagnosed diabetes: an external validation studyDiabetic Medicine, 2010, 27(1), 46-53. DOI: 10.1111/j.1464-5491.2009.02891.x
A simple risk score to identify Southern Chinese at high risk for diabetesDiabetic Medicine, 2010, 27(6), 644-649. DOI: 10.1111/j.1464-5491.2010.02993.x
The importance of postpartum glucose tolerance testing after pregnancies complicated by gestational diabetesDiabetic Medicine, 2010, 27(6), 650-654. DOI: 10.1111/j.1464-5491.2010.03001.x
The Finnish Diabetes Risk Score is associated with insulin resistance but not reduced β-cell function, by classical and model-based estimatesDiabetic Medicine, 2011, 28(9), 1078-1081. DOI: 10.1111/j.1464-5491.2011.03315.x
Undiagnosed diabetes in the over-60s: performance of the Association of Public Health Observatories (APHO) Diabetes Prevalence Model in a general practiceDiabetic Medicine, 2012, 29(1), 115-120. DOI: 10.1111/j.1464-5491.2011.03389.x
Undiagnosed diabetes-data from the English longitudinal study of ageingDiabetic Medicine, 2009, 26(7), 679-685. DOI: 10.1111/j.1464-5491.2009.02755.x
Gestational diabetes: fasting capillary glucose as a screening test in a multi-ethnic, high-risk populationDiabetic Medicine, 2009, 26(8), 760-765. DOI: 10.1111/j.1464-5491.2009.02765.x
Validation of an algorithm combining haemoglobin A1c and fasting plasma glucose for diagnosis of diabetes mellitus in UK and Australian populationsDiabetic Medicine, 2009, 26(2), 115-121. DOI: 10.1111/j.1464-5491.2008.02652.x
How much might cardiovascular disease risk be reduced by intensive therapy in people with screen-detected diabetes?Diabetic Medicine, 2008, 25(12), 1433-1439. DOI: 10.1111/j.1464-5491.2008.02600.x
Socio-economic and ethnic inequalities in diabetes retinal screeningDiabetic Medicine, 2010, 27(3), 282-288. DOI: 10.1111/j.1464-5491.2010.02946.x
The Leicester Risk Assessment score for detecting undiagnosed Type 2 diabetes and impaired glucose regulation for use in a multiethnic UK settingDiabetic Medicine, 2010, 27(8), 887-895. DOI: 10.1111/j.1464-5491.2010.03037.x
The prevalence of depressive symptoms in a white European and South Asian population with impaired glucose regulation and screen-detected Type 2 diabetes mellitus: a comparison of two screening toolsDiabetic Medicine, 2010, 27(8), 896-905. DOI: 10.1111/j.1464-5491.2010.03042.x
Who attends a UK diabetes screening programme? Findings from the ADDITION-Cambridge studyDiabetic Medicine, 2010, 27(9), 995-1003. DOI: 10.1111/j.1464-5491.2010.03056.x
Agreement and reasons for disagreement between photographic and hospital biomicroscopy grading of diabetic retinopathyDiabetic Medicine, 2011, 28(6), 741-746. DOI: 10.1111/j.1464-5491.2011.03273.x
Measuring the accuracy of different ways to identify the ‘at-risk’ foot in routine clinical practiceDiabetic Medicine, 2011, 28(6), 747-754. DOI: 10.1111/j.1464-5491.2011.03297.x
The association between anxiety and measures of glycaemia in a population-based diabetes screening programmeDiabetic Medicine, 2011, 28(7), 785-788. DOI: 10.1111/j.1464-5491.2011.03245.x
Screening for Type 2 diabetes. Lessons from the ADDITION-Europe studyDiabetic Medicine, 2011, 28(11), 1416-1424. DOI: 10.1111/j.1464-5491.2011.03365.x
Establishing an evidence base for frequency of monitoring glycated haemoglobin levels in patients with Type 2 diabetes: projections of effectiveness from a regression modelDiabetic Medicine, 2012, 29(2), 266-271. DOI: 10.1111/j.1464-5491.2011.03412.x
Validity of self-assessed waist circumference in a multi-ethnic UK populationDiabetic Medicine, 2012, 29(3), 404-409. DOI: 10.1111/j.1464-5491.2011.03478.x
A simple strategy for screening for glucose intolerance, using glycated haemoglobin, in individuals admitted with acute coronary syndromeDiabetic Medicine, 2012, 29(7), 838-843. DOI: 10.1111/j.1464-5491.2012.03643.x
Effect of screening for Type 2 diabetes on population-level self-rated health outcomes and measures of cardiovascular risk: 13-year follow-up of the Ely cohortDiabetic Medicine, 2012, 29(7), 886-892. DOI: 10.1111/j.1464-5491.2012.03570.x
The cost of diagnosing Type 2 diabetes mellitus by clinical opportunistic screening in general practiceDiabetic Medicine, 2012, 29(7), 863-868. DOI: 10.1111/j.1464-5491.2012.03607.x
Estimating the potential population impact of stepwise screening strategies for identifying and treating individuals at high risk of Type 2 diabetes: a modelling studyDiabetic Medicine, 2012, 29(7), 893-904. DOI: 10.1111/j.1464-5491.2012.03609.x
Gestational diabetes mellitus in Europe: prevalence, current screening practice and barriers to screening. A reviewDiabetic Medicine, 2012, 29(7), 844-854. DOI: 10.1111/j.1464-5491.2011.03541.x
Blood glucose testing and primary prevention of Type 2 diabetes-evaluation of the effect of evidence-based patient information: a randomized controlled trialDiabetic Medicine, 2012, 29(8), 1011-1020. DOI: 10.1111/j.1464-5491.2011.03531.x
Screening for diabetic retinopathy in pregnancy using photographic review clinicsDiabetic Medicine, 2013, 30(4), 475-477. DOI: 10.1111/dme.12077