%0 Journal Article
%@ 1438-8871
%I Gunther Eysenbach
%V 5
%N 4
%P e30
%T Design and Testing of a Tool for Evaluating the Quality of Diabetes Consumer-Information Web Sites
%A Seidman,Joshua J
%A Steinwachs,Donald
%A Rubin,Haya R
%+ Center for Information Therapy, Healthwise, Inc, 600 New Hampshire Avenue NW, Washington DC 20037, USA, +1 202 945 6810, jseidman@healthwise.org
%K Internet/standards
%K information management/standards
%K medical informatics/standards
%K guidelines
%K quality of health care
%K diabetes
%D 2003
%7 27.11.2003
%9 Original Paper
%J J Med Internet Res
%G English
%X Background: Most existing tools for measuring the quality of Internet health information focus almost exclusively on structural criteria or other proxies for quality information rather than evaluating actual accuracy and comprehensiveness. Objective: This research sought to develop a new performance-measurement tool for evaluating the quality of Internet health information, test the validity and reliability of the tool, and assess the variability in diabetes Web site quality. Methods: An objective, systematic tool was developed to evaluate Internet diabetes information based on a quality-of-care measurement framework. The principal investigator developed an abstraction tool and trained an external reviewer on its use. The tool included 7 structural measures and 34 performance measures created by using evidence-based practice guidelines and experts' judgments of accuracy and comprehensiveness. Results: Substantial variation existed in all categories, with overall scores following a normal distribution and ranging from 15% to 95% (mean was 50% and median was 51%). Lin's concordance correlation coefficient to assess agreement between raters produced a rho of 0.761 (Pearson's r of 0.769), suggesting moderate to high agreement. The average agreement between raters for the performance measures was 0.80. Conclusions: Diabetes Web site quality varies widely. Alpha testing of this new tool suggests that it could become a reliable and valid method for evaluating the quality of Internet health sites. Such an instrument could help lay people distinguish between beneficial and misleading information. 
%M 14713658
%R 10.2196/jmir.5.4.e30
%U http://www.jmir.org/2003/4/e30/
%U https://doi.org/10.2196/jmir.5.4.e30
%U http://www.ncbi.nlm.nih.gov/pubmed/14713658