TY - JOUR AU - Hochheimer, Camille J AU - Sabo, Roy T AU - Perera, Robert A AU - Mukhopadhyay, Nitai AU - Krist, Alex H PY - 2019 DA - 2019/08/23 TI - Identifying Attrition Phases in Survey Data: Applicability and Assessment Study JO - J Med Internet Res SP - e12811 VL - 21 IS - 8 KW - patient dropouts KW - surveys and questionnaires KW - survival analyses KW - statistical models AB - Background: Although Web-based questionnaires are an efficient, increasingly popular mode of data collection, their utility is often challenged by high participant dropout. Researchers can gain insight into potential causes of high participant dropout by analyzing the dropout patterns. Objective: This study proposed the application of and assessed the use of user-specified and existing hypothesis testing methods in a novel setting—survey dropout data—to identify phases of higher or lower survey dropout. Methods: First, we proposed the application of user-specified thresholds to identify abrupt differences in the dropout rate. Second, we proposed the application of 2 existing hypothesis testing methods to detect significant differences in participant dropout. We assessed these methods through a simulation study and through application to a case study, featuring a questionnaire addressing decision-making surrounding cancer screening. Results: The user-specified method set to a low threshold performed best at accurately detecting phases of high attrition in both the simulation study and test case application, although all proposed methods were too sensitive. Conclusions: The user-specified method set to a low threshold correctly identified the attrition phases. Hypothesis testing methods, although sensitive at times, were unable to accurately identify the attrition phases. These results strengthen the case for further development of and research surrounding the science of attrition. SN - 1438-8871 UR - http://www.jmir.org/2019/8/e12811/ UR - https://doi.org/10.2196/12811 UR - http://www.ncbi.nlm.nih.gov/pubmed/31444875 DO - 10.2196/12811 ID - info:doi/10.2196/12811 ER -