A Serious Game–Derived Index for Detecting Children With Heterogeneous Developmental Disabilities: Randomized Controlled Trial

Background Developmental disabilities are a set of heterogeneous delays or difficulties in one or more areas of neuropsychological development. Considering that childhood is an essential stage of brain development and developmental delays lead to personal or social burdens, the early detection of childhood developmental disabilities is important. However, early screening for developmental disabilities has been a challenge because of the fear of positive results, expensive tests, differences in diagnosis depending on examiners’ abilities, and difficulty in diagnosis arising from the need for long-term follow-up observation. Objective This study aimed to assess the feasibility of using a serious game–derived index to identify heterogeneous developmental disabilities. This study also examines the correlation between the game-derived index and existing neuropsychological test results. Methods The randomized controlled trial involved 48 children with either normal development or developmental disabilities. In this clinical trial, we used 19 features (6 from the Korean-Wechsler Preschool and Primary Scale of Intelligence, 8 from the Psychoeducational Profile Revised, 2 from the Bruininks-Oseretsky Test of Motor Proficiency, Second Edition, and 3 from the Pediatric Evaluation of Disability Inventory) from neuropsychological tests and 9 (7 game scores, path accuracy, and completion rate) from the serious game, DoBrain. The following analysis was conducted based on participants’ baseline information and neuropsychological test and game-derived index data for one week: (1) we compared the baseline information between the normal development and developmental disabilities groups; (2) then we measured the correlation between the game-derived index and the neuropsychological test scores for each group; and (3) we built a classifier based on the game-derived index with a Gaussian process method and then compared the area under the curve (AUC) with a model based on neuropsychological test results. Results A total of 16 children (normal development=9; developmental disabilities=7) were analyzed after selection. Their developmental abilities were assessed before they started to play the serious games, and statistically significant differences were found in both groups. Specifically, the normal development group was more developed than the developmental disabilities group in terms of social function, gross motor function, full-scale IQ, and visual motor imitation, in that order. Similarly, the normal development group obtained a higher score on the game-derived index than the developmental disabilities group. In the correlation analysis between the game-derived index and the neuropsychological tests, the normal development group showed greater correlation with more variables than the developmental disabilities group. The game-derived index–based model had an AUC=0.9, a similar detection value as the neuropsychological test–based model’s AUC=0.86. Conclusions A game-derived index based on serious games can detect children with heterogenous developmental disabilities. This suggests that serious games can be used as a potential screening tool for developmental disabilities. Trial Registration Clinical Research Information Service KCT0003247; https://cris.nih.go.kr/cris/en/search/search_result_st01 .jsp?seq=12365

Approx. Percentage of Users (starters) still using the app as recommended after 3 months * You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
Is this a full powered effectiveness trial or a pilot/feasibility trial? * Manuscript tracking number * If this is a JMIR submission, please provide the manuscript tracking number under "other" (The ms tracking number can be found in the submission acknowledgement email, or when you login as author in JMIR. If the paper is already published in JMIR, then the ms tracking number is the fourdigit number at the end of the DOI, to be found at the bottom of each published article in JMIR)

14924
You're editing your response. Sharing this URL allows others to also edit your response. 1a-i) Identify the mode of delivery in the title Identify the mode of delivery. Preferably use "web-based" and/or "mobile" and/or "electronic game" in the title. Avoid ambiguous terms like "online", "virtual", "interactive". Use "Internet-based" only if Intervention includes non-web-based Internet components (e.g. email), use "computer-based" or "electronic" only if o ine products are used. Use "virtual" only in the context of "virtual reality" (3-D worlds). Use "online" only in the context of "online support groups". Complement or substitute product names with broader terms for the class of products (such as "mobile" or "smart phone" instead of "iphone"), especially if the application runs on different platforms.

FILL OUT A NEW RESPONSE
Does your paper address subitem 1a-i? * Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study A "serious game"-derived index for detecting children with heterogeneous developmental disabilities: A randomized controlled trial 1a-ii) Non-web-based components or important co-interventions in title Mention non-web-based components or important co-interventions in title, if any (e.g., "with telephone support").
You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential 1b) ABSTRACT: Structured summary of trial design, methods, results, and conclusions NPT extension: Description of experimental treatment, comparator, care providers, centers, and blinding status.
subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 1a-ii?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study It is a very low level of co-intervention that sends text messages and is not included in the title.
1a-iii) Primary condition or target group in the title Mention primary condition or target group in the title, if any (e.g., "for children with Type I Diabetes") Example: A Web-based and Mobile Intervention with Telephone Support for Children with Type I Diabetes: Randomized Controlled Trial Does your paper address subitem 1a-iii? * Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study A serious game-derived index for detecting children with heterogeneous "developmental disabilities": A randomized controlled trial 1b-i) Key features/functionalities/components of the intervention and comparator in the METHODS section of the ABSTRACT Mention key features/functionalities/components of the intervention and comparator in the abstract. If possible, also mention theories and principles used for designing the site. Keep in mind the needs of systematic reviewers and indexers by including important synonyms. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 1b-i? * Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The intervention of the trial was based on a serious game and will be continued for 12 weeks for 40 minutes twice a week. " 1b-ii) Level of human involvement in the METHODS section of the ABSTRACT Clarify the level of human involvement in the abstract, e.g., use phrases like "fully automated" vs. "therapist/nurse/care provider/physician-assisted" (mention number and expertise of providers involved, if any). (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) Does your paper address subitem 1b-ii?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "There were no human interventions other than early functional game usage training." 1b-iii) Open vs. closed, web-based (self-assessment) vs. face-toface assessments in the METHODS section of the ABSTRACT Mention how participants were recruited (online vs. o ine), e.g., from an open access website or from a clinic or a closed online user group (closed usergroup trial), and clarify if this was a purely web-based trial, or there were face-to-face components (as part of the intervention or for assessment). Clearly say if outcomes were self-assessed through questionnaires (as common in web-based trials You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 1b-iii?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The intervention was based on mobile serious game play at home, and the assessment was done in face-to-face test. " 1b-iv) RESULTS section in abstract must contain use data Report number of participants enrolled/assessed in each group, the use/uptake of the intervention (e.g., attrition/adherence metrics, use over time, number of logins etc.), in addition to primary/secondary outcomes. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) Does your paper address subitem 1b-iv?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Sixteen children (ND, n=9; DD, n=7) participated in this study." 1b-v) CONCLUSIONS/DISCUSSION in abstract for negative trials Conclusions/Discussions in abstract for negative trials: Discuss the primary outcome -if the trial is negative (primary outcome not changed), and the intervention was not used, discuss whether negative results are attributable to lack of uptake and discuss reasons. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) Does your paper address subitem 1b-v?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

Your answer
You're editing your response. Sharing this URL allows others to also edit your response. Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "However, there is no study on detecting general and heterogeneous developmental disabilities in children using a serious game, in spite of the fact that detecting these developmental disabilities is important. Referring children to specialists for clinical evaluation is also the most essential part of an early diagnosis of developmental disabilities."

FILL OUT
Does your paper address CONSORT subitem 2b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Therefore, this study aimed to develop a classi er that can distinguish between children with heterogeneous developmental disabilities and those with normal development using GDI based on a serious game for improving cognitive ability. Our study reports the results obtained in the rst week of the intervention" Does your paper address CONSORT subitem 3a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "This study was based on a single blinded, parallel, randomized clinical trial in Asan Medical Center. The study consists of an intervention and a control group, with an allocation ratio of 1:1." You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
3b) Important changes to methods after trial commencement (such as eligibility criteria), with reasons subitem not at all important 1 2 3 4 5 essential 4a) Eligibility criteria for participants Does your paper address CONSORT subitem 3b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study There was no change in research design since the start of the trail.

3b-i) Bug xes, Downtimes, Content Changes
Bug xes, Downtimes, Content Changes: ehealth systems are often dynamic systems. A description of changes to methods therefore also includes important changes made on the intervention or comparator during the trial (e.g., major bug xes or changes in the functionality or content) (5-iii) and other "unexpected events" that may have in uenced study design such as staff changes, system failures/downtimes, etc. [2].
Does your paper address subitem 3b-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study There were no events such as bug x, downtime, content changes since the start of the trial.
Does your paper address CONSORT subitem 4a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Children with normal development were aged 5-6 years and con rmed to develop normally based on examinations and specialists. Children with developmental disabilities were aged 5-7 years and had a cognitive age of 4-6 years." You're editing your response. Sharing this URL allows others to also edit your response. Computer / Internet literacy is often an implicit "de facto" eligibility criterion -this should be explicitly clari ed.
Does your paper address subitem 4a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study In this study, computer/internet literacy" was not considered as eligibility 4a-ii) Open vs. closed, web-based vs. face-to-face assessments: Open vs. closed, web-based vs. face-to-face assessments: Mention how participants were recruited (online vs. o ine), e.g., from an open access website or from a clinic, and clarify if this was a purely web-based trial, or there were face-to-face components (as part of the intervention or for assessment), i.e., to what degree got the study team to know the participant. In online-only trials, clarify if participants were quasi-anonymous and whether having multiple identities was possible or whether technical or logistical measures (e.g., cookies, email con rmation, phone calls) were used to detect/prevent these.
Does your paper address subitem 4a-ii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Participants were openly recruited and enrolled in clinical studies by face-to-face evaluation by physicians.
4a-iii) Information giving during recruitment Information given during recruitment. Specify how participants were briefed for recruitment and in the informed consent procedures (e.g., publish the informed consent documentation as appendix, see also item X26), as this information may have an effect on user self-selection, user expectation and may also bias results.
You're editing your response. Sharing this URL allows others to also edit your response. Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "In this study, children aged between 3 and 18 years and between 5 and 6 years of age are included. It was impossible to get written consent, so the "children's consent manual" was not handled. Instead, we received a "subject explanatory note and consent form" from the subject's representative. "

FILL OUT A NEW RESPONSE
Does your paper address CONSORT subitem 4b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study All clinical trial data were documented, coded and stored on a computer at Asan Medical Center in Seoul, Korea.

4b-i) Report if outcomes were (self-)assessed through online questionnaires
Clearly report if outcomes were (self-)assessed through online questionnaires (as common in webbased trials) or otherwise.
Does your paper address subitem 4b-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study This study did not use online questionnaires.
You're editing your response. Sharing this URL allows others to also edit your response. Does your paper address subitem 4b-ii?

FILL OUT A NEW RESPONSE
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer

5-i) Mention names, credential, a liations of the developers, sponsors, and owners
Mention names, credential, a liations of the developers, sponsors, and owners [6] (if authors/evaluators are owners or developer of the software, this needs to be declared in a "Con ict of interest" section or mentioned elsewhere in the manuscript).
Does your paper address subitem 5-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Wooseong Lee, Byungjae Kim, and Yejin Choi are employees of DoBraine Co, You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential subitem not at all important 1 2 3 4 5 essential subitem not at all important 1 2 3 4 5 essential 5-ii) Describe the history/development process Describe the history/development process of the application and previous formative evaluations (e.g., focus groups, usability testing), as these will have an impact on adoption/use rates and help with interpreting results.
Does your paper address subitem 5-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer

5-iii) Revisions and updating
Revisions and updating. Clearly mention the date and/or version number of the application/intervention (and comparator, if applicable) evaluated, or describe whether the intervention underwent major changes during the evaluation process, or whether the development and/or content was "frozen" during the trial. Describe dynamic components such as news feeds or changing content which may have an impact on the replicability of the intervention (for unexpected events see item 3b).
Does your paper address subitem 5-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer

5-iv) Quality assurance methods
Provide information on quality assurance methods to ensure accuracy and quality of information provided [1], if applicable.
You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 5-iv?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer 5-v) Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing owcharts of the algorithms used Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing owcharts of the algorithms used. Replicability (i.e., other researchers should in principle be able to replicate the study) is a hallmark of scienti c reporting.
Does your paper address subitem 5-v?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer

5-vi) Digital preservation
Digital preservation: Provide the URL of the application, but as the intervention is likely to change or disappear over the course of the years; also make sure the intervention is archived (Internet Archive, webcitation.org, and/or publishing the source code or screenshots/videos alongside the article). As pages behind login screens cannot be archived, consider creating demo pages which are accessible without login.
Does your paper address subitem 5-vi?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

Your answer
You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential subitem not at all important 1 2 3 4 5 essential 5-vii) Access Access: Describe how participants accessed the application, in what setting/context, if they had to pay (or were paid) or not, whether they had to be a member of speci c group. If known, describe how participants obtained "access to the platform and Internet" [1]. To ensure access for editors/reviewers/readers, consider to provide a "backdoor" login account or demo mode for reviewers/readers to explore the application (also important for archiving purposes, see vi).
Does your paper address subitem 5-vii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Participants were directed to install mobile application from Google Play or App You're editing your response. Sharing this URL allows others to also edit your response. Does your paper address subitem 5-viii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Serious games are "games that do not have enjoyment, entertain or fun as their primary purpose" [7]. For example, Anzulewicz created a machine learning model that can identify children with autism [8]. Alchalabi also studied a way to detect children with attention de cit hyperactivity disorder (ADHD) using a serious game that is integrated with electroencephalogram signals [9]. Additionally, many researchers have targeted adult cognitive impairment detection [10]."

5-ix) Describe use parameters
Describe use parameters (e.g., intended "doses" and optimal timing for use). Clarify what instructions or recommendations were given to the user, e.g., regarding timing, frequency, heaviness of use, if any, or was the intervention used ad libitum.
Does your paper address subitem 5-ix?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer

5-x) Clarify the level of human involvement
Clarify the level of human involvement (care providers or health professionals, also technical assistance) in the e-intervention or as co-intervention (detail number and expertise of professionals involved, if any, as well as "type of assistance offered, the timing and frequency of the support, how it is initiated, and the medium by which the assistance is delivered". It may be necessary to distinguish between the level of human involvement required for the trial, and the level of human involvement required for a routine application outside of a RCT setting (discuss under item 21generalizability).
You're editing your response. Sharing this URL allows others to also edit your response. Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer 5-xi) Report any prompts/reminders used Report any prompts/reminders used: Clarify if there were prompts (letters, emails, phone calls, SMS) to use the application, what triggered them, frequency etc. It may be necessary to distinguish between the level of prompts/reminders required for the trial, and the level of prompts/reminders for a routine application outside of a RCT setting (discuss under item 21 -generalizability).

FILL OUT A NEW RESPONSE
Does your paper address subitem 5-xi? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "To encourage sustainable use, we sent a text message to participants' representative who did not use it once a week." 5-xii) Describe any co-interventions (incl. training/support) Describe any co-interventions (incl. training/support): Clearly state any interventions that are provided in addition to the targeted eHealth intervention, as ehealth intervention may not be designed as stand-alone intervention. This includes training sessions and support [1]. It may be necessary to distinguish between the level of training required for the trial, and the level of training for a routine application outside of a RCT setting (discuss under item 21 -generalizability. Does your paper address subitem 5-xii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "There were no human interventions other than early functional game usage training." You're editing your response. Sharing this URL allows others to also edit your response.
FILL OUT A NEW RESPONSE 6a) Completely de ned pre-speci ed primary and secondary outcome measures, including how and when they were assessed subitem not at all important 1 2 3 4 5 essential Does your paper address CONSORT subitem 6a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "In our study, we compared the baseline information between ND and DD groups using the Mann-Whitney U test. Then we measured correlation between GDI and a child's NPT for each group using the Pearson's correlation method. Finally, we assessed the feasibility of using this serious game as a tool for detecting children with heterogeneous developmental disabilities. A classi cation model was built with Gaussian process classi er, and model validation using leave-oneout cross validation (LOOCV) was conducted. For the GDI-based model, we used nine features (7 Game Scores, Path Accuracy, and Completion Rate), whereas for the NPT-based model, 19 features (6 K-WPPSI, 8 PEP-R, 2 BOT-2, 3 PEDI).
Receiver operating characteristic (ROC) and precision-recall (PR) curves were drawn from the validation result. Then area under the curve (AUC) was calculated for each curve. Sensitivity, speci city, precision, true positive rate (TPR), and true negative rate (TNR) were also measured. We assumed a signi cance level of 0.05. Data were processed and analyzed using R version 3.5.0 and Python 3.6 (including packages of Pandas 0.22.0, NumPy 1.14.3, and Jupyter 1.0.0). " 6a-i) Online questionnaires: describe if they were validated for online use and apply CHERRIES items to describe how the questionnaires were designed/deployed If outcomes were obtained through online questionnaires, describe if they were validated for online use and apply CHERRIES items to describe how the questionnaires were designed/deployed [9].
Does your paper address subitem 6a-i?
Copy and paste relevant sections from manuscript text

Your answer
You're editing your response. Sharing this URL allows others to also edit your response. Does your paper address CONSORT subitem 6b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study None.

FILL OUT A NEW RESPONSE
You're editing your response. Sharing this URL allows others to also edit your response. Does your paper address subitem 7a-i?

FILL OUT A NEW RESPONSE
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer Does your paper address CONSORT subitem 7b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study This study was a feasibility study and the sample size is too small to analyze, so we did not perform an interim analysis.
You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
8b) Type of randomisation; details of any restriction (such as blocking and block size) 9) Mechanism used to implement the random allocation sequence (such as sequentially numbered containers), describing any steps taken to conceal the sequence until interventions were assigned 10) Who generated the random allocation sequence, who enrolled participants, and who assigned participants to interventions Does your paper address CONSORT subitem 8a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The statistician of the Data Management team generated the randomly allocated sequence with the use of the R program." Does your paper address CONSORT subitem 8b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The randomization, using a block size of four, was strati ed depending on whether intervention and developmental disability." Does your paper address CONSORT subitem 9? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Randomization was done with the use of opaque, sealed envelopes. The statistician of the Data Management team generated the randomly allocated sequence with the use of the R program. Physicians enrolled the patients and opened the envelope with the lowest available registration number within the appropriate stratum. " You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
11a) If done, who was blinded after assignment to interventions (for example, participants, care providers, those assessing outcomes) and how NPT: Whether or not administering co-interventions were blinded to group assignment subitem not at all important 1 2 3 4 5 essential Does your paper address CONSORT subitem 10? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The statistician of the Data Management team generated the randomly allocated sequence with the use of the R program. Physicians enrolled the patients and opened the envelope with the lowest available registration number within the appropriate stratum. " 11a-i) Specify who was blinded, and who wasn't Specify who was blinded, and who wasn't. Usually, in web-based trials it is not possible to blind the participants [1, 3] (this should be clearly acknowledged), but it may be possible to blind outcome assessors, those doing data analysis or those administering co-interventions (if any).
Does your paper address subitem 11a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Participants knew the group to which they belong, but physicians and inspector of neuro-psychological test did not know it was maintained until the end of the trial." You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential 11b) If relevant, description of the similarity of interventions (this item is usually not relevant for ehealth trials as it refers to similarity of a placebo or sham intervention to a active medication/intervention) 12a) Statistical methods used to compare groups for primary and secondary outcomes NPT: When applicable, details of whether and how the clustering by care providers or centers was addressed 11a-ii) Discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator" Informed consent procedures (4a-ii) can create biases and certain expectations -discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator".
Does your paper address subitem 11a-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer Does your paper address CONSORT subitem 11b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study None.
Does your paper address CONSORT subitem 12a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "In our study, we compared the baseline information between ND and DD groups using the Mann-Whitney U test." You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential 12b) Methods for additional analyses, such as subgroup analyses and adjusted analyses 12a-i) Imputation techniques to deal with attrition / missing values Imputation techniques to deal with attrition / missing values: Not all participants will use the intervention/comparator as intended and attrition is typically high in ehealth trials. Specify how participants who did not use the application or dropped out from the trial were treated in the statistical analysis (a complete case analysis is strongly discouraged, and simple imputation techniques such as LOCF may also be problematic [4]).
Does your paper address subitem 12a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Imputation was not performed in this study.
Does your paper address CONSORT subitem 12b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Then we measured correlation between GDI and a child's NPT for each group using the Pearson's correlation method. Finally, we assessed the feasibility of using this serious game as a tool for detecting children with heterogenous developmental disabilities. A classi cation model was built with gaussian process classi er, and model validation using leave-one-out cross validation (LOOCV) was conducted. For the GDI-based model, we used nine features (7 Game Scores, Path Accuracy, and Completion Rate), whereas for the NPT-based model, 19 features (6 K-WPPSI, 8 PEP-R, 2 BOT-2, 3 PEDI). Receiver operating characteristic (ROC) and precision-recall (PR) curves were drawn from the validation result. Then area under the curve (AUC) was calculated for each curve.
Sensitivity, speci city, precision, true positive rate (TPR), and true negative rate (TNR) were also measured. We assumed a signi cance level of 0.05. Data were processed and analyzed using R version 3.5.0 and Python 3.6 (including packages of Pandas 0.22.0, NumPy 1.14.3, and Jupyter 1.0.0)." You're editing your response. Sharing this URL allows others to also edit your response. Does your paper address subitem X26-ii?

FILL OUT A NEW RESPONSE
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Participants were too young to receive consent. We received a "subject explanatory note and consent form" from the participants' representative (Supplement 1). " You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential RESULTS 13a) For each group, the numbers of participants who were randomly assigned, received intended treatment, and were analysed for the primary outcome NPT: The number of care providers or centers performing the intervention in each group and the number of patients treated by each care provider in each center X26-iii) Safety and security procedures Safety and security procedures, incl. privacy considerations, and any steps taken to reduce the likelihood or detection of harm (e.g., education and training, availability of a hotline) Does your paper address subitem X26-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study All clinical trial data were documented, coded and stored on a computer at Asan Medical Center in Seoul, Korea.
You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
13b) For each group, losses and exclusions after randomisation, together with reasons Does your paper address CONSORT subitem 13a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "ND and DD groups comprised nine and seven children, respectively.
Chronological age was not signi cantly different between the two groups. Sex was signi cantly different because the proportion of males in DD group was higher than that in the ND group. The K-WPPSI-IV test result, which measured a child's cognitive ability, showed that full scale IQ was signi cantly different between ND and DD groups (p<0.01). Moreover, ND group surpassed DD group in all sub-categories of K-WPPSI-IV. Especially, ND and DD groups showed statistical difference in VCI, VSI, and FRI (p<0.05; Does your paper address CONSORT subitem 13b? (NOTE: Preferably, this is shown in a CONSORT ow diagram) * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The study group consisted of 48 children with normal developmental and developmental disabilities (Figure 1). In this study, children with normal development were labeled as ND (Normal Development) group and those with developmental disabilities, as DD (Developmental Disabilities) group. The control group that did not undergo intervention and children who could not carry out level C of a serious game was excluded from this study. " You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential 14a) Dates de ning the periods of recruitment and follow-up subitem not at all important 1 2 3 4 5 essential 13b-i) Attrition diagram Strongly recommended: An attrition diagram (e.g., proportion of participants still logging in or using the intervention/comparator in each group plotted over time, similar to a survival curve) or other gures or tables demonstrating usage/dose/engagement. Does your paper address subitem 13b-i?
Copy and paste relevant sections from the manuscript or cite the gure number if applicable (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer Does your paper address CONSORT subitem 14a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The recruitment period for this study is from October 2018 to January 2019. If the group is assigned after the face to face evaluation, the intervention is given for 6 months. Then follow up for 3 months." 14a-i) Indicate if critical "secular events" fell into the study period Indicate if critical "secular events" fell into the study period, e.g., signi cant changes in Internet resources available or "changes in computer hardware or Internet delivery resources" Does your paper address subitem 14a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

Your answer
You're editing your response. Sharing this URL allows others to also edit your response. Does your paper address CONSORT subitem 14b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Clinical trials are terminated if serious side effects occur. However, this study was based on the results of the ongoing research using a weekly data of intervention rather than the entire data.

FILL OUT A NEW RESPONSE
Does your paper address CONSORT subitem 15? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Chronological age was not signi cantly different between the two groups. Sex was signi cantly different because the proportion of males in DD group was higher than that in the ND group. The K-WPPSI-IV test result, which measured a child's cognitive ability, showed that full scale IQ was signi cantly different between ND and DD groups (p<0.01). Moreover, ND group surpassed DD group in all sub-categories of K-WPPSI-IV. Especially, ND and DD groups showed statistical difference in VCI, VSI, and FRI (p<0.05; You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential 16) For each group, number of participants (denominator) included in each analysis and whether the analysis was by original assigned groups subitem not at all important 1 2 3 4 5 essential 15-i) Report demographics associated with digital divide issues In ehealth trials it is particularly important to report demographics associated with digital divide issues, such as age, education, gender, social-economic status, computer/Internet/ehealth literacy of the participants, if known.
Does your paper address subitem 15-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study We did not consider the digital divide issue in this study.

16-i) Report multiple "denominators" and provide de nitions
Report multiple "denominators" and provide de nitions: Report N's (and effect sizes) "across a range of study participation [and use] thresholds" [1], e.g., N exposed, N consented, N used more than x times, N used more than y weeks, N participants "used" the intervention/comparator at speci c prede ned time points of interest (in absolute and relative numbers per group). Always clearly de ne "use" of the intervention.
Does your paper address subitem 16-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "The study group consisted of 48 children with normal developmental and developmental disabilities (Figure 1). In this study, children with normal development were labeled as ND (Normal Development) group and those with developmental disabilities, as DD (Developmental Disabilities) group. The control group that did not undergo intervention and children who could not carry out level C of a serious game was excluded from this study. " You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential 17a) For each primary and secondary outcome, results for each group, and the estimated effect size and its precision (such as 95% con dence interval) subitem not at all important 1 2 3 4 5 essential 16-ii) Primary analysis should be intent-to-treat Primary analysis should be intent-to-treat, secondary analyses could include comparing only "users", with the appropriate caveats that this is no longer a randomized sample (see 18-i).
Does your paper address subitem 16-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer Does your paper address CONSORT subitem 17a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Correlation between NPT and GDI results were computed for each group using the Pearson's correlation method ( Figure 3). Overall, GDI and NPT showed higher correlation values in ND group than in DD group. Logical Reassignment and Completion Rate in GDI showed a high correlation with NTP. In DD group, Constructional Ability of GDI showed the highest correlation with VSI (0.92). " 17a-i) Presentation of process outcomes such as metrics of use and intensity of use In addition to primary/secondary (clinical) outcomes, the presentation of process outcomes such as metrics of use and intensity of use (dose, exposure) and their operational de nitions is critical. This does not only refer to metrics of attrition (13-b) (often a binary variable), but also to more continuous exposure metrics such as "average session length". These must be accompanied by a technical description how a metric like a "session" is de ned (e.g., timeout after idle time) [1] (report under item 6a).
You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
17b) For binary outcomes, presentation of both absolute and relative effect sizes is recommended 18) Results of any other analyses performed, including subgroup analyses and adjusted analyses, distinguishing prespeci ed from exploratory subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 17a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer Does your paper address CONSORT subitem 17b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study The purpose of this study is to develop a classi er that can distinguish between DD (Developmental disability) and ND (Normal Development), and a model for this is developed and AUC is presented as a result.
Does your paper address CONSORT subitem 18? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study None.

18-i) Subgroup analysis of comparing only users
A subgroup analysis of comparing only users is not uncommon in ehealth trials, but if done, it must be stressed that this is a self-selected sample and no longer an unbiased sample from a randomized trial (see 16-iii).
You're editing your response. Sharing this URL allows others to also edit your response.

19) All important harms or unintended effects in each group
(for speci c guidance see CONSORT for harms) subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 18-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer Does your paper address CONSORT subitem 19? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "No serious adverse events or side effects were observed in ND and DD

19-i) Include privacy breaches, technical problems
Include privacy breaches, technical problems. This does not only include physical "harm" to participants, but also incidents such as perceived or real privacy breaches [1], technical problems, and other unexpected/unintended incidents. "Unintended effects" also includes unintended positive effects [2].
Does your paper address subitem 19-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

Your answer
You're editing your response. Sharing this URL allows others to also edit your response. Does your paper address subitem 19-ii?

FILL OUT
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer 22-i) Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use) Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use).
You're editing your response. Sharing this URL allows others to also edit your response. Does your paper address subitem 22-ii?

FILL OUT
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

Your answer
You're editing your response. Sharing this URL allows others to also edit your response.

FILL OUT A NEW RESPONSE
subitem not at all important 1 2 3 4 5 essential 21) Generalisability (external validity, applicability) of the trial ndings NPT: External validity of the trial ndings according to the intervention, comparators, patients, and care providers or centers involved in the trial 20-i) Typical limitations in ehealth trials Typical limitations in ehealth trials: Participants in ehealth trials are rarely blinded. Ehealth trials often look at a multiplicity of outcomes, increasing risk for a Type I error. Discuss biases due to nonuse of the intervention/usability issues, biases through informed consent procedures, unexpected events.
Does your paper address subitem 20-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study "Our study population is not large enough, thereby limiting the generalization of our ndings to the general population. However, our ndings show the feasibility of using this serious game for screening general and heterogeneous developmental disabilities. As children continue to develop in various areas in the earlier stage of developmental disabilities, a de nite diagnosis of the disease is di cult. Our model is useful because of the exibility and heterogeneous characteristic of a developmental disability. In the future, we will widen our study population to enhance the generalization of our ndings.
Moreover, the GDI did not reveal linear correlation with NPT in DD group. In clinical situation, NPT is essential for the diagnosis of developmental disabilities.
Therefore, the estimation of NPT with GDI could provide caregivers and specialists with more information. However, our study did not build a model that estimates NPT from GDI because of small population size. Future studies must build a more complex NPT estimation model other than the simple linear correlation one." You're editing your response. Sharing this URL allows others to also edit your response. Generalizability to other populations: In particular, discuss generalizability to a general Internet population, outside of a RCT setting, and general patient population, including applicability of the study results for other organizations Does your paper address subitem 21-i?

FILL OUT A NEW RESPONSE
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Your answer 21-ii) Discuss if there were elements in the RCT that would be different in a routine application setting Discuss if there were elements in the RCT that would be different in a routine application setting (e.g., prompts/reminders, more human involvement, training sessions or other co-interventions) and what impact the omission of these elements could have on use, adoption, or outcomes if the intervention is applied outside of a RCT setting.
Does your paper address subitem 21-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study

Your answer
You're editing your response. Sharing this URL allows others to also edit your response.

24)
Where the full trial protocol can be accessed, if available 25) Sources of funding and other support (such as supply of drugs), role of funders X27) Con icts of Interest (not a CONSORT item) Does your paper address CONSORT subitem 23? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Does your paper address CONSORT subitem 25? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Changbae Bang is supported by the Seok-San Biomedical Science Scholarships, Yonsei University College of Medicine. This study was supported by the student research fund from Yonsei University College of Medicine in 2019.
You're editing your response. Sharing this URL allows others to also edit your response. In addition to the usual declaration of interests ( nancial or otherwise), also state the relation of the study team towards the system being evaluated, i.e., state if the authors/evaluators are distinct from or identical with the developers/sponsors of the intervention.

FILL OUT A NEW RESPONSE
Does your paper address subitem X27-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or brie y explain why the item is not applicable/relevant for your study Wooseong Lee, Byungjae Kim, and Yejin Choi are employees of DoBraine Co, Ltd.
All other authors declare no con icts of interest.
As a result of using this checklist, did you make changes in your manuscript? * What were the most important changes you made as a result of using this checklist?
The Method section has become more sophisticated.
How much time did you spend on going through the checklist INCLUDING making changes in your manuscript * About three days You're editing your response. Sharing this URL allows others to also edit your response. STOP -Save this form as PDF before you click submit

FILL OUT A NEW RESPONSE
To generate a record that you lled in this form, we recommend to generate a PDF of this page (on a Mac, simply select "print" and then select "print as PDF") before you submit it.
When you submit your (revised) paper to JMIR, please upload the PDF as supplementary le.
Don't worry if some text in the textboxes is cut off, as we still have the complete information in our database. Thank you! Final step: Click submit ! Click submit so we have your answers in our database! As a result of using this checklist, do you think your manuscript has improved? * Would you like to become involved in the CONSORT EHEALTH group?
This would involve for example becoming involved in participating in a workshop and writing an "Explanation and Elaboration" document Any other comments or questions on CONSORT EHEALTH None.

SUBMIT
You're editing your response. Sharing this URL allows others to also edit your response.