Review
Abstract
Background: The prevalence of dementia is increasing, and there are many associated problems that family members face as informal carers, including emotional, physical, and financial difficulties. There are benefits for a person with dementia to live at home for as long as possible, and therefore, supporting their informal carers is crucial. The growing interest in supporting carers through internet-based interventions is evidenced by the volume of systematic reviews on this topic. It is now appropriate to systematically examine this body of work and provide an overview of the literature.
Objective: This umbrella review aimed to identify the most effective internet-based intervention content and delivery method to support those caring for someone with dementia living in the community.
Methods: PsycINFO, Web of Science, CINAHL, MEDLINE, Cochrane Library, and PubMed were searched for systematic reviews examining the effectiveness of web-based interventions for informal carers of people with dementia. A total of 3 reviewers extracted data and evaluated the quality of the papers. To ascertain the extent to which the systematic reviews reported on the same evidence, the proportion of overlap between their included studies was calculated. Qualitative research findings were extracted and reported.
Results: A total of 21 papers were included in the study. The quality of the review papers was mainly rated as low to moderate, and 10% (2/21) of papers were of high quality. The findings suggest that multicomponent interventions were the most effective in supporting carers. These included combinations of cognitive behavioral therapy and relaxation strategies, educational resources, and online support groups. Interventions that were delivered on the web but included sessions with a personal element, such as telephone contact, showed the best results. When comparing the studies reviewed in all the review papers, a moderate overlap was noted. However, when comparing individual reviews with each other, they showed a high overlap of the included studies.
Conclusions: Mixed delivery methods and intervention content showed the most effective results in supporting those caring for people with dementia. However, many papers do not separate the results for differing intervention contents or delivery; this needs to be considered when drawing conclusions. There was an overlap among the studies included in the reviews. This suggests a lack of current research on the effectiveness of web-based interventions for people caring for a person with dementia. There was also a lack of consistency in the outcome measures across all papers. Future studies can involve updating research on the effectiveness of these interventions while distinguishing between different intervention types, thus creating guidelines for the use of standardized measures to enable comparisons of intervention effects and improve the scientific quality of the overall research.
Trial Registration: PROSPERO CRD42021241559; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=241559
doi:10.2196/36727
Keywords
Introduction
Background
Caring for someone with dementia is challenging emotionally and physically, and carers often need support in this role [
]. This is amplified when the person with dementia is a family member, and the carers are unlikely to have received any formal training in dementia knowledge or how to care for a person with dementia [ ]. Supporting informal carers helps not only the carer but also the person with dementia by improving their quality of life and care, thus enabling them to remain at home for longer [ ]. Informal carers are people who offer care and support to a person with dementia on a familial or friendship basis. An umbrella review of psychosocial interventions for informal carers of persons with dementia in 2017 identified 13 studies [ ]. These included randomized controlled trials (RCTs) of interventions aimed at reducing stress, depression, and other mental health issues as well as physical health problems. They used a combination of educational resources on dementia, practical caring advice, and tips as well as peer support and psychotherapeutic methods to help carers adjust their way of thinking and cope with behavior changes related to dementia. Dickinson et al [ ] concluded that multicomponent interventions consisting of educational, social, and therapeutic elements were most effective in improving the well-being of informal carers of persons with dementia. This suggests that carers need advice on caring for persons with dementia as well as for coping and managing their own emotions.Differentiating between interventions targeting formal (professional) carers and those targeting informal carers is important. Formal carers will often be more experienced in caring for a person with dementia; hence, they will have some prior knowledge and training [
]. The relationship of a person with dementia with a formal carer is different from that with an informal carer, who often knows the person before the diagnosis, suggesting a more emotionally involved relationship. This was demonstrated when carers were asked to describe their reactions to aggressive behaviors from persons with dementia [ ]. Informal carers said they devoted more time to the person with dementia and reduced outside contact, whereas formal carers gave practical ways to avoid behavioral episodes that did not isolate them from support systems [ ]. This noted difference in approach could benefit from training and understanding of behavior, helping informal carers to consider alternative approaches.Health care interventions have been moving toward becoming more technology based to combat the rising and unmaintainable health and social care costs because they require fewer staff and are able to reach more people at a similar cost [
]. This move has been accelerated by the COVID-19 pandemic, which forced several services to move to a web-based format, and many people learned how to use technology [ , ]. Technology-based interventions such as those administered on the web or by telephone are time- and cost-effective [ ]. They are especially beneficial for carers in rural areas who would ordinarily have to travel to access such services [ ]. Rurality may also cause difficulties in accessing the internet [ , ]; however, the number of people in the United Kingdom with access to the internet is consistently increasing [ ]. Web-based interventions specifically use the internet, such as an educational website or a peer support forum. Technology-based interventions developed before 2000 were mainly administered by CD-ROM or DVD [ ], and for the purpose of this review, they are not included in the definition of web-based intervention.Web-based interventions that are based solely on education and do not have a live element, such as a video call, can be more convenient for busy carers to access at any time. They also require less bandwidth to run [
]; therefore, interventions without video calls will be accessible to more carers. However, not having the engagement and accountability of speaking to another person may reduce adherence to web-based interventions [ ] and reduce personal contact.Technology-based interventions may not be appropriate for all carers because of a range of factors, including age [
]. Spouse or sibling carers of persons with dementia are often older than those caring for a parent with dementia, resulting in a large age range for carers of persons with dementia. However, the number of adults aged ≥75 years in the United Kingdom who use the internet has increased by 26% between 2011 and 2019 [ ], with a probable further increase since the COVID-19 pandemic. Given these rapidly evolving developments, it seems timely to review the evidence for web-based support for carers of persons with dementia by conducting an umbrella review of published systematic reviews of web-based interventions.An umbrella review is a relatively new tool used for evidence synthesis [
]. The method was developed in response to the growing number of systematic reviews being published [ , ]. It is a systematic review of reviews that provides an overview of the information available on a subject [ ]. It is often broader in scope than a systematic review and offers a summary that may be useful for policy makers [ , ]. This method of data synthesis was selected after a brief literature search revealed several systematic reviews focusing on the effectiveness of web-based interventions for informal carers of persons with dementia.Aims of This Review
This umbrella review aimed to synthesize systematic reviews of web-based interventions for informal carers. It will (1) identify types of web-based interventions that have been developed for informal carers of persons with dementia in the community and (2) report on which types are most effective in supporting carers of persons with dementia.
This umbrella review summarizes the topic by using a narrative approach. This may detect gaps in the topic and allow identification of effective methods for future interventions aimed at supporting informal carers of persons with dementia living in the community and enabling persons with dementia to live at home for longer.
Research Question
The research question for this review was as follows:
1. “What types of web-based interventions have been developed for informal carers of persons with dementia living in the community?”
This was further developed into a subquestion:
2. “What are the types of web-based interventions that are most effective in supporting informal carers of persons with dementia living in the community?”
Methods
Overview
The methods used in this umbrella review were based on the guidelines from the Joanna Briggs Institute (JBI) [
]. The research question, search strategy, and inclusion criteria were developed before conducting the search. This protocol was registered with PROSPERO (International Prospective Register of Systematic Reviews; registration number CRD42021241559).Inclusion Criteria
The inclusion criteria were generated using the population, concept, and context guide as suggested by JBI [
]:- P—The population were informal carers of persons with dementia (eg, family members, friends, and neighbors that identified themselves as carers. There were no restrictions on the amount of time spent caring). Paid carers were excluded from this review.
- C—The concept involved web-based interventions, which included psychosocial, educational, and therapeutic interventions administered on the web. This review focused specifically on web-based interventions owing to the convenience of being able to access them at any time compared with telephone or face-to-face interventions, which are more time sensitive. Therefore, telephone-only interventions, prerecorded videos, and face-to-face interventions were excluded.
- C—The context for the review was carers for persons with dementia who were living at home. Carers caring for a person residing in a care home or hospital were excluded from the review, as they would usually include formal carers. Carers in the community, either adjusting to their role or managing ongoing stressors from offering regular care, may require support in adjusting to the role of a carer [ , ]. They may also require web-based interventions that they can access without leaving the house, so that they do not need to make alternative care arrangements to physically access supportive interventions [ ]. Carers of people in care homes were excluded as although they continued to care for the person with dementia, their needs were conceptualized as different compared with those managing the care for persons with dementia living in the community.
Only systematic reviews and meta-analyses of web-based interventions were included in this study. We refer to systematic reviews as review papers and papers that they reviewed as study papers. Only reviews in English were included, but date limits were not imposed, as remote interventions before 2000 were mainly administered by CD-ROM or teleconferencing [
] and would not be classified as web-based interventions, and therefore, they were excluded.Search Strategy
Overview
The following databases were searched: PsycINFO, Web of Science, CINAHL, MEDLINE, Cochrane Library, and PubMed, as these contain papers from health, social care, and psychological perspectives. The reference lists of review papers were also manually searched, and furthermore, experts were consulted regarding the reviews to be included.
In total, 3 pilot searches were performed to refine the search criteria, focusing on different keywords in different parts of the papers, which provided a better understanding of the literature to create a concise and comprehensive search strategy (
). This removed irrelevant papers, resulting in a satisfactory number of review papers that addressed the research question.Search 1
The first search looked for the keywords anywhere in the papers, including the title, abstract, and text (
). The terms “dementia,” “major neurocognitive disorder,” and “Alzheimer*” were selected as they would identify papers focusing on a range of dementia subtypes including vascular dementia, dementia with Lewy bodies, and Alzheimer disease. The option to search for systematic reviews only was selected for each database. This search found 2369 review papers with many being irrelevant, containing interventions for carers of conditions other than dementia. This search was conducted only on the first 3 databases because of the large number of papers that were unrelated to the review. The words eHealth and telehealth were found to be more focused on physical health, such as blood pressure monitoring; consequently, they were replaced in the second search with more specific terms, that is, internet, on the web, and technology.Search 2
The second search included more variations of the search terms used in the first search and focused on locating these only in the abstracts (
). This resulted in fewer papers (1116 in total); however, many papers focused on conditions other than dementia such as cancer.Final Search
The third search used the same search terms, but these had to be included in the titles of the review papers, resulting in 148 results from 6 databases (
). Owing to the number and relevance of the results from the third search, this was the final search strategy used for the review. The strategy was adjusted for each database to use variations of the search that were functional. The final search was conducted on October 1, 2021. A further 3 papers were included based on the suggestion of the second reviewer.Study Selection
The results were downloaded from the databases and imported into the RefWorks (ProQuest LLC) web-based reference manager. The inbuilt tool was used to remove duplicates, and then, a manual search removed the remaining duplicates that were not identified by RefWorks, which resulted in the removal of 45 papers.
The lead author (BNM) reviewed the titles and abstracts of all 106 review papers to ensure that they met the inclusion criteria, leading to the exclusion of 75 papers. The full texts of 31 papers were assessed by the lead author (BNM), which led to the exclusion of 10 papers. To ensure that the eligibility criteria were applied consistently, coauthors (GW and CL) independently assessed 50% (5/10) of the excluded papers each. These papers were randomly allocated to the coauthors using a random number generator. The inclusion criteria were clear, and there was no disagreement regarding the exclusion of the papers.
Interventions aimed at formal (professional) carers in a care home or hospital setting were excluded, as this review focused on interventions for informal carers. However, several of the review papers included data collected from both formal and informal carers, which were still included as the exclusion of the papers would result in the loss of relevant data.
Methodological Quality
The quality of the reviews was assessed using the A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2 [
] quality assessment tool. This is an updated version of the AMSTAR tool [ ], and it measures the methodological quality of systematic reviews. There are 16 items assessing the inclusion of systematic review methods that are considered high quality ( ). The AMSTAR 2 tool is not intended to rate the quality of a review paper as a whole, and it is advised to consider the impact of each individual item to provide a rating of overall confidence in the results [ ]. Ratings range from critically low to high and are produced using the web-based assessment tool. The scores are dependent on the answers to 7 critical items presented in . A high-quality rating indicates <1 critical weakness in a review paper, moderate rating indicates >1 noncritical weakness, low rating indicates 1 critical weakness, and critically low rating indicates >1 critical weakness. All reviews were assessed for quality by the lead author (BNM), and the second and third authors (GW and RS) assessed 29% (6/21) of the papers each, resulting in 57% (12/21) of the reviews being assessed by 2 authors. The fourth author (CL) was consulted to reach a consensus in the case of any disagreement.AMSTAR 2 questions | Responses | Critical domain |
Did the research questions and inclusion criteria for the review include the components of PICOa? | Yes or no | No |
Did the report of the review contain an explicit statement that the review methods were established before the conduct of the review, and did the report justify any significant deviations from the protocol? | Yes or partial yes or no | Yes |
Did the review authors explain their selection of the study designs for inclusion in the review? | Yes or no | No |
Did the review authors use a comprehensive literature search strategy? | Yes or partial yes or no | Yes |
Did the review authors perform study selection in duplicate? | Yes or no | No |
Did the review authors perform data extraction in duplicate? | Yes or no | No |
Did the review authors provide a list of excluded studies and justify the exclusions? | Yes or partial yes or no | Yes |
Did the review authors describe the included studies in adequate detail? | Yes or partial yes or no | No |
Did the review authors use a satisfactory technique for assessing RoBb in individual studies that were included in the review? | For RCTsc—yes or partial yes or no or includes only NRSId; for NRSI—yes or partial yes or no or includes only RCTs | Yes |
Did the review authors report on the sources of funding for the studies included in the review? | Yes or no | No |
If meta-analysis was performed, did the review authors use appropriate methods for statistical combination of results? | For RCTs—yes or no or no meta-analysis conducted; for NRSI—yes or no or no meta-analysis conducted | Yes |
If meta-analysis was performed, did the review authors assess the potential impact of RoB in individual studies on the results of the meta-analysis or other evidence synthesis? | Yes or no or no meta-analysis conducted | No |
Did the review authors account for RoB in primary studies when interpreting or discussing the results of the review? | Yes or no | Yes |
Did the review authors provide a satisfactory explanation for, and discussion of, any heterogeneity observed in the results of the review? | Yes or no | No |
If they performed quantitative synthesis, did the review authors carry out an adequate investigation of publication bias (small study bias) and discuss its likely impact on the results of the review? | Yes or no or no meta-analysis conducted | Yes |
Did the review authors report any potential sources of conflict of interest, including any funding they received for conducting the review? | Yes or no | No |
aPICO: population, intervention, control group, outcome.
bRoB: risk of bias.
cRCT: randomized controlled trial.
dNRSI: nonrandomized studies of intervention.
Corrected Covered Area
Review papers on similar topics may include the same studies in their reviews. Overlap of individual studies in systematic reviews can mask a lack of current research on a given topic. If new systematic reviews are being conducted, it can give a false impression of new evidence. To address the extent of overlap, the corrected covered area (CCA) [
] measure was used. The CCA was developed to compare the overlap of studies reviewed in meta-analysis reviews. Although this review was of systematic reviews, the CCA index was used to demonstrate the overlap of studies in the review papers. The CCA was calculated by multiplying the number of index publications by the number of review papers and then subtracting the number of index publications. This was then divided by the frequency of repeated studies. Index publications are the number of primary studies in the review papers, so that they are only counted once, disregarding any repeats in other review papers. A high CCA score indicates a high percentage of overlap.The CCA measurement has been described as a “promising” measure of overlap; however, it is easily skewed by the inclusion of a single review containing many index publications [
]. To compensate for this potential skew, 5 steps were recommended: create a citation matrix ( [ , , - ]), calculate the total CCA, calculate the CCA for reviews with high overlap, examine the topic areas for differences in date or samples, and discuss the potential implications of the overlap and report on similarities and differences in outcomes.Data Extraction
A table for data extraction was created based on the JBI [
] guidelines for conducting umbrella reviews. The data extracted included authors, date, country in which the study was undertaken, number of studies reviewed, population or demographics, sample sizes, intervention details (content and delivery), measures, aims, results, and key findings related to the research question.Of 21 review papers, 3 (14%) [
- ] included data from both face-to-face interventions and technology-based interventions. The results from these 2 interventions were reported separately in each review, so only the data from the technology-based interventions were extracted (refer to column S in [ , , - ]). However, the definition of “technology-based” interventions varied among some of the review papers. For example, a study by Chang [ ], which looked at a cognitive behavioral therapy–based intervention that was delivered by video and telephone, was classified as a technology-based intervention in the reviews by Deeken et al [ ], Jackson et al [ ], Lucero et al [ ], and Waller et al [ ] but not by Thompson et al [ ]. The rationale for Thompson et al [ ] classifying the study by Chang [ ] as face-to-face was not clear. Consequently, the data from the study by Chang [ ] were extracted from the reviews that defined it as a technology-based intervention [ - ].Of 21 review papers, 3 (14%) included data from both formal and informal carers. Hopwood et al [
] included 40 studies, 3 (8%) of which were a mixture of formal and informal carers. Etxeberria et al [ ] primarily incorporated informal carers, but 2 studies included formal carers. Pleasant et al [ ] included 9 studies examining formal and informal carers. However, the results of these studies could not be separated from those of informal carers. As only 11.8% (14/119) of studies included both formal and informal carers, they were included in the data synthesis.To evaluate the interrater reliability of the data extraction, the second and third reviewers (GW and RS) evaluated 57% (12/21) of the total review papers. Any disagreements were resolved by the fourth reviewer (CL).
Data Synthesis
In line with the JBI [
] framework for conducting umbrella reviews, the data were presented as a summary of the synthesized results with no further analysis. The extracted data were used to populate a table of study characteristics ( ) and a table summarizing the evidence. The framework states that the summary table should be presented visually, showing effective interventions, mixed results, and no significant improvements. Although the term “major neurocognitive disorder” was introduced in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition [ ], to help counter the stigma associated with the term “dementia,” research and health care settings continue to use the term dementia. The key terms used in the systematic search included both “dementia” and “major neurocognitive disorder”; however, we found that most of the papers used the term “dementia,” and consequently, for the purposes of this review, we use the term “dementia” throughout.Results
The review process is illustrated in
. A total of 21 review papers met the inclusion criteria and were included for data synthesis.Methodological Quality
After reviewing the papers separately, there was agreement on 83% of the AMSTAR 2 [
] scores. Any disagreements were resolved by the third author. Of the 21 reviews included, 2 (9%) were rated as high quality, 9 (43%) were rated as moderate quality, 2 (9%) were rated as low quality, and 8 (38%) were rated as critically low quality ( ). This suggests that despite the number of papers on a similar topic, only 2 contained the recommended depth. The most common issues were a lack of bias assessment and not having a protocol in place before conducting the search, which were suggested to be because of time constraints.CCA Scores
The total CCA score showed a 7% overlap, which is considered a moderate overlap; <5% is low overlap, and >15% is high overlap [
]. The CCA matrix ( ) was used to determine reviews with a high overlap so that the CCA scores could be calculated for them. Individual CCA scores were calculated by comparing each of the 21 reviews with each other ( ). The results showed that 26% of the CCA scores were high, 50% were moderate, and 24% were low. The highest overlap was 56%, which was between those reported by Zhao et al [ ] and Egan et al [ ].Characteristics of the Included Reviews
The total number of research studies included across the review papers was 119 (50 of these were included more than once). The number of studies included in each review paper ranged from 4 to 40. The research designs varied within each review paper and included mixed methods, RCTs, and pre- and postintervention measures.
Participants
The sample sizes varied from a pre-post intervention study of 4 [
] to an RCT of 1222 participants [ ]. The participants included mainly informal carers; 29% (6/21) review papers included a mix of formal and informal carers, and 14% (3/21) review papers also looked at the intervention effects on persons with dementia ( ). There was an umbrella term of “dementia carers” being used to describe formal and informal carers for people with Alzheimer disease, vascular dementia, and early onset dementia; however, 57% (12/21) of the reviews did not describe the type of dementia that the care recipient had. Furthermore, 52% (11/21) reviews included more detailed information on the participants [ , , , , , - , ], including their nationalities. The countries in which the studies were conducted were reported in 52% (11/21) reviews. In addition, 52% (11/21) reviews reported the gender of carers. Participants were mainly female; however, 1 study [ ] that was included in 3 of the reviews specifically looked at male carers [ - ]. Of the 21 reviews, 8 (38%) reviews described age of the carers, which ranged from 18 to 88 years.Interventions
Interventions were delivered using technology, including web, telephone, DVD, or a combination of these (
). The duration of the interventions varied from having 24-hour access to websites to 6-minute telephone sessions.The content also varied; however, psychoeducation, psychotherapy, and social support were the most common types of interventions (
). Psychoeducational interventions provided information on caring and dementia to the carer. This included information from web-based encyclopedias, practical caring advice, classes with homework, web-based question-and-answer sessions with nurses, and web-based quizzes. The psychotherapy interventions contained elements of cognitive behavioral therapy to help carers manage their emotions and behavior, including cognitive restructuring, relaxation, and “telephone counseling.” The interventions offering social support used peer support via web-based groups, individual phone calls, and voice messages, facilitating carers to have contact with people in similar situations. Social support interventions have offered advice and coping strategies; however, this was from peers, and hence, it was more informal. At least one of these 3 intervention types was found to be present in all of the studies, often more than one, which is referred to as a multicomponent intervention.Outcomes of Review Papers
Outcomes differed between studies, with depression, anxiety, burden, and self-efficacy being most commonly measured. However, the measures used to assess these outcomes varied between the reviews. Waller et al [
] reported 5 different measures for depression ( ), and Jackson et al [ ] reported 5 measures for burden. This variation in measures made pooling results difficult [ ]; however, 7 reviews reported a meta-analysis of the results [ , , , , , , ].Authors | Depression measures | Number of depression measures |
Leng et al, 2020 [ | ]CES-Da, BDI-IIb, and PHQ-9c questions | 3 |
Deeken et al, 2019 [ | ]CES-D, BDI, GDSd, and BSIe depression subscale | 4 |
Hopwood et al, 2018 [ | ]CES-D and PHQ-9 | 2 |
Boots et al, 2014 [ | ]CES-D | 1 |
Egan et al, 2018 [ | ]CES-D and BDI-II | 2 |
Jackson et al, 2016 [ | ]CES-D, BDI, and GDRSf | 3 |
Lucero et al, 2019 [ | ]NRg | NR |
Pleasant et al, 2020 [ | ]CES-D, BDI-II, and GDS | 3 |
Scott et al, 2016 [ | ]CES-D and BDI-SFh | 2 |
Waller et al, 2017 [ | ]CES-D, BDI-II, PHQ-9, GDS, and SDSi | 5 |
Zhao et al, 2019 [ | ]CES-D and BDI-II | 2 |
Etxeberria et al, 2020 [ | ]CES-D, BDI, PHQ, and SDS | 4 |
Frias et al, 2020 [ | ]CES-D | 1 |
Godwin et al, 2013 [ | ]CES-D | 1 |
Kishita et al, 2018 [ | ]CES-D and BDI | 2 |
Klimova et al, 2019 [ | ]CES-D | 1 |
Parra-Vidales et al, 2017 [ | ]CES-D and BDI | 2 |
Powell et al, 2008 [ | ]NR | NR |
Lee, 2015 [ | ]CES-D | 1 |
Thompson et al, 2007 [ | ]NR | NR |
McKechnie et al, 2014 [ | ]CES-D | 1 |
aCES-D: Center for Epidemiologic Studies Depression Scale.
bBDI-II: Beck Depression Inventory-II.
cPHQ-9: Patient Health Questionnaire-9.
dGDS: Geriatric Depression Scale.
eBSI: Brief Symptom Inventory.
fGDRS: Geriatric Depression Rating Scale.
gNR: not reported.
hBDI-SF: Beck Depression Inventory short form.
iSDS: Zung Self-Rating Depression Scale.
Summary of the Evidence
is the summary of evidence table recommended by JBI [ ]. It shows the 4 most commonly reported outcomes for each review paper. Parra-Vidales et al [ ] reported 7 studies but discussed the intervention content of 5. Carer depression improved in 71% (5/7) of the meta-analyses, and anxiety improved significantly in 75% (3/4) of the meta-analyses. The outcomes for caregiver burden were inconsistent; 20% (1/5) reported improvement, 60% (3/5) found no effect or improvements in the control groups, and 20% (1/5) had mixed results. Self-efficacy was investigated in 1 meta-analysis [ ], which found positive results. A total of 5 reviews stated that the personalization of interventions was important [ , , , , ]. In total, 3 reviews suggested a need for further research into the intervention effects for specific population groups, such as caring for people with different types of dementia or the nature of the relationships with the person with dementia (spouse, child, and sibling) [ , , ]. Multicomponent interventions that combined telephone and internet delivery methods with elements of education, psychotherapy, and social support had the largest reported effect sizes [ , , , ]. However, most review papers did not differentiate the results for each type of intervention or delivery method.
Study | Intervention content, n (%) | Intervention delivery, n (%) | Depressiona | Anxietya | Burdena | Self-efficacya | |||||||||||
Educational | Psychotherapeutic | Social | Multicomponent | Telephone | DVD | Computer | Mixed | ||||||||||
Leng et al, 2020 [ | ]b9 (52.9) | 1 (5.9) | 0 (0) | 7 (41.2) | 0 (0) | 0 (0) | 14 (82.4) | 3 (17.6) | + | + | – | + | |||||
Deeken et al, 2019 [ | ]b6 (18.2) | 7 (21.2) | 2 (6.1) | 18 (54.5) | 11 (33.3) | 1 (3) | 11 (33.3) | 10 (30.3) | + | NRc | + | NR | |||||
Hopwood et al, 2018 [ | ]8 (20) | 0 (0) | 2 (5) | 30 (75) | 0 (0) | 0 (0) | 39 (97.5) | 1 (2.5) | + | + | + | + | |||||
Boots et al, 2014 [ | ]3 (25) | 0 (0) | 0 (0) | 9 (75) | 0 (0) | 0 (0) | 9 (75) | 3 (25) | + | – | ? | + | |||||
Egan et al, 2018 [ | ]4 (50) | 1 (12.5) | 0 (0) | 3 (37.5) | 0 (0) | 0 (0) | 6 (75) | 2 (25) | ? | + | – | + | |||||
Jackson et al, 2016 [ | ]6 (27.3) | 3 (13.6) | 2 (9.1) | 11 (50.0) | 13 (59.1) | 0 (0) | 5 (22.7) | 4 (18.2) | ? | + | + | + | |||||
Lucero et al, 2019 [ | ]0 (0) | 0 (0) | 0 (0) | 12 (100) | 6 (50) | 1 (8.3) | 2 (16.7) | 3 (25) | ? | ? | ? | ? | |||||
Pleasant et al, 2020 [ | ]18 (94.7) | 0 (0) | 0 (0) | 1 (5.3) | 0 (0) | 0 (0) | 19 (100) | 0 (0) | + | + | ? | ? | |||||
Scott et al, 2016 [ | ]b0 (0) | 0 (0) | 0 (0) | 4 (100) | 0 (0) | 2 (50) | 2 (50) | 0 (0) | + | NR | NR | NR | |||||
Waller et al, 2017 [ | ]0 (0) | 12 (35.3) | 3 (8.8) | 19 (55.9) | 15 (44.1) | 0 (0) | 10 (29.4) | 9 (26.5) | ? | ? | ? | ? | |||||
Zhao et al, 2019 [ | ]b2 (33.3) | 0 (0) | 0 (0) | 4 (66.7) | 0 (0) | 0 (0) | 4 (66.7) | 2 (33.3) | + | + | – | NR | |||||
Etxeberria et al, 2020 [ | ]b4 (44.4) | 0 (0) | 0 (0) | 5 (55.6) | 0 (0) | 0 (0) | 9 (100) | 0 (0) | + | – | – | NR | |||||
Frias et al, 2020 [ | ]4 (50) | 4 (50) | 0 (0) | 0 (0) | 3 (37.5) | 0 (0) | 3 (37.5) | 2 (22.2) | ? | ? | ? | + | |||||
Godwin et al, 2013 [ | ]1 (12.5) | 0 (0) | 0 (0) | 7 (87.5) | 4 (50) | 0 (0) | 3 (37.5) | 1 (12.5) | + | + | + | + | |||||
Kishita et al, 2018 [ | ]b4 (44.4) | 5 (55.6) | 0 (0) | 0 (0) | 4 (44.4) | 2 (22.2) | 2 (22.2) | 1 (11.1) | ? | + | ? | NR | |||||
Klimova et al, 2019 [ | ]4 (66.7) | 1 (16.7) | 0 (0) | 1 (16.7) | 0 (0) | 0 (0) | 6 (100) | 0 (0) | + | NR | NR | NR | |||||
Parra-Vidales et al, 2017 [ | ]5 (71.4) | 0 (0) | 0 (0) | 2 (28.6) | 0 (0) | 0 (0) | 6 (85.7) | 1 (14.3) | + | + | NR | ? | |||||
Powell et al, 2008 [ | ]0 (0) | 2 (13.3) | 0 (0) | 13 (86.7) | 2 (13.3) | 0 (0) | 11 (73.3) | 2 (13.3) | ? | ? | ? | + | |||||
Lee, 2015 [ | ]0 (0) | 0 (0) | 5 (100) | 0 (0) | 0 (0) | 1 (20.0) | 3 (60.0) | 1 (20.0) | + | NR | ? | + | |||||
Thompson et al, 2007 [ | ]b0 (0) | 0 (0) | 0 (0) | 4 (100) | 2 (50) | 0 (0) | 1 (25) | 1 (25) | – | NR | NR | NR | |||||
McKechnie et al, 2014 [ | ]0 (0) | 8 (57.1) | 0 (0) | 6 (42.9) | 0 (0) | 1 (7.1) | 11 (78.6) | 2 (14.3) | ? | + | + | ? |
a+ indicates an improvement, ? indicates mixed results, and – indicates no significant improvement or improvements in the control group.
bThe papers are the results from meta-analyses rather than the results from individual studies.
cNR: not reported.
Conclusions of Review Papers
The overall conclusion from the review papers was that technology-based interventions were effective in helping informal carers of persons with dementia [
], but there were difficulties in comparing the effectiveness because of variations in study methods ( [ , , - ]). Some studies have suggested that rigorous and standardized methods are needed to enable effective comparisons between interventions [ - ]. Low-quality RCTs have been reported, and suggestions for future research included the use of high-quality studies [ , , , ].Another suggestion from the review papers was that the lack of adherence to interventions by carers needs further investigation, with many studies not reporting on adherence, attrition bias, and poor response rates [
, ]. To overcome this, feedback from carers regarding the acceptability of the intervention could be collected. Regarding carer characteristics, 10% (2/21) of the review papers suggested further exploration of the impact of technology-based interventions for carers who look after persons with dementia at different stages of dementia or with differing dementia types [ , ]. It has also been suggested that the long-term effects of interventions should be assessed by collecting data at more time points [ , ] and after booster sessions [ ]. Training on how to use the technology may also be useful so that those unfamiliar with it are not discouraged from using the intervention [ ].Findings of This Review
The first objective of this review was to identify the types of interventions that have been developed for informal carers of persons with dementia and to report on their effectiveness. The intervention content was classified into 4 categories: psychoeducational, psychotherapeutic, social, and multicomponent. The delivery of “technology-based interventions” was classified into the categories of telephone, web-based, DVD, and mixed.
The second aim was to report the most effective type of web-based intervention. The findings suggest that multicomponent interventions were the most effective, especially when they used mixed delivery methods, such as telephone and computer. The 3 review papers that included technology-based interventions as well as face-to-face interventions reported that technology-based interventions were just as effective as face-to-face interventions [
- ].Discussion
Principal Findings
Web-based interventions and services (eHealth) are a rapidly growing area of health care delivery. This study identified and synthesized findings from 21 systematic review papers that examined the effectiveness of web-based interventions to support informal carers of persons with dementia. Web-based interventions were evaluated in 119 studies across the reviews. The delivery methods and intervention content varied between interventions, but the most effective interventions were mixed delivery and mixed content.
Clinical Findings
The findings of this review suggest that technology-based interventions are beneficial in supporting informal carers of persons with dementia. However, several points need to be considered by clinicians before recommending and implementing an intervention.
Several reviews suggested that personalization of interventions to specific carer groups was beneficial, including differentiating between carers caring for patients at different stages of dementia, carers caring for patients with different types of dementia, and carers with different levels of experience [
, , , , ]. Leng et al [ ] reported that a questionnaire asking informal carers about their time available to participate and the severity of the dementia of the person they are caring for allowed interventions to be customized for the individual situation.The delivery method is important to consider. Mixed delivery methods showed greater improvements than web-based, telephone, or DVD-based interventions alone. This could be because of the reported lack of adherence to web-based interventions that do not involve personal contact with the clinicians [
, ]. The personalized contact in mixed delivery interventions could support participants to continue with the intervention using “live” telephone calls by clarifying queries arising from web-based materials and addressing other concerns that arise [ ].Although multiple review papers have analyzed research in this field to date, there has been no umbrella review. One of the unique aspects of an umbrella review is that it considers the overlap of studies included in other review papers. It is thus able to review when data are being reported multiple times and synthesize the data, giving a clearer insight into the effectiveness of, in this paper, the eHealth interventions. Of the 119 studies included in the review, 50 (42%) were reported more than once. The results from the studies by Kajiyama et al [
] and Beauchamp et al [ ] were included in 12 of the reviews, which could give an unbalanced and unwarranted emphasis on their findings. An umbrella review considers these factors and offers clinicians an integrated review where these factors are considered. This is the first umbrella review on this topic, and therefore, it has important clinical and research implications.Strengths and Limitations
The differences in intervention content affected comparisons of data, with many reviews reporting their findings descriptively rather than pooling the diverse statistical data. The quality scores may also have been skewed by the heterogeneous methods in many reviews, resulting in a lack of meta-analyses. A total of 2 of the critical AMSTAR 2 items [
] assessed whether a meta-analysis was conducted; therefore, a negative response to those items affected the results. Further supporting this point, the only 2 reviews to score as high quality contained meta-analyses [ , ]. This may be a limitation of AMSTAR 2, leading to downgrading reviews that were otherwise well conducted but could not conduct a meta-analysis owing to the heterogeneity of the data. AMSTAR 2 was selected over the JBI recommended critical appraisal checklist [ ] as it is widely recommended to assess the quality of systematic reviews [ ].The CCA score was used to ascertain the overlap of the studies included in the reviews. A measure of overlap was selected owing to the presence of 1 study [
] in 12 of the reviews [ , , , - , , , , , , ]. It is suggested that CCA can be misrepresentative of the true overlap by the inclusion of several “index publications.” The overall moderate score of 7% overlap, yet the high scores of comparisons between individual papers, suggests that the overall score may have been skewed by a high number of “index publications” [ ]. The high overlap between several review papers could mean that despite “new” systematic reviews being conducted, there is a false impression of new evidence. This could mask the lack of research on this topic.A limitation of reviewing the reviews is that the data were limited to what the previous authors reported on. The results were not separated for different intervention types, formal or informal carers, and delivery methods, making it difficult to conclude on the most effective intervention type. Standardized and more scientifically rigorous methods have been suggested to enable better comparison, so development of more effective interventions can occur [
- ].Demographic data, such as age or dementia type, were not reported in many of the reviews. This could be because the studies themselves did not report the data, thus limiting the review papers. The countries in which the studies were conducted were all high-income countries, showing a potential lack of research in low-income countries. Rural countries may benefit the most from web-based interventions as the support can be provided to carers from anywhere. However, these interventions assume that carers are able to read, have an internet connection, and access a computer.
Conclusions and Recommendations
The findings of this review demonstrated the use of a wide variety of intervention methods and delivery, content, and outcome measures when studying web-based interventions for carers of people with dementia, making comparisons across studies difficult. Web-based interventions showed most positive results for improving carers’ depression and anxiety; however, other outcomes were not consistent. Interventions that included psychoeducation, psychosocial, and psychotherapeutic elements were the most effective in improving carer well-being. Tailored interventions for the individual to ensure relevance also improved effectiveness. Nevertheless, the methodological quality of many of the review papers was “critically low,” and this needs to be considered when interpreting the results.
Web-based interventions have the potential to reach informal carers of persons with dementia in geographically isolated areas where support may be difficult to access. Further research should aim to distinguish between the types of technology-based intervention content and delivery, thus enabling easier comparison of results. Other suggestions include a focus on specific groups of carers, such as those with different relationships with persons with dementia and those caring for patients with varying stages and types of dementia, which could help personalize the interventions and potentially encourage carers to continue to use the interventions. Research focusing on specific populations or intervention types will facilitate the development of effective web-based interventions in the future.
This is the first umbrella review to examine the effectiveness of technology-based interventions for informal carers of persons with dementia. Previous research has noted the effectiveness of multicomponent interventions and the importance of personalizing interventions. However, the overlap of research on this topic has not been reported previously. The overlap of research on the effectiveness of eHealth interventions for informal carers of persons with dementia may lead to this topic being neglected, and this has consequences for future research.
Acknowledgments
This work is part of a PhD studentship “Adaptation of an e-health intervention ‘iSupport’ for carers of people living with rare dementias.” and is linked to the Rare Dementia Support Impact project (The impact of multicomponent support groups for those living with rare dementias, ES/S010467/1) and is funded jointly by the Economic and Social Research Council (ESRC) and the National Institute for Health Research. ESRC is part of United Kingdom Research and Innovation. The views expressed are those of the authors and not necessarily those of the ESRC, United Kingdom Research and Innovation, the National Institute for Health Research or the Department of Health and Social Care. Rare Dementia Support is generously supported by the National Brain Appeal [
].Conflicts of Interest
None declared.
Corrected covered area citation matrix and individual overlap percentages between each of the review papers.
XLSX File (Microsoft Excel File), 21 KB
Characteristics of the review papers.
DOCX File , 21 KB
Aims, results, and conclusions of the review papers.
DOCX File , 20 KBReferences
- Dickinson C, Dow J, Gibson G, Hayes L, Robalino S, Robinson L. Psychosocial intervention for carers of people with dementia: What components are most effective and when? A systematic review of systematic reviews. Int Psychogeriatr 2017 Jan;29(1):31-43. [CrossRef] [Medline]
- Robinson A, Eccleston C, Annear M, Elliott KE, Andrews S, Stirling C, et al. Who knows, who cares? Dementia knowledge among nurses, care workers, and family members of people living with dementia. J Palliat Care 2018 Dec 19;30(3):158-165. [CrossRef] [Medline]
- Herron RV, Wrathall MA. Putting responsive behaviours in place: examining how formal and informal carers understand the actions of people with dementia. Soc Sci Med 2018 May;204:9-15. [CrossRef] [Medline]
- Martínez-Alcalá CI, Pliego-Pastrana P, Rosales-Lagarde A, Lopez-Noguerola JS, Molina-Trinidad EM. Information and communication technologies in the care of the elderly: systematic review of applications aimed at patients with dementia and caregivers. JMIR Rehabil Assist Technol 2016 May 02;3(1):e6 [FREE Full text] [CrossRef] [Medline]
- Lai J, Widmar NO. Revisiting the digital divide in the COVID-19 era. Appl Econ Perspect Policy 2021 Mar;43(1):458-464 [FREE Full text] [CrossRef] [Medline]
- De' R, Pandey N, Pal A. Impact of digital surge during Covid-19 pandemic: a viewpoint on research and practice. Int J Inf Manage 2020 Dec;55:102171 [FREE Full text] [CrossRef] [Medline]
- Ritterband LM, Tate DF. The science of internet interventions. Introduction. Ann Behav Med 2009 Aug;38(1):1-3. [CrossRef] [Medline]
- Internet Users, UK 2019. Office of National Statistics. 2019. URL: https://www.ons.gov.uk/businessindustryandtrade/itandinternetindustry/bulletins/internetusers/2019 [accessed 2021-11-14]
- Zhang X, Xu Y, Hu H, Liu Y, Guo Z, Wang Y. Profiling Skype video calls: rate control and video quality. In: Proceedings of the 2012 IEEE INFOCOM. 2012 Presented at: INFOCOM '12; March 25-30, USA; Orlando, FL, USA p. 621-629. [CrossRef]
- Wojtowicz M, Day V, McGrath PJ. Predictors of participant retention in a guided online self-help program for university students: prospective cohort study. J Med Internet Res 2013 May 22;15(5):e96 [FREE Full text] [CrossRef] [Medline]
- Pollock M, Fernandes RM, Becker LA, Pieper D, Hartling L. Chapter V: Overviews of reviews. In: Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions version 6.3. London, UK: Cochrane Collaboration; 2022.
- Aromataris E, Fernandez R, Godfrey C, Holly C, Khalil H, Tungpunkom P. Chapter 10: Umbrella reviews. In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis. Adelaide, Australia: Joanna Briggs Institute; 2020.
- de Vugt ME, Verhey FR. The impact of early dementia diagnosis and intervention on informal caregivers. Prog Neurobiol 2013 Nov;110:54-62. [CrossRef] [Medline]
- Afram B, Verbeek H, Bleijlevens MH, Hamers JP. Needs of informal caregivers during transition from home towards institutional care in dementia: a systematic review of qualitative studies. Int Psychogeriatr 2015 Jun;27(6):891-902. [CrossRef] [Medline]
- Leng M, Zhao Y, Xiao H, Li C, Wang Z. Internet-based supportive interventions for family caregivers of people with dementia: systematic review and meta-analysis. J Med Internet Res 2020 Sep 09;22(9):e19468 [FREE Full text] [CrossRef] [Medline]
- Pleasant M, Molinari V, Dobbs D, Meng H, Hyer K. Effectiveness of online dementia caregivers training programs: a systematic review. Geriatr Nurs 2020;41(6):921-935. [CrossRef] [Medline]
- Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 2017 Sep 21;358:j4008 [FREE Full text] [CrossRef] [Medline]
- Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007 Feb 15;7:10 [FREE Full text] [CrossRef] [Medline]
- Pieper D, Antoine SL, Mathes T, Neugebauer EA, Eikermann M. Systematic review finds overlapping reviews were not mentioned in every other overview. J Clin Epidemiol 2014 Apr;67(4):368-375. [CrossRef] [Medline]
- Hennessy EA, Johnson BT. Examining overlap of included studies in meta-reviews: guidance for using the corrected covered area index. Res Synth Methods 2020 Jan;11(1):134-145 [FREE Full text] [CrossRef] [Medline]
- Thompson CA, Spilsbury K, Hall J, Birks Y, Barnes C, Adamson J. Systematic review of information and support interventions for caregivers of people with dementia. BMC Geriatr 2007 Jul 27;7:18 [FREE Full text] [CrossRef] [Medline]
- Frias CE, Garcia-Pascual M, Montoro M, Ribas N, Risco E, Zabalegui A. Effectiveness of a psychoeducational intervention for caregivers of people with dementia with regard to burden, anxiety and depression: a systematic review. J Adv Nurs 2020 Mar;76(3):787-802. [CrossRef] [Medline]
- Kishita N, Hammond L, Dietrich CM, Mioshi E. Which interventions work for dementia family carers?: an updated systematic review of randomized controlled trials of carer interventions. Int Psychogeriatr 2018 Nov;30(11):1679-1696. [CrossRef] [Medline]
- Deeken F, Rezo A, Hinz M, Discher R, Rapp MA. Evaluation of technology-based interventions for informal caregivers of patients with dementia-a meta-analysis of randomized controlled trials. Am J Geriatr Psychiatry 2019 Apr;27(4):426-445. [CrossRef] [Medline]
- Jackson D, Roberts G, Wu ML, Ford R, Doyle C. A systematic review of the effect of telephone, internet or combined support for carers of people living with Alzheimer's, vascular or mixed dementia in the community. Arch Gerontol Geriatr 2016;66:218-236. [CrossRef] [Medline]
- Lucero RJ, Fehlberg EA, Patel AG, Bjarnardottir RI, Williams R, Lee K, et al. The effects of information and communication technologies on informal caregivers of persons living with dementia: a systematic review. Alzheimers Dement (N Y) 2019 Dec 31;5:1-12 [FREE Full text] [CrossRef] [Medline]
- Waller A, Dilworth S, Mansfield E, Sanson-Fisher R. Computer and telephone delivered interventions to support caregivers of people with dementia: a systematic review of research output and quality. BMC Geriatr 2017 Nov 16;17(1):265 [FREE Full text] [CrossRef] [Medline]
- Hopwood J, Walker N, McDonagh L, Rait G, Walters K, Iliffe S, et al. Internet-based interventions aimed at supporting family caregivers of people with dementia: systematic review. J Med Internet Res 2018 Jun 12;20(6):e216 [FREE Full text] [CrossRef] [Medline]
- Etxeberria I, Salaberria K, Gorostiaga A. Online support for family caregivers of people with dementia: a systematic review and meta-analysis of RCTs and quasi-experimental studies. Aging Ment Health 2021 Jul;25(7):1165-1180. [CrossRef] [Medline]
- Zhao Y, Feng H, Hu M, Hu H, Li H, Ning H, et al. Web-based interventions to improve mental health in home caregivers of people with dementia: meta-analysis. J Med Internet Res 2019 May 06;21(5):e13415 [FREE Full text] [CrossRef] [Medline]
- Egan KJ, Pinto-Bruno ÁC, Bighelli I, Berg-Weger M, van Straten A, Albanese E, et al. Online training and support programs designed to improve mental health and reduce burden among caregivers of people with dementia: a systematic review. J Am Med Dir Assoc 2018 Mar;19(3):200-6.e1. [CrossRef] [Medline]
- Godwin KM, Mills WL, Anderson JA, Kunik ME. Technology-driven interventions for caregivers of persons with dementia: a systematic review. Am J Alzheimers Dis Other Demen 2013 May;28(3):216-222 [FREE Full text] [CrossRef] [Medline]
- Klimova B, Valis M, Kuca K, Masopust J. E-learning as valuable caregivers' support for people with dementia - a systematic review. BMC Health Serv Res 2019 Nov 01;19(1):781 [FREE Full text] [CrossRef] [Medline]
- Lee E. Do technology-based support groups reduce care burden among dementia caregivers? A review. J Evid Inf Soc Work 2015;12(5):474-487. [CrossRef] [Medline]
- McKechnie V, Barker C, Stott J. Effectiveness of computer-mediated interventions for informal carers of people with dementia-a systematic review. Int Psychogeriatr 2014 Oct;26(10):1619-1637 [FREE Full text] [CrossRef] [Medline]
- Scott JL, Dawkins S, Quinn MG, Sanderson K, Elliott KE, Stirling C, et al. Caring for the carer: a systematic review of pure technology-based cognitive behavioral therapy (TB-CBT) interventions for dementia carers. Aging Ment Health 2016 Aug;20(8):793-803. [CrossRef] [Medline]
- Parra-Vidales E, Soto-Pérez F, Perea-Bartolomé MV, Franco-Martín MA, Muñoz-Sánchez JL. Online interventions for caregivers of people with dementia: a systematic review. Actas Esp Psiquiatr 2017 May;45(3):116-126 [FREE Full text] [Medline]
- Boots LM, de Vugt ME, van Knippenberg RJ, Kempen GI, Verhey FR. A systematic review of Internet-based supportive interventions for caregivers of patients with dementia. Int J Geriatr Psychiatry 2014 Apr;29(4):331-344. [CrossRef] [Medline]
- Powell J, Chiu T, Eysenbach G. A systematic review of networked technologies supporting carers of people with dementia. J Telemed Telecare 2008;14(3):154-156. [CrossRef] [Medline]
- Chang BL. Cognitive-behavioral intervention for homebound caregivers of persons with dementia. Nurs Res 1999;48(3):173-182. [CrossRef] [Medline]
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders Text Revision (DSM-5-TR). 5th edition. Washington, DC, USA: American Psychiatric Association; 2013.
- Christie HL, Bartels SL, Boots LM, Tange HJ, Verhey FJ, de Vugt ME. A systematic review on the implementation of eHealth interventions for informal caregivers of people with dementia. Internet Interv 2018 Sep;13:51-59 [FREE Full text] [CrossRef] [Medline]
- Gant JR, Steffen AM, Lauderdale SA. Comparative outcomes of two distance-based interventions for male caregivers of family members with dementia. Am J Alzheimers Dis Other Demen 2007;22(2):120-128 [FREE Full text] [CrossRef] [Medline]
- Kajiyama B, Thompson LW, Eto-Iwase T, Yamashita M, Di Mario J, Marian Tzuang Y, et al. Exploring the effectiveness of an Internet-based program for reducing caregiver distress using the iCare Stress Management e-Training Program. Aging Ment Health 2013;17(5):544-554 [FREE Full text] [CrossRef] [Medline]
- Beauchamp N, Irvine AB, Seeley J, Johnson B. Worksite-based Internet multimedia program for family caregivers of persons with dementia. Gerontologist 2005 Dec;45(6):793-801. [CrossRef] [Medline]
- Ma LL, Wang YY, Yang ZH, Huang D, Weng H, Zeng XT. Methodological quality (risk of bias) assessment tools for primary and secondary medical studies: what are they and which is better? Mil Med Res 2020 Feb 29;7(1):7 [FREE Full text] [CrossRef] [Medline]
- The National Brain Appeal. URL: https://www.nationalbrainappeal.org/ [accessed 2022-07-12]
Abbreviations
AMSTAR: A Measurement Tool to Assess Systematic Reviews |
CCA: corrected covered area |
ESRC: Economic and Social Research Council |
JBI: Joanna Briggs Institute |
RCT: randomized controlled trial |
Edited by M Focsa; submitted 24.01.22; peer-reviewed by AS Rigaud, N Davies; comments to author 09.03.22; revised version received 25.05.22; accepted 28.05.22; published 22.07.22
Copyright©Bethan Naunton Morgan, Gill Windle, Rebecca Sharp, Carolien Lamers. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 22.07.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.