This paper is in the following e-collection/theme issue:

Cost-Effectiveness and Economics (252) Aging in Place (283)

Published on in Vol 23, No 3 (2021): March

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/24363, first published .
eHealth Applications to Support Independent Living of Older Persons: Scoping Review of Costs and Benefits Identified in Economic Evaluations

eHealth Applications to Support Independent Living of Older Persons: Scoping Review of Costs and Benefits Identified in Economic Evaluations

eHealth Applications to Support Independent Living of Older Persons: Scoping Review of Costs and Benefits Identified in Economic Evaluations

Authors of this article:

Sandra Sülz1 Author Orcid Image ;   Hilco J van Elten1 Author Orcid Image ;   Marjan Askari1 Author Orcid Image ;   Anne Marie Weggelaar-Jansen1, 2 Author Orcid Image ;   Robbert Huijsman1, 3 Author Orcid Image
Article Authors Cited by (17) Tweetations (9) Metrics

    Review

    1Erasmus School of Health Policy & Management, Rotterdam, Netherlands

    2Clinical Informatics, Eindhoven University of Technology, Eindhoven, Netherlands

    3Geriant, Heerhugowaard, Netherlands

    Corresponding Author:

    Sandra Sülz, PhD

    Erasmus School of Health Policy & Management

    PO Box 1738

    Rotterdam, 3000 DR

    Netherlands

    Phone: 31 104088531

    Email: sulz@eshpm.eur.nl


    Background: eHealth applications are constantly increasing and are frequently considered to constitute a promising strategy for cost containment in health care, particularly if the applications aim to support older persons. Older persons are, however, not the only major eHealth stakeholder. eHealth suppliers, caregivers, funding bodies, and health authorities are also likely to attribute value to eHealth applications, but they can differ in their value attribution because they are affected differently by eHealth costs and benefits. Therefore, any assessment of the value of eHealth applications requires the consideration of multiple stakeholders in a holistic and integrated manner. Such a holistic and reliable value assessment requires a profound understanding of the application’s costs and benefits. The first step in measuring costs and benefits is identifying the relevant costs and benefit categories that the eHealth application affects.

    Objective: The aim of this study is to support the conceptual phase of an economic evaluation by providing an overview of the relevant direct and indirect costs and benefits incorporated in economic evaluations so far.

    Methods: We conducted a systematic literature search covering papers published until December 2019 by using the Embase, Medline Ovid, Web of Science, and CINAHL EBSCOhost databases. We included papers on eHealth applications with web-based contact possibilities between clients and health care providers (mobile health apps) and applications for self-management, telehomecare, telemedicine, telemonitoring, telerehabilitation, and active healthy aging technologies for older persons. We included studies that focused on any type of economic evaluation, including costs and benefit measures.

    Results: We identified 55 papers with economic evaluations. These studies considered a range of different types of costs and benefits. Costs pertained to implementation activities and operational activities related to eHealth applications. Benefits (or consequences) could be categorized according to stakeholder groups, that is, older persons, caregivers, and health care providers. These benefits can further be divided into stakeholder-specific outcomes and resource usage. Some cost and benefit types have received more attention than others. For instance, patient outcomes have been predominantly captured via quality-of-life considerations and various types of physical health status indicators. From the perspective of resource usage, a strong emphasis has been placed on home care visits and hospital usage.

    Conclusions: Economic evaluations of eHealth applications are gaining momentum, and studies have shown considerable variation regarding the costs and benefits that they include. We contribute to the body of literature by providing a detailed and up-to-date framework of cost and benefit categories that any interested stakeholder can use as a starting point to conduct an economic evaluation in the context of independent living of older persons.

    J Med Internet Res 2021;23(3):e24363

    doi:10.2196/24363

    Keywords

    cost; benefit; eHealth; aged; economic evaluation 


    Background and Motivation

    The use of information and communication technologies in health care is regarded as an important piece of the puzzle of increasing health care costs and demand [1], particularly if it targets older persons with substantial health care costs [2]. Induced by an aging population that stays home longer, an increase in self-management, and a changing role of informal caregivers, the demand for health care delivery, and the role of technology are changing rapidly. To contain health care costs and maintain the quality of care and living, governments direct policies to stimulate eHealth to increase and support self-management [3]. In this study, eHealth is defined in line with the description by Eysenbach [4] and the different taxonomies described by Oh et al [5]: eHealth is at the intersection of medical informatics, public health, and business and offers health services to support care delivery, manage care, promote prevention, and educate; it is delivered or enhanced through the internet and related technologies (eg, domotics, wearables, and sensors). In the domain of older persons living at home, we define eHealth as web-based contact possibilities between the clients and health care providers and applications for self-management, telehomecare, telemedicine, telemonitoring, and telerehabilitation.

    eHealth has shown to be valuable in promoting medication adherence and improving self-management in the population of older persons [6]. In addition, eHealth can be used to monitor clinical signs, collect health information, support users in activities related to their health, and promote a healthy lifestyle or arrange remote consultations [7-10]. Growing internet access, increasing use of mobile apps, and current technology trends create opportunities for novel services and new forms of health care through eHealth [11,12]. Governments are also increasingly funding initiatives that replace traditional care with alternatives that use information and communication technologies to remotely monitor and deliver health care services. Primary funding motivation is economic in nature—promoting preventive measures to avoid costly consequences and stimulate efforts to increase access to care [13].

    Although eHealth is frequently considered a promising development, these applications are not without considerable costs. eHealth equipment must be purchased, and systems must be operated and maintained. Data recorded by eHealth should be monitored. However, frequently, the stakeholder who benefits from the application is not the same stakeholder who is paying for it. Costs and benefits affect different stakeholders and potentially also at different points in time; therefore, the economic interests of stakeholders are often not aligned. From the health provider perspective, such an investment does not make an economic sense, whereas it might be highly valuable from a societal perspective, considering the total benefits and costs regardless of where they occur. Any assessment of the value of an eHealth application, therefore, requires considering multiple stakeholders in a holistic and integrated assessment of all costs (ie, the direct and indirect and short- and long-term costs) and all benefits (ie, the direct and indirect and short- and long-term gains) of an eHealth application. This rationale represents the core of economic evaluations in health care [14]. Economic evaluations in health care come in different forms such as cost-effectiveness analyses (CEAs), cost utility analyses (CUAs), and cost-benefit analyses (CBAs). Regardless of the type, they have in common considering both costs and benefits, that is, what we have to give up and what we will gain. The main difference is the way in which gain is incorporated: CEAs consider a one-dimensional measure of the gain, which only allows for a comparison of programs with the same effect measures. CUAs assess gain through utility, frequently in quality-adjusted life years, which is comparable between health programs. CBAs assess the gain monetarily, that is, costs and outcomes are directly on the same scale [14,15].

    Research Objective

    If an interested stakeholder wants to conduct an economic evaluation, that is, apply such an evaluation to a specific case, he or she must first identify the relevant cost and benefit elements. For this identification step, the body of literature can serve as a valuable source of information. Currently, it is unclear what types of information are available in the literature about the relevant cost and benefit elements of eHealth. Therefore, we conducted a scoping review to systematically map the literature in this area and to develop an up-to-date framework for conducting all-inclusive economic evaluations of eHealth applications that support independent living of older persons.


    Scoping Review

    Our research methodology was drafted using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analysis) protocols, specifically for scoping reviews. Among other things, scoping reviews are appropriate for identifying key characteristics and factors related to a concept [16]. Consequently, they lend themselves naturally to our research objectives.

    Search Query and Inclusion and Exclusion Criteria

    For this study, we identified papers published until December 2019 using the Embase, Medline Ovid, Web of Science, and CINAHL EBSCOhost databases. Additional papers were identified by scanning the references of the identified papers (indicated as other sources in the PRISMA flowchart in Figure 1). An experienced librarian developed search strings with some unique features to combine search terms effectively [17,18] and conducted the search. Our search terms are derived from the inclusion and exclusion criteria specified later, and the complete search query is provided in Multimedia Appendix 1.

    ‎
    Figure 1. Flowchart of paper selection.
    View this figure

    The inclusion and exclusion criteria were specified to guide the identification process. We included original papers that were peer reviewed, had an empirical or prescriptive nature, and were written in English. Research protocols, commentaries, and editorial papers were excluded from the study. We also excluded reviews to avoid duplicate findings and avoid relying on the review’s interpretation of the cost and benefit labels. Concerning the patient population, we included papers that focused on patients with an average age of at least 65 years and who were living independently at their usual place of residence. Studies were excluded if they considered nonolder persons (ie, infants, adolescents, and a sample mean age younger than 65 years) or if the patient population received care in any institutionalized form (ie, hospitals, nursing homes, rehabilitation clinics, and hospice). In terms of the eHealth application, we focused on eHealth applications with web-based contact possibilities between clients and health care providers, including mobile health (mHealth) apps, and applications for self-management, telehomecare, telemedicine, telemonitoring, telerehabilitation, and active healthy aging technologies for older persons. Papers with the following technologies were excluded: papers describing technology not connected to the internet (eg, implantable cardioverter defibrillator) and papers on health information systems, electronic health records, robotics, and telephone consults only. To obtain a comprehensive overview, we did not use a strict definition of economic evaluation and did not constrain our search to particular types of economic evaluations. The only constraint on which we relied was that economic evaluations required both costs and benefits. Therefore, we included papers that measured at least one monetary aspect and one benefit of eHealth applications in any shape or form (eg, medical expenditures and analyzing clinical effects). Papers that only described or analyzed costs at an aggregated level or (clinical) effects were excluded.

    Screening and Eligibility

    Initially, 2 of the authors (SS and HE) screened a small sample simultaneously to align the assessment. Subsequently, SS and HE conducted abstract and title screening, with each screening half of the identified references. The studies were labeled not relevant or potentially relevant based on the inclusion criteria. A random sample of the references was blindly double-checked by AW and RH. The random set has been created by selecting every 10th article from the set of annually ordered articles. Interrater reliability was evaluated using the Cohen kappa (κ) index, which is a robust statistic useful for interrater reliability testing [19]. This double screening yielded a fair overlap between the assessments by SS or HE and AW or RB (Cohen κ index=0.28). After realigning the inclusion and exclusion criteria and rescreening all of the references with previous disagreements (conducted by AW), substantial improvements in the alignment were achieved (Cohen κ index=0.75).

    In the next screening round, SS and HE conducted the screening based on full texts, and both authors went independently through all of the references initially labeled as potentially relevant. This double-blind screening yielded a substantial overlap (Cohen κ index=0.64). SS and HE discussed all of the references for which their assessments diverged and thus resolved disagreements.

    Data Extraction and Categorization

    Two authors (SS and HE) extracted the following information from the studies: patient population, country, type of eHealth intervention, type of analysis that the papers report performing, the specific cost types that the studies considered, and the specific benefits, gains, and consequences that the studies included. Subsequently, we categorized the costs and benefits. We started with 4 categories pertaining to (1) implementation activities for the eHealth application, (2) operating and maintenance activities for the eHealth application, (3) processes of health care delivery, and (4) outcomes. While extracting the information, we further refined these categories depending on activities, stakeholders, and institutions such that the subcategories were mutually exclusive but sufficiently broad to capture related items.


    Study Selection

    The search and screening processes are shown in Figure 1. The database and manual searches resulted in 1799 papers. After the first round of removal of duplicate papers and title and abstract screening, the remaining 201 papers were subjected to full-text reading. After the second step, 55 papers met our inclusion criteria and were included in the final set for analysis. The included references were published in the 2000-2019 time frame, with 5 included papers from the first 5-year period (2000-2004), 12 between 2005 and 2009, 17 between 2010 and 2014, and 21 between 2015 and 2019.

    Patient Characteristics

    The patient characteristics were rather broad; however, most studies focused on chronic or cardiovascular diseases. Of the 55 references, 13 had a patient population with various chronic health problems [13,20-31]. Cardiovascular problems received specific attention in 17 studies [32-48]. In 10 studies, the focus was on chronic obstructive pulmonary disease [49-58], and in 2 studies, the focus was on chronic skin problems [59,60]. Other studies considered diabetes [61], age-related macular degeneration [62], post-knee arthroplasty patients [63], Parkinson disease [64], and terminal patients [65]. Five studies did not specify any health conditions or diseases [66-70]. Of the 55 studies, 3 focused on mental and behavioral disorders such as anxiety [71], dementia [72], and depression [73].

    Country

    The studies in English were geographically clustered, with 26 studies conducted in North America, among which 20 occurred in the United States [20-23,25-28,30,31,33,34,37,38,42,61, 62,64,67,68] and 6 in Canada [29,40,49,51,63,66]. Among the 22 studies conducted in Europe, they were spread across countries, with 5 studies conducted in England and the United Kingdom [24,41,43,44,53]; 3 each in Denmark [50,52,58], Italy [32,45,55], the Netherlands [35,39,72]; 2 each in Austria [46,60] and Germany [47,54]; and 1 each in France [59], Spain (although not explicitly stated in the paper) [57], Norway [70], and Sweden [69]. Finally, 4 studies took place in Australia [36,56,71,73] and 3 in Asia, among which 2 were in Japan [13,65] and 1 in Taiwan [48]. With the study in Taiwan being the only one conducted in a country that is not a part of the Organization for Economic Cooperation and Development, there was a strong emphasis on economically strong countries with aging populations.

    Type of eHealth Interventions

    The majority of included studies focused on telemonitoring or remote monitoring involving the measurement of vital statistics and the transmission of patient data followed by an assessment—either automatically or manually—and triggering action by health care professionals if required [22-25,27-30,32-35,38-43,45-51,53,54,56,57,62,65,68,70]. In addition, other eHealth forms included in our review related to video consultations and virtual visits [20,21,23,30, 37,42,48,55,59,61,63,64,69]; deployment of sensor technology to analyze behavioral patterns and wireless transmitters [13,26,48,61,66,67,70,72]; email messaging services and web portal access [44,69,71,73]; online disease management courses or resources [44,71,73]; internet-delivered cognitive behavioral therapy [71,73]; remotely supervised rehabilitation activities, such as assistant mHealth [36,52,58]; and digital data transmission [60]. Note that some studies blended various eHealth forms and applications and that there was some ambiguity in the terminology, with telehealth often being used interchangeably with telemedicine, telemonitoring, or remote monitoring. The specific eHealth interventions analyzed in the studies are described in Multimedia Appendix 2 [13,20-73].

    Type of Analysis

    The included studies indicated various types of analysis. In total, 18 studies reported CEAs [24,25,27,34,35,39-41,44,46, 50,53,54,59,60,70,71,73], 2 studies combined CEAs with clinical or budget impact analyses [48,62], 2 studies reported CUAs [36,52], and 1 study reported a CBA [13]; 8 studies denoted the evaluation as cost analysis [26,45,61,63,67-69,72], the term cost minimization was used in 4 studies [29,49,51,65], and 1 study reported relying on cost consequence analysis [43]. The remaining 17 studies stated that they evaluated a range of cost and outcome measures [21,23,28,30-33,37,38,42,47, 55-58,64,66], and 2 studies relied on case studies to outline benefits, saving, expenditures, and outcomes [20,22].

    Of the 55 included studies, 8 relied on Markov modeling and simulation models with a time frame of 1 year [40,65], 5 years [13,34], 10 years [43,62], 20 years [35], up to 30 years [41]. Only a few studies without Markov modeling explicitly stated the time frame of the economic evaluation, with 1 study capturing a period of multiple weeks [63] and 6 studies with a 1-year time frame [24,39,44,45,50,54]. The remaining 40 studies did not indicate the time frame explicitly, and the period of data collection was, if applicable, used as a proxy for the time frame: 1-6 months [22,25,36-38,42,51,56,57,60,66], 7-12 months [28,29,48,52,58,59,64,67-69,71-73], 13-18 months [20,21,31, 53], 19-24 months [27,49,61], and beyond 24 months [26,30,32,33,46,47,55,70]. In 1 study, the period of data collection was insufficiently described [23].

    Specific Cost and Benefit Types

    When we consider eHealth applications, what direct and indirect costs and benefits (or consequences) might be relevant to consider? Tables 1-3 provide an answer by outlining the different cost and benefit types that the studies included in our review considered. Table 1 shows the eHealth intervention costs categorized into implementation and operating activities. Table 2 provides an overview of the consequences of eHealth and focuses on resource usage. Finally, Table 3 depicts eHealth consequences in terms of outcomes categorized by stakeholder group.

    Table 1. Intervention costs of eHealth applications.
    Intervention costsConsidered by number of studiesReferences
    Implementation activities

    		Device purchase (monitoring equipment, videoconferencing equipment, etc)32[13,22-25,29-31,35-37,39-41,44,47,50-53,55,56,59,61,63,65,66,69-73]

    		License or software or initial fee purchase7[13,24,29,50,51,59,72]

    		Equipment installation18[13,24,29,34,35,38,50-53,55,61,63,65,66,69,70,72]

    		Training or education of operators10[24,25,29,35,44,50,52,53,61,70]

    		Technician travel time to install equipment5[30,36,40,52,63]
    Operating activities

    		Maintenance (server, host, call center, or station)18[13,24,26,28,29,35,37,39,40,43,50,51,53,55,59,65,66,68,69]

    		Periodic fees (for licenses, insurance, etc)15[24,29,31,35,37,38,43,50,55,59,61,68,71-73]

    		Medical staffing: reviewing or assessing or intervening26[13,24,29,32,34-36,38,40,41,44,50,53,55-57,61-63,65,66,69-73]

    		Nonmedical staffing: technical support14[13,24,29,39,40,50,51,53,61,63,66,68,69,72]

    		Technician travel time to maintain equipment1[24]
    Table 2. Intervention consequences—resource usage.
    Intervention consequencesConsidered by the included studies, nReferences
    eHealth usage by patient

    		Televisits: number or duration of visits17[20,22,23,25,30-32,35,37,39,44,45,51,56,61,64,70]
    Health resource usage by patient—community health services or primary care

    		Travel time or transportation costs (eg, for ambulance)9[39,44,46,53,55,59,60,64,67]

    		General practitioner: number or duration of visits16[24,28,31,35,39,40,44,50,52,55-57,59,68,71,73]

    		Walk-in center: number or duration of visits2[24,44]

    		Physiotherapist: number of sessions5[24,39,52,59,63]

    		Psychologist: number of sessions2[24,39]

    		Community nurse: number or duration of visits4[24,39,44,50]

    		Home care: number or duration of visits27[21-25,28-32,34,37-39,49-51,55-57,61,64-67,69,72]

    		Meals on wheels1[24]
    Day services

    		Day care2[24,69]

    		Same-day surgeries1[67]
    Institutionalized care

    		Rehabilitation clinics: number or duration of admissions2[50,54]

    		Skilled nursing facilities: number or duration of admissions6[27,62,67,69,70,72]

    		Long-term care: number or duration of admission2[24,67]

    		Hospice: number or duration of admissions2[21,35]
    Hospital use

    		Emergency department: number of visits21[21,24,27-29,31,33,35,37-39,42,49,50,52,53,55-57,67,68]

    		Outpatient clinic: number or duration of visits to specialists21[21,24,27,28,34,35,40,43,45,46,48,50,52-54,56,59,60,62,67,68]

    		Hospital: number or duration of admissions40[21,24,25,27-31,33,34,36-59,65-68,70,71,73]

    		Intensive care unit: Admissions2[55,57]
    Drug treatment and laboratory diagnostics

    		Medication, prescriptions, or medical supplies16[21,24,31,38,39,43,44,50,52,54,55,59,62,67,71,73]

    		Laboratory3[66,67]
    Table 3. Intervention consequences—stakeholder outcomes.
    Intervention consequencesConsidered by the included studies, nReferences
    Patient or client outcomes

    		Physical health status (mortality, morbidity, cardiovascular events, exacerbations, etc)14[30,32-34,43,44,46,47,54,55,59-61,68]

    		Psychological health status (anxiety, depression, or empowerment)4[22-24,66]

    		QALYsa12[24,35,36,39-41,44,50,52,62,71,73]

    		Quality of life (if not measured in QALYs but differently)11[24,28,33,37,38,42,47,56,61,64,66]

    		Setting-specific quality of care indicators1[31]

    		Satisfaction (with the device or eHealth service)8[20,23,25,29,31,40,51,66]

    		Satisfaction (in general)5[22,28,30,37,61]

    		Patient experience or perceived benefits3[57,65,69]

    		Well-being1[72]

    		Time spent in the usual place of residence1[26]

    		Transfer to a different level of care1[30]

    		Time absent from work (productivity loss or loss of income)2[44,62]

    		Device-related technical events2[43,47]
    Professional caregivers

    		Satisfaction with the device2[20,25]

    		Satisfaction in general1[30]

    		Travel time to patient’s home11[20,25,28,30-32,49,51,56,63,65,70]
    Informal caregivers

    		Time absent from work (productivity loss)2[62,70]

    		Burden1[66]

    		Well-being1[72]
    Transfer payments

    		Attendance allowance (recipients receive payments to manage their own health)1[69]

    		Respite care (payments made to relieve informal caregivers from providing care)1[69]

    aQALYs: quality-adjusted life years.

    Level of Integration

    Although Tables 1-3 provide an extensive overview of cost and consequence aspects already considered in previous studies, they indicate that there is diversity in how many different aspects the studies have considered. For all the studies, we determined whether they included at least one element of implementation costs, operating costs, and consequences such as eHealth and resource usage, patient outcomes, professional caregiver outcomes, and informal caregiver outcomes. The studies had different foci and different levels of integration, as outlined by the diversity in Figure 2. Each study is represented by 1 bar decomposed into the cost and consequence subcategories considered in the study. The group of 28 studies on the left considered at least one implementation and one operating activity, in addition to the consequences of the eHealth intervention [13,24,29,31,34-41,44,50,51,53,55,56,59,61,63, 65,66,69-73]. The middle group of 13 studies contains either implementation or operating activities, in addition to consequences [22,23,25,26,28,30,32,43,47,52,57,62,68]. Finally, the 14 studies on the right do not consider implementation and operating activities but only focus on the consequences [20,21,27,33,45,46,48,49,54,58,60,64,67].

    ‎
    Figure 2. Level of integration in 55 included studies (represented as bars).
    View this figure

    Prominent and Lacking Features

    Tables 1-3 also show that some components have received more attention than others. Concentrating on the different consequences, we observed the following: If patient outcomes are considered, the focus lies on physical outcomes [30,32-34,43,44,46,47,54,55,59-61,68] and quality of life or quality-adjusted life years [24,35,36,39-41,44,50,52,62,71,73]. Productivity loss because of time absent from work received less attention, with only 4% (2/55) of the studies incorporating it [44,62]; however, this outcome is understandable given that our review focused on the population of older persons, which predominantly no longer participates in the labor market. In terms of resource utilization, there is a strong emphasis on home care visits, indicated by 49% (27/55) of the included studies [21-25,28-32,34,37-39,49-51,55-57,61,64-67,69,72], and hospital usage covered, indicated by 73% (40/55) of the included studies [21,24,25,27-31,33,34,36-59,65-68,70,71,73]. This outcome can be explained by many of the included studies relying on remote monitoring or virtual visits to substitute for home care visits or to prevent exacerbations that lead to hospital admissions.

    Comparing the consequences for professional caregivers and informal caregivers, it becomes obvious that certain elements are missing across all included studies. For instance, 4% (2/55) of the included studies considered the satisfaction of professional caregivers (in general or with the device) [20,25]; however, the satisfaction of informal caregivers was not captured in any of the included studies. Similarly, for professional caregivers, 20% (11/55) of the included studies captured the travel time to patients’ homes [20,25,28,30-32,49,51,56,63,65,70]; however, this aspect was neglected for informal caregivers. Conversely, for informal caregivers, emotional burden and well-being were captured by 4% (2/55) of the included studies [66,72], whereas none of the included studies focused on these 2 aspects for professional caregivers.

    Our final observation relates to the research and development (R&D) costs of eHealth applications. In fact, none of the included studies considered R&D costs, which is understandable from the perspective that these costs have already been spent by the time that the eHealth application is set up and running. However, it implicitly assumes that R&D costs only occur before the eHealth intervention is set up and that there is no ongoing refinement.


    Principal Findings

    We conducted this review to establish a framework of costs and benefits considered in the economic evaluations of eHealth applications that support the independent living of older persons. Our search identified 55 papers that conducted economic evaluations. All of the identified papers focused on independent living of older persons in their role as patients with one or more chronic conditions. The identified papers considered a range of different types of costs and benefits. Costs pertain to implementation activities and operating activities related to eHealth applications. Benefits (or consequences) can be categorized according to stakeholder groups, that is, patients, caregivers, and health care provider organizations. These benefits can be further divided into stakeholder-specific outcomes and resource utilization. Some cost and benefit types have received more attention than others. For instance, patient outcomes are predominantly captured via quality-of-life considerations and various types of physical health status indicators. From a resource utilization perspective, a strong emphasis is placed on home care visits and hospital usage. One reason for this emphasis is the frequency in which studies focus on remote monitoring to prevent unnecessary hospital admissions or to substitute for home care visits.

    Our data extraction also revealed a set of elements that have not been considered across all of the identified papers, including travel time and satisfaction of informal caregivers, emotional burden and well-being of professional caregivers, and last but not least, the R&D costs of the eHealth application. The reasons why these aspects have been neglected can be manifold: they might have been irrelevant from the perspective from which the economic evaluation was carried out, they might have been unobservable because of long time lags beyond the time frame of the evaluation, or it might have been infeasible to capture and quantify these aspects because of methodological obstacles or data unavailability. That the initial R&D costs of the eHealth applications have not been considered can be justified with the sunk cost argument—by the time that the evaluation takes place, the R&D costs have already been spent. In this sense, the eHealth application is considered a static technology. In the longer run, however, the eHealth application might require an upgrade to comply with new laws and regulations, for reasons pertaining to data privacy, data security, data storage, or improvements in usability. Whether these upgrade costs are indeed relevant for future economic evaluations depends on the perspective and time frame.

    Like any other technology, eHealth applications are subject to change. Fueled by the increasing availability of data, changes in law and regulations and improved usability, new fields, and areas of applications might emerge. Our framework is based on eHealth applications currently in place. Future eHealth applications might generate costs and benefits that are different from the eHealth applications on which our framework is based.

    Implications for Research and Practice

    Economic evaluations of eHealth applications are gaining momentum, as indicated by the increasing number of publications and reviews [74,75]. Health economic frameworks and principles are described, and the steps to measure costs and benefits are emphasized [14,15]. Our review directly connects to the measurement aspect by focusing on its first step, that is, the identification of costs and benefits. We contribute to the body of literature by providing a detailed and up-to-date framework of cost and benefit categories.

    If we consider eHealth, there are many stakeholders involved, such as patients, eHealth suppliers (formal and informal) caregivers, funding bodies, health authorities, and so on. Notably, these stakeholders are likely to attribute different values to eHealth applications because they are affected differently by their costs and benefits. This fact has consequences for investment and funding decisions, and it has long been argued that decision making remains hampered by the lack of reliable cost and benefit estimations [14,15]. To obtain reliable cost and benefit estimates, our framework could be of help by providing a starting point for the identification process. Our framework can support this goal; however, the measuring and valuing process must be context-specific and tailored to the case at hand. How to value components that, for instance, do not lend themselves naturally to being quantified in countable units, such as the feeling of safety [76], is worthy of study in itself and beyond the scope of our review. The variety that we observe in terms of costs and consequences considered in the economic evaluations and the type of analysis performed and the extent to which the costs and consequences are integrated indicates that the field has not yet reached consensus on a standard procedure for determining eHealth value. Whether and to what extent the observed variety is actually linked to the quality of the economic evaluation is an interesting avenue for future research.

    Financial costs directed to patients or informal caregivers might be an obstacle to using the eHealth service or application or continuation of usage of these services, especially in countries where mandatory health insurance coverage is lacking. Although a recent study in the Netherlands identified finance as a factor not significantly related to intention to use medical apps among older persons [77], future studies should focus on how the costs are covered and who should pay for the direct or indirect costs of eHealth.

    Conclusions

    A holistic and reliable value assessment of eHealth applications requires a profound understanding of the applications’ costs and benefits. The first step in measuring costs and benefits is identifying the relevant costs and benefit categories that the eHealth application affects. We conduct a scoping review to support this identification process by providing an overview of the direct and indirect costs and benefits that economic evaluations have incorporated so far. Our cost-and-benefit framework is particularly useful in the context of eHealth applications that support the independent living of older persons. As this patient group is expected to be increasingly targeted to contain health care costs, expanding the scope of eHealth applications to broader populations, rather than only diagnosed patient groups, and assessing the value of eHealth technologies are of the utmost importance for making well-informed investment and funding decisions.

    Acknowledgments

    This work was supported by Dutch ZonMw grant number 639003401. The authors would like to thank Wichor Bramer from the Erasmus MC Medical Library for developing and updating the search strategies. The authors further benefited from discussions with the project team Value-Driven eHealth, that is, Rachita Auragh, Karlijn Cranen, Tyrell Creton, Marleen de Mul, and Mildred Visser and their collaboration with Henk Herman Nap (Vilans) and Eveline Wouters (Tilburg University and Tranzo).

    Authors' Contributions

    All authors have contributed to the conception and design of the review, that is, specifying the inclusion and exclusion criteria (SS, HE, MA, AW, and RH), abstract and title screening (SS, HE, AW, and RH), full-text screening, and data extraction (SS and HE). SS and HE drafted the manuscript. MA, AW, and RH worked on the revisions of the paper. All authors provided feedback on the multiple draft versions. SS finalized the revisions.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Search strategy.

    PDF File (Adobe PDF File), 114 KB
    ‎
    Multimedia Appendix 2

    Type of eHealth intervention, patient population, country, and analysis type.

    PDF File (Adobe PDF File), 175 KB
    1. Granja C, Janssen W, Johansen MA. Factors Determining the Success and Failure of eHealth Interventions: Systematic Review of the Literature. J Med Internet Res 2018 May 01;20(5):e10235. [CrossRef]
    2. Wouters M, Swinkels I, van Lettow B, de Jong J, Sinnige J, Brabers A, et al. E-health in verschillende snelheden Health-monitor. 2018.   URL: https://www.nivel.nl/nl/publicatie/e-health-verschillende-snelheden-ehealth-monitor-2018 [accessed 2021-02-19]
    3. van Gemert-Pijnen L, Kelders SM, Kip H, Sanderman R. eHealth Research, Theory and Development A Multi-Disciplinary Approach. London: Routledge; 2018.
    4. Eysenbach G. What is e-health? J Med Internet Res 2001 Jun 18;3(2):e20. [CrossRef]
    5. Oh H, Rizo C, Enkin M, Jadad A, Powell J, Pagliari C. What Is eHealth (3): A Systematic Review of Published Definitions. J Med Internet Res 2005 Feb 24;7(1):e110. [CrossRef]
    6. Changizi M, Kaveh MH. Effectiveness of the mHealth technology in improvement of healthy behaviors in an elderly population—a systematic review. mHealth 2017 Nov 27;3:51-51. [CrossRef]
    7. Whitehead L, Seaton P. The Effectiveness of Self-Management Mobile Phone and Tablet Apps in Long-term Condition Management: A Systematic Review. J Med Internet Res 2016 May 16;18(5):e97. [CrossRef]
    8. Oliveira JGRD, Askari M, Silva Junior GBD, Freitas Filho RAD, Vasconcelos Filho JE. Renal Health: An Innovative Application to Increase Adherence to Treatment Through Self-monitoring for Patients With CKD and Provide Information for the General Population. Kidney International Reports 2019 Apr;4(4):609-613. [CrossRef]
    9. Helbostad J, Vereijken B, Becker C, Todd C, Taraldsen K, Pijnappels M, et al. Mobile Health Applications to Promote Active and Healthy Ageing. Sensors 2017 Mar 18;17(3):622. [CrossRef]
    10. Chiarini G, Ray P, Akter S, Masella C, Ganz A. mHealth Technologies for Chronic Diseases and Elders: A Systematic Review. IEEE J. Select. Areas Commun 2013 Sep;31(9):6-18. [CrossRef]
    11. Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Mobile Health Applications for the Most Prevalent Conditions by the World Health Organization: Review and Analysis. J Med Internet Res 2013 Jun 14;15(6):e120. [CrossRef]
    12. Martínez-Pérez B, de la Torre-Díez I, López-Coronado M, Sainz-De-Abajo B. Comparison of Mobile Apps for the Leading Causes of Death Among Different Income Zones: A Review of the Literature and App Stores. JMIR Mhealth Uhealth 2014 Jan 09;2(1):e1. [CrossRef]
    13. Akiyama M, Abraham C. Comparative cost-benefit analysis of tele-homecare for community-dwelling elderly in Japan: Non-Government versus Government Supported Funding Models. International Journal of Medical Informatics 2017 Aug;104:1-9. [CrossRef]
    14. Drummond M, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL. Methods for the Economic Evaluation of Health Care Programmes. USA: Oxford University Press; 2015.
    15. Bergmo TS. How to Measure Costs and Benefits of eHealth Interventions: An Overview of Methods and Frameworks. J Med Internet Res 2015 Nov 09;17(11):e254. [CrossRef]
    16. Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol 2018 Nov 19;18(1):1-7. [CrossRef]
    17. Bramer WM, Giustini D, Kramer BM, Anderson P. The comparative recall of Google Scholar versus PubMed in identical searches for biomedical systematic reviews: a review of searches used in systematic reviews. Syst Rev 2013 Dec 23;2(1):1-9. [CrossRef]
    18. Bramer WM, De Jonge GB, Rethlefsen ML, Mast F, Kleijnen J. A systematic approach to searching: an efficient and complete method to develop literature searches. jmla 2018 Oct 04;106(4):531. [CrossRef]
    19. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med 2012:276-282. [CrossRef]
    20. Dimmick SL, Mustaleski C, Burgiss SG, Welsh T. Home Healthcare Nurse 2000;18(2):124-135. [CrossRef]
    21. Lustbader D, Mudra M, Romano C, Lukoski E, Chang A, Mittelberger J, et al. The Impact of a Home-Based Palliative Care Program in an Accountable Care Organization. Journal of Palliative Medicine 2017 Jan;20(1):23-28. [CrossRef]
    22. Walsh M, Coleman JR. Developing a Pilot Telehealth Program. Home Healthcare Nurse: The Journal for the Home Care and Hospice Professional 2005;23(3):188-191. [CrossRef]
    23. Walsh M, Coleman JR. Trials and Tribulations: A Small Pilot Telehealth Home Care Program for Medicare Patients. Geriatric Nursing 2005 Nov;26(6):343-346. [CrossRef]
    24. Henderson C, Knapp M, Fernández JL, Beecham J, Hirani SP, Cartwright M, Whole System Demonstrator evaluation team. Cost effectiveness of telehealth for patients with long term conditions (Whole Systems Demonstrator telehealth questionnaire study): nested economic evaluation in a pragmatic, cluster randomised controlled trial. BMJ 2013 Mar 28;346(mar28 6):f2065-f2065. [CrossRef]
    25. Hicks LL, Fleming DA, Desaulnier A. The Application of Remote Monitoring to Improve Health Outcomes to a Rural Area. Telemedicine and e-Health 2009 Sep;15(7):664-671. [CrossRef]
    26. Rantz M, Lane K, Phillips LJ, Despins LA, Galambos C, Alexander GL, et al. Enhanced registered nurse care coordination with sensor technology: Impact on length of stay and cost in aging in place housing. Nursing Outlook 2015 Nov;63(6):650-655. [CrossRef]
    27. Bendixen RM, Levy CE, Olive ES, Kobb RF, Mann WC. Cost Effectiveness of a Telerehabilitation Program to Support Chronically Ill and Disabled Elders in Their Homes. Telemedicine and e-Health 2009 Jan;15(1):31-38. [CrossRef]
    28. Noel HC, Vogel DC, Erdos JJ, Cornwall D, Levin F. Home Telehealth Reduces Healthcare Costs. Telemedicine Journal and e-Health 2004 Jun;10(2):170-183. [CrossRef]
    29. Paré G, Poba-Nzaou P, Sicotte C. Home telemonitoring for chronic disease management: an economic assessment. Int J Technol Assess Health Care 2013 Mar 20;29(2):155-161. [CrossRef]
    30. Finkelstein SM, Speedie SM, Potthoff S. Home Telehealth Improves Clinical Outcomes at Lower Cost for Home Healthcare. Telemedicine and e-Health 2006 Apr;12(2):128-136. [CrossRef]
    31. Johnston B, Weeler L, Deuser J, Sousa KH. Outcomes of the kaiser permanente tele-home health research project. Arch Fam Med 2000;9(1):40-45. [CrossRef]
    32. Folino AF, Breda R, Calzavara P, Borghetti F, Comisso J, Iliceto S, et al. Remote follow-up of pacemakers in a selected population of debilitated elderly patients. Europace 2012 Nov 01;15(3):382-387. [CrossRef]
    33. Blum K, Gottlieb SS. The Effect of a Randomized Trial of Home Telemonitoring on Medical Costs, 30-Day Readmissions, Mortality, and Health-Related Quality of Life in a Cohort of Community-Dwelling Heart Failure Patients. Journal of Cardiac Failure 2014 Jul;20(7):513-521. [CrossRef]
    34. Liu SX, Xiang R, Lagor C, Liu N, Sullivan K. Economic Modeling of Heart Failure Telehealth Programs: When Do They Become Cost Saving? International Journal of Telemedicine and Applications 2016;2016:1-9. [CrossRef]
    35. Grustam AS, Severens JL, De Massari D, Buyukkaramikli N, Koymans R, Vrijhoef HJ. Cost-Effectiveness Analysis in Telehealth: A Comparison between Home Telemonitoring, Nurse Telephone Support, and Usual Care in Chronic Heart Failure Management. Value in Health 2018 Jul;21(7):772-782. [CrossRef]
    36. Hwang R, Morris NR, Mandrusiak A, Bruning J, Peters R, Korczyk D, et al. Cost-Utility Analysis of Home-Based Telerehabilitation Compared With Centre-Based Rehabilitation in Patients With Heart Failure. Heart, Lung and Circulation 2019 Dec;28(12):1795-1803. [CrossRef]
    37. Jerant AF, Azari R, Nesbitt TS. Reducing the Cost of Frequent Hospital Admissions for Congestive Heart Failure. Medical Care 2001;39(11):1234-1245. [CrossRef]
    38. Myers S, Grant RW, Lugn NE, Holbert B, Kvedar JC. Impact of Home-Based Monitoring on the Care of Patients with Congestive Heart Failure. Home Health Care Management & Practice 2016 Jun 30;18(6):444-451. [CrossRef]
    39. Boyne JJ, Di Van Asselt A, Gorgels AP, Steuten LM, De Weerd G, Kragten J, et al. Cost–effectiveness analysis of telemonitoring versus usual care in patients with heart failure: The TEHAF–study. J Telemed Telecare 2016 Jul 09;19(5):242-248. [CrossRef]
    40. Cui Y, Doupe M, Katz A, Nyhof P, Forget E. Economic Evaluation of Manitoba Health Lines in the Management of Congestive Heart Failure. hcpol 2013 Nov 27;9(2):36-50. [CrossRef]
    41. Thokala P, Baalbaki H, Brennan A. Telemonitoring After Discharge from Hospital with Heart Failure – Cost-Effectiveness Modelling of Alternative Service Designs. Value in Health 2013 Nov;16(7):A530. [CrossRef]
    42. Nouryan CN, Morahan S, Pecinka K, Akerman M, Lesser M, Chaikin D, et al. Home Telemonitoring of Community-Dwelling Heart Failure Patients After Home Care Discharge. Telemedicine and e-Health 2019 Jun;25(6):447-454. [CrossRef]
    43. Burri H, Sticherling C, Wright D, Makino K, Smala A, Tilden D. Cost-consequence analysis of daily continuous remote monitoring of implantable cardiac defibrillator and resynchronization devices in the UK. Europace 2013 Apr 18;15(11):1601-1608. [CrossRef]
    44. Dixon P, Hollinghurst S, Edwards L, Thomas C, Gaunt D, Foster A, et al. Cost-effectiveness of telehealth for patients with raised cardiovascular disease risk: evidence from the Healthlines randomised controlled trial. BMJ Open 2016 Aug 26;6(8):e012352. [CrossRef]
    45. Capucci A, De Simone A, Luzi M, Calvi V, Stabile G, D'Onofrio A, et al. Economic impact of remote monitoring after implantable defibrillators implantation in heart failure patients: An analysis from the EFFECT study. Europace 2017;19(9):1493-1499. [CrossRef]
    46. Perl S, Stiegler P, Rotman B, Prenner G, Lercher P, Anelli-Monti M, et al. Socio-economic effects and cost saving potential of remote patient monitoring (SAVE-HM trial). International Journal of Cardiology 2013 Nov;169(6):402-407. [CrossRef]
    47. Parahuleva MS, Soydan N, Divchev D, Lüsebrink U, Schieffer B, Erdogan A. Home monitoring after ambulatory implanted primary cardiac implantable electronic devices: The home ambulance pilot study. Clin Cardiol 2017 Aug 21;40(11):1068-1075. [CrossRef]
    48. Chen Y, Lin Y, Hung C, Huang C, Yeih D, Chuang P, et al. Clinical Outcome and Cost-Effectiveness of a Synchronous Telehealth Service for Seniors and Nonseniors with Cardiovascular Diseases: Quasi-Experimental Study. J Med Internet Res 2013 Apr 24;15(4):e87. [CrossRef]
    49. Paré G, Poba-Nzaou P, Sicotte C, Beaupré A, Lefrançois É, Nault D, et al. Comparing the costs of home telemonitoring and usual care of chronic obstructive pulmonary disease patients: A randomized controlled trial. European Research in Telemedicine / La Recherche Européenne en Télémédecine 2013 Jun;2(2):35-47. [CrossRef]
    50. Witt Udsen F, Lilholt PH, Hejlesen O, Ehlers L. Cost-effectiveness of telehealthcare to patients with chronic obstructive pulmonary disease: results from the Danish ‘TeleCare North’ cluster-randomised trial. BMJ Open 2017 May 17;7(5):e014616. [CrossRef]
    51. Paré G, Sicotte C, St.-Jules D, Gauthier R. Cost-Minimization Analysis of a Telehomecare Program for Patients with Chronic Obstructive Pulmonary Disease. Telemedicine and e-Health 2006 Apr;12(2):114-121. [CrossRef]
    52. Haesum LK, Soerensen N, Dinesen B, Nielsen C, Grann O, Hejlesen O, et al. Cost-Utility Analysis of a Telerehabilitation Program: A Case Study of COPD Patients. Telemedicine and e-Health 2012 Nov;18(9):688-692. [CrossRef]
    53. Clarke M, Fursse J, Brown-Connolly NE, Sharma U, Jones R. Evaluation of the National Health Service (NHS) Direct Pilot Telehealth Program: Cost-Effectiveness Analysis. Telemedicine and e-Health 2018 Jan;24(1):67-76. [CrossRef]
    54. Achelrod D, Schreyögg J, Stargardt T. Health-economic evaluation of home telemonitoring for COPD in Germany: evidence from a large population-based cohort. Eur J Health Econ 2016 Oct 3;18(7):869-882. [CrossRef]
    55. Vitacca M, Bianchi L, Guerra A, Fracchia C, Spanevello A, Balbi B, et al. Tele-assistance in chronic respiratory failure patients: a randomised clinical trial. European Respiratory Journal 2008 Sep 17;33(2):411-418. [CrossRef]
    56. De San Miguel K, Smith J, Lewin G. Telehealth Remote Monitoring for Community-Dwelling Older Adults with Chronic Obstructive Pulmonary Disease. Telemedicine and e-Health 2013 Sep;19(9):652-657. [CrossRef]
    57. Mirón Rubio M, Ceballos Fernández R, Parras Pastor I, Palomo Iloro A, Fernández Félix BM, Medina Miralles J, et al. Telemonitoring and home hospitalization in patients with chronic obstructive pulmonary disease: study TELEPOC. Expert Review of Respiratory Medicine 2018 Feb 21;12(4):335-343. [CrossRef]
    58. Dinesen B, Haesum LK, Soerensen N, Nielsen C, Grann O, Hejlesen O, et al. Using preventive home monitoring to reduce hospital admission rates and reduce costs: a case study of telehealth among chronic obstructive pulmonary disease patients. J Telemed Telecare 2012 May 31;18(4):221-225. [CrossRef]
    59. Le Goff-Pronost M, Mourgeon B, Blanchère J, Teot L, Benateau H, Dompmartin A. Real-world clinical evaluation and costs of telemedicine for chronic wound management. Int J Technol Assess Health Care 2018 Oct 29;34(6):567-575. [CrossRef]
    60. Binder B, Hofmann-Wellenhof R, Salmhofer W, Okcu A, Kerl H, Soyer HP. Teledermatological Monitoring of Leg Ulcers in Cooperation With Home Care Nurses. Arch Dermatol 2007 Dec 01;143(12):1511-1514. [CrossRef]
    61. Dansky KH, Palmer L, Shea D, Bowles KH. Cost Analysis of Telehomecare. Telemedicine Journal and e-Health 2001 Sep;7(3):225-232. [CrossRef]
    62. Wittenborn JS, Clemons T, Regillo C, Rayess N, Liffmann Kruger D, Rein D. Economic Evaluation of a Home-Based Age-Related Macular Degeneration Monitoring System. JAMA Ophthalmol 2017 May 01;135(5):452. [CrossRef]
    63. Tousignant M, Moffet H, Nadeau S, Mérette C, Boissy P, Corriveau H, et al. Cost Analysis of In-Home Telerehabilitation for Post-Knee Arthroplasty. J Med Internet Res 2015 Mar 31;17(3):e83. [CrossRef]
    64. Dorsey ER, Venkataraman V, Grana MJ, Bull MT, George BP, Boyd CM, et al. Randomized controlled clinical trial of. JAMA Neurol 2013 May;70(5):565-570 [FREE Full text] [CrossRef] [Medline]
    65. Aoki N, Ohta S, Yamamoto H, Kikuchi N, Dunn K. Triangulation Analysis of Tele-Palliative Care Implementation in a Rural Community Area in Japan. Telemedicine and e-Health 2006 Dec;12(6):655-662. [CrossRef]
    66. Vincent C, Reinharz D, Deaudelin I, Garceau M, Talbot LR. Public telesurveillance service for frail elderly living at home, outcomes and cost evolution: a quasi experimental design with two follow-ups. Health Qual Life Outcomes 2006 Jul 07;4(1):1-10. [CrossRef]
    67. Finch M, Griffin K, Pacala JT. Reduced Healthcare Use and Apparent Savings with Passive Home Monitoring Technology: A Pilot Study. J Am Geriatr Soc 2017 Apr 13;65(6):1301-1305. [CrossRef]
    68. Upatising B, Wood DL, Kremers WK, Christ SL, Yih Y, Hanson GJ, et al. Cost Comparison Between Home Telemonitoring and Usual Care of Older Adults: A Randomized Trial (Tele-ERA). Telemedicine and e-Health 2015 Jan;21(1):3-8. [CrossRef]
    69. Magnusson L, Hanson E. Supporting frail older people and their family carers at home using information and communication technology: cost analysis. J Adv Nurs 2005 Sep;51(6):645-657. [CrossRef]
    70. Aanesen M, Lotherington AT, Olsen F. Smarter elder care? A cost-effectiveness analysis of implementing technology in elder care. Health Informatics J 2011 Sep 20;17(3):161-172. [CrossRef]
    71. Dear BF, Zou JB, Ali S, Lorian CN, Johnston L, Sheehan J, et al. Clinical and Cost-Effectiveness of Therapist-Guided Internet-Delivered Cognitive Behavior Therapy for Older Adults With Symptoms of Anxiety: A Randomized Controlled Trial. Behavior Therapy 2015 Mar;46(2):206-217. [CrossRef]
    72. Nijhof N, Van Gemert-Pijnen LJ, Woolrych R, Sixsmith A. An evaluation of preventive sensor technology for dementia care. J Telemed Telecare 2013 Feb 22;19(2):95-100. [CrossRef]
    73. Titov N, Dear BF, Ali S, Zou JB, Lorian CN, Johnston L, et al. Clinical and Cost-Effectiveness of Therapist-Guided Internet-Delivered Cognitive Behavior Therapy for Older Adults With Symptoms of Depression: A Randomized Controlled Trial. Behavior Therapy 2015 Mar;46(2):193-205. [CrossRef]
    74. Bassi J, Lau F. Measuring value for money: a scoping review on economic evaluation of health information systems. J Am Med Inform Assoc 2013 Jul 01;20(4):792-801. [CrossRef]
    75. Iribarren SJ, Cato K, Falzon L, Stone PW. What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions. PLoS ONE 2017 Feb 2;12(2):e0170581. [CrossRef]
    76. Perry-Duxbury M, van Exel J, Brouwer W. How to value safety in economic evaluations in health care? A review of applications in different sectors. Eur J Health Econ 2019 Jun 6;20(7):1041-1061. [CrossRef]
    77. Askari M, Klaver NS, van Gestel TJ, van de Klundert J. Intention to use Medical Apps Among Older Adults in the Netherlands: Cross-Sectional Study. J Med Internet Res 2020 Sep 04;22(9):e18080 [FREE Full text] [CrossRef] [Medline]

    ‎
    CBA: cost-benefit analysis
    CEA: cost-effectiveness analysis
    CUA: cost utility analysis
    mHealth: mobile health
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-analysis
    R&D: research and development

    Edited by G Eysenbach; submitted 18.09.20; peer-reviewed by T Kindratt, P Winkler, V Minichiello; comments to author 30.10.20; revised version received 04.12.20; accepted 13.01.21; published 09.03.21

    Copyright

    ©Sandra Sülz, Hilco J van Elten, Marjan Askari, Anne Marie Weggelaar-Jansen, Robbert Huijsman. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 09.03.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.