This paper is in the following e-collection/theme issue:

Games and Gamification for Health (650) Gamification (128) Serious Games for Health and Medicine (683) Digital Health Reporting Standards, Quality and Transparency in e-Research (71) Formative Evaluation and Development of Games (75) Game Design and Efficacy of Game Elements (86) Theoretical Foundations and Frameworks on Games and Gamification (41) Usability of Games and Gamification (70) Digital Health Reviews (1289)

Published on in Vol 23, No 9 (2021): September

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/30390, first published .
Conceptual Ambiguity Surrounding Gamification and Serious Games in Health Care: Literature Review and Development of Game-Based Intervention Reporting Guidelines (GAMING)

Conceptual Ambiguity Surrounding Gamification and Serious Games in Health Care: Literature Review and Development of Game-Based Intervention Reporting Guidelines (GAMING)

Conceptual Ambiguity Surrounding Gamification and Serious Games in Health Care: Literature Review and Development of Game-Based Intervention Reporting Guidelines (GAMING)

Authors of this article:

Simon Warsinsky1 Author Orcid Image ;   Manuel Schmidt-Kraepelin1 Author Orcid Image ;   Sascha Rank1 Author Orcid Image ;   Scott Thiebes1 Author Orcid Image ;   Ali Sunyaev1 Author Orcid Image
Article Authors Cited by (28) Tweetations (6) Metrics

    Original Paper

    Department of Economics and Management, Karlsruhe Institute of Technology, Karlsruhe, Germany

    Corresponding Author:

    Ali Sunyaev, PhD

    Department of Economics and Management

    Karlsruhe Institute of Technology

    Kaiserstr. 89

    Karlsruhe, 76133

    Germany

    Phone: 49 72160846037

    Email: sunyaev@kit.edu


    Background: In health care, the use of game-based interventions to increase motivation, engagement, and overall sustainability of health behaviors is steadily becoming more common. The most prevalent types of game-based interventions in health care research are gamification and serious games. Various researchers have discussed substantial conceptual differences between these 2 concepts, supported by empirical studies showing differences in the effects on specific health behaviors. However, researchers also frequently report cases in which terms related to these 2 concepts are used ambiguously or even interchangeably. It remains unclear to what extent existing health care research explicitly distinguishes between gamification and serious games and whether it draws on existing conceptual considerations to do so.

    Objective: This study aims to address this lack of knowledge by capturing the current state of conceptualizations of gamification and serious games in health care research. Furthermore, we aim to provide tools for researchers to disambiguate the reporting of game-based interventions.

    Methods: We used a 2-step research approach. First, we conducted a systematic literature review of 206 studies, published in the Journal of Medical Internet Research and its sister journals, containing terms related to gamification, serious games, or both. We analyzed their conceptualizations of gamification and serious games, as well as the distinctions between the two concepts. Second, based on the literature review findings, we developed a set of guidelines for researchers reporting on game-based interventions and evaluated them with a group of 9 experts from the field.

    Results: Our results show that less than half of the concept mentions are accompanied by an explicit definition. To distinguish between the 2 concepts, we identified four common approaches: implicit distinction, synonymous use of terms, serious games as a type of gamified system, and distinction based on the full game dimension. Our Game-Based Intervention Reporting Guidelines (GAMING) consist of 25 items grouped into four topics: conceptual focus, contribution, mindfulness about related concepts, and individual concept definitions.

    Conclusions: Conceptualizations of gamification and serious games in health care literature are strongly heterogeneous, leading to conceptual ambiguity. Following the GAMING can support authors in rigorous reporting on study results of game-based interventions.

    J Med Internet Res 2021;23(9):e30390

    doi:10.2196/30390

    Keywords

    game-based interventions; gamification; serious games; literature review; reporting guidelines; conceptual ambiguity 


    Health interventions that draw on games as their inspirational source (ie, game-based interventions) come with the promise of increasing motivation, engagement, and overall sustainability of health behaviors [1] by enabling new paths of interactions between health care providers and patients [2]. Although games are present in various forms and genres, they generally share four defining traits [3]: a goal players try to achieve, rules that limit how players can achieve the goal, a feedback system telling players how they can achieve the goal, and voluntary participation of the players.

    Over time, a myriad of different labels for game-based interventions have emerged, including playification [4], educational games [5], game-based learning [6], active video games [7], fitnessification [8], fitness games [9], exergames or serious exergames [10], cognitive games [11], simulation games [12], games with a purpose [13,14], persuasive information systems [15], and persuasive games [16]. Among these approaches to game-based health interventions, gamification and serious games have emerged as the 2 prevailing concepts [13,17,18]. Both concepts have been reported to be successfully used in various areas of health care, such as promoting healthier lifestyles, supporting rehabilitation processes, or fostering the education of health professionals [19,20]. However, although serious games have been researched long before the proliferation of computer technology and can be traced back to the 1970s [21], the term gamification only became popular around the 2010s [22] and has since then rapidly gained interest from health care researchers and professionals alike [18].

    As both concepts have become increasingly established, scholars have developed a variety of definitions for the terms gamification and serious games [23,24]. In addition, several researchers have discussed substantial conceptual differences between gamification and serious games. For example, Liu et al [25] argued that serious games are full-fledged games that are modeled after but independent and separate from real-world systems, whereas gamification can never exist on its own and is always a part of a real-world system that maintains its instrumental functionality. Such conceptual considerations have been supported by empirical studies that showed differences in the effects of gamification and serious games on specific health behaviors [26]. Consistent with the law of parsimony, the differences in conceptual and empirical levels indicate that gamification and serious games are, in fact, 2 distinct concepts that require separate scholarly consideration [27,28]. However, researchers frequently report cases in which terms related to gamification or serious games are used ambiguously (eg, due to a lack of definitions [29,30]) or even interchangeably [31]. Over the course of our own research endeavors, we have also seen first indications that there is an amalgamation of the terms in the form of authors using them interchangeably or ambiguously. The fuzzy use of the 2 terms can yield negative consequences, such as an impediment to cumulative knowledge development [28,31] or the prevention of collaboration between researchers and practitioners [32]. Some of these issues are already visible in the literature. For example, Koivisto and Hamari [33] reported in their well-cited literature review that they had to consider every paper that was labeled as gamification by the authors, despite being aware of and acknowledging conceptual unclarity between the terms gamification and serious games in some research communities. To ensure the feasibility of the review, they had to perform some substantial abstraction, which “has consequently caused some specifics of the studies to be lost” [33]. In health care, negative effects stemming from conceptual unclarity may also ripple through to practice, as it is not uncommon for game-based health interventions to be built around theoretical knowledge [34,35].

    Within health care literature, the extent to which existing research explicitly distinguishes between gamification and serious games and whether it draws on existing conceptual considerations to do so remains unclear. A major challenge for authors may also be that they see themselves faced with several different definitions and conceptual differences of gamification and serious games, each operating on a different level of abstraction, focusing on different characteristics. This can lead to contradictory indications and may make it difficult for the authors to reconcile different views [23]. We argue that more practical guidelines for authors to avoid ambiguities between different types of game-based interventions can help achieve a more accurate attribution of cognitive, affective, and behavioral outcomes to either gamification or serious games and ultimately advance the development of effective interventions. In this study, we aim to provide researchers and practitioners with the necessary tools. To develop such tools, it is necessary to capture the status quo of how health care researchers understand, define, and use the terms gamification and serious games and whether they explicitly distinguish between the 2 concepts. Consequently, we formulated the following research questions (RQs):

    RQ1: How does extant research conceptualize gamification and serious games in health care?

    RQ2: How does extant research distinguish between gamification and serious games in health care?

    RQ3: How can authors be guided to avoid conceptual ambiguity when reporting game-based intervention studies?

    To answer our RQs, we use a 2-step research design. In step 1, we analyze the current understanding of the terms gamification and serious games in health care research by reviewing the literature in the Journal of Medical Internet Research and its sister journals. By doing so, we provide a comprehensive overview of existing conceptualizations of gamification and serious games in health care (RQ1) and provide rich insights into the nature of the conceptual unclarities surrounding gamification and serious games (RQ2). In step 2, we derive guidelines for authors of game-based intervention studies that may support them in avoiding conceptual ambiguity when reporting their results (RQ3).


    Literature Review

    To answer the first two RQs, we conducted a systematic web-based database search following the guidelines by Levy and Ellis [36]. We limited the search to journals of JMIR Publications, as the Journal of Medical Internet Research itself is one of the leading medical informatics and health care sciences and services journal with an impact factor of 5.43 [37] and a broad area of topics is covered in more than 30 of its sister journals. To identify relevant literature, we used the search tool on the JMIR website [38] to search for papers containing terms related to either gamification (search terms: gamification, gamified, gamifying, or gamify) or serious games (search terms: serious AND games, serious AND gaming, or serious AND game) in any field. The search was performed on November 12, 2020, and yielded 271 studies, for which we screened their full text to assess their relevance. In doing so, we excluded 65 studies that did not focus on either gamification or serious games but, for example, only mention them in the keywords of the paper [39] or as a possible future research avenue [40]. We presumed that all articles published in a journal of JMIR Publications belong to the research area of health care (ie, are related to research on efforts made to maintain or restore physical, mental, or emotional well-being [41]). Hence, we were left with 206 studies for further analysis. Our data analysis followed a concept-centric approach informed by Webster and Watson [42]. For each relevant study, we conducted a full-text analysis to identify the applied research methods, health care context (based on a study by Stepanovic and Mettler [19]), and applied conceptualizations of the terms gamification or serious games. Regarding the conceptualization of gamification and serious games, we first analyzed whether and, if so, how each of the studies defined the terms. For the purpose of this study, we broadly construed a definition as a phrase that conveys the meaning of a term. Furthermore, we analyzed the inspiration sources of each provided definition (ie, whether they were based on extant literature or self-developed). In addition, we analyzed whether and how the studies differentiated between gamification and serious games. The full results of our concept-centric data analysis, including all 206 papers, can be found in Multimedia Appendix 1 [1,2,10,18,40,43-243].

    Development of Reporting Guidelines

    To develop the reporting guidelines, we used a 3-step approach inspired by Moher et al [244]. First, one of the authors generated an initial list of items for inclusion in the checklist based on the insights of the literature review, as well as our personal experience in the field. These items cover both best practices we selected from studies that clearly define and distinguish serious games and gamification, as well as common pitfalls, inconsistencies, and inaccuracies identified within the reviewed literature. The resulting list was grouped into sets of related items. Second, the initial list of items was discussed by all authors in an iterative process to ensure a common understanding. During this step, items were merged, divided, or specified more precisely as required to develop a comprehensive yet concise list of guidelines. In addition, we developed exemplary statements to provide future authors with concrete starting points for reporting game-based interventions. Third, to pilot test our checklist, we sent it to 9 experts in the field of game-based interventions and asked for feedback regarding comprehensibility and completeness. We then consolidated their feedback and incorporated them into guidelines, where feasible. This resulted in adjustments of 6 items (1a, 1b, 2a, 2b, 2c, and 3.1b), as well as the addition of 2 new items (2d and 2e).


    Conceptualizations of Gamification and Serious Games in Health Care Literature

    Characteristics of the Included Studies

    The reviewed articles were published in the Journal of Medical Internet Research and 10 of its sister journals. Table 1 provides an overview of the number of articles published in each journal. In total, 38.8% (80/206) of studies applied quantitative methods, with the most common individual method being intervention trials (67/206, 32.5%). Another 18.9% (39/206) of studies applied qualitative methods, whereas 30% (62/206) of studies were conceptual in nature. The remaining 12.1% (25/206) of studies used mixed methods. Regarding the health care context [19], a majority of studies (99/206, 48.1%) focused on individual lifestyle habits. The most prominent theme in this context is achieving an increase in the physical activity of users, as examined by 7.3% (15/206) of studies [10,43,44]. Chronic disease management and rehabilitation is covered by 38.3% (79/206) of studies, including studies on dementia [45,46], diabetes [47,48], or depression [49,50]. Furthermore, 23.3% (48/206) of studies focused on supporting health professionals and mostly dealt with education on various topics, such as emergency care [51], specific surgical procedures [52,53], or teaching ethics in medicine [54].

    Table 1. Number of articles mentioning terms related to gamification, serious games, or both for each journal of JMIR Publications (N=206).
    OutletGamification, n (%)Serious games, n (%)Both, n (%)Total, n (%)
    JMIR Serious Games21 (10.2)38 (18.4)34 (16.5)93 (45.1)
    Journal of Medical Internet Research11 (5.3)18 (8.7)10 (4.9)39 (18.9)
    JMIR mHealth and uHealth22 (10.7)1 (0.5)4 (1.9)27 (13.1)
    JMIR Research Protocols14 (6.8)8 (3.9)3 (1.5)25 (12.1)
    JMIR Mental Health1 (0.5)1 (0.5)6 (2.9)8 (3.9)
    JMIR Formative Research5 (2.4)0 (0)1 (0.5)6 (2.9)
    JMIR Rehabilitation and Assistive Technologies1 (0.5)2 (1)1 (0.5)4 (1.9)
    JMIR Pediatrics and Parenting1 (0.5)0 (0)0 (0)1 (0.5)
    JMIR Human Factors1 (0.5)0 (0)0 (0)1 (0.5)
    JMIR Medical Education0 (0)1 (0.5)0 (0)1 (0.5)
    JMIR Public Health and Surveillance1 (0.5)0 (0)0 (0)1 (0.5)

    The 206 studies we reviewed were dated from 2010 to 2020. Across these 206 studies, 137 (66.5%) feature terms related to gamification (gamification, gamified, gamifying, or gamify), whereas 128 (62.1%) feature terms related to serious games (serious AND games, serious AND gaming, or serious AND game) in their full text. There is an overlap of 28.6% (59/206) studies that mention terms related to both concepts. Figure 1 shows the distribution of articles that mention terms related to each concept over time. As can be seen in Figure 1, both concepts became increasingly featured in JMIR journals since 2010, with no concept having a clear edge over the other. Out of the 137 studies that feature gamification, 61 (44.5%) explicitly define the term, contrasted by 76 (55.5%) studies that do not. As for serious games, of the 128 studies, 60 (46.9%) that feature the term provide an explicit definition, whereas 68 (53.1%) do not.

    ‎
    Figure 1. Number of articles in JMIR journals mentioning terms related to gamification, serious games, or both per year.
    View this figure
    References to Definitions From Extant Literature

    Of the 61 studies that define gamification, a share of 52 (85%) studies explicitly base their definitions on extant literature, whereas 9 (15%) studies provide a self-developed definition. In contrast, out of the 60 studies that define serious games, 50 (83%) explicitly refer to extant literature to do so, whereas 10 (17%) studies do not. In defining gamification, our reviewed papers draw on 29 different sources, whereas for serious games, we found 27 different sources of definitions. Figures 2 and 3 illustrate the different sources our review papers draw on to define gamification or serious games, respectively. Each node represents one such source. The number of times a source has been cited by our review papers is indicated by both the color and size of the corresponding node. An arrow from one node to another indicates that a study draws on another, specifically when defining gamification or serious games.

    ‎
    Figure 2. Identified gamification definition papers.
    View this figure
    ‎
    Figure 3. Identified serious games definition papers.
    View this figure

    The most commonly cited source for a gamification definition, cited by 14.1% (29/206) of our reviewed papers, is the seminal paper by Deterding et al [245], who define gamification as “the use of game design elements in nongame contexts.” Considering indirect citations (as indicated by arrows in Figure 2), the percentage value increases to 27.2% (56/206), thus forming the vast majority. Another definition by Deterding et al [246] was used by 2.4% (5/206) of the reviewed papers. Huotari and Hamari [247], Cugelman [1], King et al [248], and Deterding et al [249] are each cited by three (3/206, 1.5%) of the reviewed papers, whereas Zichermann and Cunningham [250], Lister et al [55], Miller et al [251], Lumsden et al [56], Stieglitz et al [252], and Hoffmann et al [57] are each referenced twice (2/206, 1%).

    In contrast to gamification, the sources of serious games definitions in our reviewed literature seem to be more fractured and heterogeneous. The most cited paper is that by Michael and Chen [14], cited by 3.4% (7/206) of our reviewed papers. They define serious games as “games that do not have entertainment, enjoyment, or fun as their primary purpose.” In addition to the seven direct citations, Michael and Chen [14] are also cited indirectly 6.3% (13/206) of the time in the definitions of our review papers of serious games (as indicated by arrows in Figure 3). Other prominent sources (based on citation count) include studies by Susi et al [24] (5/206, 2.4%) and Abt [253] (4/206, 1.9%), as well as Deterding et al [245], Zyda [254], Alvarez and Djaouti [255], Bergeron [256], and Marsh [257] (3/206, 1.5%). The remaining sources were cited only once (1/206, 0.5%) or twice (2/206, 1%).

    Conceptions of Gamification in Health Care

    We found that the content of the definitions provided for gamification in the reviewed papers represent several different conceptions. Of the 61 papers defining gamification, 58 (95%) contained only a single definition of the term. Among these articles, 74% (43/58) shared the basic notion of Deterding et al [245,246,249]. They define gamification as either “the use of game design elements in non-game contexts” [245,249] or as an “umbrella term for the use of video game elements (rather than full-fledged games) to improve user experience and user engagement in nongame services and applications” [246]. Both definitions conceptualize gamification as the intentional use of game (design) elements in some kind of nongame artifact. The latter definition, however, explicitly includes the purpose of gamification as improving user experience and user engagement. Similarly, among the 43 papers conceptualizing gamification in line with the basic notion of Deterding et al [245,249], 33 (77%) did not explicitly specify the purpose of gamification. The other 23% (10/43) of papers all specify a variation of engagement, motivation, or both as the purpose of gamification [58-60]. There are also differences regarding the inspiration that gamification draws from games. Although most of the reviewed papers adopt the term game (design) elements from the definition by Deterding et al [245,249], others instead name game (design) techniques [61-64], game principles [65], playful elements [66], game components [67], or game design features [68]. Similarly, the views differed in the artifacts that gamification is applicable to. Instead of nongame contexts, some authors speak of nongame settings [43,69], nongame environments [59], or nongame mechanisms [70]. Others more generally refer to “real world processes or problems” [71], “nongameful or nongamelike situations, services, or tools” [62], or “applications that were not games to begin with” [72].

    Another 15 articles provided a single definition that differs from the notion of Deterding et al [245] in a more substantial way. A group of 40% (6/15) of papers specify the nongame context of gamification as either health care [40,73-76] or education [18]. For example, Mendiola et al [75] described gamification as a “feature that offers points, badges, or movement through levels as a health objective is achieved or the more a patient is engaged.” Park and Kim [18] state that “gamification in education applies game elements to an educational context.” Furthermore, 47% (7/15) of articles neither narrowed the context down in a general way nor mentioned a specific context [63,77,78]. For instance, Brown et al [77] refer to gamification as “the application of game design elements to engage and motivate users.” The remaining 13% (2/15) of papers describe gamification as a process to create serious games [79] or focus on gamification as the “overall proliferation of games in culture, society, and technology” [80]. Finally, three papers provide more than one definition of gamification. Among these 3 papers, 2 (67%) [81,82] contrast the aforementioned definition by Deterding et al [245] with an alternative definition that describes gamification as “a process of enhancing a service with affordances for gameful experiences in order to support user’s overall value creation” [247]. Cheng et al [81] argue that the latter definition is more useful in an mHealth context, as it focuses on the goal of gamification instead of its method. Zakaria et al [54] provided various conceptualizations of gamification throughout the article without contrasting them.

    Conceptions of Serious Games in Health Care

    Regarding the content of serious games definitions, we first identified different views on how much serious games draw from games. Most studies simply state that serious games “are games” [83,84], whereas some expand on this by limiting serious games to, for example, “full-blown digital games” [85]. Brown et al [86] used this full game characteristic as the sole basis for their self-developed definition, as they define serious games as “the use of games in their entirety (as opposed to selected elements or individual features of a game).” On the contrary, some authors conceptualize serious games not necessarily as full games but rather as “game-like experiences” [87], “the use of game design elements” [58], or as something that “[uses] specific design principles derived from video games” [88]. Some authors even necessitate the presence of specific game elements in a serious game, such as a challenge [89,90], a responsive narrative [91,92], or interactive elements [93]. Four studies also mention that serious games must be situated in a nongame context [58,86,89,94].

    Furthermore, we found that 90% (55/61) of papers that provided a definition of serious games relate to the purpose of a serious game. They do so in any of the following 3 ways. First, 15% (8/55) of studies neutrally state that a serious game needs to have any kind of purpose, also described as a characterizing goal [95]. Second, 40% (22/55) of studies state that a serious game needs to have a specific purpose. For example, Mack et al [96] refer to serious games as “games designed to fulfill a serious purpose by providing education from health professionals via a digital device.” Other mentioned purposes include imparting in a user the skills, knowledge, or attitudes that are applicable in the real world [89], or to improve motivation when completing or addressing complex or bothersome tasks [88]. Third, the remaining 45% (25/55) of studies explicitly exclude specific purposes from being the main purpose of a serious game. This nearly unanimously involved excluding entertainment [87,97] or enjoyment [98] as the main purpose of a serious game. Only Gamito et al [99] pass over entertainment and instead state that “serious games are games designed for other purposes than gaming.”

    There were also different views in the reviewed literature on the role of entertainment in serious games. As stated earlier, most studies exclude entertainment as the main purpose of a serious game [87,97]. Nevertheless, some authors still consolidate entertainment as a core part of a serious game by explicitly mentioning that serious games “use entertainment” [100] or “[bring] fun spring from video games” [101] or by referring to serious games as “entertaining games” [102,103]. In contrast, Vilardaga et al [97] refer to serious games as “games not for entertainment,” possibly excluding entertainment as part of a serious game altogether. Furthermore, some authors [95,104,105] seem to consider serious games as an augmented form of (entertainment) games in the sense that they do “not simply [provide] entertainment” [87] or “merely entertain” [106] but rather are a “combination of serious aspects with fun” [101] or “intended to be both entertaining and educational” [103]. The studies by Andrade Ferreira et al [45] and Bindoff et al [107] most vividly represent this view, as they start with entertainment games as a basis, and then outline the differences between serious games and entertainment games (eg, an explicit purpose).

    Finally, we identified several aspects that were unique to only one or two definitions. DeSmet et al [103] posit that serious games are “a form of organized play.” Similarly, according to Shiyko et al [94], serious games use playful design strategies. The authors also stated that the term serious games is a synonym for a variety of terms, including gamification [58], applied games [108], games with a purpose [107], and transformational games [45]. In 2 studies, Tuti et al [51,109] posited that serious games have to be playable with a mobile phone. Robert et al [100] remarked that a serious game is a contest played against a computer and thus involves only 1 player.

    Distinctions

    Overall, we identified 59 articles that mention both the terms gamification and serious games in their full texts. We examined these articles to determine the relationship between the 2 terms used by the authors in each case. To start, 14% (8/59) of articles did not allow for an interpretation of the semantic link between the 2 terms (eg, the terms were used without reference to each other in completely different sections of the article). Within the remaining 86% (51/59) of articles, we identified four groups of articles with distinct approaches: (1) implicit distinction, (2) synonymous use of terms, (3) serious games as a type of gamified system, and (4) distinction based on the full game dimension. The 4 approaches are outlined in detail in the following sections.

    The first group contained 29% (15/51) of articles that only implicitly differentiated between the terms gamification and serious games. The authors of these articles use the 2 terms in relation to each other in such a way that it becomes clear that they differentiate between the two terms without providing any explanations for why and how to do so. Typical examples of this approach include articles that use and differentiate the terms in enumeration. For example, Park and Kim [18] state “[b]efore gamification, educational games, game-based learning, and serious games were applied to the classroom. As gamification was defined, however, it has become preferred among instructors compared with the other techniques.” Similarly, Martin et al [74] write “[I]n all, 2 different persuasive mechanisms—gamification and serious gaming—were proposed.”

    The second group contained 10% (5/51) of articles that used the terms gamification and serious games interchangeably. For example, Booth et al [58] state that “[s]erious gaming or gamification has been defined [...] as ‘the use of game design elements in nongame contexts’ for the purposes of engaging learners in solving complex problems.” Although some authors use the terms synonymously without making it a subject of discussion, others show awareness of conceptual ambiguity. For example, Lumsden et al [56] report: “[There is a] lack of coherence in the field [...] partly due to poor definition of terms; for example, the gamelike tasks covered in this review could be described as ‘serious games,’ ‘gamelike’, ‘gamified’, ‘games with a purpose’, ‘gamed-up’, or simply ‘computer based’.”

    The third group contains 43% (22/51) of papers that regard serious games as a type of gamified system. Many authors refer to gamification as the process of developing a game-based intervention. For example, Zhang et al [68] stated that “the gamification approaches used included the addition of gaming elements to existing tasks, transformation of a conventional task into a serious game.” Furthermore, while some of these articles focus on serious games as the only possible outcome of gamification, many other authors seem to share the view that other types of game-based interventions can also be the outcome of gamification. For example, Fornasini et al [44] reported that “a recent trend has revealed virtual physical training through exergames and serious games, making gamification an effective tool to motivate.” In this regard, serious games are also sometimes referred to as systems that integrate “gamification principles and gamification strategies” [110]. However, it mostly remains unclear what is meant by these terms and how they differ from other established terms such as game mechanics, game dynamics, and game aesthetics [258].

    The last group contains 18% (9/51) of articles that distinguish between gamification and serious games based on whether the system in consideration is regarded as a full game. For example, de Vette et al [111] state that “gamification is defined as the use of elements from games in nongame contexts to improve user experience and engagement without making that system a full game as is the case with serious games.” However, it largely remains unclear what the criteria are that determine whether a system is a full-fledged game or only gamified. Some authors try to counteract this by giving examples of gamification and serious games that are as vivid as possible. For example, Vermeir et al [60] state that “an interactive world in which players complete challenges designed to improve physical activity” is a typical example for a serious game, whereas a gamified system could be “a mobile health application that uses points and badges to encourage physical activity.” Nevertheless, these authors also report that, in practice, the actual distinction between the 2 concepts can be blurry and highly subjective because of a lack of clear criteria [60].

    Game-Based Intervention Reporting Guidelines

    General Remarks About the Guidelines

    Through our review, we found that not only are the concepts of gamification and serious games construed in various ways but also their relationship is often fuzzy and unclear. To reduce this conceptual ambiguity, we compiled reporting guidelines consisting of 25 items that are considered essential when reporting studies that deal with game-based interventions and grouped them into 4 topics. In the following sections, we present these items, each accompanied by a description and, where applicable, exemplary statements. A consolidated version that can be used as a quick reference can be found in Multimedia Appendix 2 [245]. A more detailed version including detailed rationales for each individual item may be found in Multimedia Appendix 3 [245].

    Game-Based Intervention Reporting Guidelines (GAMING) should be interpreted with some consideration. GAMING are intended to support the reporting of studies on game-based interventions. Although some of the items in GAMING may be beneficial to consider when developing a game-based intervention, our guidelines are not intended to guide the development of game-based interventions per se. GAMING are also intended only for studies that deal with game-based interventions. Accordingly, when we use the term concept in our guidelines, we refer to a type of game-based intervention (eg, gamification, serious games, or exergames). We further differentiated between those concepts that are the thematic focus of the study (henceforth termed core concepts) and those that only have auxiliary roles (henceforth termed related concepts). An example to clarify this: a study may focus on the development of a physical activity intervention based on the paradigm of serious games (core concept) but still compare its results to gamified physical activity interventions or exergames (related concepts). In the following sections, we briefly introduce the contents of our guidelines and the rationales for including them.

    Topic 1: Conceptual Focus

    The first topic contains items that ensure that the conceptual focus of a study is clear to the authors and readers alike (Table 2).

    Table 2. Game-Based Intervention Reporting Guidelines—items in topic 1: conceptual focus.
    Number and topicDescriptionExemplary or explanatory statements
    1. Conceptual Focus

    		(a) Decide which concepts (ie, gamification or serious games) best reflect the interventions you want to investigate.See Multimedia Appendix 4 [17,25,29,31,245,259-261] for existing theoretical distinctions between serious games and gamification.

    		(b) Clearly state early in the paper which core concepts (ie, gamification or serious games) you focus on in your study and which criteria the decision for this core concept was based on.“In this study, we focus on the concept of gamification, because we wanted to bring single game elements into the intervention instead of developing a full-fledged game.”

    		(c) Supply only metadata (eg, title and keywords) that corresponds to your core concepts.For a study developing a physical activity intervention based on gamification: Gamification, gamified intervention.

    Ultimately, it should be transparent for the reader, what kind of game-based interventions a study focuses on. A precondition for this is that the authors themselves understand what concepts best reflect the design of the game-based interventions they want to focus on (item 1a). In light of the plethora of existing concepts, as well as the different operationalizations of each, this is by no means a trivial task. Authors may find it beneficial to draw upon concept distinctions from extant literature to establish their conceptual focus. To decide between gamification and serious games, we compiled several distinctions from extant literature that authors may use as decision support (Multimedia Appendix 4). After deciding on their core concepts, the authors should communicate this decision early in their manuscript and include information on how the decision was reached (1b). This allows the reader to comprehend their decisions and grasp the study’s conceptual focus. Furthermore, we suggest that authors should be mindful of the metadata they supply their study with (1c). When reviewing the extant literature, researchers often use metadata to initially assess the conceptual focus of a study and subsequently derive its relevance for their own purposes. Although we acknowledge that broadly diversified metadata increases the visibility of a study, it can also blur the conceptual focus of a study and increase noise for meta-studies or literature reviews.

    Topic 2: Contribution

    The items that we propose for the second topic (Table 3) are intended to clarify the knowledge contribution of a study to both authors and readers.

    We believe that there are various research streams proximal to different concepts. What constitutes a research stream can be interpreted in various ways. Broadly, we understand a research stream as a set of studies with similar properties, such as their health care context (eg, all studies that describe the design of gamified physical activity interventions), or their applied methodology (eg, all studies that conduct literature reviews on serious games).

    Table 3. Game-Based Intervention Reporting Guidelines—items in topic 2: contribution.
    Number and topicDescriptionExemplary or explanatory statements
    2. Contribution

    		(a) Decide which research stream within the focused concepts your study contributes to.“Our work contributes to a better understanding of how gamification is being applied in real-world mHealth apps.”

    		(b) Report which research streams your study contributes to and which criteria the decision for research streams was based on.“We contribute to a better understanding of the specific game element of leaderboards. We decided for leaderboards, as they are prominently used in mHealth apps to elicit social comparison.”

    		(c) Clarify your study\'s contributions to the chosen research streams, including the boundaries of your study.“We provide rich insights into the psychological effects of leaderboards on patients when isolated from other game elements. [...] Our insights are about leaderboard specifically and are not necessarily transferable to other social comparison features.”

    		(d) Clarify your study’s contributions to solving a problem or need in practice or society.“The results of our study can support the design and implementation of successful physical activity mHealth apps in practice.”

    		(e) Report to which extent observed positive and negative outcomes can be attributed to your game-based interventions. If possible, narrow down the attribution of outcomes based on individual components of your game-based intervention (eg, game elements). “Participants showed increased motivation, because they were able to compare themselves to others via the leaderboard function. However, this function also caused some participants to feel less competent, thus decreasing their motivation.”

    Each research stream comes with its own thematic emphasis and viewing angle. Thus, the transferability of knowledge between different research streams requires care and consciousness. For instance, insights from studies focusing on physical activity are often not transferable to studies focusing on health professionals’ education [19]. Similarly, knowledge about badges is not necessarily transferable to leaderboards, although both approaches may be labeled as gamification. Thus, we think that authors should consciously decide which research streams they contribute to (2a). To facilitate transparency, the authors should communicate their decision to their readers (2b). By also including insights into the decision process (eg, explaining the criteria that shaped the decision for a research stream) in their manuscript, readers can gain a better understanding of a study’s setting and on the generalizability and transferability of its results. After deciding on a research stream, the authors should clarify their study’s contribution to the knowledge base of the research stream, including the boundaries of their study (2c). By doing so, readers can understand how the study contributes to a better understanding of core concepts. Furthermore, the ultimate goal of any intervention is usually to solve a problem in practice (eg, sedentary lifestyles). Accordingly, to foster an understanding of how specific game-based interventions can help to solve these problems, we recommend that the authors clarify their study’s practical contribution (2d). Finally, for an understanding of game-based interventions, it is vital that the outcomes of an intervention are reported and attributed to the chosen type of game-based intervention in an as granular way as possible (2e). In this way, readers can easily contextualize knowledge and understand whether an outcome is, for example, evoked by a specific game element (eg, leaderboards) or connected to a specific affective outcome (eg, envy). We also encourage authors to embrace negative outcomes of their game-based interventions, as these, despite them usually not being the desired outcome of an intervention, can notably contribute to a better understanding of a concept [262].

    Topic 3: Mindfulness About Related Concepts

    Items in the third topic (Table 4) are concerned with ensuring that authors are mindful of the conceptual ambiguities surrounding game-based interventions and possible consequences for their study.

    Table 4. Game-Based Intervention Reporting Guidelines—items in topic 3: mindfulness about related concepts.
    Number and topicDescriptionExemplary or explanatory statements
    3. Mindfulness about related concepts

    		3.1. Introduction and use of related concepts


    		(a) Make efforts to identify possibly related concepts prominent in the context of your study.Prominent related concepts for gamification in physical activity: Exergames, active video games, fitness games.


    		(b) Mention only those related concepts that are substantive for your study.‘Substantive’ in the sense that a research design necessitates the introduction of a concept. Example: A research design contrasting the effects of two game-based intervention concepts requires the introduction of both concepts.


    		(c) Be mindful about nuanced terms in the domain of any introduced concept and use established vocabulary precisely.Examples: Game design elements, game mechanics, gamification elements, ...


    		(d) Avoid using related concepts interchangeably. If you use an umbrella term, specify which terms it comprises and clarify why you introduce it.“To allow a better readability of the manuscript, we use the term activity games to describe gamified physical activity interventions, serious games for physical activity, as well as exergames.”

    		3.2. Insights from extant literature


    		(a) Be mindful about conceptual ambiguities when drawing on the literature about game-based interventions.—a


    		(b) Do not presume easy transferability of insights from one concept to another.Example: Drawing on serious games literature for a gamification-based intervention (or vice versa).


    		(c) Specify precisely what you draw from the literature and why these insights are applicable to your study.“Serious games and gamification share that they both center around game elements. Hence, to compile a list of possible game elements for our gamified intervention, we also drew upon serious games literature to widen our scope.”

    aNot available.

    First, we think that studies benefit if authors identify related concepts that are in close proximity to the core concepts (3.1a). Considering any pair of concepts, the boundaries between these closely related concepts will likely be the vaguest, which also makes them the most important boundaries to define to avoid conceptual ambiguities. Authors may assess the “proximity” of 2 concepts based on various contextual factors of an intervention, such as targeted health behavior. For example, in a physical activity context, exergames are a prominent related concept to consider. Similarly, terms with high linguistic proximity are likely to be candidates for related concepts. As Tan et al [72] remarked in their study, the terms serious games and serious gaming, although ostensibly the same, can be construed as 2 different concepts that describe different classes of game-based interventions (ie, serious games describe games specifically designed for the serious purpose of health education, whereas serious gaming is the use of any game for said purpose). For each related concept, the authors should also consider the benefits of introducing it in their manuscript. Increasing the number of concepts introduced by nature also increases the possibility of conceptual ambiguity. In our review, we faced anecdotal mentions of gamification or serious games, which were often difficult to interpret regarding the authors’ understanding of the individual concepts and the relationship between the two. Thus, we argue that concepts should only be introduced when they are substantive for understanding a study (3.1b). This also leads to less noise for meta-studies as well as less confusion for readers, as they have to keep track of only substantive concepts. Our guidelines also account for mindfulness regarding conceptual ambiguities in the vocabulary surrounding game-based interventions (3.1c). In game-based interventions, many terms can be quite nuanced or not necessarily correspond to its intuitive meaning. For instance, in games research, the term game aesthetics not only describes the artistic value of a game’s visual interface but may also refer to the desirable emotional responses evoked in the player [258]. Accordingly, we suggest being precise while using vocabulary in the domain of any concept and not lightheartedly use or arbitrarily adapt possibly nuanced terms. As there are at least theoretical differences between most concepts, we also highly discourage the interchangeable use of concepts in a manuscript (3.1d). If several concepts are summarized under an umbrella term, this should be done in a transparent way to avoid confusing the reader.

    Furthermore, we think that authors should be mindful of the applicability of insights from extant literature to their own research in 2 ways. First, if a researcher finds a study that is labeled as focusing on the same concept that they are trying to investigate, it does not necessarily follow that the researcher and the authors of said study have the same understanding of the concept in question. As our literature review illustrates for gamification and serious games, there are various understandings that are not always reconcilable. Hence, it is advisable to be mindful about conceptual ambiguities when reviewing the extant literature on game-based interventions (3.2a) and ideally challenging the label of each study against one’s own understanding. Second, when transferring knowledge from one concept to another, the authors should carefully consider the possible theoretical and empirical differences in the respective concepts. This aspect is supported by extant research that found several empirical differences with regard to the psychological and behavioral outcomes of gamification and serious games [26]. Such differences can easily impede the transferability of knowledge from one concept to another. Thus, the authors should not presume the easy transferability of knowledge from one concept to another (3.2b). Furthermore, after assessing transferability, authors should precisely specify what knowledge they draw from extant literature and why they think that said knowledge is transferable to their study (3.2c). This empowers the reader to put statements into the context of extant literature and allows a better understanding of how knowledge may be transferable, despite possible conceptual differences.

    Topic 4: Individual Concept Definitions

    The items in the fourth topic (Table 5) focus on aligning the understandings of authors and the reader regarding the introduced concepts.

    Table 5. Game-Based Intervention Reporting Guidelines—items in topic 4: individual concept definitions.
    Number and topicDescriptionExemplary or explanatory statements
    4. Individual concept definitions

    		4.1. Definition inspiration


    		(a) Familiarize yourself with definitions for a concept provided by extant literature.Reviews can often provide a good overview of different views on a concept.


    		(b) Decide whether a concept definition from extant literature is applicable for your research or if you need a self-developed definition.Decision criteria: Deficits in extant literature? Incompatibility of own views with literature?

    		4.2. Definition of concepts


    		(a) Explicitly define each introduced concept independently in a principal clause. Ideally, justify your choice for a specific definition.“We define gamification as the use of game design elements in non-game contexts, as this is the most widely applied definition of gamification across disciplines. We define serious games as games whose primary purpose is not entertainment. A game is [...].”


    		(b) Explicitly distinguish each introduced related concept pairwise to at least to your core concepts; better even to all related concepts."Gamification differs from serious games in that [...]."

    		4.3. Definitions from extant literature: if definitions are taken from extant literature...


    		(a) Make efforts to identify the original source of a definition.—a


    		(b) Include an explicit reference to the source of a definition directly following the definition.“We define gamification as the use of game-design elements in non-game contexts” [Deterding et al, 2011]; [245]

    		4.4. Self-developed definitions: if any definition for a concept is self-developed...


    		(a) Make sure to adhere to good definition design.Be specific, avoid long sentences, do not repeat the term to be defined in the definition.


    		(b) Clarify from which views your self-developed definition emerged.“We include only specific game elements of point, badges and leaderboards in our definition of gamification, because [...].”

    		4.5. Multiple definitions for a single concept: if multiple definitions for a single concept are provided...


    		(a) State clearly, which definition(s) is (are) applied in the study, and why.“Gamification can be either defined as [...][exemplary reference 1] or as [...][exemplary reference 2].”; “For the purposes of this study, we follow the view of [exemplary reference 2], because [...].”


    		(b) Apply the chosen definition(s) consistently.—

    aNot available.

    They cover individual concept definitions as well as the relationships between concepts. Having chosen that they want to introduce a certain concept, authors should first familiarize themselves with how extant literature defines it (4.1a). They should then decide whether they want to adopt a definition from the extant literature or need a self-developed definition (4.1b). The latter may especially be the case if authors find that there are no definitions for a concept in extant literature, deficits in existing definitions, or if they feel that their view of a concept is not sufficiently covered by any existing definition. Challenging existing definitions can bring vast benefits to the theoretical development of a research stream. In most cases, however, authors are better off when they build on existing definitions, as this may allow better placement within extant research and facilitate the building of cumulative knowledge. In particular, we urge not to reinvent the wheel when providing any self-developed definition. For most game-based intervention concepts, multiple prominent definitions exist that together cover a large range of views (eg, the studies by Deterding et al [245] or Huotari and Hamari [247] for gamification and the studies by Michael and Chen [14] or Alvarez and Djaouti [255] for serious games). Hence, authors should always consider first if they want to align their views with those of the extant literature.

    Irrespective of the source of a definition, it is vital that authors explicitly define every concept introduced in their study (4.2a) to ensure that readers and authors share a common understanding. A lack of an explicit definition for a concept requires the reader to subjectively appraise the authors’ understanding of it based on context. Throughout our literature review, we found that about half of the mentions of gamification or serious games are not accompanied by an explicit definition and thus require such an appraisal, which is likely error-prone. Furthermore, concepts should not be initially defined based on their boundaries to other concepts but rather in an independent manner. For example, statements such as “exergames are games that differ from serious games in [...]” do not fully reveal an author’s understanding of exergames to readers, but only that they somehow differ from serious games. Defining concepts should be done in a principal clause to ensure that a definition is actually recognized as such. Ideally, authors should also justify their choice for a particular concept definition, as this can provide valuable context to the reader (eg, the knowledge that a particular definition is the most used in a particular discipline). Once all concepts (ie, core concepts and related concepts that are substantive in the sense of 3.1b) are independently defined, the boundaries between concepts can be established (4.2b). Explicitly drawing the boundaries between concepts is the most reliable way to mitigate conceptual ambiguities. Ideally, the boundaries between all possible pairs of introduced concepts are drawn. In cases where this is infeasible (eg, due to a large number of introduced concepts), the boundaries adjacent to the core concepts of a study take priority. The study by Park and Kim [18] is a good example to note the benefits of properly introducing and delineating related concepts. They focus on developing a gamified learning environment, making gamification their core concept. Owing to their proximity to the education context, they identify the related concepts of game-based learning and educational gaming, define them individually, and subsequently sharpen their contribution by stating that gamification is their preferred intervention design for being a more accessible technique for teachers than the other concepts.

    If authors decide to adopt definitions from the extant literature, it is important that they establish a clear and unambiguous connection to their respective sources. To do so, researchers should first aim to identify the original source of a definition (4.3a). Readers with domain knowledge are usually able to recognize prominent sources of definitions (especially in the case of seminal papers) and can then immediately attribute a study to a certain view of a concept. Not citing the original source of a definition (ie, indirect citation) obfuscates the original source of a definition and prevents this process. To ensure that a definition can be attributed to its source, the source should be explicitly referenced immediately after the principal clause that contains the definition (4.3b).

    Formulating a good self-developed definition is a nontrivial task that requires great care. Authors that decide to do so find support in guidelines for a good definition design (4.4a). Although there is no universal way to formulate definitions, authors may consider general guidelines on definition design [263] or take guidance from definition development principles in other areas [264]. Within the context of our study, we particularly emphasize avoiding the use of any part of the term that is defined within the definition of the term itself. For example, when defining serious games as games with a serious purpose, the question immediately follows, how games and serious purposes are defined, essentially leaving the reader none the wiser concerning the meaning of serious games. Whenever authors decide on a self-developed definition of a concept (considering 4.1b), they should also allow the reader to comprehend this decision by clarifying from which view their self-developed definition emerged (4.4b). By fostering an understanding of the decision for a self-developed definition, the reader can also better grasp how a study contributes to an advanced, possibly novel understanding of a concept.

    Finally, in some cases, authors may find it beneficial to name several definitions of a single concept, for example, to contrast different views [81,265] or to outline the theoretical development of a concept [112]. To avoid confusing the reader, they should clarify which definition they apply in their study (4.5a) and subsequently apply this definition consistently (4.5b). By further rationalizing the reasons for the choice of a specific definition or concept view, authors can increase the comprehension of the reader of why a certain definition was chosen.


    Current State of Conceptual Ambiguity in Serious Games and Gamification Literature

    Overall, the findings of our study help to better understand the phenomena of gamification and serious games and how they are conceptualized in research published in JMIR journals. Our results paint a heterogeneous landscape of different conceptualizations and different ways of distinguishing the 2 concepts. In addition, there are also some major differences in the evolution of definitions over time. We identified some common pitfalls that may arise when researchers deal with gamification or serious games and provide guidance on how to avoid them. In the following sections, we discuss the principal findings of this study.

    First, the results from our literature review provide insights into the vast differences in how researchers conceptualize gamification or serious games. Our results show that less than half (121/265, 45.7%) of concept mentions are accompanied by an explicit definition which leaves room for improvements in scientific rigor. Regarding the sources used for definitions, our results show clear differences between gamification and serious games. Although the majority of definitions used for gamification (43/61, 70%) can be traced back to the seminal paper by Deterding et al [245], no such single central article exists for the concept of serious games. Regarding the content of definitions, in the case of gamification, most studies follow the understanding of Deterding et al [245]. Deviations from this understanding are particularly evident in a change of the nongame context, meaning that the context is either limited to a specific area of application (eg, health care and education) or omitted completely. From our perspective, both approaches can be problematic. First, we think that gamification and its potential to positively shape the cognition, affection, and behavior of people is not limited to a specific context. In fact, extant research has repeatedly stated that investigating the context specifics of gamification outcomes is one of the most interesting and challenging questions that researchers currently face [33,266]. Second, we think that omitting the nongame context from the definition of gamification can lead to great confusion around the concept, as this would technically allow including classic video games with pure entertainment purposes, which was actually intended to be avoided when conceptualizing gamification [245]. For serious games, the definition content was considerably more heterogeneous than that of gamification. However, one aspect stood out. Although some authors emphasize that serious games refer to video games in their entirety [85], others state that they only draw specific aspects from video games, such as design principles [88]. In the latter case, the definitions of serious games seemed considerably closer to the common definitions of gamification.

    Second, by analyzing 59 studies that mentioned both gamification and serious games, our results reveal 4 approaches to the relationship between the 2 terms. From our point of view, 2 of these approaches, namely interchangeable use (5/59, 8%) and implicit differentiations (15/59, 25%), are not ideal for communicating one's own ideas of the concepts to the academic audience. As outlined in our reporting guidelines, we think that explicit definitions and distinctions play a key role in mitigating the conceptual ambiguity surrounding different types of game-based interventions. This is also echoed by extant literature on conceptual ambiguity problems, which states that such problems can arise when researchers implicitly assume that because they can make a logical distinction between concepts, this distinction will also exist in the minds of others [267]. The largest group of studies (22/59, 37%) labeled serious games as a type of gamified intervention or as the product resulting from the gamification process. This seems closely related to the classic process view of gamification [265], where gamification is construed as a process of transforming a purely utilitarian system into a system that combines utilitarian and hedonic functions by implementing game design elements [268]. From our point of view, this approach is incompatible with the understanding of the last group of studies (9/59, 15%) that, similar to Deterding et al [245], consolidate serious games as full-fledged games, whereas gamification involves systems that only partly consist of game design elements and in addition have nongame parts. A similar view is shared by Marczweski [259], who argues that contrary to gamification, serious games provide gameplay, which he describes as “[having] all the elements you would expect to see in a real game.” Although conceptually sound, this distinction can also be problematic, as deciding whether users actually play a game or use a system is an often complex question that involves empirical, subjective, and social factors [56,245]. In fact, for medical interventions in practice, it seems infeasible to empirically investigate each individual user on whether they are using or playing their system. On a conceptual level, this issue may be approached by substituting actual user behavior with design intention.

    Finally, when analyzing the thematic focus of our review literature, our results show an ever-increasing amount of both gamification and serious games studies in the JMIR research community since 2015, with seemingly no concept prevailing over the other. We found this particularly interesting because it contrasts previous observations that gamification is increasingly superseding serious games as a more popular concept [18]. In fact, we also think that the circumstance that no concept prevails over the other even strengthens the relevance of clearly distinguishing between different types of game-based health interventions and attributing research results accurately in the future.

    Implications

    Our study has several implications for future research. First, our study revealed a strong heterogeneity surrounding the conceptualizations of serious games and gamification. In particular, we demonstrate that just because 2 game-based interventions are labeled similarly, it does not necessarily follow that the designers share the same understanding of the underlying concept. For researchers, this implies that they need to exercise particular caution and scientific rigor when studying game-based interventions and reporting study results. In fact, the easy transferability of knowledge based on labels provided in the literature is often not given.

    Second, our results strongly indicate that there are conceptual ambiguity problems surrounding serious games and gamification in the health care literature. To counteract this, we rigorously developed GAMING and evaluated them with the help of 9 outstanding experts from the area of game-based intervention research. To the best of our knowledge, this is the first study to formulate such reporting guidelines explicitly for game-based interventions. The individual guideline items are designed to mitigate common pitfalls that lead to conceptual ambiguities in the literature reviewed. Researchers can use GAMING as an inspiration for reporting the results of game-based health interventions while accounting for potential conceptual ambiguity. However, GAMING should not be interpreted as a prescription for the reporting of game-based health interventions in a strict or standardized format. The guideline items should be addressed in sufficient detail and with clarity somewhere in the manuscript, but the order and format for presenting the required information depends on author preferences, journal style, and the traditions of the research field.

    For practitioners, we believe that our study can help raise awareness about the conceptual ambiguity surrounding game-based health interventions. Practitioners, similar to researchers, should exercise caution when interpreting research findings and transferring them into practice. Our review and guidelines may serve as a starting point to assess whether any study they want to draw on may be affected by conceptual ambiguity and subsequently support them in evaluating the transferability of knowledge for their own purposes.

    Limitations and Future Research

    The results of our study are limited in several ways, which also opens up avenues for future research. First, we limited our literature review to studies published in the Journal of Medical Internet Research and its sister journals. Although we are convinced that the Journal of Medical Internet Research is a suitable representative of the overall landscape of game-based health interventions, future research may also benefit from investigating the conceptual ambiguities surrounding gamification and serious games outside of the JMIR research community. We would be particularly interested in whether our findings regarding the different evolutions of gamification and serious games definitions (Figures 2 and 3) hold in a different literature corpus. Researchers may also find it beneficial to extend our approach to a full citation network analysis to investigate the flow of knowledge in serious games and gamification literature [269]. This may allow further insights into whether given conceptualizations are refinements or extensions of existing ones, which is a prime indicator for investigating conceptual ambiguities [28]. Second, we only included two concepts in our literature review: gamification and serious games. As we alluded to in our introduction, a plethora of concepts for health interventions draws on games as their inspirational source. However, gamification and serious games are currently prevailing concepts in game-based interventions [13,18]. Thus, we argue that investigating the conceptual conflict between this particular concept pair allows for the extraction of the highest proportion of knowledge. Nevertheless, future research may still benefit from including additional or different concepts within the scope of the investigation. As for our reporting guidelines, we believe that we converted the insights from our literature review to a sufficient level of abstraction so that they are transferable to other types of game-based interventions.

    Conclusions

    Games are an increasingly popular source of inspiration for the design of health care interventions. With the ever-increasing number of game-based interventions, concerns regarding conceptual ambiguity have arisen. In this study, we focus on the conceptual boundaries between two of the most prominent game-based intervention concepts: gamification and serious games. Our analysis of the literature in the JMIR research community unveils various understandings of the concepts themselves, as well as the boundaries between them. Thus, our results support the initial hypothesis of conceptual ambiguity between gamification and serious games in the health care literature. On the basis of these results, we proposed GAMING, consisting of 25 items designed to guide researchers in reporting their own game-based intervention studies in a way that mitigates conceptual ambiguity. We believe that our results can serve as a valuable supplement to existing research that has discussed conceptual differences between different types of game-based interventions and can help advance cumulative knowledge development in game-based health intervention research, without being impaired by conceptual ambiguity.

    Acknowledgments

    The authors would like to thank Michelle Berger, Lobna Hassan, Andreas Janson, Jeff Mullins, Stacie Petter, Lisa-Maria Putz, Sofia Schöbel, Stefan Stepanovic, and Tobias Wolf for providing valuable feedback on the reporting guidelines.

    Authors' Contributions

    The authors’ contributions according to the Contributor Roles Taxonomy are as follows: Conceptualization was done by SW, MSK, SR, and ST. Data curation was done by SW and MSK. Formal analysis was done by SW, MSK, and SR. Funding acquisition was done by ST and AS. Investigation was done by SW, MSK, SR, and ST. Methodology was developed by SW, MSK, SR, and ST. Project administration was done by SW. Resources were provided by AS. Supervision was done by ST and AS. Validation was done by SW and MSK. Visualization was done by SR. Writing the original draft was done by all authors. Writing, review, and editing was done by all authors.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Overview of the 206 papers included in the literature review.

    XLSX File (Microsoft Excel File), 96 KB
    ‎
    Multimedia Appendix 2

    Consolidated, one-page version of Game-Based Intervention Reporting Guidelines, excluding rationales.

    DOCX File , 28 KB
    ‎
    Multimedia Appendix 3

    Consolidated, extended version of Game-Based Intervention Reporting Guidelines, including detailed rationales and exemplary statements.

    DOCX File , 32 KB
    ‎
    Multimedia Appendix 4

    Overview of existing distinctions between serious games and gamification in extant literature.

    DOCX File , 24 KB
    1. Cugelman B. Gamification: what it is and why it matters to digital health behavior change developers. JMIR Serious Games 2013;1(1):e3 [FREE Full text] [CrossRef] [Medline]
    2. Pramana G, Parmanto B, Lomas J, Lindhiem O, Kendall PC, Silk J. Using mobile health gamification to facilitate cognitive behavioral therapy skills practice in child anxiety treatment: open clinical trial. JMIR Serious Games 2018 May 10;6(2):e9 [FREE Full text] [CrossRef] [Medline]
    3. McGonigal J. Reality Is Broken: Why Games Make Us Better and How They Can Change the World. New York: Penguin Group; 2011:1-396.
    4. Segura EM, Waern A, Segura LM, Recio DL. Playification: The PhySeEar case. In: Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play. 2016 Presented at: CHI PLAY '16: The Annual Symposium on Computer-Human Interaction in Play; October 16 - 19, 2016; Austin Texas USA p. 376-388. [CrossRef]
    5. Al-Azawi R, Al-Faliti F, Al-Blushi M. Educational gamification vs. game based learning: comparative study. Int J Innov Manage Technol 2016;7(4):131-136. [CrossRef]
    6. Prensky M. Digital game-based learning. Comput Entertain 2003 Oct;1(1):21. [CrossRef]
    7. Williams WM, Ayres CG. Can active video games improve physical activity in adolescents? A review of RCT. Int J Environ Res Public Health 2020 Jan 20;17(2):669 [FREE Full text] [CrossRef] [Medline]
    8. Leibetseder A, Lux M. Gamifying fitness or fitnessifying games: a comparative study. In: Proceedings of the GamifIR Workshop. 2016 Presented at: Workshop on Gamification for Information Retrieval (GamifIR); December 2016; Pisa Italy p. 37-44   URL: http://www-itec.uni-klu.ac.at/bib/files/__GAMIFIR__Research_Fitnessification.pdf
    9. Liu L, Stacey P, Tarafdar M, Kourentzes N. Simplifying fitness games for users with learning disabilities. In: Proceedings of the 50th Hawaii International Conference on System Sciences, HICSS 2017. 2017 Presented at: 50th Hawaii International Conference on System Sciences, HICSS 2017; January 4-7, 2017; Hilton Waikoloa Village, Hawaii, USA p. 1-10. [CrossRef]
    10. McBain T, Weston M, Crawshaw P, Haighton C, Spears I. Development of an exergame to deliver a sustained dose of high-intensity training: formative pilot randomized trial. JMIR Serious Games 2018 Mar 27;6(1):e4 [FREE Full text] [CrossRef] [Medline]
    11. Murphy B, Aleni A, Belaoucha B, Dyer J, Nolan H. Quantifying cognitive aging and performance with at-home gamified mobile EEG. In: Proceedings of the International Workshop on Pattern Recognition in Neuroimaging (PRNI). 2018 Presented at: International Workshop on Pattern Recognition in Neuroimaging (PRNI); June 12-14, 2018; Singapore p. 1-4. [CrossRef]
    12. Chen AM, Kiersma ME, Yehle KS, Plake KS. Impact of an aging simulation game on pharmacy students' empathy for older adults. Am J Pharm Educ 2015 Jun 25;79(5):65 [FREE Full text] [CrossRef] [Medline]
    13. Sardi L, Idri A, Fernández-Alemán JL. A systematic review of gamification in e-Health. J Biomed Inform 2017 Dec;71:31-48. [CrossRef] [Medline]
    14. Michael D, Chen S. Serious Games: Games That Educate, Train and Inform. Boston, Massachusetts, United States: Thomson Course Technology; 2006:1-352.
    15. Bui A, Veit D, Webster J. Gamification – a novel phenomenon or a new wrapping for existing concepts? In: Proceedings of the 36th International Conference on Information Systems. 2015 Presented at: 36th International Conference on Information Systems; December 13-16, 2015; Fort Worth, Texas, USA p. 1-21   URL: https://core.ac.uk/download/pdf/301367495.pdf
    16. Orji R, Nacke L, Di Marco C. Towards personality-driven persuasive health games and gamified systems. In: Proceedings of the CHI Conference on Human Factors in Computing Systems. 2017 Presented at: CHI '17: CHI Conference on Human Factors in Computing Systems; May 6 - 11, 2017; Denver Colorado USA p. 1015-1027. [CrossRef]
    17. Croon RD, Wildemeersch D, Wille J, Verbert K, Abeele V. Gamification and serious games in a healthcare informatics context. In: Proceedings of the IEEE International Conference on Healthcare Informatics (ICHI). 2018 Presented at: IEEE International Conference on Healthcare Informatics (ICHI); June 4-7, 2018; New York, NY, USA p. 53-63. [CrossRef]
    18. Park S, Kim S. A badge design framework for a gamified learning environment: cases analysis and literature review for badge design. JMIR Serious Games 2019 May 29;7(2):e14342 [FREE Full text] [CrossRef] [Medline]
    19. Stepanovic S, Mettler T. Gamification applied for health promotion: does it really foster long-term engagement? A scoping review. In: Proceedings of the 26th European Conference on Information Systems. 2018 Presented at: 26th European Conference on Information Systems; June 23-28, 2018; Portsmouth, UK p. 1-16   URL: https://serval.unil.ch/resource/serval:BIB_50A0EC5E3795.P002/REF
    20. Wattanasoontorn V, Boada I, García R, Sbert M. Serious games for health. Entertain Comput 2013 Dec;4(4):231-247. [CrossRef]
    21. Ricciardi F, De Paolis LT. A comprehensive review of serious games in health professions. Int J Comput Games Technol 2014:1-11. [CrossRef]
    22. Thiebes S, Lins S, Basten D. Gamifying information systems-a synthesis of gamification mechanics and dynamics. In: Proceedings of the 22nd European Conference on Information Systems. 2014 Presented at: 22nd European Conference on Information Systems; June 9-11, 2014; Tel Aviv, Israel   URL: https:/​/www.​researchgate.net/​publication/​262805143_Gamifying_Information_Systems_-_A_Synthesis_of_Gamification_Mechanics_and_Dynamics
    23. Werbach K. (Re)defining gamification: a process approach. In: Proceedings of the International Conference on Persuasive Technology. 2014 Presented at: International Conference on Persuasive Technology; May 21-23, 2014; Padua, Italy p. 266-272. [CrossRef]
    24. Susi T, Johannesson M, Backlund P. Serious games – an overview. School of Humanities and Informatics, University of Skövde, Sweden. 2007.   URL: https://www.diva-portal.org/smash/get/diva2:2416/FULLTEXT01.pdf [accessed 2021-07-29]
    25. Liu D, Santhanam R, Webster J. Toward meaningful engagement: a framework for design and research of gamified information systems. MIS Q 2017 Apr 4;41(4):1011-1034. [CrossRef]
    26. Pfau J, Smeddinck J, Volkmar G, Wenig N, Malaka R. Do you think this is a game? Contrasting a serious game with a gamified application for health. In: Proceedings of the CHI Conference on Human Factors in Computing Systems. 2018 Presented at: CHI '18: CHI Conference on Human Factors in Computing Systems; April 21 - 26, 2018; Montreal QC Canada   URL: https:/​/docplayer.​net/​212316150-Do-you-think-this-is-a-game-contrasting-a-serious-game-with-a-gamified-application-for-health.​html [CrossRef]
    27. Shaffer JA, DeGeest D, Li A. Tackling the problem of construct proliferation. Organ Res Methods 2015 Aug 18;19(1):80-110. [CrossRef]
    28. Le H, Schmidt FL, Harter JK, Lauver KJ. The problem of empirical redundancy of constructs in organizational research: an empirical investigation. Organ Behav Hum Decis Process 2010 Jul;112(2):112-125. [CrossRef]
    29. Yohannis A, Prabowo Y, Waworuntu A. Defining gamification: From lexical meaning and process viewpoint towards a gameful reality. In: Proceedings of the International Conference on Information Technology Systems and Innovation (ICITSI). 2014 Presented at: International Conference on Information Technology Systems and Innovation (ICITSI); November 24-27, 2014; Bandung, Indonesia p. 284-289. [CrossRef]
    30. Kim B. Understanding Gamification. Chicago: American Library Association; 2016:1-37.
    31. Landers RN. Developing a theory of gamified learning. Simul Gaming 2015 Jan 15;45(6):752-768. [CrossRef]
    32. Rousseau DM. A sticky, leveraging, and scalable strategy for high-quality connections between organizational practice and science. Acad Manage J 2007 Oct;50(5):1037-1042. [CrossRef]
    33. Koivisto J, Hamari J. The rise of motivational information systems: a review of gamification research. Int J Info Manage 2019 Apr;45:191-210. [CrossRef]
    34. Kankanhalli A, Shin J, Oh H. Mobile-based interventions for dietary behavior change and health outcomes: scoping review. JMIR Mhealth Uhealth 2019 Jan 21;7(1):e11312 [FREE Full text] [CrossRef] [Medline]
    35. Schmidt-Kraepelin M, Warsinsky S, Thiebes S, Sunyaev A. The role of gamification in health behavior change: a review of theory-driven studies. In: Proceedings of the 53rd Hawaii International Conference on System Sciences. 2020 Presented at: 53rd Hawaii International Conference on System Sciences; Jan 07 - 10, 2020; Maui, Hawaii p. 1256-1265. [CrossRef]
    36. Levy Y, Ellis TJ. A systems approach to conduct an effective literature review in support of information systems research. InformingSciJ 2006;9:181-212. [CrossRef]
    37. Journal citation report 2019-2020. Clarivate Analytics - Journal Impact Factor (ISI) 2019 - 2020.   URL: https:/​/www.​researchgate.net/​publication/​334048283_Journal_citation_report_2019-2020_-_Clarivate_Analytics_-_Journal_Impact_Factor_ISI_2019_-_2020 [accessed 2021-07-29]
    38. Search articles. JMIR Publications.   URL: https://jmir.org/search/ [accessed 2021-08-10]
    39. Bossenbroek R, Wols A, Weerdmeester J, Lichtwarck-Aschoff A, Granic I, van Rooij MM. Efficacy of a virtual reality biofeedback game (DEEP) to reduce anxiety and disruptive classroom behavior: single-case study. JMIR Ment Health 2020 Mar 24;7(3):e16066 [FREE Full text] [CrossRef] [Medline]
    40. Fishbein JN, Nisotel LE, MacDonald JJ, Amoyal PN, Jacobs JM, Flanagan C, et al. Mobile application to promote adherence to oral chemotherapy and symptom management: a protocol for design and development. JMIR Res Protoc 2017 Apr 20;6(4):e62 [FREE Full text] [CrossRef] [Medline]
    41. Health care. Merriam-Webster.   URL: https://www.merriam-webster.com/dictionary/health%20care [accessed 2021-06-10]
    42. Webster J, Watson RT. Analyzing the past to prepare for the future: writing a literature review. MIS Q 2002;26(2):xiii-xxiii [FREE Full text]
    43. Edney S, Ryan JC, Olds T, Monroe C, Fraysse F, Vandelanotte C, et al. User engagement and attrition in an app-based physical activity intervention: secondary analysis of a randomized controlled trial. J Med Internet Res 2019 Nov 27;21(11):e14645 [FREE Full text] [CrossRef] [Medline]
    44. Fornasini S, Dianti M, Bacchiega A, Forti S, Conforti D. Using geocaching to promote active aging: qualitative study. J Med Internet Res 2020 Jun 11;22(6):e15339 [FREE Full text] [CrossRef] [Medline]
    45. Ferreira LD, Ferreira H, Cavaco S, Cameirão M, I Badia SB. User experience of interactive technologies for people with dementia: comparative observational study. JMIR Serious Games 2020 Aug 05;8(3):e17565 [FREE Full text] [CrossRef] [Medline]
    46. Tziraki C, Berenbaum R, Gross D, Abikhzer J, Ben-David BM. Designing serious computer games for people with moderate and advanced dementia: interdisciplinary theory-driven pilot study. JMIR Serious Games 2017 Jul 31;5(3):e16 [FREE Full text] [CrossRef] [Medline]
    47. Martinez W, Threatt AL, Rosenbloom ST, Wallston KA, Hickson GB, Elasy TA. A patient-facing diabetes dashboard embedded in a patient web portal: design sprint and usability testing. JMIR Hum Factors 2018 Sep 24;5(3):e26 [FREE Full text] [CrossRef] [Medline]
    48. Cafazzo JA, Casselman M, Hamming N, Katzman DK, Palmert MR. Design of an mHealth app for the self-management of adolescent type 1 diabetes: a pilot study. J Med Internet Res 2012;14(3):e70 [FREE Full text] [CrossRef] [Medline]
    49. Yokomitsu K, Irie T, Sekiguchi M, Shimizu A, Matsuoka H, Merry SN, et al. Gamified mobile computerized cognitive behavioral therapy for Japanese University students with depressive symptoms: protocol for a randomized controlled trial. JMIR Res Protoc 2020 Apr 07;9(4):e15164 [FREE Full text] [CrossRef] [Medline]
    50. Vervaeke J, Van Looy J, Hoorelbeke K, Baeken C, Koster EH. Gamified cognitive control training for remitted depressed individuals: user requirements analysis. JMIR Serious Games 2018 Apr 05;6(2):e6 [FREE Full text] [CrossRef] [Medline]
    51. Tuti T, Winters N, Edgcombe H, Muinga N, Wanyama C, English M, et al. Evaluation of adaptive feedback in a smartphone-based game on health care providers' learning gain: randomized controlled trial. J Med Internet Res 2020 Jul 06;22(7):e17100 [FREE Full text] [CrossRef] [Medline]
    52. IJgosse W, van Goor H, Rosman C, Luursema J. Construct validity of a serious game for laparoscopic skills training: validation study. JMIR Serious Games 2020 May 07;8(2):e17222 [FREE Full text] [CrossRef] [Medline]
    53. Haubruck P, Nickel F, Ober J, Walker T, Bergdolt C, Friedrich M, et al. Evaluation of app-based serious gaming as a training method in teaching chest tube insertion to medical students: randomized controlled trial. J Med Internet Res 2018 Dec 21;20(5):e195 [FREE Full text] [CrossRef] [Medline]
    54. Zakaria NS, Saripan MI, Subarimaniam N, Ismail A. Assessing Ethoshunt as a gamification-based mobile app in ethics education: pilot mixed-methods study. JMIR Serious Games 2020 Aug 10;8(3):e18247 [FREE Full text] [CrossRef] [Medline]
    55. Lister C, West JH, Cannon B, Sax T, Brodegard D. Just a fad? Gamification in health and fitness apps. JMIR Serious Games 2014;2(2):e9 [FREE Full text] [CrossRef] [Medline]
    56. Lumsden J, Edwards EA, Lawrence NS, Coyle D, Munafò MR. Gamification of cognitive assessment and cognitive training: a systematic review of applications and efficacy. JMIR Serious Games 2016;4(2):e11 [FREE Full text] [CrossRef] [Medline]
    57. Hoffmann A, Christmann CA, Bleser G. Gamification in stress management apps: a critical app review. JMIR Serious Games 2017 Jun 07;5(2):e13 [FREE Full text] [CrossRef] [Medline]
    58. Booth R, Sinclair B, McMurray J, Strudwick G, Watson G, Ladak H, et al. Evaluating a serious gaming electronic medication administration record system among nursing students: protocol for a pragmatic randomized controlled trial. JMIR Res Protoc 2018 May 28;7(5):e138 [FREE Full text] [CrossRef] [Medline]
    59. Friehs MA, Dechant M, Vedress S, Frings C, Mandryk RL. Effective gamification of the stop-signal task: two controlled laboratory experiments. JMIR Serious Games 2020 Sep 08;8(3):e17810 [FREE Full text] [CrossRef] [Medline]
    60. Vermeir JF, White MJ, Johnson D, Crombez G, Van Ryckeghem DM. The effects of gamification on computerized cognitive training: systematic review and meta-analysis. JMIR Serious Games 2020 Aug 10;8(3):e18644 [FREE Full text] [CrossRef] [Medline]
    61. Hightow-Weidman L, Muessig K, Knudtson K, Srivatsa M, Lawrence E, LeGrand S, et al. A gamified smartphone app to support engagement in care and medication adherence for HIV-positive young men who have sex with men (AllyQuest): development and pilot study. JMIR Public Health Surveill 2018 Apr 30;4(2):e34 [FREE Full text] [CrossRef] [Medline]
    62. Jessen S, Mirkovic J, Ruland CM. Creating gameful design in mHealth: a participatory co-design approach. JMIR Mhealth Uhealth 2018 Dec 14;6(12):e11579 [FREE Full text] [CrossRef] [Medline]
    63. Leinonen A, Pyky R, Ahola R, Kangas M, Siirtola P, Luoto T, et al. Feasibility of gamified mobile service aimed at physical activation in young men: population-based randomized controlled study (MOPO). JMIR Mhealth Uhealth 2017 Oct 10;5(10):e146 [FREE Full text] [CrossRef] [Medline]
    64. AlMarshedi A, Wills G, Ranchhod A. Guidelines for the gamification of self-management of chronic illnesses: multimethod study. JMIR Serious Games 2017 May 12;5(2):e12 [FREE Full text] [CrossRef] [Medline]
    65. Fleming T, Merry S, Stasiak K, Hopkins S, Patolo T, Ruru S, et al. The importance of user segmentation for designing digital therapy for adolescent mental health: findings from scoping processes. JMIR Ment Health 2019 May 08;6(5):e12656 [FREE Full text] [CrossRef] [Medline]
    66. Rohde A, Duensing A, Dawczynski C, Godemann J, Lorkowski S, Brombach C. An app to improve eating habits of adolescents and young adults (challenge to go): systematic development of a theory-based and target group-adapted mobile app intervention. JMIR Mhealth Uhealth 2019 Aug 12;7(8):e11575 [FREE Full text] [CrossRef] [Medline]
    67. White BK, Martin A, White JA, Burns SK, Maycock BR, Giglia RC, et al. Theory-based design and development of a socially connected, gamified mobile app for men about breastfeeding (Milk Man). JMIR Mhealth Uhealth 2016 Jun 27;4(2):e81 [FREE Full text] [CrossRef] [Medline]
    68. Zhang M, Ying J, Song G, Fung DS, Smith H. Gamified cognitive bias modification interventions for psychiatric disorders: review. JMIR Ment Health 2018 Oct 25;5(4):e11640 [FREE Full text] [CrossRef] [Medline]
    69. Fortunato M, Harrison J, Oon AL, Small D, Hilbert V, Rareshide C, et al. Remotely monitored gamification and social incentives to improve glycemic control among adults with uncontrolled type 2 diabetes (iDiabetes): protocol for a randomized controlled trial. JMIR Res Protoc 2019 Nov 20;8(11):e14180 [FREE Full text] [CrossRef] [Medline]
    70. Pasquier P, Mérat S, Malgras B, Petit L, Queran X, Bay C, et al. A serious game for massive training and assessment of French soldiers involved in forward combat casualty care (3D-SC1): development and deployment. JMIR Serious Games 2016 May 18;4(1):e5 [FREE Full text] [CrossRef] [Medline]
    71. Gentry SV, Gauthier A, Ehrstrom BL, Wortley D, Lilienthal A, Car LT, et al. Serious gaming and gamification education in health professions: systematic review. J Med Internet Res 2019 Mar 28;21(3):e12994 [FREE Full text] [CrossRef] [Medline]
    72. Tan JW, Zary N. Diagnostic markers of user experience, play, and learning for digital serious games: a conceptual framework study. JMIR Serious Games 2019 Jul 16;7(3):e14620 [FREE Full text] [CrossRef] [Medline]
    73. Giunti G. 3MD for chronic conditions, a model for motivational mHealth design: embedded case study. JMIR Serious Games 2018 Aug 24;6(3):e11631 [FREE Full text] [CrossRef] [Medline]
    74. Martin A, Caon M, Adorni F, Andreoni G, Ascolese A, Atkinson S, et al. A mobile phone intervention to improve obesity-related health behaviors of adolescents across Europe: iterative co-design and feasibility study. JMIR Mhealth Uhealth 2020 Mar 02;8(3):e14118 [FREE Full text] [CrossRef] [Medline]
    75. Mendiola MF, Kalnicki M, Lindenauer S. Valuable features in mobile health apps for patients and consumers: content analysis of apps and user ratings. JMIR Mhealth Uhealth 2015 May 13;3(2):e40 [FREE Full text] [CrossRef] [Medline]
    76. Nour M, Chen J, Allman-Farinelli M. Young adults' engagement with a self-monitoring app for vegetable intake and the impact of social media and gamification: feasibility study. JMIR Form Res 2019 May 10;3(2):e13324 [FREE Full text] [CrossRef] [Medline]
    77. Brown JM, Savaglio R, Watson G, Kaplansky A, LeSage A, Hughes J, et al. Optimizing child nutrition education with the foodbot factory mobile health app: formative evaluation and analysis. JMIR Form Res 2020 Apr 17;4(4):e15534 [FREE Full text] [CrossRef] [Medline]
    78. Burgess J, Watt K, Kimble RM, Cameron CM. Combining technology and research to prevent scald injuries (the cool runnings intervention): randomized controlled trial. J Med Internet Res 2018 Oct 10;20(10):e10361 [FREE Full text] [CrossRef] [Medline]
    79. Khalili-Mahani N, De Schutter B. Affective game planning for health applications: quantitative extension of gerontoludic design based on the appraisal theory of stress and coping. JMIR Serious Games 2019 Jun 06;7(2):e13303 [FREE Full text] [CrossRef] [Medline]
    80. Schmidt-Kraepelin M, Toussaint PA, Thiebes S, Hamari J, Sunyaev A. Archetypes of gamification: analysis of mhealth apps. JMIR Mhealth Uhealth 2020 Oct 19;8(10):e19280 [FREE Full text] [CrossRef] [Medline]
    81. Cheng VW, Davenport TA, Johnson D, Vella K, Mitchell J, Hickie IB. An app that incorporates gamification, mini-games, and social connection to improve men's mental health and well-being (MindMax): participatory design process. JMIR Ment Health 2018 Nov 19;5(4):e11068 [FREE Full text] [CrossRef] [Medline]
    82. Park S, Kim S. Patterns among 754 gamification cases: content analysis for gamification development. JMIR Serious Games 2018 Nov 06;6(4):e11336 [FREE Full text] [CrossRef] [Medline]
    83. Khalili-Mahani N, Assadi A, Li K, Mirgholami M, Rivard M, Benali H, et al. Reflective and reflexive stress responses of older adults to three gaming experiences in relation to their cognitive abilities: mixed methods crossover study. JMIR Ment Health 2020 Mar 26;7(3):e12388 [FREE Full text] [CrossRef] [Medline]
    84. LeGrand S, Muessig KE, Platt A, Soni K, Egger JR, Nwoko N, et al. Epic allies, a gamified mobile phone app to improve engagement in care, antiretroviral uptake, and adherence among young men who have sex with men and young transgender women who have sex with men: protocol for a randomized controlled trial. JMIR Res Protoc 2018 Apr 05;7(4):e94 [FREE Full text] [CrossRef] [Medline]
    85. Montagni I, Mabchour I, Tzourio C. Digital gamification to enhance vaccine knowledge and uptake: scoping review. JMIR Serious Games 2020 May 18;8(2):e16983 [FREE Full text] [CrossRef] [Medline]
    86. Brown M, O'Neill N, van Woerden H, Eslambolchilar P, Jones M, John A. Gamification and adherence to web-based mental health interventions: a systematic review. JMIR Ment Health 2016;3(3):e39 [FREE Full text] [CrossRef] [Medline]
    87. Fordham J, Ball C. Framing mental health within digital games: an exploratory case study of hellblade. JMIR Ment Health 2019 Apr 18;6(4):e12432 [FREE Full text] [CrossRef] [Medline]
    88. Winter M, Pryss R, Probst T, Reichert M. Learning to read by learning to write: evaluation of a serious game to foster business process model comprehension. JMIR Serious Games 2020 Jan 09;8(1):e15374 [FREE Full text] [CrossRef] [Medline]
    89. Bossen D, Broekema A, Visser B, Brons A, Timmerman A, van Etten-Jamaludin F, et al. Effectiveness of serious games to increase physical activity in children with a chronic disease: systematic review with meta-analysis. J Med Internet Res 2020 Apr 01;22(4):e14549 [FREE Full text] [CrossRef] [Medline]
    90. Glover K, Bodzin A. Learner analysis to inform the design and development of a serious game for nongaming female emerging health care preprofessionals: qualitative sample study. JMIR Serious Games 2020 Feb 06;8(1):e16003 [FREE Full text] [CrossRef] [Medline]
    91. Abraham O, Thakur T, Brown R. Developing a theory-driven serious game to promote prescription opioid safety among adolescents: mixed methods study. JMIR Serious Games 2020 Jul 03;8(3):e18207 [FREE Full text] [CrossRef] [Medline]
    92. Adjedj J, Ducrocq G, Bouleti C, Reinhart L, Fabbro E, Elbez Y, et al. Medical student evaluation with a serious game compared to multiple choice questions assessment. JMIR Serious Games 2017 May 16;5(2):e11 [FREE Full text] [CrossRef] [Medline]
    93. Reichlin L, Mani N, McArthur K, Harris AM, Rajan N, Dacso CC. Assessing the acceptability and usability of an interactive serious game in aiding treatment decisions for patients with localized prostate cancer. J Med Internet Res 2011 Jan 12;13(1):e4 [FREE Full text] [CrossRef] [Medline]
    94. Shiyko M, Hallinan S, Seif EM, Subramanian S, Castaneda-Sceppa C. Effects of playing a serious computer game on body mass index and nutrition knowledge in women. JMIR Serious Games 2016 Jun 02;4(1):e8 [FREE Full text] [CrossRef] [Medline]
    95. Caserman P, Hoffmann K, Müller P, Schaub M, Straßburg K, Wiemeyer J, et al. Quality criteria for serious games: serious part, game part, and balance. JMIR Serious Games 2020 Jul 24;8(3):e19037 [FREE Full text] [CrossRef] [Medline]
    96. Mack I, Reiband N, Etges C, Eichhorn S, Schaeffeler N, Zurstiege G, et al. The Kids Obesity Prevention Program: Cluster randomized controlled trial to evaluate a serious game for the prevention and treatment of childhood obesity. J Med Internet Res 2020 Apr 24;22(4):e15725 [FREE Full text] [CrossRef] [Medline]
    97. Vilardaga R, Rizo J, Zeng E, Kientz JA, Ries R, Otis C, et al. User-centered design of learn to quit, a smoking cessation smartphone app for people with serious mental illness. JMIR Serious Games 2018 Jan 16;6(1):e2 [FREE Full text] [CrossRef] [Medline]
    98. Lindner P, Rozental A, Jurell A, Reuterskiöld L, Andersson G, Hamilton W, et al. Experiences of gamified and automated virtual reality exposure therapy for spider phobia: qualitative study. JMIR Serious Games 2020 Apr 29;8(2):e17807 [FREE Full text] [CrossRef] [Medline]
    99. Gamito P, Oliveira J, Lopes P, Brito R, Morais D, Silva D, et al. Executive functioning in alcoholics following an mHealth cognitive stimulation program: randomized controlled trial. J Med Internet Res 2014 Apr 17;16(4):e102. [CrossRef] [Medline]
    100. Robert P, Manera V, Derreumaux A, Montesino M, Leone E, Fabre R, et al. Efficacy of a web app for cognitive training (MeMo) regarding cognitive and behavioral performance in people with neurocognitive disorders: randomized controlled trial. J Med Internet Res 2020 Mar 11;22(3):e17167 [FREE Full text] [CrossRef] [Medline]
    101. Gautier EJ, Bot-Robin V, Libessart A, Doucède G, Cosson M, Rubod C. Design of a serious game for handling obstetrical emergencies. JMIR Serious Games 2016 Dec 21;4(2):e21 [FREE Full text] [CrossRef] [Medline]
    102. Ong JG, Lim-Ashworth NS, Ooi YP, Boon JS, Ang RP, Goh DH, et al. An interactive mobile app game to address aggression (RegnaTales): pilot quantitative study. JMIR Serious Games 2019 May 08;7(2):e13242 [FREE Full text] [CrossRef] [Medline]
    103. DeSmet A, Thompson D, Baranowski T, Palmeira A, Verloigne M, De Bourdeaudhuij I. Is participatory design associated with the effectiveness of serious digital games for healthy lifestyle promotion? A meta-analysis. J Med Internet Res 2016 Apr 29;18(4):e94 [FREE Full text] [CrossRef] [Medline]
    104. Vugts MA, Zedlitz AM, Joosen MC, Vrijhoef HJ. Serious gaming during multidisciplinary rehabilitation for patients with chronic pain or fatigue symptoms: mixed methods design of a realist process evaluation. J Med Internet Res 2020 Mar 09;22(3):e14766 [FREE Full text] [CrossRef] [Medline]
    105. Carvalho DB, Domingueti DB, Santos SM, Dias DR. A game to deal with alcohol abuse (Jib): development and game experience evaluation. JMIR Serious Games 2019 Oct 15;7(4):e11151 [FREE Full text] [CrossRef] [Medline]
    106. Jander A, Crutzen R, Mercken L, Candel M, de Vries H. Effects of a web-based computer-tailored game to reduce binge drinking among Dutch adolescents: a cluster randomized controlled trial. J Med Internet Res 2016 Feb 03;18(2):e29 [FREE Full text] [CrossRef] [Medline]
    107. Bindoff I, de Salas K, Peterson G, Ling T, Lewis I, Wells L, et al. Quittr: The design of a video game to support smoking cessation. JMIR Serious Games 2016 Dec 01;4(2):e19 [FREE Full text] [CrossRef] [Medline]
    108. Graafland M, Dankbaar M, Mert A, Lagro J, De Wit-Zuurendonk L, Schuit S, et al. How to systematically assess serious games applied to health care. JMIR Serious Games 2014;2(2):e11 [FREE Full text] [CrossRef] [Medline]
    109. Tuti T, Winters N, Muinga N, Wanyama C, English M, Paton C. Evaluation of adaptive feedback in a smartphone-based serious game on health care providers' knowledge gain in neonatal emergency care: protocol for a randomized controlled trial. JMIR Res Protoc 2019 Jul 26;8(7):e13034 [FREE Full text] [CrossRef] [Medline]
    110. Shepherd M, Fleming T, Lucassen M, Stasiak K, Lambie I, Merry SN. The design and relevance of a computerized gamified depression therapy program for indigenous māori adolescents. JMIR Serious Games 2015;3(1):e1 [FREE Full text] [CrossRef] [Medline]
    111. de Vette F, Tabak M, Dekker-van WM, Vollenbroek-Hutten M. Engaging elderly people in telemedicine through gamification. JMIR Serious Games 2015 Dec 18;3(2):e9 [FREE Full text] [CrossRef] [Medline]
    112. Brauner P, Ziefle M. Serious motion-based exercise games for older adults: evaluation of usability, performance, and pain mitigation. JMIR Serious Games 2020 Apr 01;8(2):e14182 [FREE Full text] [CrossRef] [Medline]
    113. Abraham O, LeMay S, Bittner S, Thakur T, Stafford H, Brown R. Investigating serious games that incorporate medication use for patients: systematic literature review. JMIR Serious Games 2020 Apr 29;8(2):e16096 [FREE Full text] [CrossRef] [Medline]
    114. Aksoy E. Comparing the effects on learning outcomes of tablet-based and virtual reality-based serious gaming modules for basic life support training: randomized trial. JMIR Serious Games 2019 May 01;7(2):e13442 [FREE Full text] [CrossRef] [Medline]
    115. Allam A, Kostova Z, Nakamoto K, Schulz PJ. The effect of social support features and gamification on a Web-based intervention for rheumatoid arthritis patients: randomized controlled trial. J Med Internet Res 2015 Jan 09;17(1):e14 [FREE Full text] [CrossRef] [Medline]
    116. AlMarshedi A, Wills G, Ranchhod A. Gamifying self-management of chronic illnesses: a mixed-methods study. JMIR Serious Games 2016 Sep 09;4(2):e14 [FREE Full text] [CrossRef] [Medline]
    117. Almeida J, Nunes F. The practical work of ensuring effective use of serious games in a rehabilitation clinic: a qualitative study. JMIR Rehabil Assist Technol 2020 Feb 21;7(1):e15428 [FREE Full text] [CrossRef] [Medline]
    118. Alyami H, Alawami M, Lyndon M, Alyami M, Coomarasamy CL, Henning M, et al. Impact of using a 3D visual metaphor serious game to teach history-taking content to medical students: longitudinal mixed methods pilot study. JMIR Serious Games 2019 Sep 26;7(3):e13748 [FREE Full text] [CrossRef] [Medline]
    119. Amantini SN, Montilha AA, Antonelli BC, Leite KT, Rios D, Cruvinel T, et al. Using augmented reality to motivate oral hygiene practice in children: protocol for the development of a serious game. JMIR Res Protoc 2020 Jan 17;9(1):e10987 [FREE Full text] [CrossRef] [Medline]
    120. Antoniou PE, Arfaras G, Pandria N, Athanasiou A, Ntakakis G, Babatsikos E, et al. Biosensor real-time affective analytics in virtual and mixed reality medical education serious games: cohort study. JMIR Serious Games 2020 Sep 02;8(3):e17823 [FREE Full text] [CrossRef] [Medline]
    121. Badawy SM, Cronin RM, Hankins J, Crosby L, DeBaun M, Thompson AA, et al. Patient-centered eHealth interventions for children, adolescents, and adults with sickle cell disease: systematic review. J Med Internet Res 2018 Jul 19;20(7):e10940 [FREE Full text] [CrossRef] [Medline]
    122. Bang C, Nam Y, Ko EJ, Lee W, Kim B, Choi Y, et al. A serious game-derived index for detecting children with heterogeneous developmental disabilities: randomized controlled trial. JMIR Serious Games 2019 Oct 24;7(4):e14924 [FREE Full text] [CrossRef] [Medline]
    123. Benda NC, Kellogg KM, Hoffman DJ, Fairbanks RJ, Auguste T. Lessons learned from an evaluation of serious gaming as an alternative to mannequin-based simulation technology: randomized controlled trial. JMIR Serious Games 2020 Sep 28;8(3):e21123 [FREE Full text] [CrossRef] [Medline]
    124. Besoain F, Perez-Navarro A, Jacques Aviñó C, Caylà JA, Barriga NA, de Olalla PG. Prevention of HIV and other sexually transmitted infections by geofencing and contextualized messages with a gamified app, UBESAFE: design and creation study. JMIR Mhealth Uhealth 2020 Mar 17;8(3):e14568 [FREE Full text] [CrossRef] [Medline]
    125. Billis A, Pandria N, Mouratoglou SA, Konstantinidis E, Bamidis P. Development of cognitive and physical exercise systems, clinical recordings, large-scale data analytics, and virtual coaching for heart failure patients: protocol for the BioTechCOACH-ForALL project. JMIR Res Protoc 2020 May 04;9(5):e17714 [FREE Full text] [CrossRef] [Medline]
    126. Blackburne T, Rodriguez A, Johnstone SJ. A serious game to increase healthy food consumption in overweight or obese adults: randomized controlled trial. JMIR Serious Games 2016 Jul 13;4(2):e10 [FREE Full text] [CrossRef] [Medline]
    127. Block G, Azar KM, Block TJ, Romanelli RJ, Carpenter H, Hopkins D, et al. A Fully Automated Diabetes Prevention Program, Alive-PD: Program design and randomized controlled trial protocol. JMIR Res Protoc 2015 Jan 21;4(1):e3 [FREE Full text] [CrossRef] [Medline]
    128. Boendermaker WJ, Gladwin TE, Peeters M, Prins PJ, Wiers RW. Training working memory in adolescents using serious game elements: pilot randomized controlled trial. JMIR Serious Games 2018 May 23;6(2):e10 [FREE Full text] [CrossRef] [Medline]
    129. Boendermaker WJ, Maceiras SS, Boffo M, Wiers RW. Attentional bias modification with serious game elements: evaluating the shots game. JMIR Serious Games 2016 Dec 06;4(2):e20 [FREE Full text] [CrossRef] [Medline]
    130. Bray L, Sharpe A, Gichuru P, Fortune PM, Blake L, Appleton V. The acceptability and impact of the xploro digital therapeutic platform to inform and prepare children for planned procedures in a hospital: before and after evaluation study. J Med Internet Res 2020 Aug 11;22(8):e17367 [FREE Full text] [CrossRef] [Medline]
    131. Brox E, Konstantinidis S, Evertsen G. User-centered design of serious games for older adults following 3 years of experience with exergames for seniors: a study design. JMIR Serious Games 2017 Jan 11;5(1):e2 [FREE Full text] [CrossRef] [Medline]
    132. Buffel C, van Aalst J, Bangels AM, Toelen J, Allegaert K, Verschueren S, et al. A web-based serious game for health to reduce perioperative anxiety and pain in children (CliniPup): pilot randomized controlled trial. JMIR Serious Games 2019 Jun 01;7(2):e12431 [FREE Full text] [CrossRef] [Medline]
    133. Buijs-Spanjers KR, Hegge HH, Cnossen F, Jaarsma DA, de Rooij SE. Reasons to engage in and learning experiences from different play strategies in a web-based serious game on delirium for medical students: mixed methods design. JMIR Serious Games 2020 Jul 29;8(3):e18479 [FREE Full text] [CrossRef] [Medline]
    134. Buijs-Spanjers KR, Hegge HH, Jansen CJ, Hoogendoorn E, de Rooij SE. A web-based serious game on delirium as an educational intervention for medical students: randomized controlled trial. JMIR Serious Games 2018 Oct 26;6(4):e17 [FREE Full text] [CrossRef] [Medline]
    135. Bul KC, Kato PM, Van der Oord S, Danckaerts M, Vreeke LJ, Willems A, et al. Behavioral outcome effects of serious gaming as an adjunct to treatment for children with attention-deficit/hyperactivity disorder: a randomized controlled trial. J Med Internet Res 2016 Feb 16;18(2):e26 [FREE Full text] [CrossRef] [Medline]
    136. Calderita LV, Manso LJ, Bustos P, Suárez-Mejías C, Fernández F, Bandera A. THERAPIST: Towards an autonomous socially interactive robot for motor and neurorehabilitation therapies for children. JMIR Rehabil Assist Technol 2014 Oct 07;1(1):e1 [FREE Full text] [CrossRef] [Medline]
    137. Carnicer-Pont D, Loureiro-Varela E, Manresa JM, Martinez M, Avecilla À, Montero-Pons L, et al. The Notijoves Project: Protocol for a randomized controlled trial about new communication technologies and gamification to promote partner notification of sexually transmitted infections among young people. JMIR Res Protoc 2019 May 26;8(6):e12896 [FREE Full text] [CrossRef] [Medline]
    138. Castro-Sánchez E, Sood A, Rawson TM, Firth J, Holmes AH. Forecasting implementation, adoption, and evaluation challenges for an electronic game-based antimicrobial stewardship intervention: co-design workshop with multidisciplinary stakeholders. J Med Internet Res 2019 Jun 04;21(6):e13365 [FREE Full text] [CrossRef] [Medline]
    139. Chang HY, Poh DY, Wong LL, Yap JY, Yap KY. Student preferences on gaming aspects for a serious game in pharmacy practice education: a cross-sectional study. JMIR Med Educ 2015 May 11;1(1):e2 [FREE Full text] [CrossRef] [Medline]
    140. Cheek C, Fleming T, Lucassen MF, Bridgman H, Stasiak K, Shepherd M, et al. Integrating health behavior theory and design elements in serious games. JMIR Ment Health 2015;2(2):e11 [FREE Full text] [CrossRef] [Medline]
    141. Chen J, Ho E, Jiang Y, Whittaker R, Yang T, Bullen C. A mobile social network-based smoking cessation intervention for Chinese male smokers: protocol for a pilot randomized controlled trial. JMIR Res Protoc 2020 Sep 18;9(9):e18071 [FREE Full text] [CrossRef] [Medline]
    142. Chen J, Ho E, Jiang Y, Whittaker R, Yang T, Bullen C. Mobile social network-based smoking cessation intervention for Chinese male smokers: pilot randomized controlled trial. JMIR Mhealth Uhealth 2020 Oct 23;8(10):e17522 [FREE Full text] [CrossRef] [Medline]
    143. Cheng VW, Davenport T, Johnson D, Vella K, Hickie IB. Gamification in apps and technologies for improving mental health and well-being: systematic review. JMIR Ment Health 2019 Jun 26;6(6):e13717 [FREE Full text] [CrossRef] [Medline]
    144. Choi WT, Yu DK, Wong T, Lantta T, Yang M, Välimäki M. Habits and attitudes of video gaming and information technology use in people with schizophrenia: cross-sectional survey. J Med Internet Res 2020 Jul 22;22(7):e14865 [FREE Full text] [CrossRef] [Medline]
    145. Chon SH, Timmermann F, Dratsch T, Schuelper N, Plum P, Berlth F, et al. Serious games in surgical medical education: a virtual emergency department as a tool for teaching clinical reasoning to medical students. JMIR Serious Games 2019 Mar 05;7(1):e13028 [FREE Full text] [CrossRef] [Medline]
    146. Clausen JD, Nahen N, Horstmann H, Lasch F, Krutsch W, Krettek C, et al. Improving maximal strength in the initial postoperative phase after anterior cruciate ligament reconstruction surgery: randomized controlled trial of an app-based serious gaming approach. JMIR Serious Games 2020 Jan 24;8(1):e14282 [FREE Full text] [CrossRef] [Medline]
    147. Constantinescu G, Loewen I, King B, Brodt C, Hodgetts W, Rieger J. Designing a mobile health app for patients with dysphagia following head and neck cancer: a qualitative study. JMIR Rehabil Assist Technol 2017 Mar 24;4(1):e3 [FREE Full text] [CrossRef] [Medline]
    148. Creutzfeldt J, Hedman L, Felländer-Tsai L. Cardiopulmonary resuscitation training by avatars: a qualitative study of medical students' experiences using a multiplayer virtual world. JMIR Serious Games 2016 Dec 16;4(2):e22 [FREE Full text] [CrossRef] [Medline]
    149. Creutzfeldt J, Hedman L, Heinrichs L, Youngblood P, Felländer-Tsai L. Cardiopulmonary resuscitation training in high school using avatars in virtual worlds: an international feasibility study. J Med Internet Res 2013 Jan 14;15(1):e9 [FREE Full text] [CrossRef] [Medline]
    150. Creutzfeldt J, Hedman L, Medin C, Heinrichs WL, Felländer-Tsai L. Exploring virtual worlds for scenario-based repeated team training of cardiopulmonary resuscitation in medical students. J Med Internet Res 2010 Sep 03;12(3):e38 [FREE Full text] [CrossRef] [Medline]
    151. Curtis KE, Lahiri S, Brown KE. Targeting parents for childhood weight management: development of a theory-driven and user-centered healthy eating app. JMIR Mhealth Uhealth 2015 Jun 18;3(2):e69 [FREE Full text] [CrossRef] [Medline]
    152. Dargél AA, Mosconi E, Masson M, Plaze M, Taieb F, Von Platen C, et al. Toi Même, a mobile health platform for measuring bipolar illness activity: protocol for a feasibility study. JMIR Res Protoc 2020 Aug 18;9(8):e18818 [FREE Full text] [CrossRef] [Medline]
    153. Diehl LA, Souza RM, Alves JB, Gordan PA, Esteves RZ, Jorge ML, et al. InsuOnline, a serious game to teach insulin therapy to primary care physicians: design of the game and a randomized controlled trial for educational validation. JMIR Res Protoc 2013 Jan 21;2(1):e5 [FREE Full text] [CrossRef] [Medline]
    154. Diehl LA, Souza RM, Gordan PA, Esteves RZ, Coelho IC. InsuOnline, an electronic game for medical education on insulin therapy: a randomized controlled trial with primary care physicians. J Med Internet Res 2017 Mar 09;19(3):e72 [FREE Full text] [CrossRef] [Medline]
    155. Edwards EA, Caton H, Lumsden J, Rivas C, Steed L, Pirunsarn Y, et al. Creating a theoretically grounded, gamified health app: lessons from developing the cigbreak smoking cessation mobile phone game. JMIR Serious Games 2018 Nov 29;6(4):e10252 [FREE Full text] [CrossRef] [Medline]
    156. Eleftheriou A, Bullock S, Graham CA, Ingham R. Using computer simulations for investigating a sex education intervention: an exploratory study. JMIR Serious Games 2017 May 03;5(2):e9 [FREE Full text] [CrossRef] [Medline]
    157. El-Hilly AA, Iqbal SS, Ahmed M, Sherwani Y, Muntasir M, Siddiqui S, et al. Game on? Smoking cessation through the gamification of mHealth: a longitudinal qualitative study. JMIR Serious Games 2016 Oct 24;4(2):e18 [FREE Full text] [CrossRef] [Medline]
    158. Espinosa-Curiel IE, Pozas-Bogarin EE, Martínez-Miranda J, Pérez-Espinosa H. Relationship between children's enjoyment, user experience satisfaction, and learning in a serious video game for nutrition education: empirical pilot study. JMIR Serious Games 2020 Sep 17;8(3):e21813 [FREE Full text] [CrossRef] [Medline]
    159. Fadda M, Galimberti E, Fiordelli M, Schulz PJ. Evaluation of a mobile phone-based intervention to increase parents' knowledge about the measles-mumps-rubella vaccination and their psychological empowerment: mixed-method approach. JMIR Mhealth Uhealth 2018 Mar 07;6(3):e59 [FREE Full text] [CrossRef] [Medline]
    160. Fijačko N, Gosak L, Cilar L, Novšak A, Creber RM, Skok P, et al. The effects of gamification and oral self-care on oral hygiene in children: systematic search in app stores and evaluation of apps. JMIR Mhealth Uhealth 2020 Jul 08;8(7):e16365 [FREE Full text] [CrossRef] [Medline]
    161. Flogie A, Aberšek B, Aberšek MK, Lanyi CS, Pesek I. Development and evaluation of intelligent serious games for children with learning difficulties: observational study. JMIR Serious Games 2020 Apr 16;8(2):e13190 [FREE Full text] [CrossRef] [Medline]
    162. Floryan M, Chow PI, Schueller SM, Ritterband LM. The model of gamification principles for digital health interventions: evaluation of validity and potential utility. J Med Internet Res 2020 Jun 10;22(6):e16506 [FREE Full text] [CrossRef] [Medline]
    163. Giunti G, Fernández E, Zubiete E, Romero O. Supply and demand in mHealth apps for persons with multiple sclerosis: systematic search in app stores and scoping literature review. JMIR Mhealth Uhealth 2018 May 23;6(5):e10512 [FREE Full text] [CrossRef] [Medline]
    164. Giunti G, Mylonopoulou V, Romero O. More stamina, a gamified mHealth solution for persons with multiple sclerosis: research through design. JMIR Mhealth Uhealth 2018 Mar 02;6(3):e51 [FREE Full text] [CrossRef] [Medline]
    165. Gonze B, Padovani R, Simoes M, Lauria V, Proença N, Sperandio E, et al. Use of a smartphone app to increase physical activity levels in insufficiently active adults: Feasibility Sequential Multiple Assignment Randomized Trial (SMART). JMIR Res Protoc 2020 Oct 23;9(10):e14322 [FREE Full text] [CrossRef] [Medline]
    166. Gorsic M, Clapp JD, Darzi A, Novak D. A brief measure of interpersonal interaction for 2-player serious games: questionnaire validation. JMIR Serious Games 2019 Jul 23;7(3):e12788 [FREE Full text] [CrossRef] [Medline]
    167. Hansen WB, Scheier LM. Specialized smartphone intervention apps: Review of 2014 to 2018 NIH Funded Grants. JMIR Mhealth Uhealth 2019 Jul 29;7(7):e14655 [FREE Full text] [CrossRef] [Medline]
    168. Hendrie GA, James-Martin G, Williams G, Brindal E, Whyte B, Crook A. The Development of VegEze: Smartphone app to increase vegetable consumption in Australian adults. JMIR Form Res 2019 Mar 27;3(1):e10731 [FREE Full text] [CrossRef] [Medline]
    169. Hernández-Reyes A, Cámara-Martos F, Recio G, Molina-Luque R, Romero-Saldaña M, Rojas R. Push notifications from a mobile app to improve the body composition of overweight or obese women: randomized controlled trial. JMIR Mhealth Uhealth 2020 Feb 12;8(2):e13747 [FREE Full text] [CrossRef] [Medline]
    170. Hilliard ME, Hahn A, Ridge AK, Eakin MN, Riekert KA. User preferences and design recommendations for an mHealth app to promote cystic fibrosis self-management. JMIR Mhealth Uhealth 2014 Oct 24;2(4):e44 [FREE Full text] [CrossRef] [Medline]
    171. Hoffmann A, Faust-Christmann CA, Zolynski G, Bleser G. Toward gamified pain management apps: mobile application rating scale-based quality assessment of pain-mentor's first prototype through an expert study. JMIR Form Res 2020 May 26;4(5):e13170 [FREE Full text] [CrossRef] [Medline]
    172. Holzmann SL, Schäfer H, Plecher DA, Stecher L, Klinker G, Groh G, et al. Serious games for nutritional education: online survey on preferences, motives, and behaviors among young adults at university. JMIR Serious Games 2020 Jun 03;8(2):e16216 [FREE Full text] [CrossRef] [Medline]
    173. Hooglugt F, Ludden GD. A mobile app adopting an identity focus to promote physical activity (MoveDaily): iterative design study. JMIR Mhealth Uhealth 2020 Jun 15;8(6):e16720 [FREE Full text] [CrossRef] [Medline]
    174. Horvath KJ, Amico KR, Erickson D, Ecklund AM, Martinka A, DeWitt J, et al. Thrive with me: protocol for a randomized controlled trial to test a peer support intervention to improve antiretroviral therapy adherence among men who have sex with men. JMIR Res Protoc 2018 May 31;7(5):e10182 [FREE Full text] [CrossRef] [Medline]
    175. Hunter JF, Olah MS, Williams AL, Parks AC, Pressman SD. Effect of brief biofeedback via a smartphone app on stress recovery: randomized experimental study. JMIR Serious Games 2019 Nov 26;7(4):e15974 [FREE Full text] [CrossRef] [Medline]
    176. Idriss M, Tannous H, Istrate D, Perrochon A, Salle JY, Ho Ba Tho MC, et al. Rehabilitation-oriented serious game development and evaluation guidelines for musculoskeletal disorders. JMIR Serious Games 2017 Jul 04;5(3):e14 [FREE Full text] [CrossRef] [Medline]
    177. Ingadottir B, Blondal K, Thue D, Zoega S, Thylen I, Jaarsma T. Development, usability, and efficacy of a serious game to help patients learn about pain management after surgery: an evaluation study. JMIR Serious Games 2017 May 10;5(2):e10 [FREE Full text] [CrossRef] [Medline]
    178. Jaunay LB, Zerr P, Peguin L, Renouard L, Ivanoff AS, Picard H, et al. Development and evaluation of a new serious game for continuing medical education of general practitioners (Hygie): double-blinded randomized controlled trial. J Med Internet Res 2019 Nov 20;21(11):e12669 [FREE Full text] [CrossRef] [Medline]
    179. Jones M, Denisova A, Mitchell S, Owen T. Acceptability of a plasticity-focused serious game intervention for posttraumatic stress disorder: user requirements analysis. JMIR Serious Games 2019 Apr 16;7(2):e11909 [FREE Full text] [CrossRef] [Medline]
    180. Boulos MN, Gammon S, Dixon MC, MacRury SM, Fergusson MJ, Rodrigues FM, et al. Digital games for type 1 and type 2 diabetes: underpinning theory with three illustrative examples. JMIR Serious Games 2015 Mar 18;3(1):e3 [FREE Full text] [CrossRef] [Medline]
    181. Kelders SM, Sommers-Spijkerman M, Goldberg J. Investigating the direct impact of a gamified versus nongamified well-being intervention: an exploratory experiment. J Med Internet Res 2018 Jul 26;20(7):e247 [FREE Full text] [CrossRef] [Medline]
    182. Talantikite WK, Renou D, Magdelaine A, Harang W, Zmirou-Navier D, Deguen S. Development of serious games (Equit'Game) to address health and environmental inequalities: protocol for an app-delivered program to perform a territorial diagnosis. JMIR Res Protoc 2020 Jan 07;9(1):e11786 [FREE Full text] [CrossRef] [Medline]
    183. Klincova M, Harazim H, Schwarz D, Kosinova M, Smekalova O, Stourac P. What can be achieved with motivation-based teaching of medical students? A monocentric retrospective audit of retention among highly motivated graduates who underwent the learning-by-doing concept in anesthesiology and intensive care medicine. JMIR Serious Games 2019 Apr 09;7(2):e10155 [FREE Full text] [CrossRef] [Medline]
    184. Ko J, Lee JJ, Jang SW, Yun Y, Kang S, Shin DA, et al. An Epiduroscopy Simulator Based on a Serious Game for Spatial Cognitive Training (EpiduroSIM): User-centered design approach. JMIR Serious Games 2019 Aug 27;7(3):e12678 [FREE Full text] [CrossRef] [Medline]
    185. Kouwenhoven-Pasmooij TA, Robroek SJ, Ling SW, van Rosmalen J, van Rossum EF, Burdorf A, et al. A blended web-based gaming intervention on changes in physical activity for overweight and obese employees: influence and usage in an experimental pilot study. JMIR Serious Games 2017 Apr 03;5(2):e6 [FREE Full text] [CrossRef] [Medline]
    186. Kuipers DA, Terlouw G, Wartena BO, van 't Veer JT, Prins JT, Pierie JP. The role of transfer in designing games and simulations for health: systematic review. JMIR Serious Games 2017 Nov 24;5(4):e23 [FREE Full text] [CrossRef] [Medline]
    187. Lawitschka A, Buehrer S, Bauer D, Peters K, Silbernagl M, Zubarovskaya N, et al. A web-based mobile app (INTERACCT App) for adolescents undergoing cancer and hematopoietic stem cell transplantation aftercare to improve the quality of medical information for clinicians: observational study. JMIR Mhealth Uhealth 2020 Jun 30;8(6):e18781 [FREE Full text] [CrossRef] [Medline]
    188. Lázaro E, Amayra I, López-Paz JF, Martínez O, Pérez Alvarez M, Berrocoso S, et al. Using a virtual serious game (Deusto-e-motion1.0) to assess the theory of mind in primary school children: observational descriptive study. JMIR Serious Games 2020 Apr 02;8(2):e12971 [FREE Full text] [CrossRef] [Medline]
    189. Lee L, Chao Y, Huang C, Fang J, Wang S, Chuang C, et al. Cognitive style and mobile e-learning in emergent otorhinolaryngology-head and neck surgery disorders for millennial undergraduate medical students: randomized controlled trial. J Med Internet Res 2018 Feb 13;20(2):e56 [FREE Full text] [CrossRef] [Medline]
    190. LeGrand S, Knudtson K, Benkeser D, Muessig K, Mcgee A, Sullivan PS, et al. Testing the efficacy of a social networking gamification app to improve pre-exposure prophylaxis adherence (p3: prepared, protected, empowered): protocol for a randomized controlled trial. JMIR Res Protoc 2018 Dec 18;7(12):e10448 [FREE Full text] [CrossRef] [Medline]
    191. LeGrand S, Muessig KE, McNulty T, Soni K, Knudtson K, Lemann A, et al. Epic Allies: Development of a gaming app to improve antiretroviral therapy adherence among young hiv-positive men who have sex with men. JMIR Serious Games 2016 May 13;4(1):e6 [FREE Full text] [CrossRef] [Medline]
    192. Lin Y, Tudor-Sfetea C, Siddiqui S, Sherwani Y, Ahmed M, Eisingerich AB. Effective behavioral changes through a digital mhealth app: exploring the impact of hedonic well-being, psychological empowerment and inspiration. JMIR Mhealth Uhealth 2018 Jun 15;6(6):e10024 [FREE Full text] [CrossRef] [Medline]
    193. Lindqvist AK, Rutberg S. One step forward: development of a program promoting active school transportation. JMIR Res Protoc 2018 May 08;7(5):e123 [FREE Full text] [CrossRef] [Medline]
    194. Lucassen M, Samra R, Iacovides I, Fleming T, Shepherd M, Stasiak K, et al. How LGBT+ young people use the internet in relation to their mental health and envisage the use of e-therapy: exploratory study. JMIR Serious Games 2018 Dec 21;6(4):e11249 [FREE Full text] [CrossRef] [Medline]
    195. Lukhele BW, Musumari P, El-Saaidi C, Techasrivichien T, Suguimoto SP, Kihara MO, et al. Efficacy of mobile serious games in increasing hiv risk perception in swaziland: a randomized control trial (SGprev Trial) research protocol. JMIR Res Protoc 2016 Nov 22;5(4):e224 [FREE Full text] [CrossRef] [Medline]
    196. Lumsden J, Skinner A, Coyle D, Lawrence N, Munafo M. Attrition from web-based cognitive testing: a repeated measures comparison of gamification techniques. J Med Internet Res 2017 Nov 22;19(11):e395 [FREE Full text] [CrossRef] [Medline]
    197. Mairs RA, Bekker MJ, Patolo T, Hopkins SA, Cowley-Malcolm ET, Perese LM, et al. Gamifying parenting education using an app developed for pacific and other New Zealand families (Play Kindly): qualitative study. JMIR Serious Games 2020 Jun 10;8(2):e15647 [FREE Full text] [CrossRef] [Medline]
    198. Manning V, Piercy H, Garfield JB, Lubman DI. Personalized approach bias modification smartphone app ("SWIPE") to reduce alcohol use among people drinking at hazardous or harmful levels: protocol for an open-label feasibility study. JMIR Res Protoc 2020 Aug 14;9(8):e21278 [FREE Full text] [CrossRef] [Medline]
    199. Marin-Gomez F, Garcia-Moreno R, Mayos-Fernandez A, Flores-Mateo G, Granado-Font E, Barrera Uriarte M, et al. Exploring efficacy of a serious game (Tobbstop) for smoking cessation during pregnancy: randomized controlled trial. JMIR Serious Games 2019 Mar 27;7(1):e12835 [FREE Full text] [CrossRef] [Medline]
    200. Mejia CM, Acland D, Buzdugan R, Grimball R, Natoli L, McGrath MR, et al. An intervention using gamification to increase human immunodeficiency virus and sexually transmitted infection screening among young men who have sex with men in california: rationale and design of stick to it. JMIR Res Protoc 2017 Jul 17;6(7):e140 [FREE Full text] [CrossRef] [Medline]
    201. Mubin O, Alnajjar F, Jishtu N, Alsinglawi B, Al Mahmud A. Exoskeletons with virtual reality, augmented reality, and gamification for stroke patients' rehabilitation: systematic review. JMIR Rehabil Assist Technol 2019 Sep 08;6(2):e12010 [FREE Full text] [CrossRef] [Medline]
    202. Nicolaidou I, Antoniades A, Constantinou R, Marangos C, Kyriacou E, Bamidis P, et al. A virtual emergency telemedicine serious game in medical training: a quantitative, professional feedback-informed evaluation study. J Med Internet Res 2015 Jun 17;17(6):e150 [FREE Full text] [CrossRef] [Medline]
    203. Notebaert L, Grafton B, Clarke PJ, Rudaizky D, Chen NT, MacLeod C. Emotion-in-motion, a novel approach for the modification of attentional bias: an experimental proof-of-concept study. JMIR Serious Games 2018 Nov 28;6(4):e10993 [FREE Full text] [CrossRef] [Medline]
    204. Nurmi J, Knittle K, Ginchev T, Khattak F, Helf C, Zwickl P, et al. Engaging users in the behavior change process with digitalized motivational interviewing and gamification: development and feasibility testing of the precious app. JMIR Mhealth Uhealth 2020 Jan 30;8(1):e12884 [FREE Full text] [CrossRef] [Medline]
    205. Oakley-Girvan I, Lavista JM, Miller Y, Davis S, Acle C, Hancock J, et al. Evaluation of a Mobile Device Survey System for Behavioral Risk Factors (SHAPE): App development and usability study. JMIR Form Res 2019 Jan 11;3(1):e10246 [FREE Full text] [CrossRef] [Medline]
    206. Oliveri S, Mainetti R, Gorini A, Cutica I, Candiani G, Borghese NA, et al. Serious games for improving genetic literacy and genetic risk awareness in the general public: protocol for a randomized controlled trial. JMIR Res Protoc 2018 Dec 18;7(12):e189 [FREE Full text] [CrossRef] [Medline]
    207. Patchen L, Ellis L, Ma TX, Ott C, Chang KH, Araya B, et al. Engaging african American youth in the development of a serious mobile game for sexual health education: mixed methods study. JMIR Serious Games 2020 Jan 31;8(1):e16254 [FREE Full text] [CrossRef] [Medline]
    208. Payne HE, Moxley VB, MacDonald E. Health behavior theory in physical activity game apps: a content analysis. JMIR Serious Games 2015 Jul 13;3(2):e4 [FREE Full text] [CrossRef] [Medline]
    209. Perry Y, Werner-Seidler A, Calear A, Mackinnon A, King C, Scott J, et al. Preventing depression in final year secondary students: school-based randomized controlled trial. J Med Internet Res 2017 Nov 02;19(11):e369 [FREE Full text] [CrossRef] [Medline]
    210. Phungoen P, Promto S, Chanthawatthanarak S, Maneepong S, Apiratwarakul K, Kotruchin P, et al. Precourse preparation using a serious smartphone game on advanced life support knowledge and skills: randomized controlled trial. J Med Internet Res 2020 Mar 09;22(3):e16987 [FREE Full text] [CrossRef] [Medline]
    211. Rasche P, Schlomann A, Mertens A. Who is still playing Pokémon Go? A web-based survey. JMIR Serious Games 2017 Apr 05;5(2):e7 [FREE Full text] [CrossRef] [Medline]
    212. Rivera J, McPherson AC, Hamilton J, Birken C, Coons M, Peters M, et al. User-centered design of a mobile app for weight and health management in adolescents with complex health needs: qualitative study. JMIR Form Res 2018 Apr 04;2(1):e7 [FREE Full text] [CrossRef] [Medline]
    213. Sabben G, Akelo V, Mudhune V, Ondeng'e K, Ndivo R, Stephenson R, et al. A smartphone game to prevent HIV among young Africans: protocol for a randomized pilot study of a mobile intervention. JMIR Res Protoc 2019 Mar 27;8(3):e11209 [FREE Full text] [CrossRef] [Medline]
    214. Sabben G, Mudhune V, Ondeng'e K, Odero I, Ndivo R, Akelo V, et al. A smartphone game to prevent HIV among young Africans (Tumaini): assessing intervention and study acceptability among adolescents and their parents in a randomized controlled trial. JMIR Mhealth Uhealth 2019 May 21;7(5):e13049 [FREE Full text] [CrossRef] [Medline]
    215. Sanders I, Short CE, Bogomolova S, Stanford T, Plotnikoff R, Vandelanotte C, et al. Characteristics of adopters of an online social networking physical activity mobile phone app: cluster analysis. JMIR Mhealth Uhealth 2019 Jun 03;7(6):e12484 [FREE Full text] [CrossRef] [Medline]
    216. Santana C, Freitas A, Barreto G, De Avelar I, Mazaro-Costa R, Bueno G, et al. Serious game on a smartphone for adolescents undergoing hemodialysis: development and evaluation. JMIR Serious Games 2020 Sep 14;8(3):e17979 [FREE Full text] [CrossRef] [Medline]
    217. Santos J, Vairinhos M, Jesus LM. Treating children with speech sound disorders: development of a tangible artefact prototype. JMIR Serious Games 2019 Dec 05;7(4):e13861 [FREE Full text] [CrossRef] [Medline]
    218. Schakel L, Veldhuijzen DS, van Middendorp H, Prins C, Drittij AM, Vrieling F, et al. An internet-based psychological intervention with a serious game to improve vitality, psychological and physical condition, and immune function in healthy male adults: randomized controlled trial. J Med Internet Res 2020 Jul 24;22(7):e14861 [FREE Full text] [CrossRef] [Medline]
    219. Sezgin E, Lin S. Technology-based interventions, assessments, and solutions for safe driving training for adolescents: rapid review. JMIR Mhealth Uhealth 2019 Jan 24;7(1):e11942 [FREE Full text] [CrossRef] [Medline]
    220. Sharifzadeh N, Kharrazi H, Nazari E, Tabesh H, Khodabandeh M, Heidari S, et al. Health education serious games targeting health care providers, patients, and public health users: scoping review. JMIR Serious Games 2020 Mar 05;8(1):e13459 [FREE Full text] [CrossRef] [Medline]
    221. Simões M, Bernardes M, Barros F, Castelo-Branco M. Virtual travel training for autism spectrum disorder: proof-of-concept interventional study. JMIR Serious Games 2018 Mar 20;6(1):e5 [FREE Full text] [CrossRef] [Medline]
    222. Spook J, Paulussen T, Kok G, van Empelen P. Evaluation of a serious self-regulation game intervention for overweight-related behaviors ("Balance It"): a pilot study. J Med Internet Res 2016 Sep 26;18(9):e225 [FREE Full text] [CrossRef] [Medline]
    223. Steiner B, Elgert L, Saalfeld B, Wolf K. Gamification in rehabilitation of patients with musculoskeletal diseases of the shoulder: scoping review. JMIR Serious Games 2020 Aug 25;8(3):e19914 [FREE Full text] [CrossRef] [Medline]
    224. Stragier J, Vandewiele G, Coppens P, Ongenae F, Van den Broeck W, De Turck F, et al. Data mining in the development of mobile health apps: assessing in-app navigation through markov chain analysis. J Med Internet Res 2019 Jun 07;21(6):e11934 [FREE Full text] [CrossRef] [Medline]
    225. Suppan L, Abbas M, Stuby L, Cottet P, Larribau R, Golay E, et al. Effect of an e-learning module on personal protective equipment proficiency among prehospital personnel: web-based randomized controlled trial. J Med Internet Res 2020 Aug 21;22(8):e21265 [FREE Full text] [CrossRef] [Medline]
    226. Suppan M, Gartner B, Golay E, Stuby L, White M, Cottet P, et al. Teaching adequate prehospital use of personal protective equipment during the COVID-19 pandemic: development of a gamified e-learning module. JMIR Serious Games 2020 Jun 12;8(2):e20173 [FREE Full text] [CrossRef] [Medline]
    227. Tadas S, Coyle D. Barriers to and facilitators of technology in cardiac rehabilitation and self-management: systematic qualitative grounded theory review. J Med Internet Res 2020 Nov 11;22(11):e18025 [FREE Full text] [CrossRef] [Medline]
    228. Tark R, Metelitsa M, Akkermann K, Saks K, Mikkel S, Haljas K. Usability, acceptability, feasibility, and effectiveness of a gamified mobile health intervention (Triumf) for pediatric patients: qualitative study. JMIR Serious Games 2019 Sep 30;7(3):e13776 [FREE Full text] [CrossRef] [Medline]
    229. Thirkettle M, Lewis J, Langdridge D, Pike G. A mobile app delivering a gamified battery of cognitive tests designed for repeated play (OU brainwave): app design and cohort study. JMIR Serious Games 2018 Oct 30;6(4):e10519 [FREE Full text] [CrossRef] [Medline]
    230. Thomas TH, Sivakumar V, Babichenko D, Grieve VL, Klem ML. Mapping behavioral health serious game interventions for adults with chronic illness: scoping review. JMIR Serious Games 2020 Jul 30;8(3):e18687 [FREE Full text] [CrossRef] [Medline]
    231. Tong T, Chignell M, Tierney MC, Lee J. A serious game for clinical assessment of cognitive status: validation study. JMIR Serious Games 2016 May 27;4(1):e7 [FREE Full text] [CrossRef] [Medline]
    232. van de Weijer SC, Kuijf ML, de Vries NM, Bloem BR, Duits AA. Do-It-Yourself gamified cognitive training: viewpoint. JMIR Serious Games 2019 May 07;7(2):e12130 [FREE Full text] [CrossRef] [Medline]
    233. van Mierlo T, Hyatt D, Ching AT, Fournier R, Dembo RS. Behavioral economics, wearable devices, and cooperative games: results from a population-based intervention to increase physical activity. JMIR Serious Games 2016 Jan 28;4(1):e1 [FREE Full text] [CrossRef] [Medline]
    234. Verschueren S, Buffel C, Stichele G. Developing theory-driven, evidence-based serious games for health: framework based on research community insights. JMIR Serious Games 2019 May 02;7(2):e11565 [FREE Full text] [CrossRef] [Medline]
    235. Verschueren S, van Aalst J, Bangels A, Toelen J, Allegaert K, Buffel C, et al. Development of CliniPup, a serious game aimed at reducing perioperative anxiety and pain in children: mixed methods study. JMIR Serious Games 2019 Jun 01;7(2):e12429 [FREE Full text] [CrossRef] [Medline]
    236. Vugts MA, Joosen MC, Mert A, Zedlitz AM, Vrijhoef HJ. Effectiveness of serious gaming during the multidisciplinary rehabilitation of patients with complex chronic pain or fatigue: natural quasi-experiment. J Med Internet Res 2018 Aug 15;20(8):e250 [FREE Full text] [CrossRef] [Medline]
    237. White B, Giglia RC, White JA, Dhaliwal S, Burns SK, Scott JA. Gamifying breastfeeding for fathers: process evaluation of the milk man mobile app. JMIR Pediatr Parent 2019 Jun 20;2(1):e12157 [FREE Full text] [CrossRef] [Medline]
    238. Wiecek E, Torres-Robles A, Cutler RL, Benrimoj SI, Garcia-Cardenas V. Impact of a multicomponent digital therapeutic mobile app on medication adherence in patients with chronic conditions: retrospective analysis. J Med Internet Res 2020 Aug 12;22(8):e17834 [FREE Full text] [CrossRef] [Medline]
    239. Wilson H, Stoyanov SR, Gandabhai S, Baldwin A. The quality and accuracy of mobile apps to prevent driving after drinking alcohol. JMIR Mhealth Uhealth 2016 Aug 08;4(3):e98 [FREE Full text] [CrossRef] [Medline]
    240. Wunsch K, Eckert T, Fiedler J, Cleven L, Niermann C, Reiterer H, et al. Effects of a collective family-based mobile health intervention called "Smartfamily" on promoting physical activity and healthy eating: protocol for a randomized controlled trial. JMIR Res Protoc 2020 Nov 11;9(11):e20534 [FREE Full text] [CrossRef] [Medline]
    241. Zhang M, Heng S, Song G, Fung DS, Smith HE. Co-designing a mobile gamified attention bias modification intervention for substance use disorders: participatory research study. JMIR Mhealth Uhealth 2019 Oct 03;7(10):e15871 [FREE Full text] [CrossRef] [Medline]
    242. Zhang M, Ying J, Ho RC. Gamified cognitive bias interventions for psychiatric disorders: protocol of a systematic review. JMIR Res Protoc 2018 Oct 16;7(10):e10154 [FREE Full text] [CrossRef] [Medline]
    243. Zhang M, Ying J, Song G, Fung D, Smith H. Attention and cognitive bias modification apps: review of the literature and of commercially available apps. JMIR Mhealth Uhealth 2018 May 24;6(5):e10034 [FREE Full text] [CrossRef] [Medline]
    244. Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. PLoS Med 2010 Feb;7(2):e1000217 [FREE Full text] [CrossRef] [Medline]
    245. Deterding S, Dixon D, Khaled R, Nacke L. From game design elements to gamefulness: defining "gamification". In: Proceedings of the 15th International Academic MindTrek Conference. 2011 Presented at: 15th International Academic MindTrek Conference; September 28 - 30, 2011; Tampere Finland p. 9-15. [CrossRef]
    246. Deterding S, Sicart M, Nacke L, O'Hara K, Dixon D. Gamification. using game-design elements in non-gaming contexts. In: Proceedings of the CHI Conference on Human Factors in Computing Systems. 2011 Presented at: CHI '11: CHI Conference on Human Factors in Computing Systems; May 7-12, 2011; Vancouver BC Canada p. 2425-2428. [CrossRef]
    247. Huotari K, Hamari J. Defining gamification: a service marketing perspective. In: Proceedings of the 16th International Academic MindTrek Conference. 2012 Presented at: 16th International Academic MindTrek Conference; October 3 - 5, 2012; Tampere Finland p. 17-22. [CrossRef]
    248. King D, Greaves F, Exeter C, Darzi A. 'Gamification': influencing health behaviours with games. J R Soc Med 2013 Mar;106(3):76-78. [CrossRef] [Medline]
    249. Deterding S, Khaled R, Nacke L, Dixon D. Gamification: Toward a definition. CHI 2011 Gamification Workshop Proceedings. 2011.   URL: https://www.researchgate.net/publication/273947177_Gamification_Toward_a_definition [accessed 2021-07-29]
    250. Zichermann G, Cunningham C. Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps. Sebastopol, California, United States: O′Reilly Media, Inc; 2011:1-208.
    251. Miller AS, Cafazzo JA, Seto E. A game plan: Gamification design principles in mHealth applications for chronic disease management. Health Informatics J 2014 Jul 1;22(2):184-193. [CrossRef] [Medline]
    252. Stieglitz S, Lattemann C, Robra-Bissantz S, Zarnekow R, Brockmann T. Gamification. Cham, Switzerland: Springer; 2017:1-164.
    253. Abt C. Serious Games. Lanham, Maryland, United States: University Press of America; 1987.
    254. Zyda M. From visual simulation to virtual reality to games. Computer 2005 Sep;38(9):25-32. [CrossRef]
    255. Alvarez J, Djaouti D. An introduction to serious game definitions and concepts. Serious Games Simul Risks Manage 2011;11(1):11-15 [FREE Full text]
    256. Bergeron B. Developing Serious Games (Game Development Series). Massachusetts, United States: Charles River Media, Inc; 2006:1-480.
    257. Marsh T. Serious games continuum: Between games for purpose and experiential environments for purpose. Entertain Comput 2011 Jan;2(2):61-68. [CrossRef]
    258. Hunicke R, LeBlanc M, Zubek R. MDA: A formal approach to game design and game research. In: Proceedings of the Game Design and Tuning Workshop at the Game Developers Conference. 2004 Presented at: Game Design and Tuning Workshop at the Game Developers Conference; 2004; San Jose, CA p. 1-5   URL: https://aaai.org/Papers/Workshops/2004/WS-04-04/WS04-04-001.pdf
    259. Marczweski A. What’s the difference between Gamification and Serious Games? InformaTech. 2013.   URL: https:/​/www.​gamasutra.com/​blogs/​AndrzejMarczewski/​20130311/​188218/​Whats_the_difference_between_Gamification_and_Serious_Games.​php [accessed 2021-04-20]
    260. McCallum S. Gamification and serious games for personalized health. Stud Health Technol Inform 2012;177:85-96. [Medline]
    261. Santhanam R, Liu D, Shen WM. Research Note—Gamification of Technology-Mediated Training: Not all competitions are the same. Info Syst Res 2016 Jun;27(2):453-465. [CrossRef]
    262. Schmidt-Kraepelin M, Thiebes S, Stepanovic S, Mettler T, Sunyaev A. Gamification in health behavior change support systems - a synthesis of unintended side effects. In: Proceedings of the 14th International Conference on Wirtschaftsinformatik. 2019 Presented at: 14th International Conference on Wirtschaftsinformatik; February 24-27, 2019; Siegen, Germany p. 1032-1046   URL: https://serval.unil.ch/resource/serval:BIB_4B8751E9C432.P001/REF
    263. Hibberd F. What is scientific definition? J Mind Behav 2019;40(1):29-52 [FREE Full text]
    264. Hartmann NB, Hüffer T, Thompson RC, Hassellöv M, Verschoor A, Daugaard AE, et al. Are we speaking the same language? Recommendations for a definition and categorization framework for plastic debris. Environ Sci Technol 2019 Feb 05;53(3):1039-1047. [CrossRef] [Medline]
    265. Kari T, Piippo J, Frank L, Makkonen M, Moilanen P. To gamify or not to gamify? Gamification in exercise applications and its role in impacting exercise motivation. In: Proceedings of the 29th Bled eConference - Digital Economy. 2016 Presented at: 29th Bled eConference - Digital Economy; June 19-22, 2016; Bled, Slovenia   URL: https:/​/www.​researchgate.net/​publication/​304899543_To_Gamify_or_Not_to_Gamify_Gamification_in_Exercise_Applications_and_Its_Role_in_Impacting_Exercise_Motivation
    266. Nacke LE, Deterding S. The maturing of gamification research. Comput Hum Behav 2017 Jun;71:450-454. [CrossRef]
    267. Harter JK, Schmidt FL. Conceptual versus empirical distinctions among constructs: implications for discriminant validity. Ind Organ Psychol 2015 Jan 07;1(1):36-39. [CrossRef]
    268. Koivisto J, Hamari J. Demographic differences in perceived benefits from gamification. Comput Hum Behav 2014 Jun;35:179-188. [CrossRef]
    269. Schmidt-Kraepelin M, Thiebes S, Baumsteiger D, Sunyaev A. State of play: A citation network analysis of healthcare gamification studies. In: Proceedings of the 26th European Conference on Information Systems. 2018 Presented at: 26th European Conference on Information Systems; June 23-28, 2018; Portsmouth, UK. [CrossRef]

    ‎
    GAMING: Game-Based Intervention Reporting Guidelines
    RQ: research question

    Edited by G Eysenbach; submitted 12.05.21; peer-reviewed by S Goria, R Nuijten; comments to author 27.05.21; revised version received 11.06.21; accepted 17.06.21; published 10.09.21

    Copyright

    ©Simon Warsinsky, Manuel Schmidt-Kraepelin, Sascha Rank, Scott Thiebes, Ali Sunyaev. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 10.09.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.