This paper is in the following e-collection/theme issue:

Participatory Medicine & E-Patients (758)

Published on in Vol 15, No 9 (2013): September

Social and Self-Reflective Use of a Web-Based Personally Controlled Health Management System

Social and Self-Reflective Use of a Web-Based Personally Controlled Health Management System

Social and Self-Reflective Use of a Web-Based Personally Controlled Health Management System

Authors of this article:

Annie YS Lau1 ;   Adam G Dunn1 ;   Nathan Mortimer2 ;   Aideen Gallagher2 ;   Judith Proudfoot3 ;   Annie Andrews4 ;   Siaw-Teng Liaw5 ;   Jacinta Crimmins6 ;   Amaël Arguel1 ;   Enrico Coiera1
Article Authors Cited by (13) Tweetations (16) Metrics

    Original Paper

    1Centre for Health Informatics, Australian Institute of Health Innovation, University of New South Wales, Sydney, Australia

    2UNSW Medicine, University of New South Wales, Sydney, Australia

    3Black Dog Institute and School of Psychiatry, University of New South Wales, Sydney, Australia

    4UNSW Counselling and Psychological Services, University of New South Wales, Sydney, Australia

    5Centre for Primary Health Care and Equity, School of Public Health and Community Medicine, University of New South Wales, Sydney, Australia

    6University Health Service, University of New South Wales, Sydney, Australia

    Corresponding Author:

    Annie YS Lau, PhD

    Centre for Health Informatics

    Australian Institute of Health Innovation

    University of New South Wales

    Centre for Health Informatics, Australian Institute of Health Innovation, University of New South Wales

    Sydney, 2052

    Australia

    Phone: 61 431599890

    Fax:61 293858692

    Email: a.lau@unsw.edu.au


    Background: Personally controlled health management systems (PCHMSs) contain a bundle of features to help patients and consumers manage their health. However, it is unclear how consumers actually use a PCHMS in their everyday settings.

    Objective: To conduct an empirical analysis of how consumers used the social (forum and poll) and self-reflective (diary and personal health record [PHR]) features of a Web-based PCHMS designed to support their physical and emotional well-being.

    Methods: A single-group pre/post-test online prospective study was conducted to measure use of a Web-based PCHMS for physical and emotional well-being needs during a university academic semester. The PCHMS integrated an untethered PHR with social forums, polls, a diary, and online messaging links with a health service provider. Well-being journeys additionally provided information to encourage engagement with clinicians and health services. A total of 1985 students and staff aged 18 and above with access to the Internet were recruited online, of which 709 were eligible for analysis. Participants’ self-reported well-being, health status, health service utilization, and help-seeking behaviors were compared using chi-square, McNemar’s test, and Student’s t test. Social networks were constructed to examine the online forum communication patterns among consumers and clinicians.

    Results: The two PCHMS features that were used most frequently and considered most useful and engaging were the social features (ie, the poll and forum). More than 30% (213/709) of participants who sought well-being assistance during the study indicated that other people had influenced their decision to seek help (54.4%, 386/709 sought assistance for physical well-being; 31.7%, 225/709 for emotional well-being). Although the prevalence of using a self-reflective feature (diary or PHR) was not as high (diary: 8.6%, 61/709; PHR: 15.0%, 106/709), the proportion of participants who visited a health care professional during the study was more than 20% greater in the group that did use a self-reflective feature (diary: P=.03; PHR: P<.001).

    Conclusions: There was variation in the degree to which consumers used social and self-reflective PCHMS features but both were significantly associated with increased help-seeking behaviors and health service utilization. A PCHMS should combine both self-reflective as well as socially driven components to most effectively influence consumers’ help-seeking behaviors.

    J Med Internet Res 2013;15(9):e211

    doi:10.2196/jmir.2682

    Keywords

    personal health record; social networks; Internet intervention; health service; help-seeking; emotional well-being; physical well-being; preventative health; eHealth; consumer; university 


    Personal health records (PHRs), tools that allow consumers to control and maintain their own health data and information, have been advocated as a next-generation technology that can significantly improve health behaviors and outcomes [1]. Well-designed PHRs can facilitate consumers’ self-reflection of their health by personalizing evidence-based guidelines, and providing judicious prompts, decision aids and tools to assist in maintaining their own health data and associated information. They currently form a crucial component in many large-scale national eHealth reform strategies worldwide.

    Since the definitions of PHRs were clarified in 2006 [2], there has been a vast amount of survey, observational, cohort/panel, and anecdotal evidence regarding the benefits and satisfaction that PHRs provide for patients and consumers [3-11]. However, a recent scoping review on PHRs concluded that more research is still needed in order to evaluate the effectiveness of PHR implementations [12]. Specifically, there is currently a lack of understanding regarding (1) the uptake and sustainability of PHRs (eg, what motivates patients’ adoption and long-term use of a PHR), (2) how we can optimize the functionality and usability of these systems, and (3) whether PHRs play a beneficial role in supporting self-managed health care (ie, more quality evidence in the form of randomized controlled trials is needed) [12].

    In parallel, the emergence of online social media means that the Internet is no longer being used only to search for information about diseases or treatments, but it is also being used to connect individuals previously unknown to each other (via asynchronous forums like PatientsLikeMe), and assist people to engage and keep in contact with their existing social networks (such as via Facebook). Social networks have been demonstrated to significantly inform our choices and affect our decisions in relation to health (eg, choice of hospital [13] and physical activity [14]), and social media interventions are now being developed (eg, via Facebook [15]), with preliminary findings on their feasibility and efficacy emerging in areas such as sexual health [16] and physical activity [17].

    Considering these two major trends in consumer eHealth research (PHRs and online social networks), personally controlled health management systems (PCHMSs), which include a PHR, social networking features, self-management tools, and consumer resources, are rapidly being developed and deployed worldwide. While trials of PCHMSs are emerging in various health settings such as in vitro fertilization [18], hypertension [19], diabetes [20,21], influenza vaccination [22-24], medication accuracy [25], breast cancer management [26], physical and emotional well-being[27], and asthma [28], with some demonstrating acceptance and/or significant benefits among patients and consumers [18,20,21,23,26,27], there remains a lack of literature on how patients and consumers actually use these systems in their everyday settings and how the use of the PCHMS might affect their health behaviors and decisions.

    Additionally, few studies have examined ways to incorporate social features in a PCHMS for the purpose of improving health behavior outcomes—where the social network is the treatment [29]. Earlier studies on systems such as PatientsLikeMe examined how patients in similar situations accessed each other’s personal health information [30], and how having access to others’ health outcomes and treatment decisions may have impacted their decisions in medication use and choice of doctors [31]. Our recent studies identified bundles of PCHMS features that were associated with increased help-seeking behaviors [27], and how consumers interacted with each other and health care professionals in a PCHMS [32]. To our knowledge, that was the only study identifying bundles of features in a PCHMS that were significantly associated with consumers’ help-seeking behaviors [27].

    To date, it remains unclear how we can best integrate online social networking features and self-reflective tools (such as PHRs) into the design of PCHMSs in order to maximize consumers’ uptake, improve their health behaviors and outcomes, and facilitate their long-term use. In particular, few studies have examined the mutual relationship between self and the crowd in influencing one’s health behaviors. Utilizing a multimethod approach (statistical, content analysis, and social network analysis), the aims of this paper were as follows: (1) to measure how consumers used the most common self-reflective features in a PCHMS, (2) to measure how consumers interacted within the community created by the social features of the PCHMS, and (3) to provide recommendations on ways to engineer a socially driven and self-reflective PCHMS that would improve individual health behaviors.


    Study Data

    This paper utilized the data gathered during our 2011 study [27]. Previous analyses of this study have been conducted, which identified bundles of PCHMS features that were associated with increased help-seeking behaviors [27] and consumers’ patterns of usage for the social features of the PCHMS [32]. A full description of our study design is included in Multimedia Appendix 1.

    Trial Design and Participants

    A single-group pre/post-test online prospective study was conducted over a university academic semester (July to November 2011) to examine how participants used a PCHMS to manage their physical and emotional well-being. Participants were included if they were aged 18 or over and had at least monthly access to the Internet and email. Full details of the study protocol and the instruments used to measure participants’ well-being and help-seeking behaviors (ie, COOP/WONCA charts [33], well-being self-ratings and lifestyle intention, health advice-seeking and health advice-providing networks, and help-seeking behaviors and health service utilization) are described in Multimedia Appendix 1.

    Healthy.me

    The PCHMS (called Healthy.me) was iteratively developed between 2009 and 2013 at the University of New South Wales and was tested in settings such as in vitro fertilization, influenza vaccination, and breast cancer management [18,23,26]. The first version contained features such as journeys (which provide users with evidence-based, health-related information to promote engagement with clinicians and health services in an actionable way), a PHR, and online appointment booking with the university primary care service.

    The version of Healthy.me (version 2.0) that was used in this study added online appointment booking with the university counseling services, a diary (private access by default but participants could set it to public for other PCHMS users to view), forums (moderated by a general practitioner [GP] and counselor), and polls. Full details of each PCHMS feature are described in Multimedia Appendix 1.

    Data Analysis

    Analysis Methods

    We utilized multiple methods (statistical, content analysis, and social network analysis) to quantify how participants used each of these social (forum, poll) and self-reflective (diary, personal health record) features in support of their physical and emotional well-being. Polls are considered social features of the PCHMS because they reveal behavioral norms within the group and they offer participants a quick and anonymous way to evaluate their behavior against the “norms” of the group. These features were selected for further analysis because they were found to be significantly associated with consumers’ help-seeking behaviors [27] or because consumers used them frequently and found them the most engaging [32].

    Statistical analyses were used to provide a comparison of participants’ self-reported well-being, health status, health service utilization, and help-seeking behaviors based on their usage patterns of each PCHMS feature. Content analysis was employed to provide an overview of the topics and issues contributed/discussed by participants in online forums and diaries. Social network diagrams were constructed to examine the online forum communication patterns between consumers and clinicians. Social network analysis and visualization provide the tools to delve deeper into the social network, identifying the most active members of the community (via network centrality) and exploring the intergroup relationships that exist between consumers and clinicians (via reciprocity).

    Statistical Data Analysis

    For each social and self-reflective PCHMS feature, help-seeking behaviors and health service utilization during the study were compared using chi-square analysis between users and nonusers. Self-reported well-being and health status were compared pre- and post-study using the McNemar’s test and Student’s t test for paired samples. Usage of each PCHMS feature was summarized using descriptive statistics. Statistical analysis was performed using IBM SPSS Statistics 20. Tests performed were two-tailed and assumed a cut-off of P<.05 for statistical significance.

    Diary Entry Coding

    Diary entries were coded to analyze for participants’ topics of reflection, issues of concerns, and their past/present/future intended actions, where each entry could be coded multiple times within each code category. The coding process was informed by literature on young adults’ physical and emotional well-being concerns [34,35] and how people used blogging or online systems for health and self-reflection [35].

    Pre-codes were created by consensus prior to data coding based on topics, issues, and actions derived from a random selection of 20% of diary entries. While reviewing each diary entry, open codes were created to record topics, issues, and actions that were not anticipated in the pre-coding scheme. The coding process was conducted by one author (AG) and another author (AL) independently coded 10% of diary entries. Interrater reliability on entries coded by both authors was considered good according to Cohen’s kappa statistic (κ=0.71).

    Code categories for topics discussed include (1) physical only (eg, stomach pain, muscle cramp), (2) emotional only (eg, stress), (3) physical and emotional (eg, food, exercise, sleep), or (4) nonhealth (eg, finance, work/study, social, relationship). For participants’ use of the diary, code categories include (1) activity recording (eg, what they did on the day), (2) self-reflection (eg, reflecting on concerns, observations and actions), (3) goal setting (eg, recording plans and/or intentions to act), and (4) progress recording (eg, food diary, exercise diary). Participants’ actions recorded in the diary are coded according to (1) past action, (2) present action, and their (3) future intended action.

    Forum Entry Coding

    Three forums were available to participants: two were dedicated to men’s and women’s health issues, and the third forum was for discussion of general health issues related to lifestyle (Stay Healthy). Participants could seek answers from fellow participants, the GP, or the counselor on all three forums.

    Posts on the forums were coded to analyze for topic of discussion and participants’ response type, informed by literature on interaction patterns found in online social network and question-and-answering websites [36,37]. The coding scheme was pre-determined, where a random selection of 20% of forum posts were used to develop the coding scheme iteratively until consensus was reached on coding rules and the definition of each category before coding commenced. The coding process was conducted by one author (NM) and another author (AL) independently coded 10% of forum posts. Interrater reliability on entries coded by both authors was considered good according to Cohen’s kappa statistic (κ=0.75).

    Each forum post could be coded with more than one topic and participants’ response type. Code categories for discussion topics included (1) medical (ie, seeking for advice on a medical issue), (2) lifestyle (eg, dietary, exercise), (3) emotional well-being (eg, distress, stress), (4) women’s health (ie, topics specific to women issues, such as Pap smear), and (5) miscellaneous (ie, topics that do not fit into any of the above-mentioned areas). For participants’ response types, code categories included (1) asking a new/follow-up question, (2) providing advice/support/information, (3) sharing experience, and (4) expressing thanks.

    Social Network Analysis

    Social network analysis methods were used to classify the types of group-level behavior (patterns of communication within the forum community) and to consider the effects of group behavior on individual behavior, including the utilization of the PCHMS, and the decisions and behaviors of the participants. The metrics chosen for the analysis are typical indicators of forum behaviors—the relative importance of individuals within the network and the shift from one-on-one interactions to group discussions. We then discussed how the ongoing interactions in the social features of the PCHMS might improve utilization.

    Degree centrality (an indicator of the relative importance of individuals in a social network) is calculated for each node in the network by counting the total number of connections to other nodes. Reciprocity (which indicates how common “conversations” are in a forum) was calculated by the proportion of connections that were returned. A reciprocal connection is one in which two people have responded to each other at least once each. To estimate the relative significance of the reciprocity in the networks, we tested the observed values against a random baseline using a method described elsewhere [38]. Social networks of online forum communication patterns among consumers and clinicians, namely a GP and a counselor, were analyzed using MATLAB 7.11.1 and illustrated using Cytoscape 2.8.2 [39].


    Participants

    A total of 1985 participants met inclusion criteria and were recruited into the study. All completed the pre-study questionnaire. Of those, 709 (35.72%) completed the post-study questionnaire. Analyses were conducted on the 709 eligible participants who completed both the pre-study and post-study questionnaires. Of these, 80.7% (572/709) participants logged into the PCHMS at least once; where 93% (40/43) of those who posted on the forum, 60.0% (195/325) of those who answered a poll question, 90% (26/29) who wrote a diary entry, and 70.8% (75/106) of those who entered a PHR entry, logged into the PCHMS more than once.

    Baseline and demographic characteristics of eligible participants are presented elsewhere [27]. During the study, 54.4% (386/709) of participants sought formal or informal help (for themselves or others) on physical well-being matters and 31.7% (225/709) for emotional well-being concerns [27]. Furthermore, 36.5% (141/386) of participants who sought help for a physical well-being matter and 32.9% (74/225) for an emotional well-being concern indicated their decision to seek help was influenced by other people. Among those who visited the university counseling service during the study, 54% (22/41) were first-time visitors.

    For the 52 participants who self-rated as “extremely” bothered by their emotional problems at pre-study (as measured by the COOP/WONCA charts [33], which have been demonstrated to be a valid and feasible one-time screening assessment for mental disorders in primary care [33]), 44% (23/52) visited a health care professional for their emotional well-being during the study. On a scale from 1 to 5 (where higher scores indicate a poorer functional status), there was a significant improvement at post-study in these participants’ self-rated ability to conduct usual activities or tasks, both at work/study, or inside and outside the home (pre-study: mean 3.3 [SD 1.0]; post-study: mean 2.9 [SD 1.1]; t51=2.3; P=.028). At post-study, these participants also expressed being less bothered by emotional problems such as feeling stressed, anxious, depressed, irritable, or downhearted and sad compared to pre-study (pre-study: mean 5.0 [SD 0]; post-study: mean 2.6 [SD 1.1]; t51=9.5; P<.001).

    Social Features

    Among the 709 participants eligible for analysis, the three features most participants accessed in the PCHMS were journey (84%, 95% CI 81-87), poll (46%, 95% CI 42-50), and forum (16%, 95% CI 13-19). Further, the poll and the forum (ie, the social features of the PCHMS) were the two features rated most frequently by participants as “useful” (poll: 32%, 95% CI 29-36; forum: 30%, 95% CI 27-34) and “fun or engaging” (poll: 35%, 95% CI 32-39; forum: 16%, 95% CI 13-19). Chi-square analyses showed that users of a PCHMS social feature (ie, poll or the forum) proportionally outnumbered nonusers in the following observed behaviors (see Table 1).

    Forum

    The most frequently posted topic category was “medical” for both the men’s health (64%, 14/22) and women’s health (61%, 20/33) forums. For the “Stay Healthy” forum, the most frequently posted topic category was “lifestyle” (52%, 15/29). Across all three forums, the most frequent interaction type was “providing advice/support/information”—men’s health: 72% (34/47); women’s health: 73% (40/55); and Stay Healthy: 46.6% (103/221). Chi-square analyses showed that forum posters proportionally outnumbered nonposters in the following observed behaviors (see Table 2).

    Table 3 outlines the social networking characteristics for the three forums. The women’s health forum most closely represented a star-shaped pattern (also known as the hub-and-spoke typology), centered on the GP (80%, 37/46 of the connections involved the GP) (Figure 1). The GP’s position reflects a question-and-answer structure (featuring high levels of reciprocity), suggesting that the level of engagement was one-on-one conversations rather than community-wide discussions. The men’s health forum was also centered on the GP but the level of engagement with other members of the forum was higher (48%, 22/46 of connections did not involve the GP) (Figure 2). This network also featured high reciprocity (39%, 18/46 of connections were returned), and all reciprocal connections involved the GP.

    Although there were some individuals with higher numbers of incoming connections, the Stay Healthy forum least resembled the star-shaped pattern and also featured high levels of reciprocity (28.8%, 42/146 of connections were returned) (Figure 3). However, clinicians in this forum did not play a central role (only 4.1%, 6/146 of connections involved the GP). The degree of centrality and the reciprocity in the Stay Healthy forum indicated a more conversational structure among participants compared to the men’s or women’s health forums.

    Poll

    Among participants who reported using the poll, 70.2% (174/248) reported that they enjoyed learning how their health compared with others, 41.1% (102/248) were surprised by others’ answers about their health, and 33.1% (82/248) reported that the poll changed their perception of how healthy they were or how healthy others were compared to themselves (ie, perceived themselves being healthier than others).

    In addition, 13% (32/248) reported that using the poll changed some of their health actions and decisions. The results of McNemar’s test conducted on poll data shows that there was a significant increase in the number of participants reporting their perceived health as being better than others after using the poll compared to before usage (χ23=41.57, P<.001). Chi-square analyses showed that poll users proportionally outnumbered nonusers in the following observed behaviors (see Table 4).

    Table 1. Users of PCHMS social features (forum or poll) versus nonusers.
    Observed behaviorUsed social featurea, % (n) (n=332)Did not use social feature, % (n) (n=376)Difference, %χ 2dfP
    Visited a health care professional62.3 (207)50.0 (188)+12.310.91.001
    Sought formal/informal help for physical well-being concern59.3 (197)50.0 (188)+9.36.332.04
    Self-rated being physically fit at post-study91.9 (305)84.6 (318)+7.38.881.003
    Reported a higher intention to practice a healthy lifestyle at post-study58.4 (194)50.8 (191)+7.64.141.05
    Had at least one person in their advice-seeking network at post-study89.5 (297)83.8 (315)+5.74.861.03

    aPosted on forum or answered a poll question.

    Table 2. Table 2. Users of online forum versus nonusers.
    Observed behaviorPosted on forum, % (n)Did not post on forum, % (n)Difference, %χ 2dfP
    Reported a higher intention to practice a healthy lifestyle at post-study79.1 (34)a52.8 (351)b+26.311.251.001
    Visited a healthcare professional63.4 (121)c53.0 (274)d+10.46.061.01

    aOut of 43 participants who posted on the forum.

    bOut of 665 participants who did not post on the forum.

    cOut of 191 participants who accessed the forum.

    dOut of 517 participants who did not access the forum.

    Table 3. Table 3. Social network characterization for the three forums.

    		Women’s Health ForumMen’s Health ForumStay Healthy Forum
    Size, n353367
    Density, %3.84.23.2
    Degree centrality of Healthy.me GP (% of connections)37/46 (80%)24/46 (52%)6/146 (4.1%)
    Reciprocity (% of connections)18/46 (39%)12/46 (26%)42/146 (28.8%)
    Reciprocity percentile (vs random baseline)1.001.001.00
    ‎
    Figure 1. Networks for the Women’s Health forum. Black squares are female, grey circles are male, the Healthy.me GP and/or counselor is represented in the red triangle.
    View this figure
    ‎
    Figure 2. Networks for the Men’s Health forum. Grey circles are male, black squares are female, the Healthy.me GP and/or counselor is represented in the red triangle.
    View this figure
    ‎
    Figure 3. Networks for the Stay Healthy forum. Black squares are female, grey circles are male, the Healthy.me GP and/or counselor is represented in the red triangle.
    View this figure
    Table 4. Poll users versus nonusers.
    Observed behaviorAnswered poll question, % (n) (n=248)Did not answer poll question, % (n) (n=460)Difference, %χ 2dfP
    Sought formal or informal assistance on an emotional health issue37.9 (94)28.3 (130)+9.69.12.01
    Visited a health care professional60.9 (151)53.0 (244)+7.94.11.05

    Self-Reflective Features

    Personal Health Record (PHR)

    Approximately 15% of participants (106/709) added at least one entry into their PHR (ie, either an entry about their health schedule, medication, health care team member, pathology test result, imaging test results, or procedure). Altogether, 282 entries were added by participants during the study, with an average of 2.7 entries and a range of 1 to 12 entries per participant. Chi-square analyses showed that PHR users proportionally outnumbered nonusers in the following observed behaviors (see Table 5).

    Examples of medication entries, health team members, and medical test results entered by participants are presented in Multimedia Appendix 2, Tables 1-5. Medication entries include prescription medications (eg, Zoloft), off-the-shelf products (eg, Vitamin C), and complementary medications (eg, Jasmine). Team members comprise GPs, allied health professionals (eg, chiropractor, osteopath, physiotherapist), specialists (eg, dentist, gastroenterologist, cardiologist, sports medicine physician), and nonclinical members (eg, boyfriend). Tests entered included blood tests (eg, full blood count, thyroid, ferritin/iron), urine tests (eg, dipstick for protein), screening tests (eg, pap smear, serum hepatitis B), and imaging tests (eg, mammogram, MRI, ultrasound, dental x-ray, lung x-ray, and bone-related x-ray). Both invasive and non-invasive procedures (such as mole removal, gall bladder removal, fractured ankle, vision test, LETZ, cryotherapy, right knee arthroscopy, mammogram, and colonoscopy) were also entered by participants.

    Schedule and Online Appointment Booking Service

    A total of 8.0% (57/709) of participants used the online appointment booking feature on the PCHMS. Chi-square analyses showed that users of online-appointment booking service outnumbered nonusers for the following behaviors (see Table 6).

    Diary

    Almost 9% (8.6%, 61/709) of participants completed at least one diary entry in the PCHMS. A total of 140 diary entries were written by 61 participants, covering 272 topics, 271 uses, and 272 actions. These participants on average wrote 2.3 entries (SD 4.9; mode 1.0), ranging from 1 to 38 entries per person. In a diary entry, participants expressed on average 2.0 topics (SD 1.1; mode 1.0; range of 1-6 topics), 2.0 issues (SD 1.0; mode 1.0; range of 1-5), and 2.0 actions (SD 1.1; mode 1.0; range of 1-5). No significant differences in the use of the diary (ie, topics/issues discussed, length of entries, number of entries per person) were detected between participants who sought help and those who did not seek help (P>.05), nor between those who reported an emotional/physical well-being concern and those who did not during the study (P>.05). Chi-square analyses showed that diary users proportionally outnumbered nonusers for the following behaviors (see Table 7).

    Participants used the diary for both medical and nonmedical purposes, where the majority of entries were not medically related (Table 8). Most participants described their health concerns in terms of the encounters, changes, feelings, or symptoms they experienced in their everyday life (eg, food intake, feeling tired, light-headed, trouble going to sleep, crying) (Table 9). It was also uncommon for participants to use medical terminology to describe their experiences.

    The diary was also used by participants to record past, present, and future-intended actions. Past actions include recalling past experiences (eg, remembering prior experience of ovarian cyst) and recording past activities (eg, saw a GP yesterday). Present actions include thought recording (such as concerns about bodily aches), reflection on relationships with family/friends, and discussion of current mood and state (eg, feeling down/sleepy). Future actions relate to activities that need to be completed (eg, reminder to book a medical appointment) or setting goals related to food intake and exercise routine.

    Table 5. Personal health record (PHR) users versus nonusers.
    Observed behaviorEntered PHR entry, % (n) (n=106)Did not enter PHR entry, % (n) (n=602)Difference, %χ 2dfP
    Visited a health care professional78.3 (83)51.8 (312)+26.525.611<.001
    Visited the university health service28.3 (30)16.3 (98)+128.801.003
    Encountered someone who experienced a physical well-being concern70.8 (75)53.8 (324)+1710.511.001
    Sought formal/informal help for physical well-being concern67.9 (72)52.0 (313)+15.99.221.02
    Sought formal/informal help for an emotional well-being concern42.5 (45)29.7 (179)+12.86.741.009
    Table 6. Online appointment users versus nonusers.
    Observed behaviorBooked appointment online, % (n) (n=54)Did not book appointment online, % (n) (n=654)Difference, %χ 2dfP
    Visited the university counseling service18.5 (10)4.6 (30)+13.918.161<.001
    Sought formal/informal help for an emotional well-being concern44.4 (24)30.6 (200)+13.84.341.04
    Table 7. Diary users versus nonusers.
    Observed behaviorWrote diary, % (n) (n=29)Did not write diary, % (n) (n=679)Difference, %χ 2dfP
    Visited a health care professional75.9 (22)54.9 (373)+21.04.941.03
    Visited the university counseling service20.7 (6)5.0 (34)+15.712.831<.001
    Encountered someone who experienced a physical well-being concern82.8 (24)55.2 (375)+27.68.571.003
    Reported a higher intention to practice a healthy lifestyle at post-study41.4 (12)23.3 (158)+18.15.001.025
    Table 8. Issues recorded by participants in their diary entries (n=140 entries).
    Concerns / IntentionsGoalsActivitiesThoughts
    FoodStudySleep diaryFeeling guilty about procrastination
    ExerciseFitness / diet plansFood diaryFeeling worried about university progress
    Physical and emotional well-beingSmoking cessationExercise routineBrainstorming on food regimen
    University demands
    		Symptom progressCommenting on relationships
    Relationship problems
    		Weight progressReflecting on daily experiences and new encounters
    Finance
    		Daily activities
    Fatigue
    		University work
    Healthy eating/lifestyle
    		Actions taken towards physical and emotional well-being
    Seeking help for physical well-being concerns
    		Dietary intake
    Study plans


    Exercise/weight management


    Making plans for family/friends


    Table 9. Topics recorded by participants in their diary entries (n=140 entries).
    Physical HealthEmotional HealthPhysical and Emotional HealthNonhealth
    Headache/light-headednessPost-traumatic stress disorderExerciseUniversity
    NauseaDepressionFoodWork/life balance
    ConstipationMood swingSleepRelationships (family, friends, romance)
    Stomach pain/upsetsAnorexia nervosaDietDaily activities
    UTI/chlamydia screeningAngerWeightSocial life
    InjuriesParanoiaSmokingFinance
    Cold/flu/coughPanicBinge eatingHygiene
    Ovarian cystSocial anxietyFatigue/feelings of motivationDeath
    VaccinesFatigue
    		Comments on Healthy.me
    SunburnSadness/crying

    FaintWorry

    Back issuesStress

    VisionFeeling trapped

    DentalFeeling lack of self-worth

    Skin rash


    Body aches


    Menstruation



    Principal Findings

    Social Versus Self-Reflective Features

    This study compared how consumers used social and self-reflective features of a PCHMS. Our findings suggest that, although there is substantial variation in the use of social and self-reflective features, both are significantly associated with positive consumer health behaviors and outcomes.

    Use of Social Features

    In this study, social features (the poll and the forums) were two of the most frequently used features among consumers and were reported to be the most useful and most engaging. This study also contributes to our understanding of communication patterns in an online community and shows that these patterns can differ depending on the purpose of the social space (eg, medical advice seeking vs personal experience sharing) and the types of people participating in the space (eg, consumer vs clinician).

    Findings on network centrality and reciprocity suggest that when it comes to consumers seeking answers to medical questions, the forum follows a star-shaped pattern with the GP in the middle. An interpretation of this pattern is that when a person with perceived “authority” (eg, a GP) contributes to a medically oriented discussion, other participants may see this as a definitive answer or may be less likely to contribute if the interaction is perceived as a personal patient-doctor interaction. However, when it comes to sharing lifestyle experiences, the forum did not follow a star-shaped network topology. Rather, consumers freely communicated with each other and the GP no longer played a central role of mediating the conversation in the forum.

    Use of Self-Reflective Features

    Although only 15.0% (106/709) of participants entered an entry into their PHR, this is the single feature that was significantly associated with consumers’ physical well-being help-seeking behaviors [27]. The use of the PHR, which encouraged participants to keep track of their personal health details (such as medication, test results, scheduled appointments, or health care team members), was significantly associated with more visits to a health care professional and help-seeking for physical well-being matters [27]. This may be related to increasing one’s self-efficacy by being aware of past and upcoming tasks and results [40].

    Although only 8.6% (61/709) of participants used the diary, it was also one of the features identified as being significantly associated with emotional well-being help-seeking behaviors and visits to the university counseling service [27]. A diary, which encouraged self-reflection (in accordance with the principle of self-monitoring), is one of the most common behavioral change techniques [41]. However, a controlled randomized protocol would have been necessary to investigate this potential causative relationship.

    Implications for PCHMS Design and Future Research

    Potential Considerations

    This study suggests that there is potential for using the private spaces in a PCHMS (eg, diary and PHR) to enable participants to self-reflect and take action in regard to their health. As participants become more aware of their health status and concerns, they could then utilize the social environment in the PCHMS to (1) seek advice and support from similar others (eg, via online community forum), (2) engage with health professionals (eg, via expert-based question-and-answer forum), (3) verify whether they are “normal” compared to others (eg, via poll), or (4) use health service facilitation tools to connect with formal services for assistance (eg, online appointment booking).

    In fact, consumers’ usage patterns of a PCHMS could provide important “signals” of whether help-seeking assistance is needed. Based on the way a consumer uses these social and self-reflective features, the PCHMS could potentially facilitate help-seeking behavior by adaptively managing and promoting the individual’s interactions with other consumers/health care providers, thereby elucidating the path to help-seeking through a method that would be most appropriate at that point in time.

    Further, eHealth researchers should consider ways that the “crowd” (ie, social network around a person) can be systematically manipulated so that it can influence health behaviors and outcomes in a positive manner. If a PCHMS were able to “change” the crowd around a person, would that be sufficient for him or her to come into contact with a pivotal person who would encourage help-seeking and early intervention? If so, what “doses” of self-reflection and changes in social network formations are required in an intervention for an individual to take action?

    Forum

    Our social network analysis of online forums has revealed a spectrum of social interaction patterns—from question-and-answer structures to community discussions. It also provides a preliminary examination of how the presence of experts in online forums may change the patterns of communication among consumers.

    Current evidence that guides the design of social features in consumer eHealth applications is sparse. More empirical and theoretical studies are needed to investigate ways to design an “optimally social-engineered communication space” [42], according to its intended purpose and the anticipated interaction mode. Choi and colleagues have recently proposed a typology for online Question-Answering (QA) forums with four categories: community-based, collaborative, expert-based QAs, and social [37]. When designing social components of a PCHMS, researchers should consider the following important questions:

    (1) Which type of QA online space is most appropriate to address the needs of its audience? What is the optimal mix of participants that would allow interaction/moderation to be sustainable in the long-term?

    (2) In a community-based forum, would it be more appropriate to have informed “expert peers” [43] rather than “medical professionals” to act as moderators? What method of moderation is most appropriate in order to encourage participant activity without compromising on the fluidity of interaction, the safety of the space, or the accuracy of the information exchanged?

    (3) How can online spaces be optimally designed for different social and communication purposes (eg, with new acquaintances, family and friends, or health professionals)?

    Poll

    The poll was one of the most frequently used features in the PCHMS and was regarded as the most useful and engaging. Yet, its use in consumer eHealth applications is not widespread, its efficacy not thoroughly tested, and it remains unclear how we can effectively design and incorporate social norms information to influence health behaviors. As Christakis and Fowler have demonstrated in the past decade, social networks are associated with health behaviors and outcomes for a variety of conditions (such as happiness, loneliness, depression, and obesity) [44-47]. When applied in the right context, social norms information has shown to significantly influence health behaviors (such as reducing alcohol consumption [48,49]). In addition, Centola has recently demonstrated that homophily (ie, similarity of social contacts) and social network structures can significantly influence online health behaviors [50,51].

    Yet, to the best of our knowledge, no studies have examined how we can best utilize these social influence findings to inform the design of PCHMSs and other consumer eHealth applications. While previous literature and our own findings suggest that information about social norms (such as via the poll) is associated with significant changes in consumers’ health beliefs and behaviors, eHealth researchers need to examine ways we can effectively utilize social norms information to encourage positive health behaviors. Similarly, there is a need to reduce the risk of “normalizing” negative health behaviors and beliefs, such as in cases when the “norms” may convey an incorrect or misleading view of what is considered healthy.

    Diary and Personal Health Record

    The poll and the forum promote social interactions with other people, whereas the PHR and the diary provide consumers an online private space in which to organize, reflect, and hopefully, advance their health. Usage patterns of the diary suggest that it was primarily used for self-reflection, personal problem solving, and goal setting. On the other hand, the PHR was primarily used for organizational purposes, which included the self-recording of personal health data and past/upcoming tasks.

    Strengths and Limitations

    Key strengths of this study include the employment of a multifaceted PCHMS and the utilization of PCHMS usage metrics to identify associations with key consumer behavior outcomes.

    This study also presents several limitations: university setting, self-reports, self-entry functionality, causality versus association, and PCHMS engagement measures. First, participants in a university setting may have been more motivated and willing to try new technologies to manage their health than the general population [52,53]. The key limitations are the short duration and high attrition rate. High attrition rates are common in eHealth intervention studies, with a recent systematic review revealing that completion of protocol rates for depression sites ranged from 43% to 99% [54]. One of the possible reasons for the attrition rate of 64.28% (1276/1985) in this study is that participants were asked by email to complete their post-study questionnaire during the long university summer break, when students and staff were not as likely to check their university email. However, the number of participants eligible for analysis is still relatively large (n=709), with 80.7% (572/709) logging into the PCHMS at least once [27], providing a sufficient sample size to analyze whether level of PCHMS usage is associated with consumers’ heath service and help-seeking utilization rates. Overall, future studies conducted in the university setting should strive to commence and complete the study during semester time.

    Second, the study relied on self-reports by participants, which have been shown to be acceptable in studies of help-seeking, health service utilization, and mental health related studies among students [55-58]. The PCHMS currently relies on self-entry functionality, which may have caused lower usage of the tool. While it is possible that some participants could have used the PCHMS after visiting the university health services, we validated health service utilization rates by matching self-report from a subset of study participants with their health records at the University Counselling and Psychological Services, where system usage log files indicated that usage of the PCHMS preceded clinic visits.

    Third, although findings in this study are limited by its design, the use of a convenience sample, and that we could attribute no causal relationships, our findings concur with Couper and colleagues’ study, which found that website engagement was significantly associated with consumers’ health behaviors [59]. In addition, our previous analyses showed that participants’ pre-study characteristics and well-being ratings were uniformly distributed among different PCHMS log-in frequency thresholds [27], and we have demonstrated in a previous randomized controlled trial that use of the PCHMS is associated with significant uptake of the influenza vaccine [23]. Nevertheless, future studies will need to use a controlled randomized design to allow an interpretation in terms of causality.

    Finally, this study focuses on some of the simplest website engagement measures (eg, number of PCHMS log-ins) and differed from previous studies that have used numerous metrics for measuring user engagement, such as number of website visits, time spent on a site, and number of features used [53,60]. Future studies should consider incorporating a qualitative component to elicit participants’ context and reasons (eg, why and how) for engaging with the PCHMS.

    Conclusions

    Incorporating the two major trends in consumer eHealth research (ie, PHRs and online social networks) to inform the next generation design of consumer systems requires several novel considerations. This study provides preliminary findings that suggest a PCHMS should include both social and self-reflective features that allow consumers to become familiar with their personal concerns and connect with others to seek help. With the rapid growth of online social networking websites and PHRs, future designs of PCHMSs should explore novel ways in which we can intervene in a person’s level of self-awareness and social network and examine their efficacy as a complex social and self-reflective intervention for health.

    Acknowledgments

    The authors thank Farshid Anvari, Jingbo Liu, Vitaliy Kim, and Jay Liu for their contributions to software development and the staff and students at University of New South Wales who assisted or participated in the study. This paper is an extended version of a conference paper that was presented at Medinfo 2013.

    This research is supported in part by grants received from the National Health and Medical Research Council (NHMRC) Centre of Research Excellence in Informatics and eHealth (1032664), and the HCF Health and Medical Research Foundation. The funding bodies did not have a role in the design and conduct of the study; the collection, management, analysis, and interpretation of the data; nor the preparation, review, or approval of the manuscript.

    Authors' Contributions

    Study design: AL, JP, AA1, JC, STL, EC; Journey design: AA1, JC, AL; Data collection: AL, AA1, JC; Data analyses: AL, AD, NM, AG; First draft: AL; Draft revision: AL, NM, STL, AA2, AD, EC, JP, AG.

    Conflicts of Interest

    The University of New South Wales and some of the researchers (EC, AL) at the Centre for Health Informatics could benefit from the commercialization of the PCHMS.

    ‎

    Multimedia Appendix 1

    Study protocol and intervention description.

    PDF File (Adobe PDF File), 52KB
    ‎

    Multimedia Appendix 2

    Personal health record entries entered by participants.

    PDF File (Adobe PDF File), 24KB
    1. Institute of Medicine. Health IT and Patient Safety: Building Safer Systems for Better Care. Washington, DC: Institute of Medicine. The National Academies Press; 2011.
    2. Tang PC, Ash JS, Bates DW, Overhage JM, Sands DZ. Personal health records: definitions, benefits, and strategies for overcoming barriers to adoption. J Am Med Inform Assoc 2006 Apr;13(2):121-126 [FREE Full text] [CrossRef] [Medline]
    3. Tulu B, Horan TA. The electronic disability record: purpose, parameters, and model use case. J Am Med Inform Assoc 2009 Feb;16(1):7-13 [FREE Full text] [CrossRef] [Medline]
    4. Roblin DW, Houston TK, Allison JJ, Joski PJ, Becker ER. Disparities in use of a personal health record in a managed care organization. J Am Med Inform Assoc 2009 Oct;16(5):683-689 [FREE Full text] [CrossRef] [Medline]
    5. Weitzman ER, Kaci L, Mandl KD. Acceptability of a personally controlled health record in a community-based setting: implications for policy and design. J Med Internet Res 2009;11(2):e14 [FREE Full text] [CrossRef] [Medline]
    6. Hoerbst A, Kohl CD, Knaup P, Ammenwerth E. Attitudes and behaviors related to the introduction of electronic health records among Austrian and German citizens. Int J Med Inform 2010 Feb;79(2):81-89. [CrossRef] [Medline]
    7. Montelius E, Astrand B, Hovstadius B, Petersson G. Individuals appreciate having their medication record on the web: a survey of attitudes to a national pharmacy register. J Med Internet Res 2008;10(4):e35 [FREE Full text] [CrossRef] [Medline]
    8. Wright A, Sittig DF. Encryption characteristics of two USB-based personal health record devices. J Am Med Inform Assoc 2007 Aug;14(4):397-399 [FREE Full text] [CrossRef] [Medline]
    9. Frost JH, Massagli MP. Social uses of personal health information within PatientsLikeMe, an online patient community: what can happen when patients have access to one another's data. J Med Internet Res 2008;10(3):e15 [FREE Full text] [CrossRef] [Medline]
    10. Kim MI, Johnson KB. Patient entry of information: evaluation of user interfaces. J Med Internet Res 2004 May 14;6(2):e13 [FREE Full text] [CrossRef] [Medline]
    11. Lee M, Delaney C, Moorhead S. Building a personal health record from a nursing perspective. Int J Med Inform 2007 Oct;76 Suppl 2:S308-S316. [CrossRef] [Medline]
    12. Archer N, Fevrier-Thomas U, Lokker C, McKibbon KA, Straus SE. Personal health records: a scoping review. J Am Med Inform Assoc 2011 Aug;18(4):515-522 [FREE Full text] [CrossRef] [Medline]
    13. de Groot IB, Otten W, Dijs-Elsinga J, Smeets HJ, Kievit J, Marang-van de Mheen PJ, CHOICE-2 Study Group. Choosing between hospitals: the influence of the experiences of other patients. Med Decis Making 2012 Dec;32(6):764-778. [CrossRef] [Medline]
    14. Macdonald-Wallis K, Jago R, Sterne JA. Social network analysis of childhood and youth physical activity: a systematic review. Am J Prev Med 2012 Dec;43(6):636-642. [CrossRef] [Medline]
    15. Cobb NK, Graham AL. Health behavior interventions in the age of facebook. Am J Prev Med 2012 Nov;43(5):571-572. [CrossRef] [Medline]
    16. Bull SS, Levine DK, Black SR, Schmiege SJ, Santelli J. Social media-delivered sexual health intervention: a cluster randomized controlled trial. Am J Prev Med 2012 Nov;43(5):467-474. [CrossRef] [Medline]
    17. Cavallo DN, Tate DF, Ries AV, Brown JD, DeVellis RF, Ammerman AS. A social media-based physical activity intervention: a randomized controlled trial. Am J Prev Med 2012 Nov;43(5):527-532. [CrossRef] [Medline]
    18. Lau AYS, Parker A, Early J, Sacks G, Anvari F, Coiera E. Comparative usage of a web-based personally controlled health management system and normal support: a case study in IVF. electronic Journal of Health Informatics (eJHI) 2012;7(2):e12.
    19. Wagner PJ, Dias J, Howard S, Kintziger KW, Hudson MF, Seol YH, et al. Personal health records and hypertension control: a randomized trial. J Am Med Inform Assoc 2012;19(4):626-634 [FREE Full text] [CrossRef] [Medline]
    20. Grant RW, Wald JS, Schnipper JL, Gandhi TK, Poon EG, Orav EJ, et al. Practice-linked online personal health records for type 2 diabetes mellitus: a randomized controlled trial. Arch Intern Med 2008 Sep 8;168(16):1776-1782. [CrossRef] [Medline]
    21. Tang PC, Overhage JM, Chan AS, Brown NL, Aghighi B, Entwistle MP, et al. Online disease management of diabetes: engaging and motivating patients online with enhanced resources-diabetes (EMPOWER-D), a randomized controlled trial. J Am Med Inform Assoc 2013 May 1;20(3):526-534. [CrossRef] [Medline]
    22. Bourgeois FT, Simons WW, Olson K, Brownstein JS, Mandl KD. Evaluation of influenza prevention in the workplace using a personally controlled health record: randomized controlled trial. J Med Internet Res 2008;10(1):e5 [FREE Full text] [CrossRef] [Medline]
    23. Lau AYS, Sintchenko V, Crimmins J, Magrabi F, Gallego B, Coiera E. Impact of a web-based personally controlled health management system on influenza vaccination and health services utilization rates: a randomized controlled trial. J Am Med Inform Assoc 2012;19(5):719-727 [FREE Full text] [CrossRef] [Medline]
    24. Lau AYS, Sintchenko V, Crimmins J, Magrabi F, Gallego B, Coiera E. Protocol for a randomised controlled trial examining the impact of a web-based personally controlled health management system on the uptake of influenza vaccination rates. BMC Health Serv Res 2012;12:86 [FREE Full text] [CrossRef] [Medline]
    25. Schnipper JL, Gandhi TK, Wald JS, Grant RW, Poon EG, Volk LA, et al. Effects of an online personal health record on medication accuracy and safety: a cluster-randomized trial. J Am Med Inform Assoc 2012;19(5):728-734 [FREE Full text] [CrossRef] [Medline]
    26. Tiong SS, Delaney G, Lau AYS, Koh ES, Adams D, Bell V, et al. Utilisation and acceptability of an e-health strategy to facilitate care of breast cancer survivors. Asia-Pacific Journal of Clinical Oncology 2012;8(Suppl 3):330.
    27. Lau AYS, Proudfoot J, Andrews A, Liaw ST, Crimmins J, Arguel A, et al. Which bundles of features in a Web-based personally controlled health management system are associated with consumer help-seeking behaviors for physical and emotional well-being? J Med Internet Res 2013;15(5):e79 [FREE Full text] [CrossRef] [Medline]
    28. Arguel A, Lau AYS, Dennis S, Liaw ST, Coiera E. An internet intervention to improve asthma management: rationale and protocol of a randomized controlled trial. JMIR Res Protoc 2013;2(2):e28. [CrossRef] [Medline]
    29. Coiera E. Social networks, social media, and social diseases. BMJ 2013;346:f3007. [Medline]
    30. Frost HJ, Massagli PM. Social uses of personal health information within PatientsLikeMe, an online patient community: what can happen when patients have access to one another's data. J Med Internet Res 2008;10(3):e15 [FREE Full text] [CrossRef] [Medline]
    31. Wicks P, Massagli M, Frost J, Brownstein C, Okun S, Vaughan T, et al. Sharing health data for better outcomes on PatientsLikeMe. J Med Internet Res 2010;12(2):e19 [FREE Full text] [CrossRef] [Medline]
    32. Lau AYS, Dunn A, Mortimer N, Proudfoot J, Andrews A, Liaw ST, et al. Consumers' online social network topologies and health behaviours. Stud Health Technol Inform 2013;192:77-81. [Medline]
    33. de Azevedo-Marques JM, Zuardi AW. COOP/WONCA charts as a screen for mental disorders in primary care. Ann Fam Med 2011 Aug;9(4):359-365 [FREE Full text] [CrossRef] [Medline]
    34. Williams AL, Merten MJ. A review of online social networking profiles by adolescents: implications for future research and intervention. Adolescence 2008;43(170):253-274. [Medline]
    35. Mazur E, Kozarian L. Self-presentation and interaction in blogs of adolescents and young emerging adults. Journal of Adolescent Research 2010;25(1):124-144.
    36. Chuang KY, Yang CC. Interaction patterns of nurturant support exchanged in online health social networking. J Med Internet Res 2012;14(3):e54 [FREE Full text] [CrossRef] [Medline]
    37. Choi E, Kitzie V, Shah C. Developing a Typology of Online Q&A Models and Recommending the Right Model for Each Question Type. 2012 Presented at: Human Computer and Information Retrieval (HCIR) conference; 2012; Cambrige, UK.
    38. Krackhardt D. Graph theoretical dimensions of informal organizations. In: Carley KM, Prietula MJ, editors. Computational organization theory. Hillsdale, N.J: Lawrence Erlbaum Associates; 1994:89-111.
    39. Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, et al. Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res 2003 Nov;13(11):2498-2504 [FREE Full text] [CrossRef] [Medline]
    40. Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev 1977 Mar;84(2):191-215. [Medline]
    41. Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
    42. Parker J, Coiera E. Improving clinical communication: a view from psychology. J Am Med Inform Assoc 2000;7(5):453-461 [FREE Full text] [Medline]
    43. Proudfoot J, Jayawant A, Whitton AE, Parker G, Manicavasagar V, Smith M, et al. Mechanisms underpinning effective peer support: A qualitative analysis of interactions between expert peers and patients newly-diagnosed with bipolar disorder. BMC Psyciatry 2012;12(196):doi:10.1186/1471-244X-12-196.
    44. Fowler JH, Christakis NA. Dynamic spread of happiness in a large social network: longitudinal analysis over 20 years in the Framingham Heart Study. BMJ 2008;337:a2338 [FREE Full text] [Medline]
    45. Christakis NA, Fowler JH. The spread of obesity in a large social network over 32 years. N Engl J Med 2007 Jul 26;357(4):370-379. [CrossRef] [Medline]
    46. Rosenquist JN, Fowler JH, Christakis NA. Social network determinants of depression. Mol Psychiatry 2011 Mar;16(3):273-281. [CrossRef] [Medline]
    47. Cacioppo JT, Fowler JH, Christakis NA. Alone in the crowd: the structure and spread of loneliness in a large social network. J Pers Soc Psychol 2009 Dec;97(6):977-991 [FREE Full text] [CrossRef] [Medline]
    48. Bewick BM, Trusler K, Mulhern B, Barkham M, Hill AJ. The feasibility and effectiveness of a web-based personalised feedback and social norms alcohol intervention in UK university students: a randomised control trial. Addict Behav 2008 Sep;33(9):1192-1198. [CrossRef] [Medline]
    49. Moreira MT, Smith LA, Foxcroft D. Social norms interventions to reduce alcohol misuse in university or college students. Cochrane Database Syst Rev 2009(3):CD006748. [CrossRef] [Medline]
    50. Centola D. The spread of behavior in an online social network experiment. Science 2010 Sep 3;329(5996):1194-1197 [FREE Full text] [CrossRef] [Medline]
    51. Centola D. An experimental study of homophily in the adoption of health behavior. Science 2011 Dec 2;334(6060):1269-1272 [FREE Full text] [CrossRef] [Medline]
    52. Glasgow RE, Nelson CC, Kearney KA, Reid R, Ritzwoller DP, Strecher VJ, et al. Reach, engagement, and retention in an Internet-based weight loss program in a multi-site randomized controlled trial. J Med Internet Res 2007;9(2):e11 [FREE Full text] [CrossRef] [Medline]
    53. Danaher BG, Seeley JR. Methodological issues in research on web-based behavioral interventions. Ann Behav Med 2009 Aug;38(1):28-39. [CrossRef] [Medline]
    54. Christensen H, Griffiths MK, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res 2009;11(2):e13 [FREE Full text] [CrossRef] [Medline]
    55. Eisenberg D, Golberstein E, Gollust SE. Help-seeking and access to mental health care in a university student population. Med Care 2007 Jul;45(7):594-601. [CrossRef] [Medline]
    56. Eisenberg D, Golberstein E, Hunt J. Mental Health and Academic Success in College. BE Journal of Economic Analysis & Policy 2009;9(1):Article 40. [CrossRef]
    57. Eisenberg D, Gollust SE, Golberstein E, Hefner JL. Prevalence and correlates of depression, anxiety, and suicidality among university students. Am J Orthopsychiatry 2007 Oct;77(4):534-542. [CrossRef] [Medline]
    58. Eisenberg D, Downs MF, Golberstein E, Zivin K. Stigma and help seeking for mental health among college students. Med Care Res Rev 2009 Oct;66(5):522-541. [CrossRef] [Medline]
    59. Couper MP, Alexander GL, Zhang N, Little RJ, Maddy N, Nowak MA, et al. Engagement and retention: measuring breadth and depth of participant use of an online intervention. J Med Internet Res 2010;12(4):e52 [FREE Full text] [CrossRef] [Medline]
    60. Strecher VJ, McClure JB, Alexander GL, Chakraborty B, Nair VN, Konkel JM, et al. Web-based smoking-cessation programs: results of a randomized trial. Am J Prev Med 2008 May;34(5):373-381 [FREE Full text] [CrossRef] [Medline]

    ‎
    COOP/WONCA charts: Charts developed by the Dartmouth Primary Care Cooperative Research Network (COOP) and the World Organization of National Colleges, Academies, and Academic Associations of General Practitioners/Family Physicians (WONCA).
    GP: general practitioner
    PCHMS: personally controlled health management system
    PHR: personal health record
    QA: question-answering

    Edited by G Eysenbach; submitted 23.04.13; peer-reviewed by J Jones, M Whetstone; comments to author 21.05.13; revised version received 01.08.13; accepted 29.08.13; published 23.09.13

    Copyright

    ©Annie YS Lau, Adam G Dunn, Nathan Mortimer, Aideen Gallagher, Judith Proudfoot, Annie Andrews, Siaw-Teng Liaw, Jacinta Crimmins, Amaël Arguel, Enrico Coiera. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 23.09.2013.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.