Published on in Vol 21, No 6 (2019): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/12580, first published .
Comparison of Nutrigenomics Technology Interface Tools for Consumers and Health Professionals: A Sequential Explanatory Mixed Methods Investigation

Comparison of Nutrigenomics Technology Interface Tools for Consumers and Health Professionals: A Sequential Explanatory Mixed Methods Investigation

Comparison of Nutrigenomics Technology Interface Tools for Consumers and Health Professionals: A Sequential Explanatory Mixed Methods Investigation

Original Paper

1University of Hawai'i at Manoa, College of Tropical Agriculture & Human Resources, Honolulu, HI, United States

2University of British Columbia, Michael Smith Laboratories, Vancouver, BC, Canada

3Kwantlen Polytechnic University, Department of Biology, Health Science Program, Surrey, BC, Canada

4Fraser Health Authority, Clinical Nutrition, Abbotsford, BC, Canada

5Vancouver General Hospital, Clinical Nutrition, Vancouver, BC, Canada

6University of Washington, School of Public Health, Seattle, WA, United States

7Neighborhood House Washington, Tukwila, WA, United States

8University of Hawai'i at Manoa, College of Social Sciences, Honolulu, HI, United States

Corresponding Author:

Karen M Davison, RD, CHES, PhD

Kwantlen Polytechnic University

Department of Biology

Health Science Program

12666 72 Avenue

Surrey, BC,

Canada

Phone: 1 604 300 0331

Email: karen.davison@kpu.ca


Background: Nutrigenomics forms the basis of personalized nutrition by customizing an individual’s dietary plan based on the integration of life stage, current health status, and genome information. Some common genes that are included in nutrition-based multigene test panels include CYP1A2 (rate of caffeine break down), MTHFR (folate usage), NOS3 (risk of elevated triglyceride levels related to omega-3 fat intake), and ACE (blood pressure response in related to sodium intake). The complexity of gene test–based personalized nutrition presents barriers to its implementation.

Objective: This study aimed to compare a self-driven approach to gene test–based nutrition education versus an integrated practitioner-facilitated method to help develop improved interface tools for personalized nutrition practice.

Methods: A sequential, explanatory mixed methods investigation of 55 healthy adults (35 to 55 years) was conducted that included (1) a 9-week randomized controlled trial where participants were randomized to receive a standard nutrition-based gene test report (control; n=19) or a practitioner-facilitated personalized nutrition intervention (intervention; n=36) and (2) an interpretative thematic analysis of focus group interview data. Outcome measures included differences in the diet quality score (Healthy Eating Index–Canadian [HEI-C]; proportion [%] of calories from total fat, saturated fat, and sugar; omega 3 fatty acid intake [grams]; sodium intake [milligrams]); as well as health-related quality of life (HRQoL) scale score.

Results: Of the 55 (55/58 enrolled, 95%) participants who completed the study, most were aged between 40 and 51 years (n=37, 67%), were female (n=41, 75%), and earned a high household income (n=32, 58%). Compared with baseline measures, group differences were found for the percentage of calories from total fat (mean difference [MD]=−5.1%; Wilks lambda (λ)=0.817, F1,53=11.68; P=.001; eta-squared [η²]=0.183) and saturated fat (MD=−1.7%; λ=0.816; F1,53=11.71; P=.001; η²=0.18) as well as HRQoL scores (MD=8.1 points; λ=0.914; F1,53=4.92; P=.03; η²=0.086) compared with week 9 postintervention measures. Interactions of time-by-group assignment were found for sodium intakes (λ=0.846; F1,53=9.47; P=.003; η²=0.15) and HEI-C scores (λ=0.660; F1,53=27.43; P<.001; η²=0.35). An analysis of phenotypic and genotypic information by group assignment found improved total fat (MD=−5%; λ=0.815; F1,51=11.36; P=.001; η²=0.19) and saturated fat (MD=−1.3%; λ=0.822; F1,51=10.86; P=.002; η²=0.18) intakes. Time-by-group interactions were found for sodium (λ=0.844; F3,51=3.09; P=.04; η²=0.16); a post hoc analysis showed pre/post differences for those in the intervention group that did (preintervention mean 3611 mg, 95% CI 3039-4182; postintervention mean 2135 mg, 95% CI 1564-2705) and did not have the gene risk variant (preintervention mean 3722 mg, 95% CI 2949-4496; postintervention mean 2071 mg, 95% CI 1299-2843). Pre- and postdifferences related to the Dietary Reference Intakes showed increases in the proportion of intervention participants within the acceptable macronutrient distribution ranges for fat (pre/post mean difference=41.2%; P=.02). Analysis of textual data revealed 3 categories of feedback: (1) translation of nutrition-related gene test information to action; (2) facilitation of eating behavior change, particularly for the macronutrients and sodium; and (3) directives for future personalized nutrition practice.

Conclusions: Although improvements were observed in both groups, healthy adults appear to derive more health benefits from practitioner-led personalized nutrition interventions. Further work is needed to better facilitate positive changes in micronutrient intakes.

Trial Registration: ClinicalTrials.gov NCT03310814; http://clinicaltrials.gov/ct2/show/NCT03310814

International Registered Report Identifier (IRRID): RR2-10.2196/resprot.9846

J Med Internet Res 2019;21(6):e12580

doi:10.2196/12580

Keywords



Background

Since the success of the Human Genome project, scientific technology has advanced rapidly in several disciplines, including medicine and nutrition. Given that the interaction of nutrients with DNA can impact nutritional status and the development of complex diseases, nutritional genomics (nutrigenomics) has become increasingly important in nutrition practice. Nutrigenomics encompasses nutrigenetics, which investigates the effect of genetic variation on nutrient bioavailability and metabolism, and nutrigenomics, which examines how nutrients and bioactive food compounds affect human health through epigenetic modifications [1-5]. Furthermore, it forms the basis of personalized nutrition by customizing an individual’s dietary plan based on the integration of life stage, current health status, and genome information. Some common genes that are included in nutrition-based multigene test panels include CYP1A2 (rate of caffeine break down) [6,7], MTHFR (folate usage) [8-10], NOS3 (risk of elevated triglyceride levels related to omega-3 fat intake) [11], and ACE (blood pressure response in related to sodium intake) [12].

Although the advancement of nutrigenomics-based personalized nutrition shows significant promise in improving population health, it also presents challenges. These issues include concerns about the complexity in translating gene-based results into meaningful recommendations that will lead to positive health outcomes [13-15]. Despite these issues, studies have shown that those who receive personalized nutrition interventions based on gene test results show improvements in the quality of their diet [16-19]. However, differences in dietary intakes are not always observed between risk and nonrisk groups [20], and dietary changes have not been consistently observed across all identified risk gene variants (eg, MTHFR) where nutrition advice is provided [16-19]. For nutrigenomics and personalized nutrition to advance in health practice, better interface educational tools (eg, Web applications and targeted messaging after personalized nutrition advice provided) need to be developed that are easily implemented by practitioners, that are understood by consumers, and that foster positive eating behavior changes. Furthermore, they need to incorporate accepted nutrition guidelines, integrate phenotypic information about current health status, and align with behavior change theory principles [5,20]. This study proposes to compare standard and tailored personalized nutrition approaches based on gene testing and to elicit participant feedback about their experiences with the 2 types of interventions. The study results are intended to generate data that will improve nutrigenomics-based education tools for consumers and health professionals.

Objectives

The main study objectives were to compare a practitioner-facilitated personalized dietary approach that uses genotypic and phenotypic information with a self-driven approach and their impacts on changing participant’s knowledge, motivation, and behavior related to eating habits, the quality of their diet, and the quality of their life. It was hypothesized that significantly higher levels of knowledge, motivation, behavior, and quality of life would be reported and that there would be a higher level of diet quality changes in the group that receives personal DNA diet information plus customized dietary advice (practitioner led) compared with the group that is provided personal DNA diet information (direct-to-consumer, self-driven approach) only. In addition, self-efficacy was evaluated as a potential mediator/moderator of dietary changes and outcomes. Focus group interview data were also collected to facilitate interpretation of the intervention data.


Study Design

The sequential explanatory mixed methods investigation consisted of (1) a randomized controlled trial (2:1 allocation ratio) comparing standard self-driven versus practitioner-facilitated approaches that use DNA-based diet information and (2) qualitative investigation of participants’ experiences to help interpret the intervention’s quantitative outcomes. The study protocol, including paper-based or Web-based data collection forms, was approved by Quorum Institutional Review Board (protocol #32220CDN/1). All the participants provided initial Web-based consent to collect eligibility screening information and, if eligible, baseline information related to their health. At the participant’s first site visit, a second written consent form was reviewed, which participants signed to confirm their continued involvement in the study. The protocol was registered with the US National Library of Medicine (trial registration #NCT03310814) and is also detailed elsewhere [21].

Participants and Setting

The participants selected for the study included healthy medically stable adults (aged 35 to 55 years) residing in the greater Vancouver area of the province of British Columbia, Canada. The participants were recruited via social media, a newspaper article, and posters. The eligibility criteria included that they wanted to improve their health, could understand and provide informed consent, and were willing to provide a buccal swab for DNA testing. The exclusion criteria are specified in Multimedia Appendix 1.

Description of Study Groups

The participants were randomized using a random number generator by a statistician independent to the study into either the intervention or control (C) group. The intervention (I) group received their gene test result report (standard) plus a personalized nutrition plan that integrated information about their gene test results, health information, personal goals, and dietary intakes (based on nutrient analysis of 3-day food records collected at baseline). Their DNA report results and personalized nutrition plan were reviewed with a trained research registered dietitian (RD) who counseled them about the DNA-based diet recommendations derived from information about their gene markers and variants. For example, if a person possessed a dietary fat utilization–based genotype that was associated with increased risk of a health outcome (eg, dyslipidemia), they were provided targeted directives about types (eg, omega-3 fatty acids) and amounts of fat intake (eg, try to eat less than 80 g of fat per day). If a participant did not possess the specified dietary fat utilization–based risk variant, they received the standard Dietary Reference Intakes –based recommendations [22,23]. Where possible, recommendations based on the gene test results were clustered to provide manageable and meaningful dietary guidance to the participant (Table 1). As the final step in nutrition consultation, the RD worked collaboratively with the participant to define up to 3 targeted nutrition-related goals that were entered into the Web-based nutrition assessment questionnaire and written in the personalized nutrition report. Both groups received 3 follow-up emails (1 every 2 weeks post intervention) with information about gene-based personalized nutrition as well as tips and reminders (eg, information about food label reading) to help them reach their nutritional goals. After the study’s completion, participants in the C group had the option to have dietary counseling from the research RD.

Table 1. Description of gene test.
Component measuredNutrient or food subcomponent testeda
Diet managementCarbohydratesb; cholesterol—high density lipoprotein and low density lipoproteinc; fat—dietary, stored, monounsaturated, and saturatedb; insulin sensitivity; and proteind
Weight responseBody mass index
Food tolerancesAlcohol; caffeine; gluten; lactose; salte; and sugar cravingf
Food taste and preferencesCaffeine preference; carbohydrateb preference; fat preferencec; protein preferenced; and taste: bitter, salte, and sweetf
Vitamins, minerals, and essential fatsVitamins A, B6, B9 (folate), B12, C, Dg, and E; calciumg; iodine; iron; and omega 3 and 6c

aDietary advice was clustered by subcomponents labeled with the superscripted letters b to g.

bCarbohydrate-related advice.

cFat-related advice.

dProtein-related advice.

eSalt-related advice.

fSugar-related advice.

gVitamin D and calcium-related advice.

Study Visits

The 4-month study consisted of 6 stages.

Recruiting/Screening

This included the initial eligibility screen and, where applicable, baseline assessment (Web based) that collected information about sociodemographics; current health status (eg, presence of health conditions and medication and supplement usage); quality of life; self-efficacy; questions about knowledge, motivation, and action related to DNA-based information; stage of change; physical and sedentary activities; food intakes (food frequency and food selection); anthropometrics; and sleep quality. In addition, participants were sent 3-day food records to complete within 7 (±3 days) of their first site visit.

Baseline Assessment

A site visit was conducted with the RD who reviewed the participant’s baseline health assessment information and food records; collected a buccal cheek swab sample; and measured the participant’s height, weight, and waist and hip circumference according to standardized protocols [24].

Bar-coded buccal DNA samples were collected using Oracollect-DNA OCR-100 swabs (DNA Genotek) and stored between 15° and 30°C. Participants did not eat or drink at least 30 minutes before buccal sample collection. The samples were analyzed using Agena MassArray at the Clinical Genomics Centre at Mount Sinai Hospital. The gene tests included 5 evidence-based components (Table 1) [25].

Personalized Nutrition Visit or Standard Report Distributed

I group participants came to the site to have their personalized nutrition report reviewed (see Figure 1 for samples from the interface tools); those in the C group received an email with the standard report.

Figure 1. Examples from educational tools.
View this figure
Follow-Up #1

A Web-based survey was sent to I and C participants at week 3 post intervention to collect data about any changes in income; social support; and knowledge, behavior, and action; stage of change; and adverse event information. For the I group, questions that asked about whether knowing one’s personal DNA helped with eating behavior change were also included.

Follow-Up #2

At 6 weeks after the intervention, the participants received the Web-based baseline health assessment questionnaire and food records to complete in preparation for the final onsite visit (week 8 post intervention). Additional questions were asked about whether having the diet-based DNA information led to action in areas such as label reading and making healthier food choices when eating out, at the grocery store, and at home.

Final Visit

The final site visit (I and C groups) included a review of the participant’s health assessment and food record information. Anthropometric measures were repeated. The C-group participants received their individualized gene test–based diet plans and had the option to book appointments with the RD to have them reviewed. Focus groups were then conducted to solicit feedback about participants’ responses to their gene test results and RD consultation as well as about barriers, facilitators, and targets for improvement related to nutrigenomics-related education.

Data Collection Tools and Outcome Measurements

FluidSurveys software [26] was used to construct the Web-based closed questionnaires. The Web-based questionnaires were developed using the Checklist for Reporting Results of Internet E-Surveys [27], standard measurements (detailed in measurements section), and protocols for nutrition assessment [25]. All questionnaires contained 12 or less screens (pages) and were pilot tested with study staff and student volunteers (n=11) to assess the usability and technical functionality. The participants were emailed instructions and the links to each Web-based questionnaire at the appropriate times during the study. Quality control data collection procedures included ensuring all questions in each questionnaire were completed, following up with participants about responses where required, and deleting any duplicate entries according to internet protocol addresses. All the data were collected and stored in accordance with Quorum institutional review board guidelines. Copies of the questionnaires may be obtained by emailing the corresponding author. The outcome measures are described in the following sections.

Outcomes
Nutrition-Related Outcomes

All dietary intake data collection was done according to standard procedures [24,28]. The 3-day food records measured pre/post caloric, macronutrient, micronutrient, and food group intakes, which were compared with nutrition standards (eg, Eating Well with Canada’s Food Guide and Dietary Reference Intakes). The Canadian version of the Healthy Eating Index (HEI-C) [29] was used to assess diet quality. The Web-based questionnaires also included food selection questions about the types of food consumed, dietary restraint, food insecurity, motivation to change diet, and eating behavior changes. These were based on validated measures [30,31] and current literature related to measuring motivation and eating behavior changes.

Health-Related Quality of Life Short Form 8

The Health-Related Quality of Life Short Form 8 is a validated measurement tool of quality of life, functional health, and well-being [32] based on a 4-week recall period. Each item has a 5- or 6-point response range. Higher summary physical and mental component scores indicate better health [33].

General Self-Efficacy

General Self-Efficacy (GSE) is a validated item measure of self-efficacy shown to correlate with emotion, optimism, and work satisfaction [34]. It contains 10 questions each with 4 categories of responses that include not at all true, hardly true, moderately true, and exactly true. The scores for each question range from 1 to 4 and the total score is calculated by finding the sum of all items. The scale score ranges between 10 and 40; higher scores indicate greater self-efficacy. The GSE has high reliability, stability, and construct validity that have been confirmed (Cronbach alpha ranges from .86 to .94) [35].

Measures of Change in Knowledge, Motivation, and Behavior

Overall, 3 questions to assess for changes in knowledge, motivation, and behavior related to DNA-based dietary advice were developed by the authors based on the Stages of Change Model [36] and current review of the evidence. They were pilot tested among 11 young adults (aged 20 to 40 years) to assess for comprehension and face validity.

Covariates

The covariates related to dietary intake and health behavior that were measured included the following.

Natural Health Products Usage

Data about natural health products (NHP; eg, micronutrients and botanicals) included type (natural product number), dose, and frequency of use. Participants who were taking NHPs were advised at baseline to keep the type, dose, and frequency the same throughout the study.

Physical and Sedentary Activities

The physical activity index [37] collected data about the frequency, duration, and intensity of participation in certain activities in the previous 3 months to derive a score that represented the average daily energy expended on leisure time physical activity. A composite measure of sedentary activities was based on total screen time in the previous 7 days [38].

Sleep Quality

The Patient-Reported Outcomes Measurement Information System Sleep Disturbance scale-short form [39] was used to assess sleep quality over the previous 7 days. Individual scale items are scored from 1 to 5 and the total scores range between 8 and 40. Lower scores represent a lesser degree of sleep-related impairments.

Stress

Measures of stress were based on 2 validated questions from the Canadian Community Health Survey [40].

Anthropometrics

Body mass index (kg/m2) and waist-to-hip ratio were calculated from standardized height, weight, waist circumference, and hip circumference measures [24].

Sociodemographics

Measures of sex/gender, age, relationship status, income, race/ethnicity, and perceived social support were included.

Adverse Events

At each study contact point, the participants were asked if they experienced any adverse events or change in and/or had started any new medications or NHPs.

Data Analysis

Quantitative Analysis
Food Intake and Nutrient Analysis

Nutrient analysis was conducted using ESHA—The Food Processor Nutrition Analysis and Fitness software and the Canadian Nutrient File [41,42]. Averages of the 3 days of nutrient values were used in the analysis. The food frequency questionnaire (FFQ) values were used to derive usual intakes of the nutrients of interest [24].

Descriptive and Inferential Analysis

Means (SDs) or medians (and interquartile range) were reported based on a given continuous variable’s distribution. Subject characteristics, group comparisons, and pre- and postintervention differences were analyzed using the Student t tests, binomial tests of 2 proportions, Fisher exact tests, and 2-way repeated-measures analysis of variance with Bonferroni post hoc tests, where appropriate. All analyses were done on an intent-to-treat basis using STATA software [43].

Qualitative Analysis

Textual data from the Web-based questionnaires (eg, participant’s personal dietary goals) were grouped into categories where feasible. Data from the focus groups were transcribed, entered into NVivo [44], and analyzed by research team members using interpretative thematic analysis to identify patterns, concepts, themes, and examples in relation to existing behavior change theories and the study objectives [45]. Interpretations were reviewed by research team members and participants to check for descriptive and interpretative validity. Qualitative data were reported based on thematic analysis derived from 3 independent reviews of the textual data.


Sample

A total of 478 persons expressed interest in study participation. These individuals were invited sequentially from the recruitment list and balanced by sex/gender, where possible. However, the ratio of females to males who were interested in the study was approximately 8:1, and although all males on the recruitment list were contacted, there was an imbalance in the male/female participant ratio. Of the 478 individuals, a total of 180 (38%) were invited to complete the Web-based eligibility screening questionnaire (Figure 2); 73 of the invited individuals (73/180, 41%) were deemed eligible. Of the 73 eligible individuals, 58 enrolled and 55 (95%) completed the baseline health assessment questionnaire and food records (55/73, 75%). The final sample consisted of 55 adults aged between 37 and 57 years (mean 45.8 years, SD 5.8). Most participants were women (n=41, 74.6%), had graduated from a university or college (n=34, 62%), earned an income higher than Can $90,000 (n=32, 58.8%), and were in a relationship (n=47, 86%). Almost 51% (n=28) of the participants believed they were eating a healthy diet, about two-thirds indicated their health status was good (n=25, 46%) or very good (n=14, 26%), and 91% (n=50) reported they had favorable social support networks. There were no significant differences between the I and C groups based on various baseline characteristics (Table 2). In addition, the proportion of participants with the gene risk variants did not differ between the I and C groups (proportion range 6% to 69%; P values range from .27 to .77).

Figure 2. Participant selection.
View this figure
Table 2. Description of sample—baseline characteristics.
Demographics and health-related factorsIntervention (n=36)Control (n=19)P value
Age (years), mean (SD)45.4 (6.3)46.6 (5.0).49
In a relationship, n (%)29 (81)18 (95).47
Postsecondary education, n (%)20 (56)14 (74).35
Income above Can $90,000, n (%)19 (53)13 (68).13
Inactive, n (%)20 (56)14 (74).35
General Self-Efficacy, mean (SD)32.8 (4.0)32.7 (4.4).88
Health-related quality of life, mean (SD)62.6 (12.0)64.6 (9.5).53
Body mass index, mean (SD)28.7 (5.5)28.1 (4.2).69

Changes in Knowledge, Attitudes, and Behavior

At baseline, more than 90% of respondents (minimum 51) indicated that the diet-related gene test information helped them to understand their health better as well as motivated them to take action related to healthy eating (Multimedia Appendix 2). The proportions of individuals who agreed to statements about taking action on reading nutrition labels more often, selecting healthier food choices at restaurants, purchasing healthier food, making healthier meals at home, taking supplements to support their DNA, and adjusting their eating according to their DNA information were high across both groups; consistently higher proportions were found in the I group. Responses to Stages of Change questions indicated that those in the I group were more likely to report the intention of making healthy changes to their diets within the next month (Multimedia Appendix 2). Responses to questions given to the I group about diet-related changes that were asked at 3 weeks postintervention indicated that 31% (n=11) starting to take supplements, 81% (n=29) took diet-specific actions, and 42% (n=15) indicated they adjusted their eating according to their DNA information.

Changes in Dietary Intake, Anthropometrics, Self-Efficacy and Quality of Life

Significant pre-/postintervention differences (Table 3) were found for the percentage of calories from total fat (mean difference [MD]=−5.1%; Wilks’ lambda [λ]=0.817; F1,53= 11.68; P=.001; eta-squared [η²]=0.183 ) as well as from saturated fat (MD=−1.7%; λ=0.816; F1,53=11.71; P=.001; η²=0.18) and health-related quality of life (HRQoL) scores (MD=8.1 points; λ=0.914; F1,53=4.92; P=.03; η²=0.086). There were significant differences between groups over time for sodium (λ=0.846; F1,53=9.47; P=.003; η²=0.15) and HEI-C scores (λ=0.660; F1,53=27.43; P<.001; η²=0.35; Figure 3).

When group assignment was stratified by phenotypic plus genotypic information, improved total fat (MD=−5%; λ=0.815; F1,51=11.36; P=.001; η²=0.19) and saturated fat (MD=−1.3%; λ=0.822; F1,51=10.86; P=.002; η²=0.18) intakes were indicated. In addition, significant differences between groups over time for sodium (λ=0.844; F3,51=3.09; P=.04; η²=0.16) with post hoc analysis showing pre/post differences for those in the I group that did have the risk variant (premean 3611 g, 95% CI 3039-4182; postmean 2135 g, 95% CI 1564-2705) and did not have the risk variant (premean 3722 g, 95% CI 2949-4496; postmean 2071 g, 95% CI 1299-2843). Improvements in omega 3 fatty acid intakes were close to significant (MD=0.34 g; λ=0.926; F1,51=3.99; P=.051; η²=0.07). Pre/post differences related to Dietary Reference Intakes showed increases in the proportion of intervention participants within the acceptable macronutrient distribution ranges for fat (pre/post difference=41.2%; P=.02).

For self-efficacy and quality-of-life measures, there were significant group pre/post intervention differences for HRQoL scores only (MD=8.1 points; λ=0.914; F1,53=4.92; P=.03; η²=0.086).

Table 3. Pre- and postintervention comparisons of nutrient intakes, overall diet quality, Health-related Quality of Life Scores, and General Self-Efficacy scores.
Nutrient (units)Mean differenceWilks’ lambda (λ)F (df)aeta-squared (η²)P value

InterventionControl



Macronutrients and food components

Fat (% total calories)−5.1−2.90.81711.68 (1,53)0.183.001

Saturated fat (% total calories)−1.31.60.81611.71 (1,53)0.184.001

Omega 3 (gb)−0.40.41.0000.02 (1,53)0.000.88

Omega 3 (% total calories)0.10.30.9641.93 (1,53)0.036.17

Omega 6 (g)−2.2−3.40.68823.58 (1,53)0.312<.001

Omega 6 (% total calories)0.80.60.9085.26 (1,53)0.092.03

Sodium (mgc)−1537.9−398.60.8469.47 (1,53)0.150.003d

Sugar (g)1.8−0.10.9791.11 (1,53)0.021.30

Fiber (g)−1.2−1.20.0009.47 (1,53)0.000.99
Vitamins and minerals

Vitamin B6 (mg)−1.60.40.9890.58 (1,53)0.011.45

Vitamin B9 (mcg DFEe)−89.1−57.00.9502.72 (1,53)0.050.11

Vitamin B12 (mcgf)-0.4−1.70.8836.90 (1,53)0.117.011

Vitamin D (IUg)1.22.21.0000.01 (1,53)0.000.92

Calcium (mg)−176.7−121.90.8995.81 (1,53)0.101.02
Diet quality

Healthy Eating Index- Canadian26.56.90.65527.34 (1,53)0.345<.001d
Other outcomes

Health-related quality of life short form-87.05.30.9144.92 (1,53)0.086.03

General Self-Efficacy0.90.10.9750.01 (1,53)0.001.27

aExact statistic.

bg: gram.

cmg: milligram.

dSignificant interactions of time by groups.

eDFE: dietary folate equivalent.

fmcg: microgram.

gIU: international unit.

Figure 3. Time-by-group interactions for sodium and diet quality scores.
View this figure

Qualitative Analysis

On the basis of analysis of textual data from the Web-based questionnaires, the personal goals that participants set for themselves tended to be related to weight loss; reducing sugar, fat, and processed food intakes; and increasing consumption of fruits and vegetables. In total, 5 focus groups (with a range of 5 to 9 participants) were conducted that generated more than 36,000 words of textual data. From the analysis, 3 categories of feedback emerged: (1) interpretation of nutrition-related gene test information, (2) facilitation of eating behavior change, and 3) directives for personalized nutrition practice.

Category 1: Interpretation of Nutrition-Related Gene Test Information

Participants from both groups thought richly detailed reports containing their nutrition-related gene test results were valuable:

...I think this is hugely valuable I really like this and I think you know inflammation seems to be a very big problem for a lot of people that could definitely help you find the right proteins the right fits whatever it is that it's going to assist your body in lowering that level and the next one hopefully having less disease or less arthritis or issues.
I think it was the detail. I was like “Wow” because I am scrolling down and I am like there is more and more. And you know, kind of did a cursory look and then I started to look more and I was like “Wow” because you know it really gets into specifics.
I loved it. It's well designed and well-structured so it's pretty good. Color coding was really great and you can easily get it just by a glance and see exactly what you are looking at.

Both groups shared insights about challenges with interpreting their results. Some C-group participants (n=4; received report only) tried to find a practitioner to review the results, which lead to variable responses:

I tried to hire a dietitian or nutritionist and I told them I had the DNA results and I said, “Are you willing to look at them and making a meal plan?” And they both said no.
Umm well my first impression was that some of the recommendations seemed to be non specific to but I just filtered through those and focused in on the ones that I thought were those were clearly for me...
...there are ideas in there but I needed it to be spelled out and I was willing to pay someone but I just couldn't find anyone to do it who was willing. That's the only thing.
...they {results} also gave me an opportunity to sit down with my Dr and talked about what I’ve been feeling and what these results and let's play with this and so she thought this was awesome. She thought this was really good she said...She’s very innovative and forward thinking.
Category 2: Facilitation of Eating Behavior Change

The participants revealed different components of their diet they either felt motivated to act on or that they took action on, regardless of which group they were assigned to. They expressed that the tailoring of information specific to their individual circumstances was motivating:

I think it made me feel more empowered. You just have more information.
In the past, I would be making all my selections and choices based on the general knowledge of a good lifestyle but now I know more about me and so I make personal choices. Knowing more about yourself and your body and what choices you make would be beneficial for you and what would be the most useful.
...I increased my protein and tried to make sure to incorporate some protein every meal and instead of just going for a quick grab of carb stuff I'd made sure that there was a balance, there was a protein...
...orange vegetables too so I’m more conscious about going after those as well and processing of the proteins I’m consuming too...

For those in the I group, the addition of the personalized nutrition report and dietitian consult that included review of nutrient analysis information from food records was reported to be helpful in selecting dietary intake targets to change:

It's amazing that the information that [dietitian’s name] gave me just learned about different oils and how they interact...
...I think that having [dietitian’s name] discuss it hit home more and it makes me more conscious, more aware. Yeah it also helps your understanding level because sometimes you look at things and your brain doesn’t connect with it the same way as having [dietitian’s name] say “well if you did this or that” and then your brain goes “oh okay, I can get that” and then you commit to it better.
I think it was fantastic especially if you are doing a collaboration with someone you could physically talk to and it would be more meaningful...having somebody to actually talk to and work through it together and say, “Okay, what does this all mean?” or “How does this all look?” really validates and reinforces the information that is contained in the book.
I think it did some motivation for sure, but I am not going to say 100% because it's not like I changed my whole [lifestyle]. You know, I choose salad over my French fries most of the week...I wouldn't say it was the genetic report that made me change this all, but it was the food record that made me realize it was out of whack.
...I think the benefits personally to me it was also being able to sit down and talk to [dietitian’s name] yes in relation to the report...
I didn’t realize how many hidden fats I was eating with the curries and all that but writing it down on paper and then have to have a talk about it. And the recommendation try to replace the fats with proteins so I am more likely to reach for the nuts than anything else...
Category 3: Directives for Future Personalized Nutrition Practice

Consistent with previous literature [13-15], many participants stated factors such as cost and privacy concerns were potential barriers to having nutrition-related gene testing done. Others within the I group noted that ongoing reinforcement was particularly helpful to them when trying to take action on the results. Most participants in both the I and C groups discussed that the major nutrients and salt were their key targets as the advice was easy for them to remember and follow; food components that were frequently mentioned in the focus groups by both the I and C groups included fat, caffeine, and lactose. Many indicated that trying to translate gene-based micronutrient results and the associated food-based recommendations into their daily diet was much more difficult:

But it didn't kick in again when I got the reminder on the survey and because I felt lost when we were left on our own whether it was sticking to it or not...And then we got the reminder, oh yeah yeah yes I did oranges...So they kicked me back into action...
I knew the vitamins one was probably the least influential on me and of least interest to me because I couldn’t wrap my head around how much all of these different types of vitamins that I am consuming and whether or not if I truly understand what each one what it’s purpose is and how it serves me. So I probably spent the least amount of time trying to, you know, contemplate and reflect on those results.

Principal Findings

This study compared the effectiveness of standard and tailored gene-based personalized nutrition interventions in improving knowledge and motivation to change eating behavior, dietary intakes, and quality of life. A second objective was to elicit participant feedback from focus groups to better understand the quantitative findings. The results indicated that over a 9-week period, tailored interventions contributed to improved fat and sodium intakes, overall diet quality, and quality of life. In addition, the participants receiving these types of interventions typically indicated that they intended to make changes to their diet in the near future. When phenotypic plus genotypic information by group assignment was considered, improved total fat, saturated fat, and sodium intakes were found among those who possessed the risk genotype and received tailored dietary advice. Qualitative findings revealed that participants thought that the gene-based nutrition information motivated them to change eating behaviors. However, many indicated they found some of the information complicated, particularly the translation of micronutrient-based results and associated food-based recommended actions.

Results Compared With Existing Research Literature

This study’s findings were consistent with other investigations that showed greater improvements in diet quality after receiving personalized practitioner-facilitated nutrition interventions when compared with receiving a standard gene test report [16-19,44]. Our findings indicated that at 6 weeks postintervention, many participants indicated that the DNA information related to diet continued to motivate them and to take action on healthy eating. However, the proportion of individuals reporting this declined over the course of the study indicating that ongoing practitioner-led reinforcement may be more helpful in keeping participants focused on continued action to eat healthier. Similar to other studies, when genotypic and phenotypic information was considered by group assignment, significant positive differences in select nutrient intakes occurred [44]. These findings that demonstrate that the provision of nutrition-based genetic information improves dietary behaviors are practices that can facilitate eating behavior changes [45]; however, further research is needed to determine their generalizability to other populations and if the improvements are sustained long term.

The results that suggested receiving gene test results motivated participants to change their diet have also been reported in other studies [46]. In addition, the qualitative findings suggested that for many participants their main diet-related goal after receiving the results was weight management. Research suggests that motivation to positively change eating behaviors is also based on factors such as ethical concerns and mood. If a practitioner has previous knowledge of what people’s motives are, they can use this information combined with gene test results to develop appropriate goals and further inspire them to make positive dietary changes [19].

Based on the experience of other investigators [16-19], the direction in dietary changes in relation to the nutrition-based risk variant education provided was not always consistent, and in some instances, they were counterintuitive. An example of this included the significant declines in MDs of intake for calcium and vitamin B12. It is thought these decreases may have been because of reductions in intake of sources of saturated fat (eg, meat and milk-based products). Alternatively, as found in the Food4Me Study [18], if people were informed that they had the nonrisk version of the genotype, they may not be motivated to focus on the associated dietary component. The findings that showed declines in folate intake MDs are consistent with other findings, which suggest that regardless of whether one is told they do or do not have the risk version of the MTHFR 677CT gene, the information does not seem to translate into meaningful differences in folate intake measures [47]. On the basis of insights from our qualitative data, the variable findings among intakes of vitamin and mineral intakes may be because of a lack of understanding by the participant of their functions and relevance. Clearly, future work is needed to better understand how the presentation of information for different genotypes can be better used to improve a targeted eating behavior.

To the best of our knowledge, the findings that showed time-by-group interactions for sodium and overall diet quality have not been reported elsewhere. In particular, the I group had more pronounced reductions in dietary sodium intake compared with the C group. These results have implications for the prevention and treatment of hypertension, a condition that can be exacerbated by high sodium intakes and can progress to coronary heart disease in some individuals. Hypertension is becoming increasingly prevalent, affecting an estimated 1.13 billion people worldwide [48,49]. Hypertension and coronary heart disease are related to both genetic predisposition and environmental exposures such as an unhealthy diet. This study’s findings imply that tailored nutritional advisement could help prevent epigenetic changes that contribute to the development and progression of these chronic conditions. As a result, substantial savings in health care costs could be realized.

The findings that indicated that significantly greater improvements in quality-of-life measures occurred in the I group were novel. Although previous studies have shown relationships between poorer quality diet and worse quality of life [50], to the best of our knowledge, this is the first time this has been reported related to gene-based personalized nutrition interventions. We thought that GSE might play a role in this relationship; however, when we separately analyzed dietary quality as a dependent variable and quality-of-life scores as the independent variable and controlled for GSE, the findings were nonsignificant.

It was surprising that dietary improvements were not observed across all results where nutrition-related risk variants were present in the participants. The focus group data helped to provide insights about these findings by suggesting that although participants found the information useful, it was also overwhelming. As a result, they would try to simplify the implementation of their results by adjusting intakes of the major nutrients and sodium and pay less attention to the micronutrients-based gene information. However, in doing this, they may not be substantially improving the overall quality of their diet or meeting all of their micronutrient requirements. For the future, improved nutrition education strategies are needed that will facilitate the uptake of all recommended dietary changes that are based on gene test results.

Strengths and Limitations

This study’s strengths include its high retention rate, focus on a defined adult population, assessment of dietary intakes using FFQ estimates and 3-day food records to reduce misreporting error, and the provision of quantitative and qualitative data. However, this investigation could have been strengthened by including objective measures such as biochemical indicators of nutrient status. The modest sample size prevented stratification of results based on individual genes. Furthermore, given the composition of the sample was mainly female and Caucasian, the generalizability of the results is limited.

Implications and Conclusions

Providing participants with DNA information related to diet improved knowledge, motivation, and action related to healthy eating. However, tailored practitioner-led, gene-based personalized nutrition interventions tend to be more effective in improving dietary intakes of key target nutrients such as fat and sodium. Further work is needed to produce more comprehensive changes in dietary intakes that are based on gene test results. The study results will be leveraged to generate new, tailored, and digitally based nutrigenomics education tools that may help to advance gene-based personalized nutrition practice.

Acknowledgments

This study is funded by a Natural Sciences and Engineering Research Council of Canada Engage Grant (Grant #500692 – 16). The authors would like to acknowledge assistance from Charvi Gulati, Sydney Gloanec, and Breshna Saidiy during the focus group interviews and their assistance with nutrient analysis. KMD and VAA were partially supported by the Fulbright Program. RA was support by the Work Study Program.

Authors' Contributions

VAA drafted the manuscript and all other authors reviewed and provided feedback with each draft.

Conflicts of Interest

PL provides Web-based nutrigenomics education. No other conflicts of interest are declared.

Multimedia Appendix 1

Participant exclusion criteria.

DOC File, 30KB

Multimedia Appendix 2

Knowledge, attitudes, and behavior baseline to study completion. Stages of change: proportion who changed throughout the study.

DOC File, 100KB

Multimedia Appendix 3

CONSORT‐EHEALTH checklist (V 1.6.2).

PDF File (Adobe PDF File), 110KB

  1. Simopoulos AP. Nutrigenetics/Nutrigenomics. Annu Rev Public Health 2010;31:53-68. [CrossRef] [Medline]
  2. De Caterina R. Genetic and nutritional interactions in cardiovascular disease. World Rev Nutr Diet 2011;102:150-155. [CrossRef] [Medline]
  3. Tammen SA, Friso S, Choi S. Epigenetics: the link between nature and nurture. Mol Aspects Med 2013 Jul;34(4):753-764 [FREE Full text] [CrossRef] [Medline]
  4. Berná G, Oliveras-López MJ, Jurado-Ruíz E, Tejedo J, Bedoya F, Soria B, et al. Nutrigenetics and nutrigenomics insights into diabetes etiopathogenesis. Nutrients 2014 Nov 21;6(11):5338-5369 [FREE Full text] [CrossRef] [Medline]
  5. Mathers JC. Nutrigenomics in the modern era. Proc Nutr Soc 2017 Dec;76(3):265-275. [CrossRef] [Medline]
  6. El-Sohemy A, Cornelis MC, Kabagambe EK, Campos H. Coffee, CYP1A2 genotype and risk of myocardial infarction. Genes Nutr 2007 Oct;2(1):155-156 [FREE Full text] [CrossRef] [Medline]
  7. Palatini P, Ceolotto G, Ragazzo F, Dorigatti F, Saladini F, Papparella I, et al. CYP1A2 genotype modifies the association between coffee intake and the risk of hypertension. J Hypertens 2009 Aug;27(8):1594-1601. [CrossRef] [Medline]
  8. Solis C, Veenema K, Ivanov AA, Tran S, Li R, Wang W, et al. Folate intake at RDA levels is inadequate for Mexican American men with the methylenetetrahydrofolate reductase 677TT genotype. J Nutr 2008 Jan;138(1):67-72 [FREE Full text] [CrossRef] [Medline]
  9. Guinotte CL, Burns MG, Axume JA, Hata H, Urrutia TF, Alamilla A, et al. Methylenetetrahydrofolate reductase 677C-->T variant modulates folate status response to controlled folate intakes in young women. J Nutr 2003 May;133(5):1272-1280. [CrossRef] [Medline]
  10. Tsang BL, Devine OJ, Cordero AM, Marchetta CM, Mulinare J, Mersereau P, et al. Assessing the association between the methylenetetrahydrofolate reductase (MTHFR) 677C>T polymorphism and blood folate concentrations: a systematic review and meta-analysis of trials and observational studies. Am J Clin Nutr 2015 Jun;101(6):1286-1294. [CrossRef] [Medline]
  11. Ferguson JF, Phillips CM, McMonagle J, Pérez-Martínez P, Shaw DI, Lovegrove JA, et al. NOS3 gene polymorphisms are associated with risk markers of cardiovascular disease, and interact with omega-3 polyunsaturated fatty acids. Atherosclerosis 2010 Aug;211(2):539-544. [CrossRef] [Medline]
  12. Poch E, González D, Giner V, Bragulat E, Coca A, de La Sierra A. Molecular basis of salt sensitivity in human hypertension. Evaluation of renin-angiotensin-aldosterone system gene polymorphisms. Hypertension 2001 Nov;38(5):1204-1209. [Medline]
  13. Edwards KT, Huang CJ. Bridging the consumer-medical divide: how to regulate direct-to-consumer genetic testing. Hastings Cent Rep 2014 May;44(3):17-19. [CrossRef] [Medline]
  14. Covolo L, Rubinelli S, Ceretti E, Gelatti U. Internet-based direct-to-consumer genetic testing: a systematic review. J Med Internet Res 2015 Dec 14;17(12):e279 [FREE Full text] [CrossRef] [Medline]
  15. Goldsmith L, Jackson L, O'Connor A, Skirton H. Direct-to-consumer genomic testing from the perspective of the health professional: a systematic review of the literature. J Community Genet 2013 Apr;4(2):169-180 [FREE Full text] [CrossRef] [Medline]
  16. Nielsen DE, El-Sohemy A. Disclosure of genetic information and change in dietary intake: a randomized controlled trial. PLoS One 2014 Nov;9(11):e112665 [FREE Full text] [CrossRef] [Medline]
  17. Livingstone KM, Celis-Morales C, Navas-Carretero S, San-Cristobal R, Macready AL, Fallaize R, Food4Me Study. Effect of an internet-based, personalized nutrition randomized trial on dietary changes associated with the Mediterranean diet: the Food4Me Study. Am J Clin Nutr 2016 Aug;104(2):288-297 [FREE Full text] [CrossRef] [Medline]
  18. Fallaize R, Celis-Morales C, Macready AL, Marsaux CF, Forster H, O'Donovan C, Food4Me Study. The effect of the apolipoprotein E genotype on response to personalized dietary advice intervention: findings from the Food4Me randomized controlled trial. Am J Clin Nutr 2016 Sep;104(3):827-836. [CrossRef] [Medline]
  19. O'Donovan CB, Walsh MC, Gibney MJ, Brennan L, Gibney ER. Knowing your genes: does this impact behaviour change? Proc Nutr Soc 2017 Dec;76(3):182-191. [CrossRef] [Medline]
  20. Celis-Morales C, Marsaux CF, Livingstone KM, Navas-Carretero S, San-Cristobal R, Fallaize R, et al. Can genetic-based advice help you lose weight? Findings from the Food4Me European randomized controlled trial. Am J Clin Nutr 2017 May;105(5):1204-1213. [CrossRef] [Medline]
  21. Littlejohn P, Cop I, Brown E, Afroze R, Davison KM. Comparison of nutrigenomics technology interface tools for consumers and health professionals: protocol for a mixed-methods study. JMIR Res Protoc 2018 Jun 11;7(6):e115 [FREE Full text] [CrossRef] [Medline]
  22. Institute of Medicine. Dietary Reference Intakes: Applications in Dietary Assessment. Washington, USA: National Academies Press; 2001.
  23. Health Canada. Eating Well With Canada's Food Guide. Ottawa, Canada: Health Canada; 2007.
  24. British Columbia Government. British Columbia Nutrition Survey - Report on Food Group Use. Victoria, Canada: BC Ministry of Health Services; 2004.
  25. Grimaldi KA, van Ommen B, Ordovas JM, Parnell LD, Mathers JC, Bendik I, et al. Proposed guidelines to evaluate scientific validity and evidence for genotype-based dietary advice. Genes Nutr 2017 Dec;12:35 [FREE Full text] [CrossRef] [Medline]
  26. SurveyMonkey Inc. 2017.   URL: http://www.surveymonkey.com
  27. Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res 2004 Sep 29;6(3):e34 [FREE Full text] [CrossRef] [Medline]
  28. Health Canada. BC Nutrition Survey Training Manual. Ottawa, Canada: Health Canada; 1999.
  29. Garriguet D. Diet quality in Canada. Health Rep 2009 Sep;20(3):41-52 [FREE Full text] [Medline]
  30. Lowe MR. The effects of dieting on eating behavior: a three-factor model. Psychol Bull 1993 Jul;114(1):100-121. [Medline]
  31. Turner-Bowker DM, Bayliss MS, Ware JE, Kosinski M. Usefulness of the SF-8 Health Survey for comparing the impact of migraine and other conditions. Qual Life Res 2003 Dec;12(8):1003-1012. [Medline]
  32. Ware J, Kosinski M, Dewey J, Gandek B. How to Score and Interpret Single-Item Health Status Measures: A Manual for Users of the SF-8 Health Survey. Boston, USA: QualyMetric; 2001.
  33. Schwarzer R, Jerusalem M. Generalized Self-Efficacy Scale. In: Weinman J, Wright S, Johnston M, editors. Measures in health psychology: A User's Portfolio. Causal and Control Beliefs. Windsor, England: NFER-NELSON; 1995.
  34. Luszczynska A, Scholz U, Schwarzer R. The general self-efficacy scale: multicultural validation studies. J Psychol 2005 Sep;139(5):439-457. [CrossRef] [Medline]
  35. Prochaska JO, DiClemente CC. Stages of change in the modification of problem behaviors. Prog Behav Modif 1992;28:183-218. [Medline]
  36. Taylor HL, Jacobs DR, Schucker B, Knudsen J, Leon AS, Debacker G. A questionnaire for the assessment of leisure time physical activities. J Chronic Dis 1978;31(12):741-755. [Medline]
  37. Statistics Canada. Canadian Community Health Survey. Ottawa, Canada: Statistics Canada; 2010.   URL: http://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&Id=81424
  38. Yu L, Buysse DJ, Germain A, Moul DE, Stover A, Dodds NE, et al. Development of short forms from the PROMIS™ sleep disturbance and sleep-related impairment item banks. Behav Sleep Med 2011 Dec 28;10(1):6-24 [FREE Full text] [CrossRef] [Medline]
  39. ESHA Research: Food Labeling Software | Nutrition Analysis Software. Salem, OR: USAHA Research; 2017. Food Processor SQL   URL: https://www.esha.com/
  40. Health Canada. Canadian Nutrient File. Ottawa, Canada: Health Canada; 2016.
  41. Stata Corporation. Stata Statistical Software: Release 2. College Station, USA: Stata Corporation; 2011.
  42. NVivo qualitative data analysis software, Version 11. Victoria, Australia: QSR International Pty Ltd; 2015.   URL: https://www.qsrinternational.com/nvivo/nvivo-products
  43. Sandelowski M. Qualitative analysis: what it is and how to begin. Res Nurs Health 1995 Aug;18(4):371-375. [Medline]
  44. Forster H, Walsh MC, O'Donovan CB, Woolhead C, McGirr C, Daly EJ, et al. A dietary feedback system for the delivery of consistent personalized dietary advice in the web-based multicenter Food4Me study. J Med Internet Res 2016 Jun 30;18(6):e150 [FREE Full text] [CrossRef] [Medline]
  45. Marteau TM, French DP, Griffin SJ, Prevost AT, Sutton S, Watkinson C, et al. Effects of communicating DNA-based disease risk estimates on risk-reducing behaviours. Cochrane Database Syst Rev 2010 Oct 6(10):CD007275 [FREE Full text] [CrossRef] [Medline]
  46. Rankin A, Bunting BP, Poínhos R, van der Lans IA, Fischer AR, Kuznesof S, et al. Food choice motives, attitude towards and intention to adopt personalised nutrition. Public Health Nutr 2018 Oct;21(14):2606-2616. [CrossRef] [Medline]
  47. O'Donovan CB, Walsh MC, Forster H, Woolhead C, Celis-Morales C, Fallaize R, et al. The impact of 677C → T risk knowledge on changes in folate intake: findings from the Food4Me study. Genes Nutr 2016;11:25 [FREE Full text] [CrossRef] [Medline]
  48. NCD Risk Factor Collaboration (NCD-RisC). Worldwide trends in blood pressure from 1975 to 2015: a pooled analysis of 1479 population-based measurement studies with 19·1 million participants. Lancet 2017 Dec 7;389(10064):37-55 [FREE Full text] [CrossRef] [Medline]
  49. Global Health Observatory (GHO) data. Geneva, Switzerland: World Health Organization; 2015.   URL: http://www.who.int/gho/ncd/risk_factors/blood_pressure_prevalence/en
  50. Jing X, Chen J, Dong Y, Han D, Zhao H, Wang X, et al. Related factors of quality of life of type 2 diabetes patients: a systematic review and meta-analysis. Health Qual Life Outcomes 2018 Sep 19;16(1):189 [FREE Full text] [CrossRef] [Medline]


C: control group
DFE: dietary folate equivalent
FFQ: Food Frequency Questionnaire
GSE: General Self-Efficacy
I: intervention group
HEI-C: Healthy Eating Index–Canadian
HRQoL: health-related quality of life
MD: mean difference
NHP: natural health product
RD: registered dietitian


Edited by G Eysenbach; submitted 23.10.18; peer-reviewed by A Rankin, E Seto; comments to author 21.03.19; revised version received 05.05.19; accepted 05.05.19; published 28.06.19

Copyright

©Vanessa Araujo Almeida, Paula Littlejohn, Irene Cop, Erin Brown, Rimi Afroze, Karen M Davison. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 28.06.2019.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.