Original Paper
Abstract
Background: Emerging evidence suggests that people with arthritis are reporting increased physical pain and psychological distress during the COVID-19 pandemic. At the same time, Twitter’s daily usage has surged by 23% throughout the pandemic period, presenting a unique opportunity to assess the content and sentiment of tweets. Individuals with arthritis use Twitter to communicate with peers, and to receive up-to-date information from health professionals and services about novel therapies and management techniques.
Objective: The aim of this research was to identify proxy topics of importance for individuals with arthritis during the COVID-19 pandemic, and to explore the emotional context of tweets by people with arthritis during the early phase of the pandemic.
Methods: From March 20 to April 20, 2020, publicly available tweets posted in English and with hashtag combinations related to arthritis and COVID-19 were extracted retrospectively from Twitter. Content analysis was used to identify common themes within tweets, and sentiment analysis was used to examine positive and negative emotions in themes to understand the COVID-19 experiences of people with arthritis.
Results: In total, 149 tweets were analyzed. The majority of tweeters were female and were from the United States. Tweeters reported a range of arthritis conditions, including rheumatoid arthritis, systemic lupus erythematosus, and psoriatic arthritis. Seven themes were identified: health care experiences, personal stories, links to relevant blogs, discussion of arthritis-related symptoms, advice sharing, messages of positivity, and stay-at-home messaging. Sentiment analysis demonstrated marked anxiety around medication shortages, increased physical symptom burden, and strong desire for trustworthy information and emotional connection.
Conclusions: Tweets by people with arthritis highlight the multitude of concurrent concerns during the COVID-19 pandemic. Understanding these concerns, which include heightened physical and psychological symptoms in the context of treatment misinformation, may assist clinicians to provide person-centered care during this time of great health uncertainty.
doi:10.2196/24550
Keywords
Introduction
Social media contains a plethora of health information pertaining to individuals living with chronic illness [
, ]. Social media provides a unique opportunity to observe thoughts, feelings, and interactions between individuals living with chronic illness, and to leverage this information to promote positive health outcomes [ , ]. The COVID-19 pandemic has seen widespread uptake of social media use. Twitter, a well-known social media platform primarily used for microblogging, plays a significant role in crisis communications and can be a powerful tool to communicate to entire populations during a time of rapid change [ ]. Twitter is already frequently used by individuals with arthritis to communicate with peers [ ] and to receive up-to-date information from health professionals and services about novel therapies and management techniques [ ].Many inflammatory arthritis medications act as immunosuppressants, which are advantageous in controlling arthritis-mediated inflammatory responses, but can increase the risk of infection [
]. Long-term use of immune-modulating therapies or glucocorticoids may place individuals with arthritis in a higher-risk category for contracting the novel coronavirus SARS-CoV-2, although the level of risk is poorly understood [ - ]. Current guidelines suggest that individuals living with arthritis should physically distance from other individuals and their communities [ ], and will likely need to do so for a longer duration than the general public. Heightened stress due to potential medication shortages, reduced opportunities to personally consult health care professionals, and enforced limitations on physical activity (which, for many, is a core component of arthritis self-management [ ]) contribute to worsening arthritis symptoms, including disease flares. At present, individuals with arthritis have already reported increased physical pain and psychological distress during the COVID-19 pandemic [ , ].In the current COVID-19 outbreak, Twitter’s overall daily usage has surged by 23% in 2020 [
], presenting a unique opportunity to assess the content and sentiment of tweets. Examining publicly available tweets allows exploration of important proxy topics through microblogging data, without directly burdening this population. This research aims to identify proxy topics of importance for people with arthritis (of any diagnostic category) during the COVID-19 pandemic by characterizing the textual content and sentiment of tweets, and to explore the emotional context of tweets by people with arthritis during the early phase of the pandemic.Methods
Design
An exploratory content and sentiment analysis was undertaken. All data were collected and reported according to the terms and conditions of Twitter, which state that content posted by individuals is publicly available to syndicate, broadcast, distribute, retweet, promote, or publish, excluding private information (eg, home addresses or identity documents) [
]. Use of tweets by individuals outside of Twitter can be carried out with no compensation paid to the individual tweeter, as use of Twitter is agreed upon as sufficient compensation [ ]. The Monash University Human Research Ethics Committee (Project ID 24354) approved this project.Inclusion and Exclusion Criteria
Publicly available tweets posted in English or with English translation (automated through Twitter), with the hashtags shown in
were included.Topic | Hashtag |
COVID-19 |
|
Arthritis |
|
Hashtags were selected based on trialing various combinations through Twitter’s search function. The highest number of tweets retrieved were for the hashtags #coronavirus, #covid19, #arthritis, and #spoonie (the latter term coined by people living with chronic illness to describe various methods of pain management [
]). Hashtags were also searched as words; for example, where #arthritis was searched, arthritis without a hashtag was searched as well. This ensured that specific arthritis types mentioned in tweets without hashtags (eg, rheumatoid arthritis or psoriatic arthritis) were included. Hashtags and words were combined through the advanced search function on Twitter using the domains Hashtags, Words, Language, and Dates ( [ ]). Tweets were excluded if they originated from organizations, news outlets, or health professionals rather than individuals in order to focus on the personal perspective.Data Collection
Tweets were retrospectively extracted from March 20 to April 20, 2020. The search strategy and search results are included in
. The search timeframe was chosen to align with the early phase of the COVID-19 pandemic and the period when many developed countries (eg, the United States, the United Kingdom, Italy, Australia) announced enforceable physical distancing or isolation measures [ - ]. The desktop version of the Twitter website (versus the mobile app) was used for data collection for ethical purposes with only publicly available tweets extracted, rather than through a private login. In addition to the tweets themselves, accompanying data fields were extracted from each tweet using a customized template. Extracted data fields included (where possible): Twitter profile blurb, gender of tweeter, country of tweeter, number of likes, number of retweets, number of replies, hashtags used, number of hashtags, and use of accompanying photos. Data were stored in a Microsoft Excel spreadsheet (v16.0, Microsoft Corp).Data Analysis
To address the research aims, two data analysis techniques were utilized: summative content analysis and sentiment analysis. Content analysis was used to characterize the textual contents of tweets related to arthritis and COVID-19. Content analysis is exploratory; it aims to quantify and describe unknown phenomena [
]. During the content analysis process, the primary researcher (DB) read each tweet and categorized the tweets into a representative theme and subtheme related to a topic of importance for people with arthritis during the study period.Summative content analysis occurred through a process of coding, which involved counting and comparisons of Twitter content, followed by interpretation of the underlying context [
]. To begin with, the first 10 tweets were analyzed and allocated a summary code. The code represents the theme of a tweet (eg, “health care experiences”). As additional tweets were examined, they were given one of the original codes or allocated a new code based on new content. This process was repeated until each tweet was coded and themed. Once these original themes were finalized, they were recoded for additional context, and a second researcher (DA) checked the coding. For example, “health care experiences” was coded for similarities in people’s health care experiences, such as difficulties accessing medications. Given Twitter’s character limits, each tweet only contained one theme. The frequency of original themes and subthemes was counted to indicate importance [ ].Sentiment analysis enables an examination of written and spoken words for positive and/or negative emotion. When applied to health care or social media research, sentiment analysis facilitates interpretation of textual information about patient experience from a person-centered perspective [
]. Once tweets were coded and categorized into themes, sentiment analysis was employed to assess the emotion associated with the theme using Glaser and Strauss’s [ ] 6 codes for sentiment analysis, a common framework used for Twitter-based research [ , ]:- No sentiment: the tweet has no emotion or words or special punctuation; is matter-of-fact sounding;
- Wretched: the tweet is purely negative;
- Bad: the tweet contains mainly negative phrases and words that outweigh any positive sentiment;
- So-so: the tweet has a mediocre and balanced sentiment where positive and negative statements are balanced;
- Swell: the tweet contains mainly positive phrases and words which outweigh negative sentiment;
- Great: the tweet is purely positive.
The presence of emojis, which are shorthand facial expression symbols that are frequently used to facilitate communication of mood and emotion, in tweets were also analyzed. To provide information regarding the emotional content of the tweets, Emoji Sentiment Ranking, as outlined by Kralj Novak et al [
], was applied. Tweets containing an emoji were categorized into one of three sentiment scores: (1) negative, (2) neutral, and (3) positive. Together, the content and sentiment analyses provide a proxy indicator of the topics of interest for, and perceived emotions of, people with arthritis during the COVID-19 pandemic.Even in social media studies, it is imperative to protect participant anonymity [
]. To avoid reverse identification of participants based on their tweets (which can be found through internet searches), tweets analyzed in this study are not quoted verbatim. Instead, all data are expressed in aggregate form through descriptive statistics and qualitative syntheses.Results
The analysis included 149 tweets posted during the study period. The majority of tweeters were female and based in the United States. The most common arthritis type was rheumatoid arthritis.
outlines gender, country of residence, and arthritis type.Characteristic | Users (N=149), n (%) | |
Gender | ||
Female | 105 (70.0) | |
Male | 31 (21.0) | |
Unknown | 13 (9.0) | |
Country | ||
United States | 68 (45.5) | |
United Kingdom and Northern Ireland | 39 (26) | |
Canada | 18 (12.0) | |
Australia | 1 (0.7) | |
France | 1 (0.7) | |
Germany | 1 (0.7) | |
India | 1 (0.7) | |
New Zealand | 1 (0.7) | |
Unknown | 19 (13.0) | |
Diagnostic category | ||
Arthritis (specific arthritis type unclear) | 86 (58.0) | |
Rheumatoid arthritis | 32 (21.0) | |
Systemic lupus erythematosus | 12 (8.0) | |
Psoriatic arthritis | 10 (7.0) | |
Ankylosing spondylitis | 3 (2.0) | |
Osteoarthritis | 3 (2.0) | |
Juvenile idiopathic arthritis | 3 (2.0) |
Content analysis revealed seven themes from the tweets: (1) health care experiences, (2) personal stories, (3) links to or advertisements of relevant blogs, (4) discussion of arthritis-related symptoms, (5) advice sharing, (6) messages of positivity, and (7) stay-at-home messaging.
details the original themes and subthemes.Theme and subthemes | Tweets, n (%) | Examples of phrases or #hashtags describing content | |
Health care experiences | 55 (37.0) |
| |
Difficulties accessing hydroxychloroquine | 20 (36.5) | ||
Past experiences using hydroxychloroquine | 20 (36.5) | ||
Support for President Trump’s advice to use hydroxychloroquine to cure COVID-19 | 9 (16.0) | ||
Experiences within the National Health Service (UK NHS) | 4 (7.0) | ||
Managing medication changes during COVID-19 | 2 (4.0) | ||
Personal stories | 29 (20.0) |
| |
Explanation of history of managing arthritis, and subsequent fears of contracting or dying from COVID-19 | 9 (31.0) | ||
Description of ways to self-manage physical symptoms (eg, exercising, staying connected with friends) | 7 (24.0) | ||
Physical and psychological challenges of socially distancing | 7 (24.0) | ||
Perceived barriers to attending rheumatologist appointments (eg, discomfort of wearing masks, fear of entering a high-risk location) | 6 (21.0) | ||
Links to or advertisements of relevant blogs and forums | 22 (14.0) |
| |
Recommendations and links from individuals to official patient- and consumer-led blogs (eg, CreakyJoints) | 10 (45.0) | ||
Personal blogs on individual COVID-19 experiences (eg, how to manage worsening symptoms) | 7 (32.0) | ||
Unofficial patient blogs (eg, online communities and forums) to create support networks for individuals | 5 (23.0) | ||
Discussion of arthritis-related symptoms | 15 (10.0) |
| |
Increased physical pain | 11 (73.5) | ||
Difficulty sleeping | 2 (13.5) | ||
Reduced dexterity | 2 (13.5) | ||
Advice seeking and sharing | 14 (9.0) |
| |
Questions directed at government bodies (eg, the NHS and national working-from-home regulations) | 5 (36.0) | ||
Seeking advice from physiotherapists on at-home exercises to manage physical symptom burden | 3 (22.0) | ||
Advice on whether to temporarily cease taking immunosuppressant medications | 2 (14.0) | ||
Advice on how to protect airways if dexterity limitations prevent mask-wearing | 2 (14.0) | ||
Questions directed to delivery services regarding delays | 2 (14.0) | ||
Messages of positivity | 8 (6.0) |
| |
Gratitude for friends, family, and to still be able to appreciate life | 4 (50.0) | ||
Spare time as a result of physical distancing facilitating more time to exercise and reduce physical symptom burden | 4 (50.0) | ||
Stay-at-home messaging | 6 (4.0) |
| |
Emotional appeals for people to stay at home | 4 (67.0) | ||
Angry appeals for people to stay at home | 2 (33.0) |
The most common theme identified was experiences of navigating the health care system during the COVID-19 pandemic. Hydroxychloroquine (brand name Plaquenil) featured prominently in tweets, in terms of difficulties accessing the medication, past experiences using the medication, and recommendations from the President of the United States to use this medication to cure or prevent COVID-19, despite the lack of evidence or medical advice. Some individuals tweeted about their experiences within the National Health Service (NHS) in the United Kingdom, where patients were subject to longer-than-usual delays for rheumatology appointments, medication infusions, and general health check-ups.
Many individuals used Twitter as a platform to connect with and seek support from peers with arthritis. Tweets contained personal stories, links to personal and consumer-led blogs, discussion of arthritis-related symptoms, and advice seeking and sharing. Some individuals shared their challenges managing arthritis symptoms whilst being confined to their homes and questioned their physical and psychological capacity to function if they were to contract COVID-19. Others described the physical and emotional challenges associated with isolation, including increased physical pain, reduced dexterity, and missing family. Strategies to manage these symptoms included exercising and staying socially connected online with friends to ease mental strain. Tweeters were willing to guide others to potentially helpful resources, particularly blogs run by professional organizations (eg, CreakyJoints, the Arthritis Society [Canada]). Several tweets contained questions were directed toward government bodies (eg, regarding national working-from-home policies), whereas others reached out to physiotherapists or peers with arthritis for advice on appropriate exercises or lifestyle modifications to manage symptom burden during the isolation period. Some tweeters noted dexterity limitations that were highly relevant to COVID-19, such as being incapable of placing a mask behind their ears.
Some tweets were positive with tweeters noting they used their newfound spare time to concentrate on exercise, which was beneficial for mental health and pain reduction. Finally, some individuals expressed their desire for people to stay at home to flatten the curve of infections to return to normal life. Disapproval was voiced toward those refusing to practice physical distancing, whereas others expressed anger toward people not adhering to stay-at-home orders.
Sentiment analysis provided complementary information about the emotions associated with the content analysis themes.
details the original themes and corresponding sentiment, with phrases or hashtags describing tweeters’ personal experiences.Original theme and sentimenta | Tweets, n (%) | Examples of phrases or #hashtags | |
Health care experiences | 55 (37.0) | ||
Great | 5 (9.0) | “doddle,” “virus gone in 3 days,” “NO SIDE EFFECTS,” “credible and good” | |
Swell | 3 (5.0) | “thankful,” “it must be working,” “don’t be afraid” | |
So-so | 8 (15.0) | “hope it helps,” “minimal risk,” “might work,” #BeWarnedBeWell, “it might fight COVID-19,” “take care world!” “interesting to see” | |
Bad | 6 (11.0) | #plaquenilshortage,” “no tests will be done for 2 months,” “facing shortages,” “no proof #Hydroxychloroquine makes us safe” | |
Wretched | 28 (51.0) | “seriously ill,” “madness,” “pissed off,” #coronavirushoax, #painsomnia, “f*ck all chance,” “made me sick,” “I could die,” “harmful results,” “side effects unbearable,” “I call bullsh*t,” “[medication] shortages & living with symptoms,” #EVIL!!, “shorten my life,” “life threatening for us,” “true danger,” “scared,” “fear a shortage,” #drugshortage, “will end up in hospital,” “write us all off,” “it made me so sick,” “NO real testing,” “it’s not safe” | |
No sentiment | 5 (9.0) | “research says,” “UK government wants,” “prove hypothesis,” “IL-6 is raised,” “from the CDC” | |
Personal stories | 29 (20.0) | ||
Great | 5 (17.0) | “all good during this #covid19,” “it makes me feel better on a personal level,” “bring it on world,” “I am a champion!” #livingmybestlife | |
Swell | 5 (17.0) | #AloneTogether, #nevergiveup, #hope, #makethebestofit, “trying to keep active” | |
So-so | 3 (10.0) | “it is what it is,” “I hope they have a lot of masks and sanitizer!” | |
Bad | 2 (7.5) | “I didn’t want to risk heading out,” “limiting my usual walk” | |
Wretched | 12 (41.0) | “give us a break, FFS!” #HighRiskCovid19, “I hate #Coronavirus,” “literally a pain,” “holy sh*t,” “screaming into the void,” “I am not #expendable,” “being told to go to a germy hospital,” “my chances of surviving #covid19 are horrible,” “vulnerable patients like me” | |
No sentiment | 2 (7.5) | “info is changing daily,” “I’m immunocompromised because” | |
Links to or advertisements of relevant blogs and forums | 22 (14.0) | ||
Great | 1 (5.0) | “so grateful” | |
Swell | 2 (9.0) | “talking about work/life balance,” “we are here for you” | |
So-so | 4 (18.0) | “coping in isolation,” “trying to deal,” “hoping to support others” | |
Bad | 2 (9.0) | “how to handle flares,” “learn what’s happening to people with arthritis” | |
Wretched | 4 (18.0) | “covid19 scariness,” “fear of dying,” “unpredictability and fear,” “we worry about everyone” | |
No sentiment | 9 (41.0) | “video games during covid19,” “questions I have,” “share with your networks,” “breaking news,” “please consider sharing,” “please retweet,” “I found this information” | |
Discussion of arthritis-related symptoms | 15 (10.0) | ||
Great | 0 (0.0) | —b | |
Swell | 0 (0.0) | — | |
So-so | 1 (7.0) | “not the end of the world” | |
Bad | 1 (7.0) | “I have to take a break” | |
Wretched | 13 (86.0) | “struggling to sleep/be active,” “spoonie fail,” “the arthritis flared out of control,” “my shoulder is a casualty,” “pain in the knees,” “I’m screwed,” “ouchy grouchy,” “feet are burning,” “f*ck you coronavirus,” “worsening arthritis pain,” “I’m already achy,” “flaring due to extra phone use” | |
No sentiment | 0 (0.0) | — | |
Advice seeking | 14 (9.0) | ||
Great | 0 (0.0) | — | |
Swell | 1 (7.0) | “thanks to the doctors for their expertise” | |
So-so | 0 (0.0) | — | |
Bad | 1 (7.0) | “some chance of developing complications” | |
Wretched | 8 (57) | “lowered immunity more than it already is,” “significantly increase risk of infection,” “things have been rough,” “zero immune system,” “so stressed about #coronavirus,” “no money for food let alone masks,” “I’m disabled” | |
No sentiment | 4 (29.0) | “grateful for info,” “where can I volunteer to get tested,” #lockdownUK, “would appreciate a video of exercises for in #lockdown” | |
Messages of positivity | 8 (6.0) | ||
Great | 2 (25.0) | “coronavirus caused some good things to happen,” “amazing how motivating boredom is” | |
Swell | 3 (37.5) | #selfmanagement, “right exercises to keep arthritis at bay,” “enjoy the little things” | |
So-so | 1 (12.5) | “life is too short to be scared” | |
Bad | 1 (12.5) | “keeping positive a challenge” | |
Wretched | 0 (0.0) | — | |
No sentiment | 1 (12.5) | “this information might help” | |
Stay-at home-messaging | 6 (4.0) | ||
Great | 0 (0.0) | — | |
Swell | 0 (0.0) | — | |
So-so | 0 (0.0) | — | |
Bad | 0 (0.0) | — | |
Wretched | 5 (83.0) | “#selfisolation only because of my immune system,” #arthritissucks so stay the f*ck home,” “coronavirus could kill me #StayHomeSaveLives,” “#PLEASESTAYHOME I’m devastated,” “arthritis shot to sh*t stay home” | |
No sentiment | 1 (17.0) | #GoHomeStayHome |
aGreat: the tweet is purely positive; swell: the tweet contains mainly positive phrases and words that outweigh negative sentiment; so-so: the tweet has a mediocre and balanced sentiment where positive and negative statements are balanced; bad: the tweet contains mainly negative phrases and words that outweigh any positive sentiment; wretched: the tweet is purely negative; no sentiment: the tweet has no emotion or words or special punctuation and is matter-of-fact sounding.
bNot available.
A few tweets contained messages of positivity. While overall “keeping positive [was] a challenge,” some people encouraged others to “enjoy the little things” and that “life is too short to be scared.” Still, the extent to which people with arthritis were concerned for their health was evident in people’s stay-at-home messaging. Tweeters were notably anxious and angry, writing that “#arthritissucks so stay the f*ck home,” that “coronavirus could kill me #StayHomeSaveLives,” and “#PLEASESTAYHOME I’m devastated.”
Using Glaser and Strauss’s [
] classifications, more than half of the tweets contained wretched (purely negative) or bad (mainly negative) sentiment (n=83, 56%), whereas only one-fifth of tweets contained great (purely positive) or swell (mainly positive) sentiment (n=27, 18%). In total, 16 (11%) tweets contained sentiment that was so-so (balanced negativity and positivity), and 22 (15%) tweets contained no sentiment (matter-of-fact sounding).Individuals in the United States appeared particularly despondent regarding their health care experiences during the COVID-19 pandemic. When referencing interactions with the health care system, tweets contained phrases such as “true danger,” “seriously pissed off,” and “scared.” Tweeters noted “it’s not safe” for people with arthritis facing hydroxychloroquine shortages, and that the #drugshortage was “life threatening.” Some individuals mused that there is “minimal risk” trying hydroxychloroquine to cure COVID-19, and that it might be “interesting to see” the results of this medication. Outside of the United States, Canadians tweeted that engaging with the health care system during the pandemic was a “doddle” and that they were “thankful” to continue to have access to their health professionals.
Many individuals described their personal stories negatively. People with arthritis discussed barriers to accessing care, such as being surprised at “being told to go to a germy hospital” and that they “didn’t want to risk going out.” Tweets with links to blogs were accompanied by captions “fear of dying,” “unpredictability and fear,” and “we worry about everyone.” Some were more positive, encouraging followers that they are “hoping to support others.” Although their representation was small, people with arthritis in Ireland and New Zealand viewed the isolation measures as an opportunity for #hope, encouraging others to #makethebestofit and to #nevergiveup.
A consistent sentiment was that people with arthritis were negative in their discussion of physical and psychological symptoms, with many individuals seeking advice from peers and health professionals to remedy symptoms. Tweets highlighted the spectrum of symptoms that individuals experienced during the pandemic, with people “struggling to sleep/be active,” experiencing “worsening arthritis pain,” and having “pain in the knees.” Some noted that attempting to manage physical symptoms while in isolation was “literally a pain” and that the psychological toll was like “screaming into the void.” One tweeter mentioned that their arthritis was “flaring due to extra phone use,” which was frustrating since this was a primary method of maintaining social connection and communication with family or colleagues during the pandemic. Similarly, individuals tweeting and asking for advice did so by prefacing that “things have been rough,” that they have “zero immune system,” and that they are “so stressed about #coronavirus.”
Our sentiment analysis included an overview of emoji use in tweets, as summarized in
.Emojia | Count, n | Emoji name | Phrases or #hashtags accompanying the emoji | Emotion | Link to original themes |
3 | Face with no good gesture | “my feet are burning,” things are very painful,” “my chances of surviving are horrible” | Negative | Discussion of arthritis-related symptoms, personal stories | |
2 | Clapping hands sign | “my team have worked so hard,” “massive thanks” | Positive | Links to or advertisements of relevant blogs and forums, advice seeking | |
2 | Smiling face with smiley eyes | “hope it helps all” | Positive | Health care experiences | |
2 | Confused face | “I might be screwed,” “I think my consultant is wrong” | Negative | Health care experiences, discussion of arthritis-related symptoms | |
2 | Person with folded hands | #lupuswarrior | Positive | Personal stories, health care experiences | |
2 | Red heart suit | “hoping to support others,” #BeSafe | Positive | Links to or advertisements of relevant blogs and forums | |
2 | Purple heart | “choose to spread awareness” | Positive | Personal stories | |
1 | Crying face | “#coronavirus has opened my eyes” | Neutral | Health care experiences | |
1 | Smirking face | “#makingthebestofit | Positive | Personal stories | |
1 | Fisted hand sign | “I’ve got a morphine patch on to help” | Positive | Personal stories | |
1 | Face with tears of joy | “happy sitting in the sun” | Positive | Messages of positivity | |
1 | Leaves fluttering in the wind | “I’m laying outside” | Positive | Personal stories | |
1 | Face with mouth open | “could potentially lead to the cure for #Coronavirus” | Positive | Health care experiences | |
1 | Winking face | “I made healthy Easter treats in self islation” | Positive | Personal stories | |
1 | Pill | “I really miss anti-inflammatories” | Negative | Stay-at-home messaging | |
1 | Front-facing baby chick | #livingmybestlife | Positive | Personal stories | |
1 each | See-no-evil monkey, speak-no-evil monkey, hear-no-evil monkey, monkey, monkey face | “my rheumatologist said I wasn’t at high risk” | Positive | Health care experiences |
aEmoji Sentiment Ranking did not include the upside-down face, the spectacle face, or the high-five emoji. There was one of each included in our data collection.
The emoji within tweets established tone and emphasized emotions. Most tweets used an emoji to express positive sentiment, such as clapping hands to thank colleagues for their support and a person with folded hands in acknowledgment of the personal commitment to the ongoing management of arthritis symptoms in isolation. The main emoji used to express negative sentiment were the face with “no good” gesture, and the confused face. Tweeters used the face with “no good” gesture to highlight their physical pain, and the confused face was used to express confusion around what arthritis patients perceived to be ill-informed health advice during the pandemic.
Discussion
Principal Findings
This study aimed to identify proxy topics of importance for people with arthritis during COVID-19 by characterizing the textual content and sentiment of tweets, and exploring the emotional context of tweets by people with arthritis during the early phase of the pandemic. We anticipated that this novel approach would ascertain contemporary topics of importance for immunocompromised and isolated individuals. Content analysis revealed seven themes relating to health care experiences, and sentiment analysis revealed that the majority of tweets contained negative emotion, particularly around medication shortages, increased arthritis symptoms, and the physical and mental toll of physical distancing or living in isolation. Our findings provide a starting point for understanding the impacts of COVID-19 on vulnerable arthritis populations and provide some insights for physicians and researchers regarding current concerns that may inform tailored care.
More than one-third of tweets discussed health care experiences, primarily focusing on the reduced availability of hydroxychloroquine. Individuals were highly anxious about hydroxychloroquine shortages after preliminary research found that the drug might act as a potential preventive measure, or possible cure, for COVID-19 and these early findings were highly publicized around the world. The original published article has since been retracted after researchers were unable to verify the reliability of their results [
]. Regardless, President Trump tweeted his support for hydroxychloroquine as “one of the biggest game changers in the history of medicine” [ ], causing panic about medication shortages, particularly from those with systemic lupus erythematosus for which it is the first-line therapy [ ]. Due to off-label prescriptions and hoarding practices, difficulties accessing hydroxychloroquine have been reported globally [ ]. Hydroxychloroquine shortages pose a threat to the health and safety of people with inflammatory arthritis, with reports that many will experience flare-ups and may develop irreversible organ damage without their regular dose [ ]. Our findings highlight the need for accurate information about treatments and their effectiveness and the critical role that clinicians play in dispelling myths and inaccuracies during times of rapidly changing information. A growing body of literature describes the potential benefits of using Twitter in clinical settings, and reports ways that clinicians are using platforms such as Twitter to communicate health information to the broader population [ - ]. In the context of infectious diseases in particular, evidence suggests that Twitter is beneficial to translate real-time clinical information [ , ]. Use of Twitter, being a component of mobile health (mHealth), also empowers patients to more positively perceive their abilities to manage chronic illness [ ]. This presents an opportunity for clinicians and professional societies to use social media platforms such as Twitter to overcome evidence dissemination methods (eg, peer-reviewed articles and care guidelines) that are traditionally slow. Together, clinicians and patients can contribute to care in adults with arthritis, encouraging positive health outcomes throughout, and beyond, the pandemic.Several tweets contained very personal narratives that highlighted individual fears of contracting COVID-19, and the challenges associated with being vulnerable to infection. Individuals described perceived barriers to accessing care, citing discomfort caused by wearing medical-grade personal protective equipment. Tweets contained accounts of neck pain attributed to wearing a mask; a documented side effect in other vulnerable populations [
]. Fitting a mask is also a dexterous task that some people with arthritis struggled to perform, and as a result, encountered abuse from others when buying groceries or going for a walk. The long-term psychosocial impact of this stigma should receive consideration in future research. Clinicians should consider COVID-19–related functional concerns for physically impaired patients, and incorporate new aspects of information-seeking into clinical consultations. For example, asking patients about their degree of difficulty with COVID-19–related functional tasks would help to elicit relevant functional challenges faced by people with arthritis and inform the provision of tailored patient education. Asking these questions also contributes to factors beyond patient education and care, such as facilitating access to nonacute symptom or pain management services such as allied health. These health services still need to be maintained during and after the pandemic, and for musculoskeletal health in particular, there is emerging commentary around the physical and psychosocial impacts of inhibited access [ , ].Tweets detailed marked increases in general physical symptom burden; a concerning prospect as COVID-19 has impacted face to face consultations, with indications that disruptions to traditional service models will likely persist for some time. Evidence about the utility of telemedicine to manage pain is emerging, with consideration of barriers to implementation, and potential inequity in access [
], although health systems have been generally slow to implement this approach at scale. While the included tweets provide preliminary information about the growing symptom burden during the pandemic, the collection of systematic patient-reported outcomes data is needed to ensure that health care services are meeting the needs of people with arthritis during and after the COVID-19 pandemic.A proportion of tweets related to social connection, that is, people reaching out to likeminded peers with arthritis through potentially informative blogs. Most links provided were to official (eg, CreakyJoints) or unofficial (eg, online communities and forums) blogs and provided information on how to manage physical and mental health in isolation, a range of arthritis-appropriate exercises, and existing evidence on the association between arthritis and risk of COVID-19 infection. Access to resources that are relevant, credible, and trustworthy appears to have been challenging for people with arthritis throughout the pandemic [
], and combined with high levels of misinformation online [ , ], this may account for the recent growth of platforms such as Twitter for sourcing information and advice.Before the COVID-19 pandemic, people with arthritis primarily used social media for self-expression and positive messaging [
, ]. Our sentiment analysis (enhanced by classifying emojis to further characterize common emotions) demonstrates that the role of Twitter has evolved throughout the current pandemic to act as a space for people to share symptoms; to reach out to peers, organizations, and health professionals for information; and to create a sympathetic community of care. This is advantageous as it fosters connection between individuals with shared experiences but conversely may enable proliferation of misinformation [ ]. Already, Twitter has been shown to inform clinical practice by capturing the experiences of patients with multiple sclerosis during the pandemic [ ]. Understanding the COVID-19–related concerns of people with arthritis is also key to providing person-centered care and reducing distress during these rapidly changing times.Strengths and Limitations
The observational exploratory nature of this study enabled us to examine topics of importance for individuals with arthritis through a person-centered lens, without ethical issues or compromising the well-being of immunocompromised patients during the pandemic. Social media research is still in its infancy, and this novel method of data collection demonstrates the concerns of people with arthritis during a time of peak anxiety. There is some indication that tweeters were representative of the general inflammatory arthritis population; the majority were female and the most common arthritis type identified was rheumatoid arthritis. Nearly half (44.0%) of tweeters were based in the United States, which currently leads the world in COVID-19 cases and deaths [
].We also acknowledge the research limitations. It is important to note that only 15% of adults regularly use Twitter, and that younger adults and minority communities tend to be more highly represented on Twitter than the general population [
], although minority communities have been significantly impacted by COVID-19 [ , ]. Our results should therefore be interpreted as representing a small subset of people with arthritis, and not all people with the disease. Data were extracted rather than collected directly from people with arthritis and critics of social media research purport that posts or tweets are often curated and may not be reflective of reality. We have attempted to minimize this potential bias by conducting sentiment analysis, which helped us determine the emotional tone associated with Twitter content. Regardless, sentiment analysis has its limitations: populations and individuals are constantly stimulated by their political and socioeconomic surroundings and individual demographics, which can influence the content and sentiment of people’s tweets [ , ]. We also recognize the potential limitations of our search strategy (eg, we did not search for hashtags related to specific symptoms, such as pain or function, that are not unique to arthritis) that may have impacted the number of retrieved tweets. While we had a modest sample size of tweets due to our focused study aims, sentiment analysis has previously been conducted in studies with comparable sample sizes of tweets (n=260 and n=200) [ , ]. We were unable to determine the specific diagnostic category for over half the people tweeting; while a small number of tweets were from people with osteoarthritis, it is possible that more may be represented within the “diagnosis not specified” category. We were only able to analyze tweets in English, and these largely came from high-income, developed countries. Tweets in other languages and those from people in low-and-middle income countries may provide further insights, especially where the prevalence of COVID-19 infection is high [ ].Conclusion
This study highlights the spectrum of concerns facing people with arthritis during the COVID-19 pandemic. By exploring the content and sentiment of recent tweets, we found that individuals with arthritis conditions experience marked anxiety about medication shortages and increased physical symptom burden, and are seeking connection with and information from peers. These findings can be used to raise awareness of key issues relevant to people with arthritis during the pandemic, and to guide clinicians to tailor care that addresses the specific concerns and needs of their patients during the pandemic.
Acknowledgments
DB received a PhD scholarship from Musculoskeletal Australia to conduct this research [PURE ID #230581862]. INA is supported by a Victorian Health and Medical Research Fellowship from the Victorian Government.
Conflicts of Interest
None declared.
Twitter search strategy and results.
DOCX File , 15 KBReferences
- Hamm MP, Chisholm A, Shulhan J, Milne A, Scott SD, Given LM, et al. Social media use among patients and caregivers: a scoping review. BMJ Open 2013 May 09;3(5):e002819 [FREE Full text] [CrossRef] [Medline]
- Zhao Y, Zhang J. Consumer health information seeking in social media: a literature review. Health Info Libr J 2017 Dec 17;34(4):268-283. [CrossRef] [Medline]
- Merolli M, Gray K, Martin-Sanchez F. Health outcomes and related effects of using social media in chronic disease management: a literature review and analysis of affordances. J Biomed Inform 2013 Dec;46(6):957-969 [FREE Full text] [CrossRef] [Medline]
- Santoro E, Castelnuovo G, Zoppis I, Mauri G, Sicurello F. Social media and mobile applications in chronic disease prevention and management. Front Psychol 2015 May 07;6:567 [FREE Full text] [CrossRef] [Medline]
- Eriksson M, Olsson E. Facebook and Twitter in Crisis Communication: A Comparative Study of Crisis Communication Professionals and Citizens. J Contingencies & Crisis Man 2016 Jun 13;24(4):198-208. [CrossRef]
- Curtis JR, Chen L, Higginbotham P, Nowell WB, Gal-Levy R, Willig J, et al. Social media for arthritis-related comparative effectiveness and safety research and the impact of direct-to-consumer advertising. Arthritis Res Ther 2017 Mar 07;19(1):48 [FREE Full text] [CrossRef] [Medline]
- Kloth YM, Deutsch KM, Danielson KA, Strack J, Law C. What Twitter teaches us about patient-provider communication on pain. PLoS One 2019 Dec 26;14(12):e0226321 [FREE Full text] [CrossRef] [Medline]
- Caporali R, Caprioli M, Bobbio-Pallavicini F, Montecucco C. DMARDS and infections in rheumatoid arthritis. Autoimmun Rev 2008 Dec;8(2):139-143. [CrossRef] [Medline]
- Coronavirus (COVID-19) advice for people with chronic conditions. Australian Government. 2020. URL: https://www.health.gov.au/news/health-alerts/novel-coronavirus-2019-ncov-health-alert/advice-for-people-at-risk-of-coronavirus-covid-19/coronavirus-covid-19-advice-for-people-with-chronic-health-conditions [accessed 2020-09-10]
- Fredi M, Cavazzana I, Moschetti L, Andreoli L, Franceschini F, Airò P, et al. COVID-19 in patients with rheumatic diseases in northern Italy: a single-centre observational and case–control study. The Lancet Rheumatology 2020 Sep;2(9):e549-e556. [CrossRef]
- Zhong J, Shen G, Yang H, Huang A, Chen X, Dong L, et al. COVID-19 in patients with rheumatic disease in Hubei province, China: a multicentre retrospective observational study. The Lancet Rheumatology 2020 Sep;2(9):e557-e564. [CrossRef]
- Gianfrancesco M, Hyrich KL, Al-Adely S, Carmona L, Danila MI, Gossec L, COVID-19 Global Rheumatology Alliance. Characteristics associated with hospitalisation for COVID-19 in people with rheumatic disease: data from the COVID-19 Global Rheumatology Alliance physician-reported registry. Ann Rheum Dis 2020 Jul 12;79(7):859-866 [FREE Full text] [CrossRef] [Medline]
- UPDATED: Advice regarding Coronavirus (COVID-19) from the Australian Rheumatology Association. Arthritis Australia. 2020. URL: https://arthritisaustralia.com.au/advice-regarding-coronavirus-covid-19-from-the-australian-rheumatology-association/ [accessed 2020-09-10]
- Décary S, Barton JL, Proulx L, Richards DP, Paterson G, de Wit M, et al. How to Effectively Support Patients with Rheumatic Conditions Now and Beyond COVID-19. ACR Open Rheumatol 2020 Sep 28;2(9):505-506 [FREE Full text] [CrossRef] [Medline]
- Michaud K, Wipfler K, Shaw Y, Simon TA, Cornish A, England BR, et al. Experiences of Patients With Rheumatic Diseases in the United States During Early Days of the COVID-19 Pandemic. ACR Open Rheumatol 2020 Jun 09;2(6):335-343 [FREE Full text] [CrossRef] [Medline]
- Mobasheri A. COVID-19, osteoarthritis and women's health. Case Reports in Women's Health 2020 Jul;27:e00207. [CrossRef]
- Gadde V, Derella M. An update on our continuity strategy during COVID-19. Twitter. 2020. URL: https://blog.twitter.com/en_us/topics/company/2020/An-update-on-our-continuity-strategy-during-COVID-19.html [accessed 2020-09-10]
- Terms of Service. Twitter. 2020. URL: https://twitter.com/en/tos [accessed 2020-09-10]
- Advanced search function [image]. Twitter. URL: https://twitter.com/search-advanced?lang=en [accessed 2020-09-10]
- Staying at home and away from others (social distancing). Gov.UK. 2020. URL: https://www.gov.uk/government/publications/full-guidance-on-staying-at-home-and-away-from-others [accessed 2020-09-10]
- Update on Coronavirus Measures. Prime Minister of Australia. 2020. URL: https://www.pm.gov.au/media/update-coronavirus-measures-24-March-2020 [accessed 2020-09-10]
- Vinceti M, Filippini T, Rothman KJ, Ferrari F, Goffi A, Maffeis G, et al. Lockdown timing and efficacy in controlling COVID-19 using mobile phone tracking. EClinicalMedicine 2020 Aug;25:100457 [FREE Full text] [CrossRef] [Medline]
- Zhang R, Li Y, Zhang AL, Wang Y, Molina MJ. Identifying airborne transmission as the dominant route for the spread of COVID-19. Proc Natl Acad Sci U S A 2020 Jun 30;117(26):14857-14863 [FREE Full text] [CrossRef] [Medline]
- Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nurs Health Sci 2013 Sep 11;15(3):398-405. [CrossRef] [Medline]
- Hsieh H, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005 Nov;15(9):1277-1288. [CrossRef] [Medline]
- Briggs A, Houlding E, Hinman R, Desmond L, Bennell K, Darlow B, et al. Health professionals and students encounter multi-level barriers to implementing high-value osteoarthritis care: a multi-national study. Osteoarthritis Cartilage 2019 May;27(5):788-804. [CrossRef] [Medline]
- Greaves F, Ramirez-Cano D, Millett C, Darzi A, Donaldson L. Use of sentiment analysis for capturing patient experience from free-text comments posted online. J Med Internet Res 2013 Nov 01;15(11):e239 [FREE Full text] [CrossRef] [Medline]
- Glaser B, Strauss A. The Discovery of Grounded Theory: Strategies for Qualitative Research. London and New York: Routledge Taylor & Francis Group; 1967.
- Jansen BJ, Zhang M, Sobel K, Chowdury A. Twitter power: Tweets as electronic word of mouth. J Am Soc Inf Sci 2009 Nov;60(11):2169-2188. [CrossRef]
- Williams SA, Terras MM, Warwick C. What do people study when they study Twitter? Classifying Twitter related academic papers. Journal of Documentation 2013 May 10;69(3):384-410. [CrossRef]
- Kralj Novak P, Smailović J, Sluban B, Mozetič I. Sentiment of Emojis. PLoS One 2015 Dec 7;10(12):e0144296 [FREE Full text] [CrossRef] [Medline]
- Ayers JW, Caputi TL, Nebeker C, Dredze M. Don't quote me: reverse identification of research participants in social media studies. NPJ Digit Med 2018 Aug 2;1(1):30 [FREE Full text] [CrossRef] [Medline]
- Mehra MR, Desai SS, Ruschitzka F, Patel AN. RETRACTED: Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis. The Lancet 2020 May. [CrossRef]
- @realDonaldTrump. Twitter. 2020 Mar 22. URL: https://twitter.com/realDonaldTrump/status/1241367239900778501 [accessed 2020-09-10]
- Mehta B, Salmon J, Ibrahim S. Potential Shortages of Hydroxychloroquine for Patients with Lupus During the Coronavirus Disease 2019 Pandemic. JAMA Health Forum 2020 Apr 10;1(4):e200438. [CrossRef]
- Choo EK, Rajkumar SV. Medication Shortages During the COVID-19 Crisis: What We Must Do. Mayo Clin Proc 2020 Jun;95(6):1112-1115 [FREE Full text] [CrossRef] [Medline]
- Pershad Y, Hangge P, Albadawi H, Oklu R. Social Medicine: Twitter in Healthcare. J Clin Med 2018 May 28;7(6):121 [FREE Full text] [CrossRef] [Medline]
- Hawn C. Take Two Aspirin And Tweet Me In The Morning: How Twitter, Facebook, And Other Social Media Are Reshaping Health Care. Health Affairs 2009 Mar;28(2):361-368. [CrossRef]
- Cifu AS, Vandross AL, Prasad V. Case Reports in the Age of Twitter. Am J Med 2019 Oct;132(10):e725-e726. [CrossRef] [Medline]
- Goff DA, Kullar R, Newland JG. Review of Twitter for infectious diseases clinicians: useful or a waste of time? Clin Infect Dis 2015 May 15;60(10):1533-1540. [CrossRef] [Medline]
- Ghosh P, Schwartz G, Narouze S. Twitter as a powerful tool for communication between pain physicians during COVID-19 pandemic. Reg Anesth Pain Med 2020 Apr 21. [CrossRef] [Medline]
- Slater H, Campbell JM, Stinson JN, Burley MM, Briggs AM. End User and Implementer Experiences of mHealth Technologies for Noncommunicable Chronic Disease Management in Young Adults: Systematic Review. J Med Internet Res 2017 Dec 12;19(12):e406 [FREE Full text] [CrossRef] [Medline]
- Ong JJ, Bharatendu C, Goh Y, Tang JZ, Sooi KW, Tan YL, et al. Headaches Associated With Personal Protective Equipment - A Cross-Sectional Study Among Frontline Healthcare Workers During COVID-19. Headache 2020 May 12;60(5):864-877. [CrossRef] [Medline]
- Karos K, McParland JL, Bunzli S, Devan H, Hirsh A, Kapos FP, et al. The social threats of COVID-19 for people with chronic pain. Pain 2020 Oct 13;161(10):2229-2235 [FREE Full text] [CrossRef] [Medline]
- Nestola T, Orlandini L, Beard JR, Cesari M. COVID-19 and Intrinsic Capacity. J Nutr Health Aging 2020 May 28;24(7):692-695. [CrossRef] [Medline]
- Eccleston C, Blyth FM, Dear BF, Fisher EA, Keefe FJ, Lynch ME, et al. Managing patients with chronic pain during the COVID-19 outbreak: considerations for the rapid introduction of remotely supported (eHealth) pain management services. Pain 2020 May;161(5):889-893 [FREE Full text] [CrossRef] [Medline]
- Duron G, Gelman L, Dua A, Putman M. Tracking clinical resources for coronavirus disease 2019. Curr Opin Rheumatol 2020 Sep;32(5):441-448. [CrossRef] [Medline]
- Li HO, Bailey A, Huynh D, Chan J. YouTube as a source of information on COVID-19: a pandemic of misinformation? BMJ Glob Health 2020 May 14;5(5):e002604 [FREE Full text] [CrossRef] [Medline]
- Erku DA, Belachew SA, Abrha S, Sinnollareddy M, Thomas J, Steadman KJ, et al. When fear and misinformation go viral: Pharmacists' role in deterring medication misinformation during the 'infodemic' surrounding COVID-19. Res Social Adm Pharm 2020 May 01 [FREE Full text] [CrossRef] [Medline]
- Modica R, Lomax KG, Batzel P, Cassanas A. OARRR 2018 Jun;Volume 10:73-81. [CrossRef]
- des Bordes JKA, Foreman J, Westrich-Robertson T, Lopez-Olivo MA, Peterson SK, Hofstetter C, et al. Interactions and perceptions of patients with rheumatoid arthritis participating in an online support group. Clin Rheumatol 2020 Jun 31;39(6):1775-1782. [CrossRef] [Medline]
- Malecki K, Keating J, Safdar N. Crisis Communication and Public Perception of COVID-19 Risk in the Era of Social Media. Clin Infect Dis 2020 Jun 16:2020 [FREE Full text] [CrossRef] [Medline]
- Nesbitt C, Rath L, Yeh WZ, Zhong M, Wesselingh R, Monif M, et al. MSCOVID19: Using social media to achieve rapid dissemination of health information. Mult Scler Relat Disord 2020 Oct;45:102338. [CrossRef] [Medline]
- Schneider EC. Failing the Test — The Tragic Data Gap Undermining the U.S. Pandemic Response. N Engl J Med 2020 Jul 23;383(4):299-302. [CrossRef]
- Smith A, Brenner R. Twitter Use 2012. Pew Research Center Internet & Technology. 2012 May 31. URL: https://www.pewresearch.org/internet/2012/05/31/twitter-use-2012/ [accessed 2020-09-10]
- Clark E, Fredricks K, Woc-Colburn L, Bottazzi ME, Weatherhead J. Disproportionate impact of the COVID-19 pandemic on immigrant communities in the United States. PLoS Negl Trop Dis 2020 Jul 13;14(7):e0008484 [FREE Full text] [CrossRef] [Medline]
- Pan D, Sze S, Minhas JS, Bangash MN, Pareek N, Divall P, et al. The impact of ethnicity on clinical outcomes in COVID-19: A systematic review. EClinicalMedicine 2020 Jun;23:100404 [FREE Full text] [CrossRef] [Medline]
- Padilla JJ, Kavak H, Lynch CJ, Gore RJ, Diallo SY. Temporal and spatiotemporal investigation of tourist attraction visit sentiment on Twitter. PLoS One 2018 Jun 14;13(6):e0198857 [FREE Full text] [CrossRef] [Medline]
- Gore RJ, Diallo S, Padilla J. You Are What You Tweet: Connecting the Geographic Variation in America's Obesity Rate to Twitter Content. PLoS One 2015 Sep 2;10(9):e0133505 [FREE Full text] [CrossRef] [Medline]
- Nemes L, Kiss A. Social media sentiment analysis based on COVID-19. Journal of Information and Telecommunication 2020 Jul 14:1-15. [CrossRef]
- Clyne W, Pezaro S, Deeny K, Kneafsey R. Using Social Media to Generate and Collect Primary Data: The #ShowsWorkplaceCompassion Twitter Research Campaign. JMIR Public Health Surveill 2018 Apr 23;4(2):e41 [FREE Full text] [CrossRef] [Medline]
- Walker P, Whittaker C, Watson OJ, Baguelin M, Winskill P, Hamlet A, et al. The impact of COVID-19 and strategies for mitigation and suppression in low- and middle-income countries. Science 2020 Jul 24;369(6502):413-422 [FREE Full text] [CrossRef] [Medline]
Abbreviations
mHealth: mobile health |
NHS: National Health Service |
Edited by G Eysenbach; submitted 24.09.20; peer-reviewed by R Safari, R Gore; comments to author 09.10.20; revised version received 26.10.20; accepted 28.10.20; published 03.12.20
Copyright©Danielle Berkovic, Ilana Ackerman, Andrew M Briggs, Darshini Ayton. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 03.12.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.