This paper is in the following e-collection/theme issue:

Recruitment of Research Participants (296)

Published on in Vol 21, No 11 (2019): November

Cost Per Participant Recruited From Rural and Remote Areas Into a Smoking Cessation Trial Via Online or Traditional Strategies: Observational Study

Cost Per Participant Recruited From Rural and Remote Areas Into a Smoking Cessation Trial Via Online or Traditional Strategies: Observational Study

Cost Per Participant Recruited From Rural and Remote Areas Into a Smoking Cessation Trial Via Online or Traditional Strategies: Observational Study

Authors of this article:

Judith Byaruhanga1, 2 Author Orcid Image ;   Flora Tzelepis1, 2, 3 Author Orcid Image ;   Christine Paul1, 3 Author Orcid Image ;   John Wiggers1, 2, 3 Author Orcid Image ;   Emma Byrnes1, 3 Author Orcid Image ;   Christophe Lecathelinais2 Author Orcid Image
Article Authors Cited by (17) Tweetations (7) Metrics

    Original Paper

    1University of Newcastle, Callaghan, Australia

    2Hunter New England Population Health, Wallsend, Australia

    3Hunter Medical Research Institute, New Lambton Heights, Australia

    Corresponding Author:

    Judith Byaruhanga, MPH

    University of Newcastle

    University Drive

    Callaghan, 2308

    Australia

    Phone: 61 2 4924 6454

    Email: judith.byaruhanga@uon.edu.au


    Background: Rural and remote residents are more likely to smoke than those who live in major cities; however, recruitment of research participants from rural and remote areas can be challenging. The cost per participant recruited from rural and remote areas via online (eg, social media) and traditional strategies (eg, print) has implications for researchers on how to allocate resources to maximize the number of participants recruited. Participant characteristics such as demographics, financial stress, mental health, and smoking-related factors may be associated with recruitment method (ie, online vs traditional), and so it is important to understand whether certain subgroups are more likely to be recruited via a particular strategy.

    Objective: This study aimed to determine the cost per participant recruited and examine whether characteristics such as demographics, financial stress, mental health, and smoking-related factors may be associated with the recruitment method (ie, online vs traditional).

    Methods: Participants were recruited into a randomized trial that provided smoking cessation support. Eligible participants were aged 18 years or older; used tobacco daily; had access to video communication software, internet, and telephone; had an email address; and lived in a rural or remote area of New South Wales, Australia. This study describes the natural (observed) experience of recruiting participants via online and traditional methods into a smoking cessation trial.

    Results: Over 17 months, 655 participants were recruited into the smoking cessation trial. A total of 88.7% (581/655) of the participants were recruited via online methods. Moreover, 1.8% (12/655) of the participants were recruited from remote locations and none from very remote areas. The cost per participant recruited by the various online strategies ranged from Aus $7.29 (US $4.96, £4.09, and €4.43) for Gumtree, a local online classified website, to Aus $128.67 (US $87.63, £72.20, and €78.28) for email. The cost per participant recruited using traditional strategies ranged from Aus $0 (US $0, £0, and €0) for word of mouth to Aus $3990.84 (US $2757.67, £2227.85, and €2477.11) for telephone. Women had greater odds of being recruited via online methods than men (odds ratio 2.50, 95% CI 1.42-4.40). No other characteristics were associated with the recruitment method.

    Conclusions: The cost per participant recruited via online and traditional strategies varied, with the range being smaller for online than traditional recruitment strategies. Women have greater odds of being recruited via online strategies into rural smoking cessation trials.

    Trial Registration: Australian New Zealand Clinical Trials Registry ACTRN12617000514303; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372584&isReview=true

    J Med Internet Res 2019;21(11):e14911

    doi:10.2196/14911

    Keywords

    smoking cessation; tobacco use; rural population 


    Tobacco Use in Rural Population

    In high-income countries such as Australia [1] and the United States [2], people who live in rural and remote areas have been identified as a priority population for smoking cessation interventions. Research has found that factors such as lower income [3], lower education levels [4], and fewer substance abuse treatment facilities [4,5] contribute to higher rates of tobacco use in rural areas, and rural residents are more likely to smoke tobacco than their counterparts who live in major cities [4]. Rural and remote locations comprise all areas outside major cities [1,4]. In the United States, the smoking prevalence is 24.9% in rural areas [6] compared with 20.8% of US adults in the general population [7]. In Australia, those in remote and very remote areas are 1.7 times more likely to smoke than those in major cities [8]. In Australia, the smoking rate is 12.8% [9] in the general population compared with 22% [10] among those living in regional and remote areas. There is, therefore, a need for tobacco control research to focus on such high-risk populations; however, recruitment of research participants who live in rural or remote locations for smoking cessation interventions can be challenging [11]. Several factors such as large geographical areas, limited resources, and transport barriers contribute to the difficulty of recruiting participants from these locations [12].

    Recruitment Methods

    Timely recruitment of participants is a very important aspect of large research studies [13] because delays in recruitment may increase financial costs [14], reduce the sample size obtained, and limit the study’s robustness through inadequate statistical power [15,16], resulting in the reduced possibility of detecting a statistically significant result when there is a true difference between treatments [17]. Researchers conducting trials, therefore, often explore several avenues to recruit participants ranging from online to traditional methods. Traditional recruitment approaches that have been used include print (eg, direct mail, newspapers, posters, and flyers), broadcast advertising (eg, radio and television advertisements) [18], and word of mouth. Online methods such as social media (eg, Facebook and Twitter) [19,20], online advertisements (eg, Google advertisements), email, and other website promotions have also been used to recruit participants into research [21-23]. The potential reach of online recruitment strategies makes them appealing for recruiting participants into smoking cessation programs [23-25] and smoking cessation trials [26-29]. For example, in 2018, there were 3.9 billion internet users [30], and in 2016 to 2017, 86% of all households in Australia had access to the internet [31]. Specifically, 82.7% of those living in inner regional locations of Australia have internet access at home, as do 80.7% in outer regional locations and 77.1% in remote areas [31].

    There is also evidence that online recruitment strategies are able to recruit participants with different demographic characteristics to those recruited via traditional recruitment methods [26-28,32,33]. Google advertisements, links on websites [27], and Facebook advertising are significantly more likely to recruit smokers aged between 18 and 25 years [32] or find a 7-year age difference between traditional and online recruitment [26]. In contrast, participants recruited by traditional methods such as newspapers, flyers, radio, and word of mouth in another smoking cessation trial were older and more confident in their quit attempts compared with those recruited via online methods [28]. Furthermore, people with depression have been found to be more likely to use the internet for health purposes [34,35], and social media users are more likely to have mental health conditions [36]. Financial stress, defined as “the difficulty that an individual or household may have in meeting basic financial commitments due to a shortage of money” [37], may also affect whether people have access to the internet and online advertisements; however, no research has examined whether financial stress is associated with recruitment strategy (ie, online vs traditional).

    Cost of Recruitment

    Traditional and online recruitment strategies have been found to be cost effective [26,28,29,38]. For example, in 2016, an Australian study reported that the cost of an enrolled participant into a smoking cessation trial was Aus $56.34 (US $38.93, £31.43, and €34.95) for online (social media) and Aus $52.33 (US $36.13, £29.20, and €32.46) for traditional recruitment strategies [28]. In another Australian smoking cessation trial, the cost of online social media recruitment was Aus $42.34 (US $29.24, £23.63, and €26.27) per participant enrolled and Aus $21.52 (US $14.86, £12.01, and €13.35) per participant for traditional recruitment strategies [26]. Furthermore, a US study with young adult smokers used Facebook and spent up to US $10 (£8.08 and €8.98) in 2014 for each participant recruited into the smoking cessation trial [38]. Similarly, in a study conducted in the United States using other online strategies but not Facebook (ie, an online health risk assessment [HRA], online advertisements, traditional material [offline promotions], and quit-line screening), young adult smokers were recruited for US $41.35 (£33.41 and €37.10) for each enrolled smoker [29]. Online materials recruited the most smokers (online advertisements: n=1426; US $41.35) for the lowest cost in comparison with the other 3 recruitment strategies (HRA: n=397, US $630.85; quit-line screening: n=189, US $133.61; and offline materials: n=1341, US $56.23) [29]. This cost information has also been presented as a table in Multimedia Appendix 1. The existing research on the cost of recruiting smokers into research trials and characteristics of participants recruited by online versus traditional methods has focused on the general population [26-29] and suggests that online recruitment is a feasible method that can complement traditional recruitment strategies [26,28].

    Objectives

    To our knowledge, no studies have compared the cost per participant recruited and subgroups of smokers from rural and remote locations recruited using online and traditional strategies into a smoking cessation trial. Therefore, this study described the different methods used for recruitment of smokers from rural and remote areas and aimed to (1) determine the cost per participant recruited for each recruitment strategy and (2) examine whether demographic characteristics, financial stress, mental health, and smoking-related characteristics of the participants were associated with the type of recruitment method (ie, online vs traditional).


    Design

    This study used the baseline survey of a smoking cessation trial that assessed how participants were recruited into the study (ie, via online or traditional strategies). Participants were recruited to take part in a 3-arm randomized trial of behavioral support for smoking cessation [39]. The 3 arms of the trial provided (1) real-time video counseling delivered via video communication software (eg, Skype (Microsoft Corporation) and FaceTime (Apple Inc), (2) telephone counseling, or (3) written self-help materials (control) [39]. The University of Newcastle Human Research Ethics Committee granted ethics approval. The trial is prospectively registered with the Australian New Zealand Clinical Trials Registry (ACTRN12617000514303).

    Participants

    Participants were recruited over a 17-month period from May 25, 2017, to October 2, 2018. To be eligible for the trial, smokers needed to be aged 18 years or older; use tobacco daily; have access to a mode of video communication (eg, Skype and FaceTime), the internet, and a telephone; have a current email address; and reside in an inner or outer regional, remote, or very remote area of New South Wales (NSW) Australia. The classification of these areas was based on the Accessibility and Remoteness Index of Australia (ARIA+) [40]. The ARIA+ is a geographic accessibility index that reflects the ease or difficulty people face in accessing services in nonmetropolitan Australia based on residential postcode [40]. The different degrees of rurality are established on road distances needed to be traveled from the location to service centers of various population sizes. The resulting index of geographic accessibility classification is then used to categorize locations as inner regional (>0.2 to ≤2.4), outer regional (>2.4 to ≤5.92), remote (>5.92 to 10.53), and very remote (>10.53) areas [40].

    Recruitment

    Both traditional and online advertising methods were used concurrently to recruit participants. The success of the recruitment approaches was monitored on an ongoing basis, and recruitment resources were allocated to each method based on participant numbers recruited by each method throughout the recruitment period.

    Online Recruitment Strategies

    For all the online strategies, there were advertisements throughout the entire recruitment period of May 2017 to October 2018.

    Facebook

    All Facebook advertisements targeted only adults in rural and remote postcodes that were eligible for this study as classified by the ARIA+. A total of 41 paid advertisements were placed on Facebook as needed to boost the recruitment rate with a fixed daily budget limit of Aus $30 to Aus $100 (US $20.73-US $69.10). Unpaid Facebook promotions were posted on a daily basis to more than 1161 Facebook community boards.

    Twitter

    A total of 38 Twitter posts were made from the study twitter account and used to promote the research project using the hashtag quit smoking (#quitsmoking).

    Emails to Businesses and Individuals

    A total of 11,858 emails obtained from a business directory and partners in health services, such as local health districts, were sent out to corporate businesses, health organizations, mining companies, local area businesses, and trades people located in the eligible areas.

    Gumtree

    A total of 9 advertisements were placed on Gumtree, a local free online classified website, in postcodes that were eligible, and these remained on the website for the entire recruitment period.

    Web Promotions and Internet Search

    A study website was set up at the beginning of the study to promote the study and was active for the entire study period. The website was visible to anyone that searched online search engines for smoking cessation information and was cited on all print and online study advertising material.

    Traditional Recruitment Strategies

    Newspaper

    The newspaper recruitment strategy was used from August 2017 to September 2018 with a total of 51 different rural and remote newspapers. Two sizes of paid advertisements were used (92×63 mm or 100×72 mm) and were placed in the middle section of the newspaper. There were 44 free newspaper articles and 7 paid newspaper advertisements in different rural and remote newspapers. The free articles were written by journalists together with the research team to promote the research.

    Posters

    In total, 68 Men’s Sheds located in rural and remote NSW were telephoned in October 2017 and asked to display a poster promoting the study on their premises. Of these, 10 premises indicated that they were willing to do so, and a colored poster was distributed to them. In May 2017, posters were sent to 28 gyms, 21 Police-Citizens Youth clubs, 5 dental centers, 2 pharmacies, 2 hairdressers, 1 laundry shop, and 1 restaurant. Given the geographic diversity of locations, the study team did not visit these sites to verify if in fact the posters were displayed.

    Flyers

    A total of 2400 flyers were distributed. Flyers were printed in color on 1 side of an A4 paper and trifolded. A total of 19,00 flyers were placed into residential mailboxes in inner and outer regional locations of NSW in June, July, November, and December 2017, and 500 flyers were distributed to attendees at a rural conference in September 2018.

    Radio

    A total of 6 live radio interviews on different radio stations targeting rural and remote areas were conducted in July, August, September, and November 2017 and September 2018. The interviews promoted the smoking cessation trial, including information about the study and how to enroll into the study.

    Telephone Calls

    Telephone calls were made to 2465 households (2284 landlines and 181 mobiles) from an unlisted landline between June 2017 and September 2018. A single call was made to these households to determine if there was a potentially eligible participant and, if so, whether they would be interested in enrolling into the study.

    Magazine

    A single, colored advertisement, 136×61 mm in size, that promoted the study was placed in the middle section of a rural magazine in April 2017.

    Data Collection Procedures

    All the advertising materials promoted the study website. Potential participants could click on (for online) or type (for traditional) the study website address to access information about the smoking cessation trial. The study website included a detailed information letter that described the research, outlined the importance of the study, informed who was eligible to participate, and contained a hyperlink that potential participants could select to complete the online screening survey. The screening survey computer software determined whether eligibility requirements were met, and if participants were eligible, they were immediately redirected to the online baseline survey. The baseline survey took about 10 to 15 min to complete.

    Measures

    Recruitment Method

    To determine whether participants were recruited via an online or traditional strategy, each participant was asked how they heard about the study during the baseline survey. The response options were as follows: Facebook advertisement or page, Twitter, Gumtree, Google advertisements, Web promotions (eg, study promoted on websites), Instagram, email, posters, flyers, postcards, magazine, newspaper, television, radio, word of mouth, telephone, or other (please specify).

    Sociodemographic Characteristics

    The baseline survey assessed sociodemographic characteristics including age, gender, country of birth, Aboriginal or Torres Strait Islander origin, education, marital status, and occupational status.

    Geographical Location

    The participant’s residential postcode collected during the baseline survey was used to determine location of residence (ie, inner regional, outer regional, remote, or very remote) according to the ARIA+ [40]. ARIA+ is a geographic accessibility index that reflects the ease or difficulty people face in accessing services. It is based on road distances needed to be traveled from the location to service centers of various population sizes from a point to the nearest urban centers and localities in 5 separate population ranges [40]. The classification comprises major cities, inner regional Australia, outer regional Australia, remote Australia, and very remote Australia [40].

    Mental Health

    Anxiety and depression were assessed using the 4-item Patient Health Questionnaire-4 (PHQ-4). The PHQ-4 is a reliable and valid measure of depression and anxiety in the general population [41]. The participants were asked, over the last 2 weeks, how often they had been bothered by the following: (1) feeling nervous, anxious, or on edge; (2) not being able to stop or control worrying, (3) little interest or pleasure in doing things, and (4) feeling down, depressed, or hopeless. The response options were as follows: not at all, several days, more than half the days, or nearly every day.

    Financial Stress

    Financial stress was assessed by asking if in the past 6 months, the participant did any of the following because of a shortage of money: (1) could not pay electricity, gas, or telephone bills on time; (2) could not pay the mortgage or rent on time; (3) pawned or sold something; (4) went without meals; (5) was unable to heat home; (6) asked for financial help from friends or family; and (7) asked for help from a welfare or community organization. The response options were yes or no [42].

    Quitting Intentions

    Participants were asked what best described their intentions regarding quitting. The response options were as follows: will quit in the next 30 days, will quit in the next 6 months, may quit in the future but not in the next 6 months, never expect to quit, and do not know.

    Nicotine Dependence

    The Heaviness of Smoking Index (HSI), which comprises 2 questions (time to first cigarette of day and number of cigarettes per day), was used to assess nicotine dependence [43]. The HSI was used rather than the Fagerstrom Test for Nicotine Dependence [44] because it has fewer items and it has been found to have acceptable reliability and validity [45].

    Confidence to Quit

    Confidence to quit was assessed by asking “if you decided to give up smoking altogether, how likely do you think you would be to succeed?” The response options were as follows: (1) very likely, (2) fairly likely, (3) fairly unlikely, (4) very unlikely, and (5) do not know.

    Statistical Analysis

    Statistical analyses were completed using SAS software version 9.3 (SAS Institute Inc). Categorical measures were described using frequencies and percentages. For continuous measures, means, medians, and standard deviations were reported. To assess the relationship between variables of interest and recruitment strategy, a multiple logistic regression model was run, which included the recruitment strategy as the dependent outcome and the following as independent variables: sociodemographic characteristics, mental health measures, financial stress, and smoking-related variables. Odds ratios (ORs) and 95% CIs were reported. A criterion for statistical significance of P<.05 was used.

    Cost Analysis

    All monetary costs were recorded directly from invoices as they were incurred. Costs associated with each recruitment strategy were tracked and summarized. The traditional recruitment costs included staff time for telephone calls; preparing materials; delivering radio interviews; liaising with newspaper journalists; dropping materials into mailboxes; printing and postage of materials; and costs for paid newspaper advertisements, magazine advertisements, and resources (eg, printing materials). The costs associated with the online strategies included staff time to send emails; posting advertisements on Facebook, Twitter, and Gumtree; setting up the study website, and the cost of paid Facebook advertisements. The cost per participant recruited was calculated by summing the total cost for each recruitment strategy and dividing it by the number of participants recruited via that strategy.


    Participant Characteristics

    Between May 25, 2017, and October 2, 2018, 655 participants were enrolled in the study. Moreover, 77.4% (507/655) of the participants were female, 87.0% (570/655) were Australian born, and 40.3% (264/655) had completed a certificate or diploma from a Technical and Further Education campus, which provided vocational education in Australia. The average age of the participants was 43.7 years, 55.4% (363/655) participants were married or living in a de facto relationship, 62.6% (410/655) were employed, and 73.0% (477/655) lived in an inner regional area. The mean number of cigarettes smoked per day was 19.0 (SD 9.2), and the average minutes to first cigarette after waking up was 37.3 (SD 86.5) min. The mean age participants started smoking regularly was 16.6 (SD 4.5) years. Almost half of the participants (48.6%, 318/655) had made a quit attempt in the last 12 months, 45.0% (295/655) intended to quit in the next 30 days, and 53.0% (347/655) were confident that they were likely to quit (Table 1).

    Table 1. Participants’ characteristics (N=655).
    Demographic characteristicsValue
    Age (years), mean (SD); median43.7 (11.8); 43.0
    Gender, n (%)

    		Female507 (77.4)

    		Male148 (22.6)
    Country of birth, n (%)

    		Australia570 (87.0)

    		Other85 (13.0)
    Aboriginal or Torres Strait Islander, n (%)

    		Yes53 (8.1)

    		No or do not know602 (91.9)
    Education, n (%)

    		Completed primary school5 (0.8)

    		Completed years 7-952 (7.9)

    		Completed year 10127 (19.4)

    		Completed Higher Secondary Certificate or leaving year 1252 (7.9)

    		Technical and Further Education Certificate or diploma264 (40.3)

    		University degree or higher146 (22.2)

    		Other9 (1.4)
    Marital status, n (%)

    		Never married147 (22.4)

    		Married or de facto363 (55.4)

    		Married but separated46 (7.0)

    		Divorced74 (11.3)

    		Widowed16 (2.4)

    		Don’t know9 (1.4)
    Location, n (%)

    		Inner regional477 (73.0)

    		Outer regional164 (25.1)

    		Remote12 (1.8)
    Employment, n (%)

    		Full time or part time or casual410 (62.6)

    		Home duties73 (11.2)

    		Permanently unable to work or ill56 (8.6)

    		Retired35 (5.3)

    		Student (full or part time)27 (4.1)

    		Unemployed40 (6.1)

    		Other14 (2.1)
    Smoking characteristics

    		Cigarettes per day (n=620), mean (SD); median19.0 (9.21); 20

    		Time to first cigarette (n=632), mean (SD); median37.3 (86.5); 15

    		Age (years) started smoking regularly (n=649), mean (SD); median16.6 (4.5); 16

    		Quit attempt in the past 12 months, n (%)


    		Yes318 (48.6)


    		No335 (51.2)


    		Don’t know1 (0.2)

    		Quitting intentions, n (%)


    		Will quit in the next 30 days295 (45.0)


    		Will quit in the next 6 months229 (35.0)


    		Will not quit in the next 6 months or never expect to quit or do not know131 (20.0)

    		Confidence to quit, n (%)


    		Very or fairly likely to quit347 (53.0)


    		Very or fairly unlikely to quit168 (25.7)


    		Do not know140 (21.4)

    Recruitment Strategies

    Table 2 outlines the percentage of participants recruited by online and traditional methods. A total of 88.7% (581/655) of the participants were recruited via online strategies and 11.3% (74/655) of the participants were via traditional strategies. The majority (83.5%, 547/655) of the participants reported that they heard about the study through Facebook, whereas 7.2% (47/655) were recruited via newspaper.

    Cost per Smoker Recruited

    The cost per participant recruited for each online and traditional recruitment strategy are described in Table 2. The cost for each participant recruited by the different online strategies ranged from Aus $7.29 for Gumtree to Aus $128.67 for email. In contrast, for the traditional recruitment strategies, the cost per participant recruited ranged from Aus $0 for word of mouth and television (initiated and completed by television station at no cost to the study) to Aus $3990.84 for telephone recruitment.

    Comparison of Participant Characteristics Recruited via Online Versus Traditional Strategies

    Table 3 compares the characteristics of participants recruited via online or traditional methods. Women had greater odds of being recruited via online strategies than men (OR 2.50, 95% CI 1.42-4.40; P=.002). There were no significant associations between any other participant characteristics and type of recruitment method.

    Table 2. Participant recruitment via recruitment methods.
    Recruitment methodParticipants, n (%)Total cost for each strategyCost per participant recruited
    Aus $US $£€Aus $US $£€
    Online methods         
     Gumtree5 (0.8)36.4324.8120.4422.167.294.964.094.43
     Web promotions and internet search10 (1.5)437.56298.00245.55266.2243.7629.8024.5626.62
     Twitter1 (0.2)61.5241.9034.5237.4361.5241.9034.5237.43
     Facebook547 (83.5)33,738.5222,977.2818,932.4720,526.2461.6842.0134.6137.53
     Email18 (2.7)2315.981577.321299.561409.07128.6787.6372.2078.28
    Traditional methods
     Word of mouth19 (2.9)00000000
     Television (initiated or completed by television station—no cost to study)1 (0.2)00000000
     Newspaper47 (7.2)2363.381609.601326.271437.9050.2834.2528.2230.59
     Radio (live interviews)2 (0.3)205.55139.99115.36125.06102.7870.0057.6862.53
     Magazine2 (0.3)170.81116.3395.86103.9285.4151.9647.9358.17
     Posters1 (0.2)566.65385.92318.01344.76566.65385.92318.01344.76
     Flyers1 (0.2)2546.291734.181429.381549.642546.291734.181429.381549.64
     Telephone1 (0.2)3990.842757.672227.852477.113990.842757.672227.852477.11
    Table 3. Comparison of participants recruited via online and traditional strategies.
    Variable and categoriesOnline strategies (n=581)Traditional strategies (n=74)Odds ratio (95% CI)P value
    Gender, n (%)   .002
     Female460 (90.7)47 (9.3)2.50 (1.42-4.40) 
     Male121 (81.8)27 (18.2)Reference 
    Age (years) mean (SD)43.72 (11.7)43.23 (12.8)1.01 (0.98-1.03).52
    Education,n (%)   .39
     Year 10 or less166 (89.7)19 (10.3)1.56 (0.75-3.26) 
     Higher Secondary Certificate or year 12 or Technical and Further Education290 (90.1)32 (9.9)1.50 (0.79-2.83) 
     University or tertiary124 (84.9)22 (15.1)Reference 
    Marital status, n (%)   .09
     With partner328 (90.4)35 (9.6)1.61 (0.94-2.77) 
     Without partner253(86.6)39 (13.4)Reference 
    Employment,n (%)   .21
     Employed full or casual or part time366 (89.3)44(10.7)1.45 (0.81-2.59) 
     Not employed215 (87.8)30 (12.2)Reference 
    Aboriginal or Torres Strait Islander, n (%).14
     Yes49 (92.5)4 (7.6)2.55 (0.73-8.87) 
     No532 (88.4)70 (11.6)Reference 
    Australian born, n (%)   .15
     No79 (92.9)6 (7.1)1.95 (0.79-4.81) 
     Yes502 (88.1)68 (11.9)Reference 
    Anxiety, n (%)   .87
     No295 (88.3)39 (11.7)1.05 (0.57-1.95) 
     Yes286 (89.1)35 (10.9)Reference 
    Depression, n (%)   .41
     No348 (88.3)46 (11.7)0.76 (0.40-1.46) 
     Yes233 (89.3)28 (10.7)Reference 
    Financial stress, n (%)   .73
     0268 (88.5)35 (11.6)0.71 (0.29-1.72) 
     1-3241 (89.3)29 (10.7)0.82 (0.34-1.96) 
     4-772 (87.8)10 (12.2)Reference
    Quitting intentions, n (%).31
     Will quit in the next 30 days267 (90.5)28 (9.5)1.68 (0.86-3.28) 
     Will quit in the next 6 months203 (88.7)26 (11.4)1.41 (0.71-2.80) 
     Will not quit within the 6 months, never expect to quit, and do not know111 (84.7)20 (15.3)Reference 
    Confidence to quit, n (%)   .40
     Very or fairly likely313 (90.2)34 (9.8)1.25 (0.74-2.11) 
     Very or fairly unlikely or do not know268 (87.0)40 (13.0)Reference 
    Heaviness Smoking Index score, n (%).57
     0-2: low addiction143 (87.2)21 (12.8)0.60 (0.23-1.58) 
     3-4: moderate addiction307 (88.0)42 (12.0)0.65 (0.27-1.58) 

    		5-6: high addiction79 (90.8)8 (9.2)Reference 

    Principal Findings

    This Australian study found that both online and traditional recruitment strategies could facilitate the recruitment of smokers who lived in rural and remote areas into a smoking cessation trial. The online strategy had a high yield of smokers residing in rural and remote locations, similar to other studies conducted with the wider general population [26,29,32,38,46-50]. This is the first study to compare the cost per participant recruited from rural and remote locations using online and traditional strategies into a smoking cessation trial. The findings provide insight on the variability of cost per participant depending on the recruitment strategy used. The cost per participant recruited ranged from Aus $7.29 to Aus $128.67 for online strategies and Aus $0 to Aus $3990.84 for traditional strategies. Word of mouth was, by far, the most inexpensive method per participant recruited because the study incurred no cost from this recruitment strategy. However, word of mouth would not have been sufficient to recruit enough participants into the smoking cessation trial and, therefore, is not practical on its own, although it is an inexpensive strategy.

    Facebook recruited the largest number of participants in this study compared with other online strategies and traditional recruitment methods (although this would have been influenced by the most money being spent on Facebook). However, Facebook was neither the most inexpensive online recruitment method in terms of cost per participant recruited nor was it cheaper than every traditional recruitment strategy. Nevertheless, to maximize the number of rural and remote participants recruited into smoking cessation trials, there needs to be a balance between the cost per participant recruited and the capacity (ie, total participants’ that can access each method). Specifically, there would be substantially fewer participants recruited into the study if only the most inexpensive methods (eg, word of mouth and Gumtree) were used, as these strategies did not recruit as large a number of participants as Facebook.

    Comparison With Prior Studies

    The cost per participant for recruiting rural and remote smokers is variable and comparable with recruiting smokers in the general population [26,28,29,32,38,49,50], especially given that this study included all the costs such as staff time and printing of flyers unlike other studies [26,28,29,38,49]. For instance, in a US study of a Web-based smoking intervention [49], the total advertisement cost per randomized participant was US $40.51 (£33.33 and €36.32) for Facebook, US $34.71 (£28.56 and €31.12) for Google, and US $20.30 (£16.7 and €18.2) for traditional sources but excluded the costs for personnel. In another Australian study, the cost of online social media recruitment was Aus $42.34 (US $29.24, £23.63, and €26.27) per participant enrolled in a smoking cessation trial, whereas for the traditional recruitment strategies, it was Aus $21.52 (US $14.86, £12.01, and €13.35) per participant [26]. However, these costs did not include call back costs for after-hours’ time and materials sometimes mailed out to the newspaper participants [26]. In 2016, another Australian study [28] reported that the costs to recruit an eligible respondent into a smoking cessation trial via online (social media) methods was Aus $57.34 (US $38.93, £31.43, and €34.95) versus Aus $52.33 (US $36.13, £29.20, and €32.46) for the traditional methods. However, some costs such as printing and distribution of flyers were not included, and radio interviews were conducted free of charge [28]. Another smoking cessation trial [29] reported that online advertisements cost US $41.35 (£33.41 and €37.10), whereas traditional materials cost US $56.23 per enrolled participant. Finally, another study of young adult smokers using Facebook recruitment reported a cost of US $8.80 per eligible participant recruited into a cessation trial [38].

    The results from this study showed that compared with men, women had greater odds of being recruited via online strategies. This is similar to a study by Stanczyk et al [50] where the internet yielded a higher proportion of female smokers, compared with other strategies. However other smoking cessation trials [26,28,51] have found no association between gender and method of recruitment. Nonetheless, it should be noted that the majority of men in this study were still recruited via online methods. Bearing in mind that most participants recruited via online strategies were recruited via Facebook, the finding that women had greater odds of being recruited via online strategies might be explained by evidence that women, unlike men, considered Facebook an integral part of their life to connect daily [52] and were more likely to seek support, either social (Facebook) or otherwise [53], but this was not the case for men and, particularly, men living in rural areas [54]. The participation of fewer men in smoking cessation research compared with women is not surprising. For instance, in a systematic review of proactive telephone counseling for smoking cessation [55], 17 out of the 21 studies reported a greater proportion of women than men participated [55]. Similarly, in a smoking cessation trial conducted in rural Kansas, United States, only 35% of the sample were men [56].

    There were no significant associations found for other characteristics between participants recruited via online and traditional strategies in this study. In contrast, a study by Frandsen et al [28] reported a significant association between social media recruitment and younger participants compared with those recruited by traditional methods into smoking cessation support. Furthermore, although there is evidence that social media users are more likely to have mental health conditions [36], this study did not find any association between anxiety or depression and the recruitment method.

    Limitations

    The study had a number of limitations. First, access to the internet was an eligibility criterion and might have excluded some smokers who would have been interested in behavioral support and had no internet connection. Second, most people were recruited from inner or outer regional areas, and the recruitment strategies were only able to reach a small proportion of smokers from remote areas and no one from very remote areas. This may not be surprising given that few newspapers and online notice boards or local classified websites specifically targeted very remote areas. In addition, the study targeted only 0.001% of the NSW population that lives in very remote areas [57]. Third, another limitation is that self-report was used as the measure of how participants were recruited into the study. Although there are online systems to track users after having clicked on an online advertisement (eg, via Facebook), people who heard about the study from traditional sources (eg, hardcopy newspaper) could not be tracked via such a system. Finally, this study recruited only adults living in rural and remote areas of Australia, and therefore, the findings might have limited generalizability to other countries, particularly low- and middle-income countries.

    Conclusions

    The cost per participant recruited via online and traditional strategies varied with the range of costs being smaller for online than traditional recruitment strategies. Women have greater odds of being recruited via online strategies into rural smoking cessation trials.

    Acknowledgments

    This study and author FT were supported by a Cancer Institute New South Wales Early Career Fellowship (15/ECF/1-44). CP was supported by a National Health and Medical Research Council Career Development Fellowship (1061335). Hunter New England Population Health and the Hunter Medical Research Institute provided infrastructure support. The sponsors did not have any role in the study design; collection, analysis, and interpretation of data; writing of the paper; and decision to submit the paper for publication.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Supplementary table of studies reporting cost per participant recruited in the general population via online and traditional recruitment strategies (summarises literature in Introduction).

    PDF File (Adobe PDF File), 128 KB
    1. Australian Institute of Health and Welfare. 2016. Australia's Health 2016   URL: https://www.aihw.gov.au/getmedia/9844cefb-7745-4dd8-9ee2-f4d1c3d6a727/19787-AH16.pdf.aspx [accessed 2019-09-18]
    2. Doogan NJ, Roberts ME, Wewers ME, Stanton CA, Keith DR, Gaalema DE, et al. A growing geographic disparity: rural and urban cigarette smoking trends in the United States. Prev Med 2017 Nov;104:79-85 [FREE Full text] [CrossRef] [Medline]
    3. vander Weg MW, Cunningham CL, Howren MB, Cai X. Tobacco use and exposure in rural areas: findings from the behavioral risk factor surveillance system. Addict Behav 2011 Mar;36(3):231-236. [CrossRef] [Medline]
    4. Eberhardt MS, Freid VM, Harper S, Ingram DD, Makuc DM, Pamuk E, et al. Centers for Disease Control and Prevention. 2001. Health, United States, 2001: Urban and Rural Health Chartbook   URL: https://www.cdc.gov/nchs/data/hus/hus01cht.pdf [accessed 2019-09-18]
    5. Eberhardt MS, Pamuk ER. The importance of place of residence: examining health in rural and nonrural areas. Am J Public Health 2004 Oct;94(10):1682-1686. [CrossRef] [Medline]
    6. Doescher MP, Jackson JE, Jerant A, Hart LG. Prevalence and trends in smoking: a national rural study. J Rural Health 2006;22(2):112-118. [CrossRef] [Medline]
    7. Pleis JR, Lethbridge-Cejku M. Summary health statistics for US adults: national health interview survey, 2005. Vital Health Stat 10 2006 Dec(232):1-153 [FREE Full text] [CrossRef] [Medline]
    8. National Rural Health Alliance. 2014. Smoking and Rural Health: Fact Sheet   URL: http://www.ruralhealth.org.au/sites/default/files/publications/nrha-factsheet-smoking.pdf [accessed 2019-12-03]
    9. Australian Institute of Health and Welfare. Drug statistics series #28, Cat. #PHE 183. National Drug Strategy Household Survey detailed report 2013. Canberra: Australian Institute of Health and Welfare; 2014.
    10. Australian Institute of Health and Welfare. 2014. Australia’s Health 2014   URL: https://www.aihw.gov.au/getmedia/d2946c3e-9b94-413c-898c-aa5219903b8c/16507.pdf.aspx?inline=true [accessed 2019-09-18]
    11. Morgan LL, Fahs PS, Klesh J. Barriers to research participation identified by rural people. J Agric Saf Health 2005 Nov;11(4):407-414. [CrossRef] [Medline]
    12. Friedman DB, Bergeron CD, Foster C, Tanner A, Kim SH. What do people really know and think about clinical trials? A comparison of rural and urban communities in the south. J Community Health 2013 Aug;38(4):642-651. [CrossRef] [Medline]
    13. Patrick JH, Pruchno RA, Rose MS. Recruiting research participants: a comparison of the costs and effectiveness of five recruitment strategies. Gerontologist 1998 Jun;38(3):295-302. [CrossRef] [Medline]
    14. Treweek S, Wilkie E, Craigie AM, Caswell S, Thompson J, Steele RJ, BeWEL Team. Meeting the challenges of recruitment to multicentre, community-based, lifestyle-change trials: a case study of the BeWEL trial. Trials 2013 Dec 18;14:436 [FREE Full text] [CrossRef] [Medline]
    15. Sully BG, Julious SA, Nicholl J. A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials 2013 Jun 9;14:166 [FREE Full text] [CrossRef] [Medline]
    16. Relton C, Torgerson D, O'Cathain A, Nicholl J. Rethinking pragmatic randomised controlled trials: introducing the 'cohort multiple randomised controlled trial' design. Br Med J 2010 Mar 19;340:c1066. [CrossRef] [Medline]
    17. Carlisle B, Kimmelman J, Ramsay T, MacKinnon N. Unsuccessful trial accrual and human subjects protections: an empirical analysis of recently closed trials. Clin Trials 2015 Feb;12(1):77-83 [FREE Full text] [CrossRef] [Medline]
    18. Rait MA, Prochaska JJ, Rubinstein ML. Recruitment of adolescents for a smoking study: use of traditional strategies and social media. Transl Behav Med 2015 Sep;5(3):254-259 [FREE Full text] [CrossRef] [Medline]
    19. Thornton LK, Harris K, Baker AL, Johnson M, Kay-Lambkin FJ. Recruiting for addiction research via Facebook. Drug Alcohol Rev 2016 Jul;35(4):494-502. [CrossRef] [Medline]
    20. O'Connor A, Jackson L, Goldsmith L, Skirton H. Can I get a retweet please? Health research recruitment and the Twittersphere. J Adv Nurs 2014 Mar;70(3):599-609. [CrossRef] [Medline]
    21. Pedersen ER, Helmuth ED, Marshall GN, Schell TL, PunKay M, Kurz J. Using Facebook to recruit young adult veterans: online mental health research. JMIR Res Protoc 2015 Jun 1;4(2):e63 [FREE Full text] [CrossRef] [Medline]
    22. Valdez RS, Guterbock TM, Thompson MJ, Reilly JD, Menefee HK, Bennici MS, et al. Beyond traditional advertisements: leveraging Facebook's social structures for research recruitment. J Med Internet Res 2014 Oct 27;16(10):e243 [FREE Full text] [CrossRef] [Medline]
    23. Muñoz RF, Barrera AZ, Delucchi K, Penilla C, Torres LD, Pérez-Stable EJ. International Spanish/English internet smoking cessation trial yields 20% abstinence rates at 1 year. Nicotine Tob Res 2009 Sep;11(9):1025-1034 [FREE Full text] [CrossRef] [Medline]
    24. Graham AL, Fang Y, Moreno JL, Streiff SL, Villegas J, Muñoz RF, et al. Online advertising to reach and recruit Latino smokers to an internet cessation program: impact and costs. J Med Internet Res 2012 Aug 27;14(4):e116 [FREE Full text] [CrossRef] [Medline]
    25. Barrera AZ, Pérez-Stable EJ, Delucchi KL, Muñoz RF. Global reach of an internet smoking cessation intervention among Spanish- and English-speaking smokers from 157 countries. Int J Environ Res Public Health 2009 Mar;6(3):927-940 [FREE Full text] [CrossRef] [Medline]
    26. Frandsen M, Walters J, Ferguson SG. Exploring the viability of using online social media advertising as a recruitment method for smoking cessation clinical trials. Nicotine Tob Res 2014 Feb;16(2):247-251. [CrossRef] [Medline]
    27. Gordon JS, Akers L, Severson HH, Danaher BG, Boles SM. Successful participant recruitment strategies for an online smokeless tobacco cessation program. Nicotine Tob Res 2006 Dec;8(Suppl 1):S35-S41. [CrossRef] [Medline]
    28. Frandsen M, Thow M, Ferguson SG. The effectiveness of social media (Facebook) compared with more traditional advertising methods for recruiting eligible participants to health research studies: a randomized, controlled clinical trial. JMIR Res Protoc 2016 Aug 10;5(3):e161 [FREE Full text] [CrossRef] [Medline]
    29. Buller DB, Meenan R, Severson H, Halperin A, Edwards E, Magnusson B. Comparison of 4 recruiting strategies in a smoking cessation trial. Am J Health Behav 2012 Sep;36(5):577-588 [FREE Full text] [CrossRef] [Medline]
    30. Statista. 2019. Number of Internet Users Worldwide From 2005 to 2018 (in Millions)   URL: https://www.statista.com/statistics/273018/number-of-internet-users-worldwide/ [accessed 2019-12-03]
    31. Australian Bureau of Statistics, Australian Government. 2018. 8146.0 - Household Use of Information Technology, Australia, 2016-17   URL: http://www.abs.gov.au/Ausstats/abs%40.nsf/mf/8146.0 [accessed 2019-09-18]
    32. Ramo DE, Hall SM, Prochaska JJ. Reaching young adult smokers through the internet: comparison of three recruitment mechanisms. Nicotine Tob Res 2010 Jul;12(7):768-775 [FREE Full text] [CrossRef] [Medline]
    33. Nolte MT, Shauver MJ, Chung KC. Analysis of four recruitment methods for obtaining normative data through a web-based questionnaire: a pilot study. Hand (N Y) 2015 Sep;10(3):529-534 [FREE Full text] [CrossRef] [Medline]
    34. Bessière K, Pressman S, Kiesler S, Kraut R. Effects of internet use on health and depression: a longitudinal study. J Med Internet Res 2010 Feb 28;12(1):e6 [FREE Full text] [CrossRef] [Medline]
    35. Park S, Lee SW, Kwak J, Cha M, Jeong B. Activities on Facebook reveal the depressive state of users. J Med Internet Res 2013 Oct 1;15(10):e217 [FREE Full text] [CrossRef] [Medline]
    36. Pantic I. Online social networking and mental health. Cyberpsychol Behav Soc Netw 2014 Oct;17(10):652-657 [FREE Full text] [CrossRef] [Medline]
    37. Nicol A. Melbourne Institute. 2010. The Experience of Financial Stress in Australia: the Role of Life Events and Prior Stress   URL: https:/​/melbourneinstitute.​unimelb.edu.au/​assets/​documents/​hilda-bibliography/​conference-papers-lectures/​2010/​Nicol_AIFS2010.​pdf [accessed 2019-09-18]
    38. Ramo DE, Rodriguez TM, Chavez K, Sommer MJ, Prochaska JJ. Facebook recruitment of young adult smokers for a cessation trial: methods, metrics, and lessons learned. Internet Interv 2014 Apr;1(2):58-64 [FREE Full text] [CrossRef] [Medline]
    39. Tzelepis F, Wiggers J, Paul CL, Byaruhanga J, Byrnes E, Bowman J, et al. A randomised trial of real-time video counselling for smoking cessation in regional and remote locations: study protocol. Contemp Clin Trials 2018 Nov;74:70-75. [CrossRef] [Medline]
    40. Australian Bureau of Statistics, Australian Government. 2018. Australian Statistical Geography Standard (ASGS): Volume 5 - Remoteness Structure, July 2016   URL: http://www.abs.gov.au/AUSSTATS/abs@.nsf/Latestproducts/1270.0.55.005Main%20Features15July%202016 [accessed 2019-09-18]
    41. Löwe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: validation and standardization of the Patient Health questionnaire-4 (PHQ-4) in the general population. J Affect Disord 2010 Apr;122(1-2):86-95. [CrossRef] [Medline]
    42. Siahpush M, Borland R, Scollo M. Smoking and financial stress. Tob Control 2003 Mar;12(1):60-66 [FREE Full text] [CrossRef] [Medline]
    43. Kozlowski LT, Porter CQ, Orleans CT, Pope MA, Heatherton T. Predicting smoking cessation with self-reported measures of nicotine dependence: FTQ, FTND, and HSI. Drug Alcohol Depend 1994 Feb;34(3):211-216. [CrossRef] [Medline]
    44. Heatherton TF, Kozlowski LT, Frecker RC, Fagerström KO. The Fagerström test for nicotine dependence: a revision of the Fagerström tolerance questionnaire. Br J Addict 1991 Sep;86(9):1119-1127. [CrossRef] [Medline]
    45. Borland R, Yong HH, O'Connor RJ, Hyland A, Thompson ME. The reliability and predictive validity of the heaviness of smoking index and its two components: findings from the International Tobacco Control Four Country Study. Nicotine Tob Res 2010 Oct(12 Suppl):S45-S50 [FREE Full text] [CrossRef] [Medline]
    46. McDonnell D, Lee H, Kazinets G, Moskowitz JM. Online recruitment of targeted populations: lessons learned from a smoking cessation study among Korean Americans. Soc Mar Q 2010 Aug 26;16(3):2-22 [FREE Full text] [CrossRef]
    47. Danaher BG, McKay HG, Seeley JR. The information architecture of behavior change websites. J Med Internet Res 2005 May 18;7(2):e12 [FREE Full text] [CrossRef] [Medline]
    48. Lane TS, Armin J, Gordon JS. Online recruitment methods for web-based and mobile health studies: a review of the literature. J Med Internet Res 2015 Jul 22;17(7):e183 [FREE Full text] [CrossRef] [Medline]
    49. Watson NL, Mull KE, Heffner JL, McClure JB, Bricker JB. Participant recruitment and retention in remote ehealth intervention trials: methods and lessons learned from a large randomized controlled trial of two web-based smoking interventions. J Med Internet Res 2018 Aug 24;20(8):e10351 [FREE Full text] [CrossRef] [Medline]
    50. Stanczyk NE, Bolman C, Smit ES, Candel MJ, Muris JW, de Vries H. How to encourage smokers to participate in web-based computer-tailored smoking cessation programs: a comparison of different recruitment strategies. Health Educ Res 2014 Feb;29(1):23-40. [CrossRef] [Medline]
    51. Coday M, Richey P, Thomas F, Tran QT, Terrell SB, Tylavsky F, et al. The recruitment experience of a randomized clinical trial to aid young adult smokers to stop smoking without weight gain with interactive technology. Contemp Clin Trials Commun 2016 Apr 15;2:61-68 [FREE Full text] [CrossRef] [Medline]
    52. Thompson SH, Lougheed E. Frazzled by Facebook? An exploratory study of gender differences in social network communication among undergraduate men and women. Coll Stud J 2012;46(1):88-98 [FREE Full text]
    53. Joiner R, Cuprinskaite J, Dapkeviciute L, Johnson H, Gavin J, Brosnan M. Gender differences in response to Facebook status updates from same and opposite gender friends. Comput Hum Behav 2016 May;58:407-412. [CrossRef]
    54. Roy P, Tremblay G, Robertson S. Help-seeking among male farmers: connecting masculinities and mental health. Sociol Ruralis 2014 Apr 16;54(4):460-476 [FREE Full text] [CrossRef]
    55. Tzelepis F, Paul CL, Walsh RA, McElduff P, Knight J. Proactive telephone counseling for smoking cessation: meta-analyses by recruitment channel and methodological quality. J Natl Cancer Inst 2011 Jun 22;103(12):922-941. [CrossRef] [Medline]
    56. Richter K, Shireman TI, Ellerbeck EF, Cupertino AP, Catley D, Cox LS, et al. Comparative and cost effectiveness of telemedicine versus telephone counseling for smoking cessation. J Med Internet Res 2015 May 8;17(5):e113 [FREE Full text] [CrossRef] [Medline]
    57. Australian Bureau of Statistics, Australian Government. 2017. Regional Population Growth, Australia, 2014-15   URL: http:/​/www.​abs.gov.au/​ausstats/​abs@.nsf/​Previousproducts/​3218.​0Main%20Features152014-15?opendocument&tabname=Summary&prodno=3218.​0&issue=2014-15&num=&view [accessed 2019-08-18]

    ‎
    ARIA+: Accessibility and Remoteness Index of Australia
    HSI: Heaviness of Smoking Index
    HRA: health risk assessment
    NSW: New South Wales
    OR: odds ratio
    PHQ-4: Patient Health Questionnaire-4

    Edited by G Eysenbach; submitted 03.06.19; peer-reviewed by N Walker, N Machado; comments to author 06.07.19; revised version received 09.08.19; accepted 29.08.19; published 12.11.19

    Copyright

    ©Judith Byaruhanga, Flora Tzelepis, Christine Paul, John Wiggers, Emma Byrnes, Christophe Lecathelinais. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 12.11.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.