This paper is in the following e-collection/theme issue:

Recruitment of Research Participants (296) Engagement with and Adherence to Digital Health Interventions, Law of Attrition (491) New Methods (944) mHealth for Health Administration (144)

Published on in Vol 21, No 4 (2019): April

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/11166, first published .
Use of Rideshare Services to Increase Participant Recruitment and Retention in Research: Participant Perspectives

Use of Rideshare Services to Increase Participant Recruitment and Retention in Research: Participant Perspectives

Use of Rideshare Services to Increase Participant Recruitment and Retention in Research: Participant Perspectives

Authors of this article:

Eleanor Ladd Schneider Leavens1, 2 Author Orcid Image ;   Elise Marie Stevens1 Author Orcid Image ;   Emma Irene Brett2 Author Orcid Image ;   Neil Molina1 Author Orcid Image ;   Thad Ryan Leffingwell2 Author Orcid Image ;   Theodore Lee Wagener1, 3 Author Orcid Image
Article Authors Cited by (6) Tweetations (27) Metrics

    Original Paper

    1Oklahoma Tobacco Research Center, Oklahoma City, OK, United States

    2Oklahoma State University, Department of Psychology, Stillwater, OK, United States

    3University of Oklahoma Health Sciences Center, Department of Pediatrics, Oklahoma City, OK, United States

    Corresponding Author:

    Eleanor Ladd Schneider Leavens, MS

    Oklahoma Tobacco Research Center

    655 Research Parkway

    Oklahoma City, OK,

    United States

    Phone: 1 9139728841

    Email: leavens@okstate.edu


    Background: Recruitment and retention of participants are important factors in empirical studies. Methods that increase recruitment and retention can reduce costs and burden on researchers related to the need for over-recruitment because of attrition. Rideshare services such as Uber and Lyft are a potential means for decreasing this burden.

    Objective: This study aimed to understand the role rideshare utilization plays in participant recruitment and retention in research trials.

    Methods: Data are presented for a study (N=42) in which rideshare services were utilized for participant transportation to and from study visits during a 2-session, in-laboratory research study.

    Results: Retention at visit 2 was greater than 95% (42/44) in the initial study. In a follow-up survey of the participants from the original trial, participants (N=32) reported that the rideshare service was an important reason they returned for all study visits. Participants reported whether they would prefer differing levels of additional monetary compensation or a ride from a rideshare service. When the additional compensation was less than US $15, participants reported a preference for the rideshare service.

    Conclusions: Rideshare services may represent a relatively low cost means for increasing study retention. Specifically, findings indicate that rideshare services may not be crucial for initial participant recruitment but for their retention in multi-visit studies.

    J Med Internet Res 2019;21(4):e11166

    doi:10.2196/11166

    Keywords

    rideshare service; recruitment; retention; attrition; transportation 


    Background

    In health, behavioral, and social sciences, human laboratory and randomized controlled trials are imperative to further science and interventions [1-4]. Two critical aspects of research studies are recruitment and retention [5]. Recruitment is the process by which potential research participants are made aware of and then enrolled in the study [5], whereas retention refers to participants staying in the study and completing study visits [6]. When researchers fail to recruit and retain participants, findings can be invalid, inconclusive, and insufficient to answer research questions [7-9]. In addition, attrition can be costly and result in using greater resources, extending studies, and in some cases, terminating studies prematurely [10].

    Research suggests that telephone reminders and financial incentives are advantageous ways to recruit and retain participants [11]. Specifically, studies have shown that participants increase their willingness to participate when compensation increases [12,13], regardless of the risk of adverse events that may result from study participation [12]. Recruitment and retention strategies that reduce participant burden, including costs associated with transportation, are likely to impact desirability of study participation.

    It is also likely that the content area impacts recruitment and retention of participants. On one hand, because of the unique challenges associated with retaining participants in substance abuse studies, the threshold for good retention in these studies has been set relatively low (70%) [14]. However, in studies utilizing alcohol and tobacco administration, retention rates are relatively high (90%-96%) [15,16]. However, these referenced studies also required participants to complete baseline screening visits and did not include participants who did not return following screening, which likely increased retention rates.

    A recent study proposed a conceptual framework specific to improving recruitment and retention in tobacco and alcohol research, including (1) creating a team mindset that promotes regular and positive communication with participants, (2) leveraging technology, and (3) increasing efforts to contact nonresponsive participants [17]. Applying such techniques as applicable to a specific sample may improve retention by establishing an alliance between the study team and the participant and reducing participant burden. In addition, literature on retention suggests that using more strategies across several separate categories (eg, visit characteristics, study personnel, and nonfinancial incentives) will result in improved retention [18].

    With the advent, popularity, and low cost of rideshare services such as Uber and Lyft, it is important to understand if and how such services may represent a novel and advantageous strategy to recruit and retain participants. Past studies among low-income urban participants have shown that reimbursing for taxi services was not always an effective method for recruitment and retention because of unreliability of taxis [8]. However, rideshare services may be more advantageous given the researcher’s capability to order the rides remotely at the scheduled time, track participants’ rides to the study location, and set up an account to facilitate hassle-free payment for the service. Use of rideshare services may also increase safety for studies in which acute intoxication is necessary and driving would put participants in harm’s way. Finally, use of rideshare services reduces participants’ burden and is consistent with the suggestions within Smith and colleagues’ framework for increasing retention [17].

    Objectives

    The aim of this study was to assess participants’ perceptions of the use of a rideshare service in terms of the impact it had on decisions to return to study visits in a recently completed, multi-visit study. We also examined how providing rideshare services in future studies would influence participants’ decisions to participate. Finally, we aimed to understand whether differing levels of additional compensation or rideshare services would be better for recruitment and retention.


    Participants and Procedure

    This study recruited participants from a recently completed study [19]. The purpose of the original study was to understand the impact of acute alcohol intoxication on waterpipe smoking patterns and toxicant exposure. The completed research study recruited 21 dyads (N=42) of current waterpipe smokers and drinkers for a 2-session, in-laboratory study. Each visit included survey completion, 2 blood draws, breath tests (breath alcohol concentration and carbon monoxide), and alcohol or placebo beverage administration, followed by a waterpipe smoking session lasting up to 2 hours. Of the 44 participants, 42 (95.5%) were retained in the study. Retention methods included regular calls to participants, relationship building between research staff and participants, fair compensation (US $125 per visit) with a bonus (US $20) for completing both study visits, and transportation to and from study visits via a rideshare service.

    Participants who completed both study visits in the original study were invited to provide feedback on their experiences, with the primary aim of understanding the role of the provision of a rideshare service in their choice to complete both study visits. Before completing study procedures, participants provided informed consent. All data were collected remotely via a brief, Web-based survey. Participants were compensated with a US $5 gift card. Of the 42 participants who completed the original study, 32 (mean age 25.7, SD 3.0; 58% male; 79% white) completed this study. The university’s institutional review board approved all study procedures.

    Use of Rideshare

    All participants were required to utilize rideshare services (eg, Uber and Lyft) for their transportation to and from the research site. This requirement not only facilitated the double-blind nature of the study but also enhanced participant safety following alcohol administration. An Uber account was created for the purpose of this research, and all rides were placed from this account. Participants were required to be picked up from and dropped off at their home address to limit the likelihood participants would drive following participation. Pick up from work or other locations was not allowed because of the likelihood that participants would be dropped off at their car following study participation. Ten to 20 min before the scheduled study visit, the research staff contacted participants via phone to ensure they were ready for the ride request to be placed. If confirmed, research staff placed a request for a rideshare service to pick up the participant and bring them to the laboratory. As participants confirmed they were available for pick up, only 2 rides necessitated cancelling during the study. One cancellation was due to the participant having difficulty locating the vehicle, and the other was due to the participant necessitating additional time. Both rides were able to be rescheduled soon after the original ride was declined. Following each visit, research staff placed a request for the rideshare service to pick up the participants at the laboratory and take them to their home addresses.

    Table 1. Importance of recruitment and retention strategies compared with provision of rideshare services (N= 32).
    VariablesRecruitment and retention strategies

    		Mean (SD)t testP value
    Reasons for study completion

    		Rideshare service was provideda5.75 (1.70)—b—

    		The study visits were in the evening5.47 (1.90)0.64.53

    		The staff was nice6.47 (1.30)−2.26.03

    		I received reminder short message service (SMS) text messages4.97 (1.84)2.60.01

    		I received reminder calls from staff4.66 (1.81)2.86.01

    		Alcohol was provided at study visits4.56 (2.23)2.65.01

    		Hookah was provided at study visits5.28 (1.42)1.17.25

    		The compensation was fair6.28 (0.96)−1.78.08

    		I would feel bad if I did not attend all visits5.72 (1.69)0.07.94

    		I got to complete study with my friend6.31 (0.90)−1.74.09

    		The study visits were fun6.47 (0.88)−2.35.03
    Intentions for future study participation

    		Rideshare service was provideda4.13 (0.75)——

    		The study visits were in the evening4.38 (0.71)−1.61.12

    		The staff was nice4.56 (0.62)−2.95.01

    		I received reminder SMS text messages4.06 (0.67)0.44.66

    		I received reminder calls from staff3.88 (0.79)1.54.13

    		Alcohol was provided at study visits4.25 (0.84)−0.89.38

    		Hookah was provided at study visits4.13 (0.79)0.00>.99

    		The compensation was fair4.81 (0.40)−4.98<.01

    		I got to complete study with my friend4.63 (0.55)−3.22.003

    		The study visits were fun4.69 (0.54)−3.97<.001

    aReasons for study completion were measured on a 1 (not at all important) to 7 (extremely important) scale. Intention for future study participation were measured on a 1 (strongly disagree) to 5 (strongly agree) scale.

    bAll t tests compared use or rideshare to each other strategy, therefore no values are included for the rideshare test as there is no comparator.

    Confidentiality Considerations

    Participants consented to the use of the rideshare service at screening and via the main consent form. Specifically, participants were informed a rideshare service would be utilized for transportation but that only their first name and address would be provided to the rideshare service. Drivers were not informed that participants were enrolled in a research study. Participants were further informed that the researcher would place the ride requests but that their participation remained voluntary and could be discontinued at any time and with no penalty to participants.

    Measures

    Reasons for Study Completion

    Participants completed 11 items assessing the importance of different recruitment and retention strategies in their decision to complete both visits of the original study. Items were rated on a Likert scale from 1 (not at all important) to 7 (extremely important). See Table 1 for a complete list of recruitment and retention strategies that were assessed.

    Intention for Future Study Participation

    Intention for future study participation was measured by 10 items. Participants reported their agreement with each item. Each item completed the sentence beginning with “I would participate in another study like this if...” Response options ranged from 1 (strongly disagree) to 5 (strongly agree). See Table 1 for a complete list of recruitment and retention strategies that were assessed.

    Multiple-Choice Procedure

    To further understand participant preferences for rideshare services in research, participants completed a multiple-choice procedure (MCP) [20] task in which they were presented with the choice between varying levels of additional compensation or a ride to and from the study via a rideshare service. The purpose of this item was to assess participants’ interest in the rideshare service versus additional compensation in some future study. The prompt did not specify the amount of compensation for the hypothetical future study, only the additional compensation amounts versus rideshare provision. Participants were instructed: “ Imagine you have been invited to participate in an in-person research study similar to the one you previously completed in our laboratory. Below is a list of monetary values and free Uber rides. Please choose between the monetary value and Uber ride for each set. In other words, for each set, would you rather have the money or a free Uber ride to your study visit?” Monetary values ranged from US $0.00/free to US $1000. The crossover value, or point where a switch in preference occurred from the rideshare service to the monetary value, was used to indicate the importance of rideshare compared with additional compensation.

    Data Analysis

    For outcomes including reasons for returning to study visits and intentions for future study participants, means and SDs were calculated for each item. The mean for the rideshare item was compared with the means for all other recruitment and retention strategy items using paired samples t tests. Significance was set to P<.05. For the MCP, descriptive information regarding the frequency of preferences for additional compensation or the rideshare service is presented.


    Reasons for Study Completion

    Participants reported that the provision of transportation via a rideshare service was an important reason they returned for all study visits (mean 5.75, SD 1.70). Participants reported that the provision of a rideshare service was more important in their decision to complete all visits than reminder short message service (SMS) text messages from staff (mean 4.97, SD 1.84; t31=2.60; P=.01), reminder calls from staff (mean 4.66, SD 1.81; t31=2.86; P=.007), and alcohol being provided at study visits (mean 4.56, SD 2.23; t31=2.65; P=.01). However, compared with the provision of a rideshare service, participants rated the staff being nice (mean 6.47, SD 1.30; t31=−2.26; P=.03) and the visits being fun (mean 6.47, SD 0.88; t31=−2.35; P=.03) as more important in their completion of all study visits.

    Intention for Future Study Participation

    Overall, participants reported that they would participate in a similar study that offered rideshare services in the future (mean 4.13, SD 0.75). However, compared with other recruitment strategies, participants reported a preference for nice staff (mean 4.56, SD 0.62; t31=−2.95; P=.006), fair compensation (mean 4.81, SD 0.40; t31=4.98; P ≤.001), the option to participate with a friend (mean 4.63, SD 0.55; t31=3.22; P=.003), and fun study visits (mean 4.69, SD 0.54; t31=−3.97; P ≤.001) compared with the provision of rideshare services to and from study visits. See Table 1 for complete results.

    Multiple-Choice Procedure

    The crossover point on the MCP was observed from US $10 to US $15 such that at levels of additional compensation below US $15, participants showed a preference for the rideshare service. However, participants showed a preference for compensation when the monetary value exceeded US $15 (see Figure 1).

    ‎
    Figure 1. Multiple Choice Procedure—Rideshare versus compensation crossover.
    View this figure

    Principal Findings

    This study is the first to examine participants’ perceptions of the use of a rideshare service on their decision to return to study visits and participate in future studies. Recruitment and retention are 2 highly important aspects of successful research [5], and rideshare services may represent a new way to increase participant engagement. In this study, provision of rideshare services was reported to be an important reason participants completed all visits of the original study. Participants also reported they would be interested in completing a future study that provided transportation via a rideshare service. Provision of rideshare services was rated as more important for continued participation than other common recruitment and retention strategies, such as providing reminders for study visits. Alternatively, when considering strategies that would be important in their decision to participate in future studies, participants rated fair compensation and an enjoyable study visit as more important than provision of rideshare services. These seemingly discrepant findings may indicate that rideshare services may not be crucial for the initial recruitment of participants into studies, but for their retention in studies that require more than 1 on-site visit.

    Past research has shown that provision of taxi services is not an effective method for recruitment or retention because of the unreliability of taxis [8], but participants in this study reported provision of rideshare was an important reason they returned for study visits, indicating rideshare may be preferred. This difference may be because of reduced participant burden because the researcher is facilitating provision of the ride. In addition, as app-based rideshare services continue to increase in popularity, more people will have experience using them, and thus, be more comfortable with their utilization in research studies. It is currently unknown how perceptions of rideshare versus taxi services may or may not account for these discrepant findings. The use of rideshare services may be a cost-effective way to retain participants, particularly given the high costs both to the researcher and the integrity of the study associated with attrition [7-9]. We investigated the trade-off between providing additional compensation and providing transportation via a rideshare service. The crossover point may indicate that additional compensation is more beneficial than provision of rideshare services at values greater than US $15 but that rideshare services may be more effective if participants live close to the study site and rides cost less than US $10 per participant.

    The results of this study, coupled with the outstanding retention rate (95%; 42/44) in the original study, suggest that provision of transportation via rideshare services may be a means for increasing retention that should be shared with other research teams. The potential decreased costs and burdens on research staff related to a decreased need to over-recruit to address attrition may result in significant saved costs. Specifically, saved costs would include those associated with recruiting and compensating additional participants because of decreased attrition. Furthermore, compared with taxis, rideshare services are often less expensive, resulting in additional saved costs. Research staff can also be aware of exact arrival time of participants, given that the rideshare services provide real-time locations of the transportation. In addition, it is likely that the avoided costs of over-recruiting to replace participants lost to follow-up outweigh the costs associated with providing rideshare services. This strategy may be particularly helpful for recruiting and retaining individuals with inconsistent methods of transportation or financial barriers that would make obtaining reliable transportation and attending study visits difficult. Furthermore, utilization of rideshare services in addiction studies in which substance administration is required can reduce additional time and resource burden on researchers. Rideshare services represent a means by which to ensure participants arrive home safely. In the case of alcohol administration studies, particularly those using low alcohol doses, use of rideshare services may limit the need for research staff to remain in the lab with participants until their breath alcohol concentration is 0.000.

    Limitations

    Although this study is an important step in understanding the integration and use of rideshare services in research, this study has 2 primary limitations. First, we did not utilize a control and are therefore unable to compare differences in recruitment and retention in studies that did and did not use rideshare services. However, the study demonstrated exceptional retention relative to typical studies in the literature, indicating the retention procedures were successful. It is impossible to conclude with strong inference that rideshare was the critical ingredient, but participant reports are consistent with this conclusion. Second, this study may not generalize to other study designs, studies with different aims and methods, or more highly diverse participant populations. Third, although approximately 76% (32/42) of eligible participants participated in this study, we were not able to make conclusions regarding those who chose not to participate in this study and similarly did not assess reasons for discontinuing participation in the original trial.

    Conclusions

    Despite the large number of studies that require multiple in-lab visits, there has been little research on novel retention and recruitment strategies, an area that is critical for the success of such research. As illustrated in this study, use of rideshare services for in-lab studies may be a worthwhile strategy for increasing retention in research. Utilization of rideshare services should be considered to supplement existing and established methods for improving study recruitment and retention in multi-visit studies.

    Conflicts of Interest

    None declared.

    1. Cooley ME, Sarna L, Brown JK, Williams RD, Chernecky C, Padilla G, et al. Challenges of recruitment and retention in multisite clinical research. Cancer Nurs 2003 Oct;26(5):376-384. [Medline]
    2. Epstein WM. Randomized controlled trials in the human services. Soc Work Res Abstr 1993 Sep 01;29(3):3-10. [CrossRef]
    3. Good M, Schuler L. Subject retention in a controlled clinical trial. J Adv Nurs 1997 Aug;26(2):351-355. [Medline]
    4. Siddiqui O, Flay BR, Hu FB. Factors affecting attrition in a longitudinal smoking prevention study. Prev Med 1996;25(5):554-560. [CrossRef] [Medline]
    5. Gul R, Ali PA. Clinical trials: the challenge of recruitment and retention of participants. J Clin Nurs 2010 Jan;19(1-2):227-233. [CrossRef] [Medline]
    6. Patel M, Doku V, Tennakoon L. Challenges in recruitment of research participants. Adv Psychiatr Treat 2018 Jan 02;9(3):229-238. [CrossRef]
    7. Chang R, Falconer J, Stulberg SD, Arnold WJ, Dyer AR. Prerandomization: an alternative to classic randomization. The effects on recruitment in a controlled trial of arthroscopy for osteoarthrosis of the knee. J Bone Joint Surg Am 1990 Dec;72(10):1451-1455. [Medline]
    8. Gross D, Julion W, Fogg L. What motivates participation and dropout among low-income urban families of color in a prevention intervention? Fam Relat 2001 Jul;50(3):246-254. [CrossRef]
    9. Mason MJ. Methods, plainly speaking: A review of procedural and statistical methods for handling attrition and missing data in clinical research. Meas Eval Couns Dev 1999;32(2):111.
    10. Treweek S, Lockhart P, Pitkethly M, Cook JA, Kjeldstrøm M, Johansen M, et al. Methods to improve recruitment to randomised controlled trials: Cochrane systematic review and meta-analysis. BMJ open 2013;3(e002360):1-24 [FREE Full text] [CrossRef]
    11. Booker CL, Harding S, Benzeval M. A systematic review of the effect of retention methods in population-based cohort studies. BMC Public Health 2011;11(249):1-12. [CrossRef] [Medline]
    12. Bentley JP, Thacker PG. The influence of risk and monetary payment on the research participation decision making process. J Med Ethics 2004 Jun;30(3):293-298 [FREE Full text] [Medline]
    13. Halpern S, Karlawish JH, Casarett D, Berlin JA, Asch DA. Empirical assessment of whether moderate payments are undue or unjust inducements for participation in clinical trials. Arch Intern Med 2004 Apr 12;164(7):801-803. [CrossRef] [Medline]
    14. Scott C. A replicable model for achieving over 90% follow-up rates in longitudinal studies of substance abusers. Drug Alcohol Depend 2004 Apr 09;74(1):21-36 [FREE Full text] [CrossRef] [Medline]
    15. Kahler C, Metrik J, Spillane N, Tidey J, Leventhal A, Mckee S, et al. Alcohol dependence moderates the effects of alcohol on smoking lapse in a laboratory analogue model: s264. Alcoholism: Clinical & Experimental Research 2012;36:79A.
    16. Kahler C, Metrik J, Spillane NS, Day A, Leventhal AM, McKee SA, et al. Acute effects of low and high dose alcohol on smoking lapse behavior in a laboratory analogue task. Psychopharmacology (Berl) 2014 Dec;231(24):4649-4657 [FREE Full text] [CrossRef] [Medline]
    17. Smith L, McNamara PJ, King AC. Optimizing follow-up and study retention in the 21st century: advances from the front line in alcohol and tobacco research. Drug Alcohol Depend 2017 Dec 01;175:171-178 [FREE Full text] [CrossRef] [Medline]
    18. Robinson K, Dinglas VD, Sukrithan V, Yalamanchilli R, Mendez-Tellez PA, Dennison-Himmelfarb C, et al. Updated systematic review identifies substantial number of retention strategies: using more strategies retains more study participants. J Clin Epidemiol 2015 Dec;68(12):1481-1487 [FREE Full text] [CrossRef] [Medline]
    19. Leavens EL, Morgan TL, Brett EI, Lee K, Son J, Molina N, et al. Concurrent alcohol use and waterpipe tobacco smoking: smoking topography, toxicant exposure, and abuse liability. Nicotine Tob Res 2019:- (forthcoming).
    20. Griffiths R, Troisi JR, Silverman K, Mumford GK. Multiple-choice procedure: an efficient approach for investigating drug reinforcement in humans. Behav Pharmacol 1993 Feb;4(1):3-13. [Medline]

    ‎
    MCP: multiple-choice procedure
    SMS: short message service

    Edited by G Eysenbach; submitted 30.05.18; peer-reviewed by E Warner, A Cyr; comments to author 17.08.18; revised version received 29.10.18; accepted 10.12.18; published 08.04.19

    Copyright

    ©Eleanor Ladd Schneider Leavens, Elise Marie Stevens, Emma Irene Brett, Neil Molina, Thad Ryan Leffingwell, Theodore Lee Wagener. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 08.04.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.