This paper is in the following e-collection/theme issue:

Recruitment of Research Participants (296) Electronic/Mobile Data Capture, Internet-based Survey & Research Methodology (832) Demographics of Users, Social & Digital Divide (739) Obstetrics, Gynecology, and Reproductive Medicine (225) Epidemiology (159)

Published on in Vol 23, No 4 (2021): April

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/24716, first published .
Multimodal Recruitment to Study Ovulation and Menstruation Health: Internet-Based Survey Pilot Study

Multimodal Recruitment to Study Ovulation and Menstruation Health: Internet-Based Survey Pilot Study

Multimodal Recruitment to Study Ovulation and Menstruation Health: Internet-Based Survey Pilot Study

Authors of this article:

Shruthi Mahalingaiah1, 2, 3 Author Orcid Image ;   J Jojo Cheng2, 4 Author Orcid Image ;   Michael R Winter5 Author Orcid Image ;   Erika Rodriguez1, 2 Author Orcid Image ;   Victoria Fruh1 Author Orcid Image ;   Anna Williams2 Author Orcid Image ;   MyMy Nguyen2 Author Orcid Image ;   Rashmi Madhavan2 Author Orcid Image ;   Pascaline Karanja2 Author Orcid Image ;   Jill MacRae2 Author Orcid Image ;   Sai Charan Konanki1 Author Orcid Image ;   Kevin J Lane6 Author Orcid Image ;   Ann Aschengrau3 Author Orcid Image
Article Authors Cited by (6) Tweetations (8) Metrics

    Original Paper

    1Department of Environmental Health, Harvard T.H. Chan School of Public Health, Boston, MA, United States

    2Department of Obstetrics and Gynecology, Boston University School of Medicine, Boston, MA, United States

    3Department of Epidemiology, Boston University School of Public Health, Boston, MA, United States

    4Department of Biostatistics and Medical Informatics, University of Wisconsin, Madison, WI, United States

    5Biostatistics and Epidemiology Data Analytics Center, Boston University School of Public Health, Boston, MA, United States

    6Department of Environmental Health, Boston University School of Public Health, Boston, MA, United States

    *all authors contributed equally

    Corresponding Author:

    Shruthi Mahalingaiah, MD, MS

    Department of Environmental Health

    Harvard T.H. Chan School of Public Health

    665 Huntington Avenue

    Building 1, Floor 14

    Boston, MA, 02115

    United States

    Phone: 1 6174324381

    Email: shruthi@hsph.harvard.edu


    Background: Multimodal recruitment strategies are a novel way to increase diversity in research populations. However, these methods have not been previously applied to understanding the prevalence of menstrual disorders such as polycystic ovary syndrome.

    Objective: The purpose of this study was to test the feasibility of recruiting a diverse cohort to complete a web-based survey on ovulation and menstruation health.

    Methods: We conducted the Ovulation and Menstruation Health Pilot Study using a REDCap web-based survey platform. We recruited 200 women from a clinical population, a community fair, and the internet.

    Results: We recruited 438 women over 29 weeks between September 2017 and March 2018. After consent and eligibility determination, 345 enrolled, 278 started (clinic: n=43; community fair: n=61; internet: n=174), and 247 completed (clinic: n=28; community fair: n=60; internet: n=159) the survey. Among all participants, the median age was 25.0 (SD 6.0) years, mean BMI was 26.1 kg/m2 (SD 6.6), 79.7% (216/271) had a college degree or higher, and 14.6% (37/254) reported a physician diagnosis of polycystic ovary syndrome. Race and ethnicity distributions were 64.7% (176/272) White, 11.8% (32/272) Black/African American, 7.7% (21/272) Latina/Hispanic, and 5.9% (16/272) Asian individuals; 9.9% (27/272) reported more than one race or ethnicity. The highest enrollment of Black/African American individuals was in clinic (17/42, 40.5%) compared to 1.6% (1/61) in the community fair and 8.3% (14/169) using the internet. Survey completion rates were highest among those who were recruited from the internet (159/174, 91.4%) and community fairs (60/61, 98.4%) compared to those recruited in clinic (28/43, 65.1%).

    Conclusions: Multimodal recruitment achieved target recruitment in a short time period and established a racially diverse cohort to study ovulation and menstruation health. There were greater enrollment and completion rates among those recruited via the internet and community fair.

    J Med Internet Res 2021;23(4):e24716

    doi:10.2196/24716

    Keywords

    polycystic ovary syndrome; PCOS; menstrual cycle; multimodal recruitment strategy; epidemiology; recruitment; pilot; strategy; women; feasibility; online survey; ovulation; menstrual 


    Polycystic ovary syndrome, initially described in 1935 [1], is now considered the most common endocrine disorder in reproductive-aged women [2]. Affecting 10% to 15% [2], prevalence estimates range from as low as 8% [3] to as high as 26% [4], depending on the definition used and population studied. The disorder is characterized by clinical or biochemical androgen excess, menstrual irregularity, and the presence of polycystic ovarian morphology on ultrasound visualization [5]. Clinical androgen excess typically presents as acne, hirsutism, or androgenic alopecia [6-8]. Women with polycystic ovary syndrome may also experience infertility, insulin resistance, and obesity [9-12].

    Existing research on polycystic ovary syndrome is typically conducted in either small clinical cohorts or larger epidemiologic studies. The latter have variable ascertainment of the disease or disease features which may increase misclassification of disease state and bias estimates of risk [13]. Preliminary studies on polycystic ovary syndrome in existing population-based cohorts such as the Nurses’ Health Study 2, the Framingham Heart Study, and the Cape Cod Health Study were limited by poor correlation of polycystic ovary syndrome self-reports compared to medical records [14], too few reported cases of menstrual irregularity [15], and inadequate determination of phenotype [16], respectively. Inaccurate classification using single yes or no questions to identify women with polycystic ovary syndrome may bias estimates of the disease.

    Existing epidemiologic cohorts were also limited with respect to race and ethnic diversity; more than 90% of participants were White in these 3 cohorts [16-18], thereby limiting the ability to detect differences in prevalence and etiological associations across racial and ethnic groups. Racial and ethnic-specific differences in androgen excess and metabolic syndrome symptoms are well established but the reasons for this are not well understood [19-21].

    The Ovulation and Menstruation Health Pilot Study was conducted to (1) determine the feasibility of enrolling participants from diverse backgrounds using varied recruitment modalities, and (2) understand how survey completion status differed by participant characteristics.


    Design

    The Ovulation and Menstruation Health study website consists of a short animated educational recruitment video, a web-based consent form, screening questions, and a survey instrument. The animated video was designed to appeal to a diverse audience, as its illustrations included women of all races and body types. The goal of the Ovulation and Menstruation Health Pilot Study was to recruit at least 200 reproductive-aged women over a 1-year period. Those who were menstruating or had the capacity to menstruate were eligible (trans-male and other). Individuals who were <18 years or >45 years of age; identified as male; were pregnant at the time of the survey; had a hysterectomy/oophorectomy, amenorrhea due to radiation, or chemotherapy; or were unwilling or unable to provide an email address were deemed ineligible. The survey instrument was publicly accessible from August 21, 2017 to February 26, 2018 on the study website and was used in each recruitment modality. The Boston Medical Center and Boston University Medical Campus Institutional Review Boards approved the study (IRB H-35075).

    Incentive

    The first 200 participants who completed the survey were entered into a lottery for a US $200 gift card. All who were approached for recruitment were offered free earphones.

    Recruitment

    The multimodal recruitment locations were in clinic, a Boston-based community event, and the internet. The recruitment approach was adapted to meet the needs of each recruitment location.

    In-Clinic

    In-clinic recruitment occurred from September to October 2017. Approximately 2000 informational recruitment letters including the study website were sent during this recruitment period to patients with an upcoming visit to the Department of Obstetrics and Gynecology (OB/GYN) at Boston Medical Center (BMC). For 20 days, research assistants showed the study website and the promotional video via an electronic tablet to interested persons at 2 OB/GYN waiting rooms.

    Community Event

    A recruitment table was set up at the Boston Women’s Market in the Jamaica Plain neighborhood of Boston on September 17, 2017. This community event was an opportunity for those who identify as female or supporters of women’s causes to sell products from their small businesses.

    Internet

    Internet-based recruitment methods included sending out email communications, creating study social media engagement accounts, and sharing recruitment materials on individual social networks of the study staff. The study website and social media pages were discoverable on any internet search. Boston University Medical Campus (BUMC)–wide electronic communications, which included a brief description of the study, eligibility requirements, incentive, and study contact information, began in September 2017 and ran for the duration of the enrollment period. The study website link was shared on personal networks of study personnel (RM, MN, AW) with the Boston University Masters of Medical Science Class of 2018 and the Bates Feminist Collective Facebook groups in September 2017.

    Physical flyers and business cards (paper materials) were posted around the BUMC campus for the duration of the study, and at Boston Skin Solutions, a center that treats excess facial and body hair on September 27, 2017.

    Informed Consent, Screening, and Survey Initiation

    The web-based consent form included questions on a participant’s interest in follow-up surveys, other studies, and contributing biospecimens. Once consented, the individual was presented with an eligibility screener. Eligible participants recruited in clinic were able to start the survey in the waiting room. For eligible participants from the community event and the internet, a unique link to the survey was emailed to the participant’s email address. For all enrolled participants, up to 3 reminders were sent on consecutive days to those who did not complete the survey.

    Survey Description

    The Ovulation and Menstruation Health Pilot Study survey had a total of 10 sections, with 219 questions; however, most respondents had fewer questions due to skip patterns. The About You section included questions on current residence and whether they ever received care at BMC. The Demographics section included questions on race and ethnicity, education, birth country, and income. The Anthropometrics section captured data regarding height, weight, and body shape using a pictorial tool. The Menstrual Cycle section asked about menarche, regularity of cycles, and cycle tracking. The Hormone Usage section obtained data on hormonal contraceptive usage, history and reasons for hormone usage. The Health and Body section included questions for self-reported androgen excess using a pictorial tool for androgenic alopecia and hirsutism based on the modified Ferriman-Gallwey scale [22]; polycystic ovary syndrome status (questions specific to polycystic ovary syndrome diagnosis, symptoms for diagnosis, and medication and supplement use, and family history of polycystic ovary syndrome); reproductive health (history of infertility, uterine fibroids, endometriosis, and premature ovarian failure); general health (diagnosed medical conditions such as hypertension, diabetes, and other chronic conditions and their treatment); diet and lifestyle (limited questions about alcoholic, nonalcoholic beverage consumption, and smoking habits); obstetric history (ever pregnant, number of prior pregnancies, and each pregnancy outcome, including stillbirths and miscarriages, and live births). For every livebirth, an additional question was asked regarding gestational length and birth outcomes such as birth weight. Study data were recorded and stored on encrypted servers at the Boston University School of Public Health Biostatistics & Epidemiology Data Analytics Center. The Ovulation and Menstruation Health Pilot Study survey can be found on the Harvard Dataverse [23].

    Data Analysis

    Participant characteristics were evaluated by recruitment location and survey completion. Those who started the survey via the internet included those who input the link into their web-browser after learning of the study from any web-based or printed recruitment materials and completed the web-based consent and screener. Survey initiation was defined as anyone who started the “About You” section. Survey completion was defined as having completed the first question of the “Pregnancy and Birth History” upon entering the total number of pregnancies experienced. Those who entered 0 pregnancies had no further questions to complete. Those who entered 1 or more had additional pregnancy related questions to complete. For both nulliparous and multiparous responses, completing the survey was as entering the total number of pregnancies experienced. To assess the geographical catchment area associated with the survey, participants’ self-reported home states were mapped.


    Recruitment and Enrollment

    Recruitment exceeded our target of 200 women in 8 weeks. During the 6-month recruitment window, 438 women began the consent process, 384 were assessed for eligibility, and 345 women were screened and included (88.7% of those assessed for eligibility). Of the 345, 278 women started the survey, of whom 66 were recruited in clinic, 61 were recruited from the community event, and 174 were recruited from the internet. Figure 1 displays the study enrollment flow chart. Spikes in cumulative enrollment coincided with the active in-clinic recruitment and the community event (Figure 2). Out of the 384 participants who consented and completed screening, only 39 (10.2%) were excluded. Of the individuals who were excluded, 18 were no longer menstruating, 16 were unwilling or unable to provide email addresses, and 5 were over the age of 45 years. Among those who initiated the survey and responded to re-contact questions, agreement for re-contact was high—96.0% (266/277) consented to be re-contacted for additional information, 81.2% (225/277) for biological samples, 96.4% (267/277) for a follow-up survey, and 79.4% (220/277) for a different research study.

    ‎
    Figure 1. Flowchart of participants enrolled in the Ovulation and Menstruation Health Pilot Study.
    View this figure
    ‎
    Figure 2. Ovulation and Menstruation Health Pilot Study enrollment graph.
    View this figure

    Participant Characteristics

    Among the 278 women who started the survey, the average age was 27.3 years and the median age was 25.0 (SD 6.0), with the majority (224/273, 82.1%) born in the United States (Table 1). Participants were White (176/272, 64.7%), Black/African American (32/272, 11.8%), Latina/Hispanic (21/272, 7.7%), and mixed race (27/272, 9.9%). Two individuals identified their gender as other (nonbinary or gender queer). While the majority (216/271, 79.7%) had a 4-year college degree or more, 7.0% (19/271) had a high school degree or less education. Participants were distributed across all income categories, with 21.3% (58/272) in the less than $25,000 category. The mean BMI was 26.1 kg/m2 (SD 6.6), with 15.4% (41/266) in the overweight category; 13.1% (32/245) had smoked at least 100 cigarettes over their lifetime. The reported prevalence of doctor-diagnosed polycystic ovary syndrome was 14.6% (37/254), and 82.3% (218/265) had ever used hormonal contraception. The geographic distribution of the cohort included 20 states (Figure 3). The majority of the participants were recruited from Massachusetts (n=173) and Missouri (n=50).

    ‎
    Figure 3. Ovulation and Menstruation Health Study participant population map.
    View this figure
    Table 1. Demographics in the Ovulation and Menstruation pilot study.
     CharacteristicValue (n=278a)
    Age (years), median (SD)25.0 (6.0)
    Born in the United States, n (%) 224 (82.1) 
    Race, n (%)  

    		White176 (64.7) 

    		Latina/Hispanic 21 (7.7) 

    		Black/African American 32 (11.8) 

    		Asian 16 (5.9) 

    		More than one race 27 (9.9) 
    Educational attainment, n (%)  

    		High school graduate/GED or less education 19 (7.0) 

    		Some college or 2-year degree 36 (13.3) 

    		4-year college graduate 101 (37.3) 

    		More than 4-year college degree 115 (42.4) 
    Total annual household income, n (%)  

    		Below $25,000 58 (21.3) 

    		$25,000 to $49,999 70 (25.7) 

    		$50,000 to $74,999 44 (16.2) 

    		$75,000 to $99,999 20 (7.4) 

    		$100,000 or more 43 (15.8) 

    		Prefer not to answer 17 (6.3) 

    		Don\'t know 20 (7.4) 
    Smoked at least 100 cigarettes over lifetime, n (%) 32 (13.1) 
    BMIb, n (%)  

    		Underweight (<18.5 kg/m2)  8 (3.0) 

    		Normal weight (18.5-24.9 kg/m2) 153 (57.5) 

    		Overweight (25.0-29.9 kg/m2) 41 (15.4) 

    		Obese (≥30.0 kg/m2) 64 (24.1) 
    Polycystic ovary syndrome diagnosis by doctor, n (%) 37 (14.6) 
    Ever pregnant, n (%) 42 (17.0) 
    Gravidityc, n (%)  

    		1 pregnancy 17 (40.5) 

    		2 pregnancies 10 (23.8) 

    		3 pregnancies 7 (16.7) 

    		>4 pregnancies 8 (19.1) 
    Hormonal contraceptives ever use, n (%) 218 (82.3) 
    Self-rated current health, n (%)  

    		Excellent37 (14.1) 

    		Very good108 (41.2) 

    		Good91 (34.7) 

    		Fair25 (9.5) 

    		Poor1 (0.4) 
    Survey completed, n (%) 247 (88.9) 

    aMissing—born in the United States n=5 (1.8%); race: n=6 (2.2%); education: n=7 (2.5%); income: n=6 (2.2%); smoking status: n=33 (11.9%); BMI: n=12 (4.3%); polycystic ovary syndrome diagnosis: n=24 (8.6%); gravidity: n=26 (9.4%); ever pregnant: n=31 (11.2%); hormonal contraceptive: n=13 (4.7%); self-rated current health: n=16 (5.8%).

    bBMI: body mass index.

    cGravidity among women who were ever pregnant (n=42).

    Population Demographic Characteristics by Recruitment Location

    Differences were found in age, birth country, race, educational attainment, BMI, and physician-diagnosed polycystic ovary syndrome, by location of recruitment (Table 2). Women recruited in clinic tended to be older (median 34.0 years, SD 6.7), born outside the US (26/42, 61.9%), and with lower educational attainment, 19.0% (8/42) were high school graduate/GED or less education compared to women recruited at the community fair and via the internet. Women recruited in clinic were also more likely to be obese (18/38, 47.4%), have had a physician diagnosis of polycystic ovary syndrome (12/33, 36.4%), and less likely to have ever used oral contraceptives (23/37, 62.2%) compared to women recruited at the community fair and via the internet. Those from the community fair and internet were more likely to be born in the US (58/61, 95.1% and 150/170, 88.2%, respectively), White (47/61, 77.0% and 121/169, 71.6%, respectively), and have greater than a 4-year college degree (24/61, 39.3% and 83/168, 49.4%, respectively) than those recruited from the clinic. Women recruited from outside the clinic were younger (community fair: median 23.0, SD 4.0; internet: median 25.0, SD 5.4 years), leaner BMI (community fair: 23.3 kg/m2 SD 4.8; internet: 23.5 kg/m2 SD 7.0) and had a lower prevalence of physician diagnosed polycystic ovary syndrome (community fair: 3/61, 4.9%; internet: 22/160, 13.8%). Of note, 46.4% of women recruited in clinic (13/28) had been pregnant compared to 3.3% (2/61) and 17.0% (27/159) for the community fair and internet participants, respectively. Income and smoking status were similar among recruitment locations.

    Table 2. Demographic characteristics by recruitment location.
    CharacteristicLocation
    Clinic (n=43)aCommunity fair (n=61)bInternet (n=174)c
    Age (years), median (SD)34.0 (6.7)23.0 (4.0)25.0 (5.4)
    Born in the United States, n (%)16 (38.1)58 (95.1)150 (88.2)
    Race, n (%)

    		White8 (19.0)47 (77.0)121 (71.6)

    		Latina/Hispanic12 (28.6)2 (3.3)7 (4.1)

    		Black/African American17 (40.5)1 (1.6)14 (8.3)

    		Asian3 (7.1)1 (1.6)12 (7.1)

    		More than one race2 (4.8)10 (16.4)15 (8.9)
    Educational attainment, n (%)

    		High school graduate/GED or less education8 (19.0)6 (9.8)5 (3.0)

    		Some college or 2-year degree14 (33.3)8 (13.1)14 (8.3)

    		4-year college graduate12 (28.6)23 (37.7)66 (39.3)

    		More than 4-year college degree8 (19.1)24 (39.3)83 (49.4)
    Total annual household income, n (%)

    		Below $25,0004 (9.5)13 (21.3)41 (24.3)

    		$25,000 to $49,99912 (28.6)20 (32.8)38 (22.5)

    		$50,000 to $74,99911 (26.2)9 (14.8)24 (14.2)

    		$75,000 to $99,9991 (2.4)3 (4.9)16 (9.5)

    		$100,000 or more5 (11.9)6 (9.8)32 (18.9)

    		Prefer not to answer8 (19.1)2 (3.3)7 (4.1)

    		Don\'t know1 (2.4)8 (13.1)11 (6.5)
    Smoked at least 100 cigarettes over lifetime, n (%)5 (17.9)5 (8.3)22 (14.0)
    BMId, n (%)

    		Normal weight or underweight (≤25 kg/m2)14 (36.8)40 (65.6)107 (64.1)

    		Overweight (25-30 kg/m2)6 (15.8)11 (18.0)24 (14.4)

    		Obese (≥30 kg/m2)18 (47.4)10 (16.4)36 (21.6)
    Polycystic ovary syndrome diagnosis by doctor, n (%)12 (36.4)3 (4.9)22 (13.8)
    Ever pregnant, n (%)13 (46.4)2 (3.3)27 (17.0)
    Graviditye, n (%)

    		1 pregnancy5 (38.5)1 (50.0)11 (40.7)

    		2 or more pregnancies8 (61.5)1 (50.0)16 (59.3)
    Hormonal contraceptives ever use, n (%)23 (62.2)54 (88.5)141 (84.4)
    Self-rated current health, n (%)

    		Excellent6 (16.2)8 (13.1)23 (14.0)

    		Very good7 (18.9)29 (47.5)72 (43.9)

    		Good18 (48.7)21 (34.4)52 (31.7)

    		Fair to poor6 (16.2)3 (4.9)17 (10.4)
    Survey completed, n (%)28 (65.1)60 (98.4)159 (91.4)

    aMissing—born in the US: n=1 (2.3%); race: n=1 (2.3%); education: n=1 (2.3%); income: n=1 (2.3%); smoking status: n=15 (34.9%); BMI: n=5 (11.6%); polycystic ovary syndrome diagnosis: n=10 (23.3%); ever pregnant: n=15 (34.9%); hormonal contraceptive: n=6 (14.0%); self-rated current health: n=6 (14.0%).

    bMissing—smoking status: n=1 (1.6%).

    cMissing—born in the US: n=4 (2.3%); race: n=5 (2.9%); education: n=6 (3.5%); income: n=5 (2.9%); smoking status n=17 (9.8%); BMI: n=7 (4.0%); polycystic ovary syndrome diagnosis: n=14 (8.1%); ever pregnant: n=15 (8.6%); hormonal contraceptive: n=7 (4.0%); self-rated current health: n=10 (5.7%).

    dBMI: body mass index.

    eGravidity among women who were ever pregnant (n=42).

    Survey Completion

    Among the 278 women who started the survey, 247 (88.8%) completed it. The median time to completion was 12.6 minutes (range 1.03 minutes to 92 days); 7 participants took more than 24 hours to complete the survey. Women completing the survey were more likely to be US born (210/246, 85.4% vs 14/27, 51.9%), White (165/245, 67.3% vs 11/27, 40.7%) and have 4 years of college education or more (200/244, 81.9% vs 16/27, 59.2%) compared to those who did not complete the survey (Table 3).

    We also found that the women who did not complete the survey were older and had higher annual household income compared to those who completed the survey. Among the 31 women who did not complete the survey, dropout seemed equally distributed across section categories (Figure 4).

    Table 3. Demographic characteristics by survey completion status (N=278).
    CharacteristicComplete (n=247)aIncomplete (n=31)b
    Age (years), median (SD)25.0 (5.7)29.0 (7.4)
    Born in the United States, n (%)210 (85.7)14 (51.9)
    Race, n (%)

    		White165 (67.4)11 (40.7)

    		Latina/Hispanic15 (6.1)6 (22.2)

    		Black/African American25 (10.2)7 (25.9)

    		Asian15 (6.1)1 (3.7)

    		More than one race25 (10.2)2 (7.4)
    Educational attainment, n (%)

    		High school graduate/GED or less education14 (5.7)5 (18.5)

    		Some college or 2-year degree30 (12.3)6 (22.2)

    		4-year college graduate94 (38.5)7 (25.9)

    		More than 4-year college degree106 (43.4)9 (33.3)
    Total annual household income, n (%)

    		Below $25,00054 (22.0)4 (14.8)

    		$25,000 to $49,99963 (25.7)7 (25.9)

    		$50,000 to $74,99942 (17.1)2 (7.4)

    		$75,000 to $99,99919 (7.8)1 (3.7)

    		$100,000 or more39 (15.9)4 (14.8)

    		Prefer not to answer11 (4.5)6 (22.2)

    		Don\'t know17 (4.5)3 (11.1)

    aMissing—born in the US: n=1 (0.4%); race: n=2 (0.8%); education: n=3 (1.2%); income: n=2 (0.8%).

    bMissing—born in the US: n=4 (12.9%); race: n=4 (12.9%); education: n=4 (12.9%); income: n=4 (12.9%).

    ‎
    Figure 4. Survey completion by last module answered in the survey.
    View this figure

    We determined the feasibility of a multimodal recruitment approach for a study of ovulation and menstruation health by comparing in-clinic, community-based, and internet-based recruitment activities. Among the recruitment modalities, the majority of women were recruited via the internet after encountering advertising materials informing them of the study website. The race and ethnicity of the cohort was notably similar to the US population [24]. Based on census data from 2018, the US population was comprised of 166,038,755 women which was 50.8% of the total population. Of those women, 60.3% were White, 17.8% were Latina or Hispanic, 12.9% were Black or African American, 5.9% were Asian, and 2.2% identified as being of more than one race [24].

    The participant characteristics did differ by recruitment location, suggesting that multimodal recruitment is a feasible solution to increase the variation in participant characteristics including race, ethnicity, and health characteristics such as BMI, oral contraceptive use, and whether physician diagnosed. These different characteristics may reflect differences in the source population. For example, approximately 59% of the patients at BMC come from an underserved population [25], whereas the community event was held in Jamaica Plain, a neighborhood that has a 53.6% White population and a median household annual income of $55,861 [26]. While use of the internet usage demographics are reported as 92% of White, 86% of Hispanic, and 85% of Black individuals in the US [27], those accessing the study via the internet were recruited through flyers, email communications, and personal social media networks. The geographic distribution of the participants was notable for the majority in Massachusetts, with second-highest participation in Missouri, corresponding to the personal network of 1 research assistant.

    Similarly, another study [28] was also successful in recruiting racially and ethnically diverse participants using a combination of 340 recruitment sites and digital campaigns. Among the core participants of that study [28], 51% were considered non-White, whereas participants in traditional reproductive health cohorts have been 83% Caucasian [29] and 89% White [14]. Furthermore, while participants from the original Framingham Heart Study were 100% White, racial diversity increased in subsequent studies with inclusion of 28% African American, 42% Hispanic American, and 24% Asian American participants within the Framingham-related Omni Cohort [30].

    The completion rate among those who started our survey (247/278, 88.8%) was high. This completion rate is comparable to those of the Pregnancy Study Online [29], with 72% of enrolled participants completing the baseline survey, and the most recent Framingham Heart Study [31], with participants using an electronic survey (85% completion). It is possible that our survey was shorter than those used in those studies [29,31] and as such had a slightly higher completion rate. Furthermore, the Ovulation and Menstruation Health survey was designed for an 8th grade reading level and underwent cognitive and usability testing to facilitate question comprehension [32], potentially supporting a pleasant participant experience. While participants could skip any question, the rate of missing responses was low. Birthplace outside of the US was a key variable noted to be missing among a small proportion of women who did not complete the survey.

    This study has several strengths. We achieved target recruitment in half the expected time, which may have been due to the appealing web-based study platform that included an educational cartoon featuring women from multiple backgrounds or the monetary incentive. Use of a cognitively tested survey designed for an 8th grade reading level may also have facilitated the high completion rate. The broad inclusion criteria also allowed for those with and without polycystic ovary syndrome to be included. Most importantly, the multimodal recruitment approach enabled us to recruit a more diverse cohort, which is comparable to those in other studies using a similar multimodal recruitment strategy for other health conditions [33].

    However, the study also has some key limitations. While racial and ethnic diversity were improved compared to existing large epidemiologic cohorts, the proportion of Latina or Hispanic women was slightly lower than that in the US population, possible due to language access issues. We recently translated the Ovulation and Menstruation Health Platform for availability in Spanish language to test in future studies. Also, completion rate by those born outside the US may be improved by having the survey in the primary language of the participant. In the future, using paid advertisements may not only lead to high click-through rates to the study website, but may also provide for a unique opportunity to engage with specific targeted demographics depending on advertisement dissemination. For example, the Nurses’ Health Study 3 [17] sent recruitment postcards to minority-dense zip codes doubling the enrollment rate of African American and Hispanic women.

    Furthermore, we considered whether bias in multimodal recruitment exists. We do not believe that multimodal recruitment increased the likelihood of selection bias since enrollment would need to be related to both the exposure and outcome under study for such a bias to occur [34-37]. The multimodal recruitment strategy increases the generalizability of the study and increases its ability to examine effect measure modification by racial and ethnic group by ensuring sufficient numbers in each category. Because differences exist in racial or ethnic-specific risks for a variety of health outcomes potentially due to structural racism and other inequities [38], a multiethnic cohort is needed to assess health outcomes subsequent to polycystic ovary syndrome diagnosis and to determine ideal windows for risk-reducing interventions.

    Multimodal recruitment was feasible and established a more racially and ethnically diverse cohort for the study of ovulation and menstruation health than those of prior studies [14,28,29]. Samples from 3 different recruitment locations demonstrated variability in racial, ethnic, and other demographic and health-related features.

    Acknowledgments

    We would like to acknowledge the support of the Department of OB/GYN at Boston University Medical Campus, where this work was conducted, and Vasantha Padmanabhan for her inspirational input.

    Conflicts of Interest

    None declared.

    1. Stein IF, Leventhal ML. Amenorrhea associated with bilateral polycystic ovaries. Am J Obstet Gynecol 1935;29(2):181-191. [CrossRef]
    2. Yildiz BO, Bozdag G, Yapici Z, Esinler I, Yarali H. Prevalence, phenotype and cardiometabolic risk of polycystic ovary syndrome under different diagnostic criteria. Hum Reprod 2012 Oct;27(10):3067-3073. [CrossRef] [Medline]
    3. Diamanti-Kandarakis E, Kouli CR, Bergiele AT, Filandra FA, Tsianateli TC, Spina GG, et al. A survey of the polycystic ovary syndrome in the Greek island of Lesbos: hormonal and metabolic profile. J Clin Endocrinol Metab 1999 Nov;84(11):4006-4011. [CrossRef] [Medline]
    4. Boyle JA, Cunningham J, Norman RJ, Dunbar T, O'Dea K. Polycystic ovary syndrome and metabolic syndrome in Indigenous Australian women. Intern Med J 2015 Dec;45(12):1247-1254. [CrossRef] [Medline]
    5. Rotterdam ESHRE/ASRM-Sponsored PCOS Consensus Workshop Group. Revised 2003 consensus on diagnostic criteria and long-term health risks related to polycystic ovary syndrome. Fertil Steril 2004 Jan;81(1):19-25. [CrossRef] [Medline]
    6. Sheehan MT. Polycystic ovarian syndrome: diagnosis and management. Clin Med Res 2004 Feb;2(1):13-27 [FREE Full text] [CrossRef] [Medline]
    7. Azziz R, Carmina E, Dewailly D, Diamanti-Kandarakis E, Escobar-Morreale HF, Futterweit W, Task Force on the Phenotype of the Polycystic Ovary Syndrome of The Androgen ExcessPCOS Society. The Androgen Excess and PCOS Society criteria for the polycystic ovary syndrome: the complete task force report. Fertil Steril 2009 Feb;91(2):456-488. [CrossRef] [Medline]
    8. Lizneva D, Gavrilova-Jordan L, Walker W, Azziz R. Androgen excess: investigations and management. Best Pract Res Clin Obstet Gynaecol 2016 Nov;37:98-118. [CrossRef] [Medline]
    9. Wild S, Pierpoint T, McKeigue P, Jacobs H. Cardiovascular disease in women with polycystic ovary syndrome at long-term follow-up: a retrospective cohort study. Clin Endocrinol (Oxf) 2000 May;52(5):595-600. [CrossRef] [Medline]
    10. Apridonidze T, Essah PA, Iuorno MJ, Nestler JE. Prevalence and characteristics of the metabolic syndrome in women with polycystic ovary syndrome. J Clin Endocrinol Metab 2005 Apr;90(4):1929-1935. [CrossRef] [Medline]
    11. Jacewicz-Święcka M, Kowalska I. Polycystic ovary syndrome and the risk of cardiometabolic complications in longitudinal studies. Diabetes Metab Res Rev 2018 Nov;34(8):e3054. [CrossRef] [Medline]
    12. Aziz M, Naver KV, Wissing MLM, Mikkelsen AL, Nilas L, Skouby SO. Polycystic ovary syndrome: infertility, cardiovascular, metabolic and obstetrical risks, laboratory and clinical outcomes -- the PICOLO Study. Gynecol Endocrinol 2012 Apr;28(4):253-258. [CrossRef] [Medline]
    13. Wolf WM, Wattick RA, Kinkade ON, Olfert MD. Geographical prevalence of polycystic ovary syndrome as determined by region and race/ethnicity. Int J Environ Res Public Health 2018 Nov 20;15(11):2589 [FREE Full text] [CrossRef] [Medline]
    14. Chavarro JE, Rich-Edwards JW, Gaskins AJ, Farland LV, Terry KL, Zhang C, et al. Contributions of the Nurses' Health Studies to reproductive health research. Am J Public Health 2016 Sep;106(9):1669-1676. [CrossRef] [Medline]
    15. Mahalingaiah S, Sun F, Cheng JJ, Chow ET, Lunetta KL, Murabito JM. Cardiovascular risk factors among women with self-reported infertility. Fertil Res Pract 2017;3:1-7. [CrossRef] [Medline]
    16. Mahalingaiah S, Winter MR, Aschengrau A. Association of prenatal and early life exposure to tetrachloroethylene (PCE) with polycystic ovary syndrome and other reproductive disorders in the Cape Cod health study: A retrospective cohort study. Reprod Toxicol 2016 Oct;65:87-94 [FREE Full text] [CrossRef] [Medline]
    17. Bao Y, Bertoia ML, Lenart EB, Stampfer MJ, Willett WC, Speizer FE, et al. Origin, methods, and evolution of the three Nurses' Health Studies. Am J Public Health 2016 Sep;106(9):1573-1581. [CrossRef] [Medline]
    18. Govindaraju D, Adrienne Cupples L, Kannel W, O'Donnell C, Atwood L, D'Agostino R, et al. Genetics of the Framingham Heart Study population. Adv Genet 2008;62:33-65 [FREE Full text] [CrossRef] [Medline]
    19. DeUgarte CM, Woods KS, Bartolucci AA, Azziz R. Degree of facial and body terminal hair growth in unselected black and white women: toward a populational definition of hirsutism. J Clin Endocrinol Metab 2006 Apr;91(4):1345-1350. [CrossRef] [Medline]
    20. Cheewadhanaraks S, Peeyananjarassri K, Choksuchat C. Clinical diagnosis of hirsutism in Thai women. J Med Assoc Thai 2004 May;87(5):459-463. [Medline]
    21. Moore JX, Chaudhary N, Akinyemiju T. Metabolic syndrome prevalence by race/ethnicity and sex in the United States, National Health and Nutrition Examination Survey, 1988-2012. Prev Chronic Dis 2017 Mar 16;14:E24 [FREE Full text] [CrossRef] [Medline]
    22. Bode D, Seehusen DA, Baird D. Hirsutism in women. Am Fam Physician 2012 Feb 15;85(4):373-380 [FREE Full text] [Medline]
    23. Mahalingaiah S. The Ovulation and Menstruation Health (OM) Pilot Study survey instrument. Harvard Dataverse. 2020.   URL: https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/XACYQA [accessed 2021-03-31]
    24. 2018 population estimates by age, sex, race and hispanic origin. United States Census Bureau. 2019 Jun 20.   URL: https://www.census.gov/newsroom/press-kits/2019/detailed-estimates.html [accessed 2020-10-30]
    25. Commitment to our community. Boston Medical Center.: Boston Medical Center; 2017.   URL: https://tinyurl.com/3smmk59r [accessed 2021-03-31]
    26. Jamaica Plain data profile population demographics. City of Boston.: Policy Development & Research Division; 2010.   URL: https://www.cityofboston.gov/images_documents/Jamaica_Plain_Planning_District_Profile_tcm3-12993.pdf [accessed 2020-10-30]
    27. Internet/broadband fact sheet. Pew Research Center. 2019 Jun 12.   URL: https://www.pewresearch.org/internet/fact-sheet/internet-broadband/ [accessed 2020-10-30]
    28. All of Us Research Program Investigators, Denny JC, Rutter JL, Goldstein DB, Philippakis A, Smoller JW, et al. The "All of Us" research program. N Engl J Med 2019 Aug 15;381(7):668-676. [CrossRef] [Medline]
    29. Wise LA, Rothman KJ, Mikkelsen EM, Stanford JB, Wesselink AK, McKinnon C, et al. Design and conduct of an internet-based preconception cohort study in North America: pregnancy study online. Paediatr Perinat Epidemiol 2015 Jul;29(4):360-371 [FREE Full text] [CrossRef] [Medline]
    30. Tsao CW, Vasan RS. Cohort profile: the Framingham Heart Study (FHS): overview of milestones in cardiovascular epidemiology. Int J Epidemiol 2015 Dec;44(6):1800-1813 [FREE Full text] [CrossRef] [Medline]
    31. McManus DD, Trinquart L, Benjamin EJ, Manders ES, Fusco K, Jung LS, et al. Design and preliminary findings from a new electronic cohort embedded in the Framingham Heart Study. J Med Internet Res 2019 Mar 01;21(3):e12143 [FREE Full text] [CrossRef] [Medline]
    32. Mahalingaiah S, Cosenza C, Cheng J, Rodriguez E, Aschengrau A. Cognitive testing of a survey instrument for self-assessed menstrual cycle characteristics and androgen excess. Fertil Res Pract 2020 Dec 09;6(1):1-10 [FREE Full text] [CrossRef] [Medline]
    33. DiBonaventura MD, Sadosky A, Concialdi K, Hopps M, Kudel I, Parsons B, et al. The prevalence of probable neuropathic pain in the US: results from a multimodal general-population health survey. J Pain Res 2017;10:2525-2538 [FREE Full text] [CrossRef] [Medline]
    34. Hatch EE, Hahn KA, Wise LA, Mikkelsen EM, Kumar R, Fox MP, et al. Evaluation of selection bias in an internet-based study of pregnancy planners. Epidemiology 2016 Jan;27(1):98-104. [CrossRef] [Medline]
    35. Aschengrau A, Seage III GR. Essentials of Epidemiology in Public Health 4th edition. Burlington, MA: Jones & Bartlett Learning LLC; 2020:267-292.
    36. Nohr EA, Liew Z. How to investigate and adjust for selection bias in cohort studies. Acta Obstet Gynecol Scand 2018 Apr;97(4):407-416. [CrossRef] [Medline]
    37. Rothman KJ, Greenland S, Lash TL. Modern Epidemiology 3rd edition. Philadelphia, PA: Lippincott Williams & Wilkins; 2008.
    38. Singh GK, Daus GP, Allender M, Ramey CT, Martin EK, Perry C, et al. Social determinants of health in the United States: addressing major health inequality trends for the nation, 1935-2016. Int J MCH AIDS 2017;6(2):139-164 [FREE Full text] [CrossRef] [Medline]

    ‎
    BMC: Boston Medical Center
    BMI: body mass index
    BUMC: Boston University Medical Campus
    OB/GYN: Obstetrics and Gynecology

    Edited by G Eysenbach, R Kukafka; submitted 01.10.20; peer-reviewed by S Butts, R Krukowski; comments to author 23.10.20; revised version received 30.10.20; accepted 11.03.21; published 16.04.21

    Copyright

    ©Shruthi Mahalingaiah, J Jojo Cheng, Michael R Winter, Erika Rodriguez, Victoria Fruh, Anna Williams, MyMy Nguyen, Rashmi Madhavan, Pascaline Karanja, Jill MacRae, Sai Charan Konanki, Kevin J Lane, Ann Aschengrau. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 16.04.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.