Health Outcomes in Patients Using No-Prescription Online Pharmacies to Purchase Prescription Drugs

Health Outcomes in Patients Using No-Prescription Online Pharmacies to Purchase Prescription Drugs

Health Outcomes in Patients Using No-Prescription Online Pharmacies to Purchase Prescription Drugs

Authors of this article:

Theodore J Cicero1 ;   Matthew Stephen Ellis1

Original Paper

School of Medicine, Department of Psychiatry, Washington University in St. Louis, Saint Louis, MO, United States

*all authors contributed equally

Corresponding Author:

Theodore J Cicero, PhD

School of Medicine

Department of Psychiatry

Washington University in St. Louis

Campus Box 8134

660 S. Euclid Ave.

Saint Louis, MO, 63110

United States

Phone: 1 314 362 0459

Fax:1 314 362 0936

Email: cicerot@wustl.edu


Background: Many prescription drugs are freely available for purchase on the Internet without a legitimate prescription from a physician.

Objective: This study focused on the motivations for using no-prescription online pharmacies (NPOPs) to purchase prescription drugs rather than using the traditional doctor-patient-pharmacy model. We also studied whether users of NPOP-purchased drugs had poorer health outcomes than those who obtain the same drug through legitimate health care channels.

Methods: We selected tramadol as a representative drug to address our objective because it is widely prescribed as an unscheduled opioid analgesic and can easily be purchased from NPOPs. Using search engine marketing (SEM), we placed advertisements on search result pages stemming from the keyword “tramadol” and related terms and phrases. Participants, who either used the traditional doctor-patient-pharmacy model to obtain tramadol (traditional users, n=349) or purchased it on the Web without a prescription from their local doctor (ie, nontraditional users, n=96), were then asked to complete an online survey.

Results: Respondents in both groups were primarily white, female, and in their mid-forties (nontraditional users) to upper forties (traditional users). Nearly all nontraditional users indicated that their tramadol use was motivated by a need to treat pain (95%, 91/96) that they perceived was not managed appropriately through legitimate health care channels. A majority of nontraditional users (55%, 41/75) indicated they used NPOPs because they did not have access to sufficient doses of tramadol to relieve pain. In addition, 29% (22/75) of nontraditional users indicated that the NPOPs were a far cheaper alternative than seeing a physician, paying for an office visit, and filling a prescription at a local pharmacy, which is often at noninsured rates for those who lack medical insurance (37%, 35/96, of NPOP users). The remainder of participants (16%, 12/96) cited other motivations (eg, anonymity) for using NPOPs. In terms of health outcomes, nontraditional users experienced a significantly (P<.01) greater number and severity of adverse events, including life-threatening seizures: 7% (7/96) of nontraditional users reported seizures, while none of the traditional users reported seizures.

Conclusions: Although online pharmacies can offer distinct advantages in terms of convenience and cost, users of these “rogue” pharmacies that offer drugs with no prescription or doctor supervision do so at great risk to their health, as evidenced by much higher rates of adverse events. The most logical explanation for these findings is that the lack of physician oversight of dosage schedules, contraindicated conditions, and concomitant medications, were responsible for the increased intensity and frequency of adverse events in the nontraditional users. Although we only examined tramadol, it is logical to postulate that similar results would be observed with dozens of equally accessible prescription drugs. As such, the geometric growth in the use of online pharmacies around the world should prompt intense medical and regulatory discussion about their role in the provision of medical care.

J Med Internet Res 2012;14(6):e174

doi:10.2196/jmir.2236

Keywords



The Internet has evolved into a source of consumer products that were historically only available in “brick-and-mortar” establishments. Recently, there has been growth in the use of the Internet in medical practice, most prominently in the use of online pharmacies to fill physicians’ prescriptions and mail the drug directly to the patient. These pharmacies serve as an important resource for patients, particularly for those who have limited mobility or accessibility needs [1-5]. Unfortunately, this positive use of modern technology has had an unanticipated outcome: the advent of online pharmacies that provide drugs—such as opioid analgesics, antidepressants, cholesterol-management drugs, and erectile dysfunction medications—without a legitimate prescription from a physician [6-11]. In fact, it has been estimated that in the United States alone, 1 in 6 consumers, or roughly 36 million people, have bought or currently buy prescription medications online without a valid prescription [12].

Initially, as the number of no-prescription online pharmacies (NPOPs) [13] increased exponentially in the late 1990s, there was widespread concern that the Internet would serve as a major source of diversion for prescription drug abusers, since many sites offered controlled substances (such as hydrocodone and oxycodone) for purchase [6,14-15]. After Ryan Haight died from an overdose of hydrocodone, allegedly bought over the Internet without a valid prescription, a law bearing his name was passed in 2008 that made it illegal in the United States for NPOPs to sell controlled substances [16]. No matter the reason, research has shown that the Internet has not evolved into a significant source of prescription drugs for the purpose of drug abuse [17-18].

While controlled substances may not be readily accessible from domestic NPOPs [19], other studies have described the availability of many other types of medication through these outlets. These medications include HIV drugs, benzodiazepines, and cholesterol medications, as well as lifestyle drugs, such as diet pills and erectile dysfunction medications. Unlike controlled substances with the potential for abuse, there are no current laws regulating the sale of these other potentially dangerous prescription medications through NPOPs. The main arguments against taking the easiest step, which would be to simply eliminate all online pharmacies, is that they are difficult to close down [4] and that with appropriate controls they can provide consumers advantages in both cost and accessibility [1-5,20]. In fact, one study demonstrated the efficacy of utilizing an accredited online pharmacy to prescribe Viagra. Patients who used the online pharmacy showed similar numbers of side effects and similar treatment efficacy compared to those receiving Viagra through a local pharmacy. They also provided a more complete medical history [21]. To manage the increased use of online pharmacies, however, more regulations are being proposed, including the Online Pharmacy Safety Act and the development of state-run online pharmacy programs [22,23].

In a major effort to steer consumers toward legitimate online pharmacies that are safe to use and away from rogue online pharmacies that pose a potential threat to consumer safety, the National Association of Boards of Pharmacy developed the Verified Internet Pharmacy Practice Sites (VIPPS) program to accredit online pharmacies based on a number of qualifying criteria [24]. Unfortunately, this accreditation is limited to domestic online pharmacies and, as it only approves online pharmacies that require a valid prescription [24], it does not address the larger issue of people seeking medications through NPOPs outside of a typical doctor-patient-pharmacy relationship.

It should be stressed that no matter what legislative controls are adopted, there is a simple way to bypass these restrictions: move the NPOPs offshore, which is rapidly occurring with little government control [7,25-31]. For example, a report by the World Health Organization (WHO) noted that most countries, particularly India and China, which are major loci for NPOPs, have little or no regulation of online pharmacies [11]. This lack of oversight generates a number of safety concerns for NPOP consumers in distribution, information, and medication-related issues. Distribution issues include damaged packaging that exposes pills to light and moisture, shipments that do not meet manufacturer specifications (such as temperature-controlled or insulated packaging), and the ability of the consumer to reorder as many pills as desired [8-10,32-33]. The lack of proper labeling or safety information is common with NPOP-purchased medications and provides consumers with little to no information on dosage scheduling, dosage administration, or potential side effects [9,32-36]. Finally, the medications themselves could be expired, counterfeit, or cut with other substances. Even genuine drugs purchased from NPOPs could lead to a number of adverse events, including death, if the user is unaware of dangerous drug combinations or contraindicated medical conditions [3,5,32,37].

While the recent focus, appropriately, has been placed on the regulation of online pharmacies, there is very little systematic research outside of case reports on two potentially more important basic issues: (1) why consumers use online pharmacies in the place of legitimate medical channels; and (2) with such a variety of safety concerns, why consumers of drugs purchased from NPOPs have worse health outcomes than those who obtain the same the drugs through legitimate healthcare channels. The study described in this paper was designed to address these issues.


Selection of Target Drug

Since most online pharmacies offer dozens of drugs for purchase, we needed to narrow the focus to users of a single representative target drug. Tramadol was selected as the representative drug for this study because it is extensively prescribed (the third most frequently used analgesic [38]) and it is one of the most commonly offered authentic drugs from NPOPs with few restrictions on refills or quantity of tablets offered [8,10]. Tramadol has a demonstrated abuse profile [39-41], but its rate of abuse is not as high as other opioids (hence its noncontrolled status in the Controlled Substances Act). Like all drugs, there is also the potential for adverse side effects that can pose serious health risks. For example, tramadol not only has the potential to produce many of the same adverse events as other opioids (eg, constipation and dependence [39]), but also carries a serious risk of potentially fatal grand mal seizures, which are exacerbated by contraindicated medications and medical conditions [42-44]. In a prior report, we documented the ease of obtaining tramadol over the Internet, the authenticity of which was certified by a chemical analysis [8]. The purchase required the completion of a brief questionnaire that served as a medical examination. Subsequently, a virtual prescription was generated and filled by a pharmacy in Canada. The tramadol was received within 24 hours, and numerous phone calls and emails were received almost immediately to refill the prescription (some offers included up to 400 pills in a single order) and have continued on a monthly basis for over three years thus far.

Recruitment

It has been widely documented that recruiting and administering surveys over the Internet is an acceptable and beneficial research methodology [45-46]. While these methods provide quick access to thousands of people, they are not easily used to attract a targeted audience. To circumvent this problem, we developed a recruitment program that directly targeted a population of tramadol users with access to the Internet. We utilized search engine marketing (SEM), which is defined as a “form of Internet marketing that seeks to promote websites by increasing their visibility in search engine result pages through the use of paid placement, contextual advertising and paid inclusion [47].” Using Google AdWords and Yahoo Advertising Solutions for this study, we placed short advertisements (eg, “Do You Use Tramadol?”) in the margins of Google and Yahoo search result pages stemming from keyword searches of the term “tramadol” and related terms and phrases (eg, pain relief, Ultram, and buy tramadol online). Thus, our advertisement only appeared to Internet users who had an interest in tramadol or tramadol-related topics, making our target population more likely to include potential participants (ie, users of tramadol). When users clicked the ad, they were automatically directed to an online consent form and the subsequent survey hosted on an institutional website. Subjects were screened to be 18 years of age, users of tramadol in the past 30 days for any reason, and United States residents. Upon completion of the survey, participants were mailed a $50 Visa Check Card for their time.

Survey Instrument

Since this study represents a preliminary approach into this area of research, no standardized instruments could address all points of inquiry. As such, we developed a descriptive tool centered on our representative drug, in which questions about dosage schedules, adverse events, etc, were specifically related to tramadol. While we developed this descriptive tool to meet the objectives of this pilot study, we hope that the results can provide a basis for a more standardized instrument that can be used to investigate the same objectives for any number of drugs purchased from NPOPs in future studies. Other than demographics, the survey covered a broad variety of topics related specifically to tramadol, including the following: dosage schedule, intended use, comorbidity, legitimate and illegitimate drug use, and adverse events. Participants who listed NPOPs as a source of tramadol were presented with a subset of questions to determine the underlying factors behind their use of online pharmacies.

Data Analysis

A total of 445 tramadol users qualified for and completed this study. Of these participants, 349 indicated that they received tramadol solely through a valid prescription from their local doctor and filled it at a local pharmacy. These participants are referred to as “traditional users.” The other 96 participants are referred to as “nontraditional users.” This group obtained tramadol from an online pharmacy without a valid prescription from their doctor, and included those who were provided a prescription online by a “virtual” physician. We analyzed data using IBM SPSS Statistics Version 20. We used chi-square and logistical regression analyses to test for significant differences between traditional and nontraditional users at a P<.01 level.


Demographics

As shown in Table 1, both traditional and nontraditional users were primarily white and female. Traditional users were significantly older than nontraditional users. Looking at various types of health care coverage, 37% (n=35/95) of nontraditional users had no form of insurance, compared to just 16% (n=56/345) of traditional users.

Table 1. Demographics and health information for traditional and nontraditional users.
  Traditional users Nontraditional users P values
  (n=349) (n=96)  
Gender, %
      

Female 67.0 57 .08
Ethnicity, %
      

Caucasian 80.2 91 .02

African American 8.6 3 .07

Hispanic 4.6 4 .86

Other 6.6 2 .09
Age in years, mean (SE) 47.2 (0.7) 38.5 (1.2) <.001
Health care coverage, %
      

Private 36.8 35 .71

Dependent 10.4 4 .06

Medicare/Medicaid 25.2 13 .009

Military 5.5 1 .07

Other 5.8 11 .11

None 16.2 37 <.001

Use of NPOPs

We asked nontraditional users what their primary reason was for using online pharmacies in place of other sources (Figure 1): 55% (n=41/75) indicated that they did so for reasons related to accessibility of tramadol (eg, their doctor would not prescribe enough, they could not find a doctor who would prescribe it, or there was no other way to get it), 29% (n=22/75) did so for economic purposes (eg, they had no insurance, their medical plan would not cover it, or it was cheaper than other sources), and 16% (n=12/75) did so for other reasons (eg, anonymity or to prevent withdrawals).

Figure 1. Motivations for using online pharmacies as a source of tramadol reported by nontraditional users (N=96). The values given are the percent of respondents who endorsed a motivation listed or specified a motivation that was not listed (in quotation marks).
View this figure

Tramadol Use

Table 2 shows that nontraditional users were more likely to take the higher dose (100 mg) traditional users. Nontraditional users were also considerably more likely to use tramadol more frequently (5 or more times per week). All traditional users used tramadol for its indicated purpose (ie, to treat pain), with only 2.3% (n=8/349) additionally using tramadol for its euphorigenic properties. Despite using a source outside of legitimate medical channels, the vast majority of nontraditional users (95%, n=91/96) also cited pain as a reason for using tramadol. Of these, 63% (n=60/96) used tramadol for pain only and 32% (n=31/96) used it for both pain and to get high. Just 5% (n=5/96) of nontraditional users indicated that getting high was the main reason for taking tramadol.

Table 2. Tramadol use among traditional and nontraditional users.
 Traditional usersNontraditional usersP values
 (n=349)(n=96) 
Tramadol dosage, %
   

25 mg4.95.91

50 mg83.773.02

100 mg6.219<.001

150 mg5.23.39
Tramadol frequency, %
   

1-2 times/week38.226.03

3-4 times/week49.529<.001

5 or more times/week12.245<.001
    
Reasons for using tramadol, %
   

Only to treat pain97.763<.001

Both to treat pain and to get high2.332<.001

Only to get high0.05<.001

Adverse Events

Figure 2 shows that we found that the difference in the mean number of adverse events experienced by traditional and nontraditional users was significant (P<.001). Nontraditional users experienced a much more severe adverse event profile than traditional users (Figure 2). Euphoria, shallow breathing, slow heartbeat, cold/clammy skin, gastrointestinal issues, flushing, and sleep problems all occurred significantly more frequently in the nontraditional users that in the traditional users. Importantly, seizures, which can have potentially fatal outcomes, had an incidence rate of 7% (n=7/96) among nontraditional users, but were not experienced by a single traditional user.

Figure 2. Percent of traditional and nontraditional users who experienced each adverse event while taking tramadol. Asterisks denote a significant difference (P<.01) between groups. The legend indicates the mean number of adverse events ± standard error) experienced by both groups.
View this figure

Physical Dependence

Both groups had high rates of suddenly stopping their use of tramadol, but nontraditional users were significantly more likely to cease use abruptly (traditional users: 41.9%, n=144/344; nontraditional users: 66%, n=61/92; P<.01). Upon cessation, nontraditional users experienced more severe withdrawal symptoms than traditional users (see Figure 3). We found that the difference in the mean number of withdrawal symptoms experienced by traditional and nontraditional users was significant (P<.001).

Figure 3. Percent of traditional and nontraditional users who experienced each withdrawal symptom as a result of the abrupt cessation of tramadol. Asterisks denote a significant difference (P<.01) between groups. In addition , the legend indicates the mean number of withdrawal symptoms ± standard error experienced by both groups.
View this figure

Our data indicate that those who eschew the typical doctor-patient relationship to obtain tramadol through NPOPs do so primarily for reasons related to cost and accessibility and, most importantly, expose themselves to great health risks. We found that nontraditional users who used NPOPs had much higher rates of all recorded adverse events, particularly life-threatening seizures, than traditional users who obtained a prescription for tramadol from their physician. Seizures are quite rare in normal pain patients being treated with tramadol, observed at a rate of less than 1% [48], and they may be related to the dual effect of tramadol on opioid and adrenergic systems in the brain [49-51]. While the precise mechanisms are unknown, seizures are more prevalent in people who take high doses of tramadol [42,52], have predisposing medical conditions (eg, history of head injuries) [53], or take contraindicated medications (eg, tricyclic antidepressants) [54-55]. Physicians are trained to recognize such predisposing factors, but nontraditional users are likely to be unaware of these potential complications, leading to poor health outcomes. Moreover, we found that nontraditional users experienced much more intense opioid withdrawal symptoms when they stopped taking tramadol. The most logical explanation for these findings is that the lack of physician oversight in monitoring dosage schedules, contraindicated conditions, and concomitant medications was responsible for the increased intensity and frequency of adverse events in nontraditional users.

Nearly all nontraditional users in our study indicated that their tramadol use was motivated, at least in part, by a need to treat a health condition (eg, pain) that was not otherwise managed through legitimate health care channels. It was this perception of their unmet medical need (ie, inadequate pain management) that drove them to use NPOPs. This finding raises an important question: Why were normal medical channels shunned in favor of an online pharmacy? There appear to be three distinct motivations for using online pharmacies: (1) inability to pay the costs associated with obtaining a legitimate prescription; (2) limited access to a doctor who would prescribe tramadol or prescribe it at doses sufficient to fully relieve pain; and (3) unwillingness, not inability, to use legitimate medical channels.

With regard to economic motivations, 37% (n=35/95 of NPOP users lacked medical insurance coverage and NPOPs are a less expensive alternative to seeing a physician, paying for an office visit, and filling a prescription at a local pharmacy at noninsured rates. Furthermore, many respondents indicated “no other way to get tramadol” as their main reason for using an NPOP, which suggests there were barriers to accessing a physician, such as cost or the patient’s distance from a medical facility. By far the most commonly reported motivation for using an NPOP was an issue of accessibility: the absence of a physician who was willing to prescribe tramadol either at all or at levels sufficient to meet a patient’s perceived need. There are several possible interpretations of the latter motivation. First, the patient had an unrealistic expectation for “total” pain relief and the physician believed that other drugs would be a suitable alternative to tramadol in providing tolerable pain relief. Second, the physician denied the patient additional tramadol because the doctor incorrectly believed the pain was managed to the extent possible (ie, inadequate pain management). Third, the physician was reluctant to prescribe opioid analgesics, even a weak one such as tramadol, at sufficient levels to adequately relieve pain due to the inherent fear of iatrogenic dependence. At this time, it is unclear which of these was the strongest motivation to use NPOPs, but lack of access to appropriate medical treatment appears to be a major factor. This should not be surprising given the well-documented regional, social, and economic differences in access to medical care in the United States [56-59]. Because of this, there is a large market for the many drugs easily available from online pharmacies, which can best be explained within the context of cost and/or access to appropriate medical care.

While most of the foregoing discussion focused on pain management, 32% (n=31/96) of our population indicated they used an NPOP to buy tramadol for both its euphorigenic and analgesic properties. However, only 5% (n=5/96) reported the Internet as their primary source for tramadol as a drug of abuse. This agrees with a number of studies that show the Internet is not often used as a source of opiates among habitual drug abusers (<5% claim to have obtained their drugs from the Internet [18]). Nevertheless, it needs to be recognized that off-label use to “get high” may serve as one of the motivating factors for the use of NPOPs. In fact, the euphorigenic use of tramadol may explain why a number of respondents indicated “anonymity” as their primary motivator for using NPOPs. It is also possible that some NPOP users, while initially using tramadol for therapeutic purposes, had predisposing factors that led to the development of tramadol misuse or abuse. This euphorigenic use, a health outcome itself, would have led to higher dosages and increased frequency of use, playing a role in the higher rates of adverse events. In a physician-patient relationship, however, a doctor may have recognized predisposing factors for misuse and not prescribed an opioid analgesic or, if already prescribed, recognized the signs of abuse and misuse and switched from tramadol to a less addictive drug.

Although we used tramadol as a prototype in these studies, there is no reason to believe that different results would be observed with dozens of equally accessible prescription drugs obtained through NPOPs that are used without the oversight of a physician. The dangers of overdose and other adverse events with these medications, especially when little to no information about contraindicated medications and medical conditions is included with purchase, have the potential to be more clinically significant with other medications than those we observed with tramadol. As such, the geometric growth in the use of online pharmacies around the world, both legitimate and illegitimate, should prompt intense medical and regulatory discussion about their role, if any, in the provision of medical care.

Currently there are several bills and regulations being discussed to control the use of online pharmacies, some of which ban the use of those located outside of the United States [22,23], but the following two factors need to be considered. First, the passage of online pharmacy regulations that promote verification programs [24], licensure and location disclosures [3], standardized criteria for Internet-based prescriptions [60-61], and a more thorough analysis of the advantages and disadvantages of online health care services (eg, the ability of online pharmacies to detect interactions between medications instantly [5]) may help integrate online pharmacies into health care utilization models. The reality, however, is that regulating these legitimate online pharmacies is likely to have no effect on those using NPOPs. These users have already turned their back on typical medical channels and seem to be able to quickly adapt to any change in access to online pharmacies (eg, shift of NPOPs to foreign countries), and no amount of regulatory oversight would likely change their drug-purchasing behaviors.

Second, so long as a licensed doctor provides a prescription and the pharmacy verifies the legitimacy of the prescription, it would be inappropriate, perhaps unethical, to ban a patient from shopping around to find the most economical and convenient means of filling their prescriptions. Whether this doctor-patient relationship needs to be on a physical basis merits further discussion. Research has shown that email and virtual consultations are just as good, if not better, at capturing patient information necessary for health care decisions [21,62]. However, the old phrase “buyer beware” must be kept in mind, particularly for online pharmacies outside of the United States. Because of aggressive marketing and pricing strategies, as well as the recent shift in patients becoming more involved in their own health care decisions, people using online pharmacies are in danger of unconsciously transforming from patients to consumers, and then back to patients again when they suffer from adverse effects from the use of the drug [13, 63-64]. Patients should be aware of the real possibility that while offshore pharmacies may be cheaper and easier to use, the medications received may not be what was advertised. For this reason, recent US Food and Drug Administration (FDA) and WHO reports have advocated global drug safety, including international cooperation regarding the regulation of online pharmacies [11,31]. Such an effort is badly needed because if one country attempts to ban online pharmacies, most users will simply try a website from another country. Clearly, in addition to regulatory activity, educational efforts are needed to ensure that patients and physicians understand the positive and negative aspects of online pharmacies. Perhaps most importantly, more research is needed to better understand the motivations of people who, despite the availability of legitimate online pharmacies, continue to seek medications using NPOPs.

Limitations

Inherent in this study are all of the limitations typical of epidemiological and survey research, most notably generalizability and veracity of information gathered. With regard to the latter, most studies indicate that the results obtained from self-administered surveys are comparable to those elicited by trained interviewers. In our study, there were no right or wrong answers. There was no incentive or need to lie about any information because respondents were paid for their participation regardless of their answers. In terms of a biased sample, it is true that our subjects might have greater economic status and certainly more computer literacy than the average person, but these users would most likely to be exposed to advertisements touting online pharmacies.

Conclusion

Our data suggest that online pharmacies may have a role in supplying prescribed medications because they are convenient and may charge less than traditional brick-and-mortar pharmacies. However, from a public health perspective, the potential benefits of online medical care need to be balanced against the use of unregulated pharmacies that could sell counterfeit or adulterated drugs and the dangers inherent in self-medication without any physician supervision.

Acknowledgments

This study was financed with institutional funds and was approved by the Institutional Review Board at Washington University in St. Louis.

Conflicts of Interest

None declared.

  1. Bessell TL, Silagy CA, Anderson JN, Hiller JE, Sansom LN. Quality of global e-pharmacies: can we safeguard consumers? Eur J Clin Pharmacol 2002 Dec;58(9):567-572. [CrossRef] [Medline]
  2. Fung CH, Woo HE, Asch SM. Controversies and legal issues of prescribing and dispensing medications using the Internet. Mayo Clin Proc 2004 Feb;79(2):188-194. [CrossRef] [Medline]
  3. Henney JE. Cyberpharmacies and the role of the US Food And Drug Administration. J Med Internet Res 2001;3(1):E3 [FREE Full text] [CrossRef] [Medline]
  4. Montoya ID, Jano E. Online pharmacies: safety and regulatory considerations. Int J Health Serv 2007;37(2):279-289. [Medline]
  5. Weiss AM. Buying prescription drugs on the internet: promises and pitfalls. Cleve Clin J Med 2006 Mar;73(3):282-288 [FREE Full text] [Medline]
  6. National Center on Addiction and Substance Abuse White Paper. A CASA White Paper. 2008 Jul. "You've Got Drugs!" V: Prescription Drug Pushers on the Internet   URL: http://www.casacolumbia.org/download.aspx?path=/UploadedFiles/2zlhtwsh.pdf [accessed 2012-11-28] [WebCite Cache]
  7. National Association of Boards of Pharmacy. Updated Progress Report for State and Federal Regulators. 2012 Apr. Internet drug outlet identification program   URL: http://www.nabp.net/programs/assets/NABP%20Internet%20Drug%20Outlet%20Report_April%202012_final.pdf [accessed 2012-11-28] [WebCite Cache]
  8. Cicero TJ, Shores CN, Paradis AG, Ellis MS. Source of drugs for prescription opioid analgesic abusers: a role for the Internet? Pain Med 2008 Sep;9(6):718-723. [CrossRef] [Medline]
  9. Orizio G, Merla A, Schulz PJ, Gelatti U. Quality of online pharmacies and websites selling prescription drugs: a systematic review. J Med Internet Res 2011;13(3):e74 [FREE Full text] [CrossRef] [Medline]
  10. Orizio G, Rubinelli S, Schulz PJ, Domenighini S, Bressanelli M, Caimi L, et al. "Save 30% if you buy today." Online pharmacies and the enhancement of peripheral thinking in consumers. Pharmacoepidemiol Drug Saf 2010 Sep;19(9):970-976. [CrossRef] [Medline]
  11. World Health Organization. World Health Organization. 2011. Safety and security on the internet: challenges and advances in member states. Dec   URL: http://whqlibdoc.who.int/publications/2011/9789241564397_eng.pdf [accessed 2012-07-31] [WebCite Cache]
  12. Besson, C. The Partnership at Drugfree.org. 2010. Thirty-six million Americans have bought medications online without a doctor's prescription. Dec   URL: http:/​/www.​drugfree.org/​newsroom/​thirty-six-million-americans-have-bought-medications-online-without-a-doctor%E2%80%99s-prescription-2 [accessed 2012-11-28] [WebCite Cache]
  13. Levaggi R, Orizio G, Domenighini S, Bressanelli M, Schulz PJ, Zani C, et al. Marketing and pricing strategies of online pharmacies. Health Policy 2009 Oct;92(2-3):187-196. [CrossRef] [Medline]
  14. Forman RF. Availability of opioids on the Internet. JAMA 2003 Aug 20;290(7):889. [CrossRef] [Medline]
  15. Forman RF, Marlowe DB, McLellan AT. The Internet as a source of drugs of abuse. Curr Psychiatry Rep 2006 Oct;8(5):377-382. [Medline]
  16. Drug Enforcement Administration (DEA)‚ Department of Justice. Implementation of the Ryan Haight Online Pharmacy Consumer Protection Act of 2008. Interim final rule with request for comments. Fed Regist 2009 Apr 6;74(64):15595-15625. [Medline]
  17. Inciardi JA, Surratt HL, Cicero TJ, Rosenblum A, Ahwah C, Bailey JE, et al. Prescription drugs purchased through the internet: who are the end users? Drug Alcohol Depend 2010 Jul 1;110(1-2):21-29. [CrossRef] [Medline]
  18. Rosenblum A, Parrino M, Schnoll SH, Fong C, Maxwell C, Cleland CM, et al. Prescription opioid abuse among enrollees into methadone maintenance treatment. Drug Alcohol Depend 2007 Sep 6;90(1):64-71. [CrossRef] [Medline]
  19. Boyer EW, Wines JD. Impact of Internet pharmacy regulation on opioid analgesic availability. J Stud Alcohol Drugs 2008 Sep;69(5):703-708 [FREE Full text] [Medline]
  20. National Association of Boards of Pharmacy. National Association of Boards of Pharmacy. 2012 Jun. Report of the Task Force on Internet Pharmacy Practice   URL: http://www.nabp.net/news/assets/2012%20Internet%20Pharmacy%20Practice%20TF%20ReportFinal.pdf [accessed 2012-11-28] [WebCite Cache]
  21. Jones MJ. Internet-based prescription of sildenafil: a 2104-patient series. J Med Internet Res 2001;3(1):E2 [FREE Full text] [CrossRef] [Medline]
  22. United States Congress. United States Congress. Online Pharmacy Safety Act, H. R   URL: http://www.govtrack.us/congress/bills/112/hr4095/text [accessed 2012-06-11] [WebCite Cache]
  23. National Alliance for Model State Drug Laws. National Alliance for Model State Drug Laws. 2009. State and Federal Regulation of Internet Pharamcies. May   URL: http://www.namsdl.org/documents/StateandFederalRegulationofInternetPharmaciesMay2009.pdf [accessed 2012-07-31] [WebCite Cache]
  24. National Association of Boards of Pharmacy. Updated Progress Report for State and Federal Regulators: April 2012 (reissued May 14, 2012). 2012 May. Internet Drug Outlet Identification Program   URL: http://nabp.net/news/assets/idoireportjuly11.pdf [accessed 2012-11-28] [WebCite Cache]
  25. United States Government Accountability Office. United States Government Accountability Office. 2004 Jul 22. Prescription Drugs: Preliminary Observations on Efforts to Enforce the Prohibitions on Personal Importation   URL: http://www.gao.gov/new.items/d04839t.pdf [accessed 2012-06-11] [WebCite Cache]
  26. Castronova JR. Operation cyber chase and other agency efforts to control internet drug trafficking. The "virtual" enforcement initiative is virtually useless. J Leg Med 2006 Jun;27(2):207-224. [CrossRef] [Medline]
  27. US Food and Drug Administration. US Food and Drug Administration. 2007 Feb 16. FDA Alerts Consumers to Unsafe, Misrepresented Drugs Purchased Over the Internet   URL: http://www.fda.gov/newsevents/newsroom/pressannouncements/2007/ucm108846.htm [accessed 2012-06-11] [WebCite Cache]
  28. Yahoo News. Yahoo News. 2008 Jun 11. With Record Number of Uninsured, Americans Turn To Foreign Pharmacies For Lowest-Cost Prescription Drugs   URL: http://www.internationaldrugmart.com/media/yahoo-news-story.html [accessed 2012-06-11] [WebCite Cache]
  29. Silverman E. Pharmalot. 2007. FDA: We Can't Inspect All Overseas Plants   URL: http://www.pharmalot.com/2007/09/fda-we-cant-inspect-all-those-overseas-plants/ [accessed 2012-06-11] [WebCite Cache]
  30. Flaherty MP, Gaul GM. Washington Post. 2003 Oct 3. Millions of Americans Look Outside US for Drugs   URL: http://www.washingtonpost.com/wp-dyn/content/article/2007/06/28/AR2007062801634.html [accessed 2012-06-11] [WebCite Cache]
  31. US Food and Drug Administration. US Food and Drug Administration. 2011 Jun 20. Pathway to Global Product Safety and Quality   URL: http://www.fda.gov/downloads/AboutFDA/CentersOffices/OC/GlobalProductPathway/UCM259845.pdf [accessed 2012-06-11] [WebCite Cache]
  32. US Government Accountability Office. US Government Accountability Office. 2004 Jun 17. Internet Pharmacies: Some Pose Safety Risks for Consumers and Are Unreliable in Their Business Practices   URL: http://www.gao.gov/new.items/d04888t.pdf [accessed 2012-07-31] [WebCite Cache]
  33. Veronin MA, Nguyen NT. Comparison of simvastatin tablets from the US and international markets obtained via the Internet. Ann Pharmacother 2008 May;42(5):613-620. [CrossRef] [Medline]
  34. Westenberger BJ, Ellison CD, Fussner AS, Jenney S, Kolinski RE, Lipe TG, et al. Quality assessment of internet pharmaceutical products using traditional and non-traditional analytical techniques. Int J Pharm 2005 Dec 8;306(1-2):56-70. [CrossRef] [Medline]
  35. Levaggi R, Marcantoni C, Filippucci L, Gelatti U. Not a good buy: value for money of prescription drugs sold on the internet. Health Policy 2012 Aug;106(3):241-245. [CrossRef] [Medline]
  36. Veronin M. Packaging and labeling of pharmaceutical products obtained from the Internet. J Med Internet Res 2011;13(1):e22 [FREE Full text] [CrossRef] [Medline]
  37. Eysenbach G. Online prescribing of sildanefil (Viagra) on the World Wide Web. J Med Internet Res 1999;1(2):E10 [FREE Full text] [CrossRef] [Medline]
  38. Bartholow M. Pharmacy Times. 2011 May 16. Top 200 Drugs of 2010   URL: http://www.pharmacytimes.com/publications/issue/2011/May2011/Top-200-Drugs-of-2010 [accessed 2012-06-11] [WebCite Cache]
  39. Cicero TJ, Inciardi JA, Adams EH, Geller A, Senay EC, Woody GE, et al. Rates of abuse of tramadol remain unchanged with the introduction of new branded and generic products: results of an abuse monitoring system, 1994-2004. Pharmacoepidemiol Drug Saf 2005 Dec;14(12):851-859. [CrossRef] [Medline]
  40. Adams EH, Breiner S, Cicero TJ, Geller A, Inciardi JA, Schnoll SH, et al. A comparison of the abuse liability of tramadol, NSAIDs, and hydrocodone in patients with chronic pain. J Pain Symptom Manage 2006 May;31(5):465-476. [CrossRef] [Medline]
  41. Senay EC, Adams EH, Geller A, Inciardi JA, Muñoz A, Schnoll SH, et al. Physical dependence on Ultram (tramadol hydrochloride): both opioid-like and atypical withdrawal symptoms occur. Drug Alcohol Depend 2003 Apr 1;69(3):233-241. [Medline]
  42. Potschka H, Friderichs E, Löscher W. Anticonvulsant and proconvulsant effects of tramadol, its enantiomers and its M1 metabolite in the rat kindling model of epilepsy. Br J Pharmacol 2000 Sep;131(2):203-212 [FREE Full text] [CrossRef] [Medline]
  43. Rehni AK, Singh I, Kumar M. Tramadol-induced seizurogenic effect: a possible role of opioid-dependent gamma-aminobutyric acid inhibitory pathway. Basic Clin Pharmacol Toxicol 2008 Sep;103(3):262-266. [CrossRef] [Medline]
  44. Sansone RA, Sansone LA. Tramadol: seizures, serotonin syndrome, and coadministered antidepressants. Psychiatry (Edgmont) 2009 Apr;6(4):17-21 [FREE Full text] [Medline]
  45. McCabe SE, Boyd CJ, Couper MP, Crawford S, D'Arcy H. Mode effects for collecting alcohol and other drug use data: Web and U.S. mail. J Stud Alcohol 2002 Nov;63(6):755-761. [Medline]
  46. Rhodes SD, Bowie DA, Hergenrather KC. Collecting behavioural data using the world wide web: considerations for researchers. J Epidemiol Community Health 2003 Jan;57(1):68-73 [FREE Full text] [Medline]
  47. Search Engine Marketing Professional Organization. Search Engine Marketing Professional Organization. SEM Glossary   URL: http://www.sempo.org/?page=glossary [accessed 2012-06-11] [WebCite Cache]
  48. Gardner JS, Blough D, Drinkard CR, Shatin D, Anderson G, Graham D, et al. Tramadol and seizures: a surveillance study in a managed care population. Pharmacotherapy 2000 Dec;20(12):1423-1431. [Medline]
  49. Rehni AK, Singh I, Kumar M. Tramadol-induced seizurogenic effect: a possible role of opioid-dependent gamma-aminobutyric acid inhibitory pathway. Basic Clin Pharmacol Toxicol 2008 Sep;103(3):262-266. [CrossRef] [Medline]
  50. Rehni AK, Singh TG, Singh N, Arora S. Tramadol-induced seizurogenic effect: a possible role of opioid-dependent histamine H1 receptor activation-linked mechanism. Naunyn Schmiedebergs Arch Pharmacol 2010 Jan;381(1):11-19. [CrossRef] [Medline]
  51. Manocha A, Sharma KK, Mediratta PK. On the mechanism of anticonvulsant effect of tramadol in mice. Pharmacol Biochem Behav 2005 Sep;82(1):74-81. [CrossRef] [Medline]
  52. Taghaddosinejad F, Mehrpour O, Afshari R, Seghatoleslami A, Abdollahi M, Dart RC. Factors related to seizure in tramadol poisoning and its blood concentration. J Med Toxicol 2011 Sep;7(3):183-188. [CrossRef] [Medline]
  53. Farajidana H, Hassanian-Moghaddam H, Zamani N, Sanaei-Zadeh H. Tramadol-induced seizures and trauma. Eur Rev Med Pharmacol Sci 2012 Mar;16 Suppl 1:34-37. [Medline]
  54. Clarot F, Proust B, Vaz E, Goullé JP. Tramadol-benzodiazepines and buprenorphine-benzodiazepines: two potentially fatal cocktails? J Clin Forensic Med 2003 Jun;10(2):125-126. [CrossRef] [Medline]
  55. Boyd IW. Tramadol and seizures. Med J Aust 2005 Jun 6;182(11):595-596. [Medline]
  56. Chen AY, Escarce JJ. Quantifying income-related inequality in healthcare delivery in the United States. Med Care 2004 Jan;42(1):38-47. [CrossRef] [Medline]
  57. Zuckerman S, Waidmann T, Berenson R, Hadley J. Clarifying sources of geographic differences in Medicare spending. N Engl J Med 2010 Jul 1;363(1):54-62. [CrossRef] [Medline]
  58. Cooper RA, Cooper MA, McGinley EL, Fan X, Rosenthal JT. Poverty, wealth, and health care utilization: a geographic assessment. J Urban Health 2012 Oct;89(5):828-847 [FREE Full text] [CrossRef] [Medline]
  59. Braveman PA, Cubbin C, Egerter S, Williams DR, Pamuk E. Socioeconomic disparities in health in the United States: what the patterns tell us. Am J Public Health 2010 Apr 1;100 Suppl 1:S186-S196. [CrossRef] [Medline]
  60. Jones MJ, Thomasson WA. Establishing guidelines for Internet-based prescribing. South Med J 2003 Jan;96(1):1-5. [Medline]
  61. Eysenbach G. Online prescriptions of pharmaceuticals: where is the evidence for harm or for benefit? A call for papers--and for reflection. J Med Internet Res 2001;3(1):E1 [FREE Full text] [CrossRef] [Medline]
  62. Brebner C, Jones R, Krisjanous K, Marshall W, Parry G, Holt A. Electronic medical consultation: a New Zealand perspective. J Med Internet Res 2001;3(1):E13 [FREE Full text] [CrossRef] [Medline]
  63. Donohue JM, Cevasco M, Rosenthal MB. A decade of direct-to-consumer advertising of prescription drugs. N Engl J Med 2007 Aug 16;357(7):673-681. [CrossRef] [Medline]
  64. Lineberry TW, Bostwick JM. Taking the physician out of "physician shopping:" a case series of clinical problems associated with Internet purchases of medication. Mayo Clin Proc 2004 Aug;79(8):1031-1034. [CrossRef] [Medline]


FDA: US Food and Drug Administration
NPOP: no-prescription online pharmacy
SEM: search engine marketing
VIPPS: Verified Internet Pharmacy Practice Sites
WHO: World Health Organization


Edited by G Eysenbach; submitted 22.06.12; peer-reviewed by K Clauson; comments to author 06.07.12; revised version received 07.08.12; accepted 07.09.12; published 06.12.12

Copyright

©Theodore J Cicero, Matthew Stephen Ellis. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 06.12.2012.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.