This paper is in the following e-collection/theme issue:

Infodemiology and Infoveillance (1274) Infoveillance and Social Listening (181)

Published on in Vol 16, No 9 (2014): September

Internet Search and Krokodil in the Russian Federation: An Infoveillance Study

Internet Search and Krokodil in the Russian Federation: An Infoveillance Study

Internet Search and Krokodil in the Russian Federation: An Infoveillance Study

Authors of this article:

Andrey Zheluk1 Author Orcid Image ;   Casey Quinn2 Author Orcid Image ;   Peter Meylakhs3 Author Orcid Image
Article Authors Cited by (25) Tweetations (19) Metrics

    Original Paper

    1Menzies Centre for Health Policy, University of Sydney, University of Sydney, Australia

    2PRMA Consulting Ltd, Fleet, Hampshire, United Kingdom

    3 Laboratory for Internet Studies, National Research University, Higher School of Economics, St Petersburg, Russian Federation

    *these authors contributed equally

    Corresponding Author:

    Andrey Zheluk, BAppSc, GDip(Hist), GDip(IT), MBA

    Menzies Centre for Health Policy

    University of Sydney

    D02 Victor Coppleson Building

    University of Sydney, 2006

    Australia

    Phone: 61 29036522

    Fax:61 293512818

    Email: andreyzheluk@gmail.com


    Related ArticlesThis is a corrected version. See correction statement in: http://www.jmir.org/2015/3/e76/
    This is a corrected version. See correction statement in: http://www.jmir.org/2016/1/e16/

    Background: Krokodil is an informal term for a cheap injectable illicit drug domestically prepared from codeine-containing medication (CCM). The method of krokodil preparation may produce desomorphine as well as toxic reactants that cause extensive tissue necrosis. The first confirmed report of krokodil use in Russia took place in 2004. In 2012, reports of krokodil-related injection injuries began to appear beyond Russia in Western Europe and the United States.

    Objective: This exploratory study had two main objectives: (1) to determine if Internet search patterns could detect regularities in behavioral responses to Russian CCM policy at the population level, and (2) to determine if complementary data sources could explain the regularities we observed.

    Methods: First, we obtained krokodil-related search pattern data for each Russia subregion (oblast) between 2011 and 2012. Second, we analyzed several complementary data sources included krokodil-related court cases, and related search terms on both Google and Yandex to evaluate the characteristics of terms accompanying krokodil-related search queries.

    Results: In the 6 months preceding CCM sales restrictions, 21 of Russia's 83 oblasts had search rates higher than the national average (mean) of 16.67 searches per 100,000 population for terms associated with krokodil. In the 6 months following restrictions, mean national searches dropped to 9.65 per 100,000. Further, the number of oblasts recording a higher than average search rate dropped from 30 to 16. Second, we found krokodil-related court appearances were moderately positively correlated (Spearman correlation=.506, P≤.001) with behaviors consistent with an interest in the production and use of krokodil across Russia. Finally, Google Trends and Google and Yandex related terms suggested consistent public interest in the production and use of krokodil as well as for CCM as analgesic medication during the date range covered by this study.

    Conclusions: Illicit drug use data are generally regarded as difficult to obtain through traditional survey methods. Our analysis suggests it is plausible that Yandex search behavior served as a proxy for patterns of krokodil production and use during the date range we investigated. More generally, this study demonstrates the application of novel methods recently used by policy makers to both monitor illicit drug use and influence drug policy decision making.

    J Med Internet Res 2014;16(9):e212

    doi:10.2196/jmir.3203

    Keywords

    Russia; search engine; surveillance; controlled substances; designer drugs; street drugs 


    Overview

    Krokodil, otherwise known as desomorphine, is a cheap injectable drug easily synthesized in household kitchens from codeine-containing medication (CCM). The first confirmed report of krokodil use in Russia occurred in 2004. In 2012, reports of horrific krokodil-related injection injuries began to appear beyond Russia in Western Europe [1] and the United States [2]. We conducted this exploratory study to determine if several complementary data sources may provide insight into the relative scale and spatial patterns of behaviors consistent with an interest in the production and use of krokodil before and after the imposition of Russian federal restrictions on CCM sales in 2012.

    Review of Literature on Krokodil

    Current scientific literature on krokodil is limited. We reviewed international literature available through PubMed and Google Scholar. In addition, we searched the four most popular Russian online news sources [3] for the term “desomorphine” in the date range January 2009 to December 2012 using Yandex News (see Table 1). Across the four sources, we identified 929 Russian language articles associated with the term “desomorphine” in this date range, which was bounded by a period of increasing public interest in 2009, and the 6-month period following federal restrictions on CCM sales across Russia in June 2012.

    Table 1. Russian news sources reviewed via Yandex News (Jan 1, 2009 to Dec 31, 2012).
    SourceWebsiteCount (N=929)Orientation
    RIA Novostirian.ru103State-owned
    Vesti.ru (Website of Russia 24 TV)vesti.ru38State-owned
    Komsomlskaya Pravdakp.ru748Private, tabloid
    Russia business consultingrbk.ru40Private, business focus

    The Origins of Krokodil

    Current literature describing the origins of krokodil in Russia is vague. Time magazine reported the first appearance of krokodil in the Siberian and the Far East Federal Regions of Russia in the early 2000s [4]. We identified the first Russian news report of krokodil use in the Komi Republic in the western part of the Siberian Federal Region in May 2004 [5]. A police report from 2004 described the seizure of a new illicit drug never before seen in Russia called desomorphine. Conversely, a 2010 video produced by the Russian Drug Control Service (FSKN) suggested krokodil first appeared in the Komi Republic in 2002 [6] and that by 2006, 19 Russian oblasts (subregional administrative units) were affected. These affected oblasts were primarily in the Siberian, Volga, Northwestern, and Central Federal Regions. From 2006 onwards, krokodil use increased dramatically according to Russian news reports [7]. The ease of access to low-cost CCM and ease of domestic manufacture were widely reported as contributing to the spread of krokodil use [1]. Shortages of heroin during 2010 have been described as a further factor contributing to krokodil use. Several authors suggested krokodil largely displaced traditional opiates as a consequence of Afghan heroin shortages after 2010 [1,4,8,9]. A 2012 police report stated seizures of krokodil grew by 40 times from 2 kg in 2006 to 100 kg in 2011. By comparison, a mean of 2922 kg of heroin were seized each year between 2006 and 2010 in the Russian Federation [10,11].

    Prevalence of Krokodil Use

    Estimates of the scale of krokodil use diverged markedly. In 2011, a senior Russian addiction medicine specialist reported 5000 krokodil users were receiving treatment nationally, out of a total estimated national population of 20,000-30,000 users [12]. In June 2012, the FSKN estimated between 5000 and 7000 deaths were attributable to krokodil in Russia over the preceding 2 years [7]. Also in 2012, international researchers estimated 100,000 people were krokodil dependent in Russia, while suggesting the actual number could be higher [13]. Pharmacy sales of CCM provided a further indicator of the scale and spatial distribution of krokodil use. For example, in the Urals Region, the FSKN reported an increase in annual CCM sales from 4.2 million in 2007 to 12 million packets in 2010 [14].

    There were limited data describing the spatial distribution of krokodil use before the federal restrictions on sales of CCM in June 2012. Krokodil use had been widely reported across Russia and bordering Ukrainian regions [15,16]. A December 2011 news report citing “various sources” described the results of toxicology tests conducted in several Russian oblasts [17]. According to this unreferenced news report, toxicology tests suggested 20% of people who inject drugs (PWID) in Chechnya were krokodil users, compared with 60% in Kazan and Ryazan, and 90% in Yaroslavl oblast. Overall, the publicly available data on the scale and prevalence were both limited and fragmented [18] before the introduction of restrictions in June 2012.

    Researching Krokodil

    A series of articles reviewing the current scientific understanding of krokodil appeared in the International Journal of Drug Policy in 2013. One of these articles by Grund et al consolidated current scientific information, including interview data from Russian key informants [13]. The authors pointed to the paucity of scientific research into krokodil prevalence and use. Several commentary articles accompanied Grund et al’s review. In one accompanying commentary piece, Heimer described the difficulties of investigating the prevalence of krokodil use without ethnographic and epidemiological data [18]. Heimer further noted the time lag between submitting research proposals and fieldwork, describing how his personal efforts to set up field interviews were thwarted by changes in krokodil use patterns resulting from federal restrictions on the sale of CCM in June 2012. In summary, conducting research into krokodil was more complex than with many established illicit drugs because of the novel nature of the substance and policy changes.

    Morbidity and Mortality Associated With Krokodil in Russia

    Desomorphine was originally developed as a morphine substitute. It was first synthesized in the United States in 1932, with the aim of producing a low-cost substitute with minimal side effects [19]. However, laboratory-synthesized desomorphine was regarded as an unsuccessful substitute, being shorter lasting, stronger, and more addictive than morphine. In Russia, krokodil, or what is termed desomorphine, is an illicit injectable drug domestically manufactured from codeine, iodine, phosphorus, paint thinner, and lighter fuel [13]. The resulting substance is regarded as impure, creating the potential for severe injury among PWID. It is the presence of impurities that has produced consistent reports of injuries characteristic of krokodil use. Characteristic injuries have included vascular damage, skin and soft tissue infections, necrosis and gangrene [20,21], as well as burns associated with domestic manufacture [22]. The short duration of narcotic effects, strong dependence, and chemical instability of the domestically produced drug has led to reports of binges of frequent injecting among krokodil users [23].

    Frequent injecting is generally regarded as a risk factor for human immunodeficiency virus (HIV) and other injecting-related harms [24,25]. Further, PWID experience multiple comorbidities, creating a disproportionate need for health services [13,26]. However, as a consequence of punitive drug laws, Russian PWID are often particularly unwilling to seek medical assistance, exacerbating injecting-related injuries [27-29]. In summary, the characteristics of drug preparation and use, as well as the legal environment in which PWID use illicit drugs increased the morbidity and mortality associated with krokodil use in Russia before the restrictions on CCM in 2012.

    Russian Policy Responses to Krokodil

    The easing of restrictions on access to CCM may have increased the production and use of krokodil in Russia. During the Soviet period up to 1991, CCM was available only through pharmacies with a medical prescription [2]. Following the fall of USSR in 1991, restrictions on sales of CCM were removed. In 2004, Russian manufacturers introduced new CCMs targeted at Russian consumers. Following advocacy by the largest Russian manufacturer, Pharmstandard, these new CCMs remained accessible to consumers without medical prescriptions [30]. While a two-packet-per-person limit on CCM sales formally existed, this was routinely ignored by pharmacists [31]. From the mid-2000s, Russian government agencies explicitly linked the unrestricted access to CCM with the illicit consumption of krokodil [32]. After 2009, krokodil became increasingly recognized as a public health and policy problem. Increasing public concern was accompanied by Russian media reports of conflicts of interest. In particular, the relationship between Pharmstandard and the Russian Minister of Health became the target of media scrutiny [33,34]. Media reports suggested Pharmstandard’s advocacy had prevented the imposition of restrictions on the sale of CCM. In summary, several failures in CCM regulation may have facilitated the expansion of krokodil use in Russia.

    National Restrictions on Codeine-Containing Medication

    At a national drug control conference in 2011, Russian President Medvedev announced restrictions on the sale of CCM without medical prescriptions [35]. Federal restrictions on CCM sales were original scheduled to start mid-2011. However, the Russian Ministry of Health effectively delayed the implementation of restrictions for 12 months. Ministry of Health officials argued that 40 million individuals using CCM for intended analgesic purposes would be disadvantaged by premature restrictions [36]. In opposing immediate restrictions, the Ministry of Health also drew on widespread public opposition to restrictions on CCM sales [37] (see Table 2). The delays in restrictions led to conflict in Russian national media between the FSKN, academics [38], and the Ministry of Health [36]. The public debate over CCM restrictions thus illuminated interagency tensions in an otherwise generally opaque Russian federal health policy landscape.

    Table 2. Public opinion survey into consequences of proposed federal CCM restrictions May 2011 [34].

    		How will this affect the battle against drugs in Russia?How will this affect the needs of ordinary patients?
    Generally positive32%11%
    No effect49%21%
    Generally negative5%56%
    Difficult to answer14%12%

    The Effect of Restrictions on Codeine-Containing Medication

    From 2011 to June 2012, several Russian oblast governments implemented interim local restrictions on CCM sales [39,40]. These interim restrictions were directed at reducing the production and consumption of krokodil in advance of federal bans [41,42]. On June 1, 2012, a federal law restricted CCM sales across all of Russia. Russian media subsequently reported decreased sales volumes of CCM [43]. However, media reports of krokodil production and use and krokodil-related arrests continued [44,45]. These media reports suggested the federal restrictions on CCM sales had been only partially effective in curtailing krokodil production and use.

    Krokodil and the Internet

    Between 2010 and 2012, Russian policy makers emphasized the negative influence of the Internet in disseminating krokodil-related information. In April 2011, the FSKN presented the results of its research into Internet search patterns for krokodil-associated terms [46]. The FSKN described a marked increase in Internet searches for methods of preparing and purchasing krokodil, from 3000 searches during 2010, to 50,000 in the first 3 months of 2011. Several days later, Russian President Dmitry Medvedev reiterated Russian government concerns about the relationship between krokodil and the Internet at a national forum dedicated to illicit drug use prevention. President Medvedev demonstrated that when the term “desomorphine” was entered into the Yandex search engine, the first results revealed information on how to prepare the drug [35]. Medvedev suggested these results proved that Internet users were most interested in producing desomorphine, rather than simply searching for general information about the drug. This widely reported demonstration by the Russian President served as the catalyst for subsequent federal restrictions on CCM.

    Russian Government Statements About Krokodil

    President Medvedev’s demonstration stimulated increased public interest in krokodil. The FSKN had reported steadily increasing Internet searches in the 12 months before President Medvedev’s speech. However, extensive media coverage and the highest recorded volume of searches for “desomorphine” emerged in the week following the President’s speech (see Figure 1). Further, searches remained consistently elevated after April 2011 until the Russian CCM restrictions in June 2012. Medvedev’s speech may thus have contributed to the Russian government’s unintentional amplification of popular interest in krokodil production and use [47-49]. Both before and after President Medvedev’s speech, Russian media consistently reported the harms of krokodil alongside the low price and ease of access to ingredients, and ease of drug synthesis in domestic laboratories.

    Political and public concern over illicit drug use preceded President Medvedev’s speech. Public opinion polls since 2005 consistently rated illicit drug use as one of the most serious social problems in Russia [50]. Between 2010 and 2012, the Russian government progressively tightened restrictions on all illicit drug information available online. For example, in 2011, a website operated by the nongovernmental organization, Andrey Rylkov Foundation, was suspended for publishing public health information about opioid substitution therapy and harm reduction [51]. Russian government policy towards illicit drug use and drug users is regarded as punitive. Moreover, in the post-Soviet period, drug use came to represent an existential threat, implicated in national spiritual and demographic decay (eg, [52]). The intensity of public concern and political action directed at illicit drug use in Russia has been described as a moral panic [53]. Moral panics are a sociological concept describing the disproportionate public response to issues represented in media [54,55]. Over two decades, intense social and political pressures led to the demonization of drug users in Russia. After 2009, krokodil increasingly served as a focus for illicit drug-related concerns. However, President Medvedev’s April 2011 speech may have triggered a moral panic surrounding krokodil, amplified public interest, and stimulated Internet search behavior.

    ‎
    Figure 1. Desomorphine searches Google Trends Russia - 2009-2013.
    View this figure

    Public Curiosity Stimulated by Media Reporting on Illicit Drugs

    Exposure to stories about illicit drugs in traditional and online media has been found to increase public curiosity and the use of illicit drugs [56,57]. Dasgupta et al found mortality from prescription opiates increased significantly in the months following media reporting [58]. In addition to the news effects, online media has increased information about manufacture, sales, and use of novel illicit drugs, and undermined international drug control efforts [59-61]. Further, researchers have noted the cohort most likely to experiment with new drugs is also most likely to use the Internet [62]. The Internet is now regarded as the main medium from spreading information about novel illicit drugs [63-65]. Notably, Forsythe directly linked news reporting to increased rates of Internet search to increased use of the novel illicit drug mephedrone in the United Kingdom during 2010 [66].

    We conducted this exploratory infodemiology study in order to better understand if the relative scale and spatial distribution of search behavior was consistent with an interest in the production and use of krokodil in Russia before and after the imposition of federal restrictions on CCM sales in 2012. In conducting this study, we examined “the science of distribution and determinants of information...(on) the Internet (and) a population, with the ultimate aim to inform public health and public policy” [67].


    Objectives

    This study had two main objectives: (1) to determine if Internet search patterns could detect regularities in behavioral responses to Russian CCM policy at population level, and (2) if complementary data sources could explain the regularities we observed.

    Search Patterns and Illicit or Stigmatized Behaviors

    Each Internet search is a behavioral measure of an issue’s importance to an individual [68]. If individuals are concerned or interested in an issue, they are more likely to search for information related to that issue. The relative importance of an issue can thus be inferred from the volume of search queries for a specific term or terms representing that issue. The use of aggregated Internet search patterns may be considered a method of unobserved, real time behavioral field research at population scale [69]. Researchers have used Internet search patterns to investigate illegal or stigmatized behaviors. For example, researchers analyzed search patterns to monitor US cigarette tax avoidance [70] and the use of racist terms when searching for information about Barak Obama prior to the 2012 US presidential elections [71]. Other investigators have studied global abortion patterns, finding higher search rates in those geographic regions where abortions were illegal or restricted [72]. In each of these instances, the authors suggested Internet search provided insights into behavior at a population level, beyond that available to traditional survey research.

    Google and Yandex Search in Russia

    Most Internet search pattern studies have used Google Trends as the data source. Google Trends has been deployed in studies of influenza [73,74], dengue [75], and HIV checks [66,76]. Globally, Google provided 84% of global Internet search queries in May 2011 [77]. In Russia, Google’s market share in Russia was only 25% in 2011 [78], whereas Yandex had a 60% share. The proportion of the Russian population using the Internet grew from 43% in 2010 to 55% in 2012 [79]. Further, there was near universal Internet use among the age groups most likely to use illicit drugs [80]. Among both males and females aged under 35 years and living in major Russian urban centers, more than 90% were regular Internet users during 2012.

    Case Study: Why Is Search-Based Krokodil Surveillance Important in Russia?

    Illicit drug use data are generally regarded as difficult to obtain. Drug use estimates are imperfect even in high-income countries with adequate resources [81]. Researchers have generally divided illicit drug use estimation methods into direct and indirect approaches. Direct methods involve surveying household members about patterns of drug use. However, this method is expensive and may not produce truthful responses, particularly in countries such as Russia, where illicit drug use carries severe criminal penalties and stigma [82]. Further, household surveys may fail to reach drug-using populations such as prisoners and the homeless. Indirect methods aim to estimate the size of drug-using populations through comparing data sources. Examples of indirect methods include the multiplier method, based on estimates of the proportion of drug users receiving treatment each year [83]. Additional methods include capture-recapture and back-projection [84], using data sources such as arrest, overdose, and needle exchange data [85,86]. Drug use researchers suggest the main advantage of indirect methods is their lower cost and greater accuracy, as several measures from different data sources are generally combined to produce a single aggregated measure.

    In addition, we identified two references to national drug agencies using novel methods for estimating illicit drug use prevalence. The UK government made use of Google Trends when considering restrictions on the novel substance mephedrone in 2010 [66]. Similarly, the Russian FSKN used Internet searches to develop a case for restricting CCM sales in Russia in 2011 [46]. These two instances suggest online search pattern data have been used by national governments in shaping national drug policies. Through conducting this study, we aimed to develop search patterns as an additional method to complement indirect estimates of illicit drug-using populations in Russian-speaking countries.

    RQ1: Were There Regularities in the Internet Search Patterns for “Desomorphine” Across Russia in 2011-2013?

    To answer this question, we examined search patterns using Yandex and Google Internet search engines. First, we determined the most appropriate search term to represent the informal term “krokodil” in Internet searches. We initially selected two search terms that we believed reflected the majority of searches for the concept central to this study [87]. These two search terms we selected were “desomorphine” (дезоморфин in Russian) and “Krokodil” (крокодил). We referred to the Google Trends related terms (Top Searches) feature to ensure each term referred to the subject of this study. Google related terms provide information on the relative importance of searches related to the specific search term entered into Google Trends. In the case of “desomorphine”, all terms were related to the drug desomorphine, whereas the term “krokodil” revealed primarily unrelated terms (see Table 3). The term “krokodil” also means “crocodile” in Russian, leading to considerable ambiguity in search results. For example, the most popular term associated with “krokodil” (crocodile) referred to a 1960s Soviet-era children’s animated character “Gena the Crocodile”. Conversely, there is anecdotal evidence to suggest that some Russian PWID may not immediately associate the term krokodil with desomorphine [15]. Overall, based on information available from Google Trends and Russian respondents, we anticipated that the search term “desomorphine” would be more likely to reflect search patterns consistent with an interest in the production and use of krokodil.

    Table 3. Google Trends related terms for desomorphine, Russian Federation.
    Search termsRussianValue
    Desomorphine-related

    		Desomorphine how to prepareдезоморфин как приготовить100

    		Prepare desomorphineприготовить дезоморфин100

    		Krokodil desomorphineкрокодил дезоморфин80

    		Krokodilкрокодил80

    		Drug desomorphineнаркотик дезоморфин60

    		Desomorphine recipeдезоморфин рецепт50

    		Krokodil drugкрокодил наркотик30
    Krokodil-related

    		Gena the crocodile (Children’s animation)крокодил гена100

    		Crocodile game (Children’s game)игра крокодил50

    		Krokodil drugкрокодил наркотик50

    		Crocodile/krokodil onlineкрокодил онлайн45

    		Crocodile Dundee (Australian film)крокодил данди35

    		Dundee (Australian film)данди35

    		Cheburashka (Children’s animation)чебурашка30

    Publicly available Google Trends data for Russia has several limitations. First, Google did not provide complete results, returning only oblasts with the highest search volume. Google data for the term desomorphine was available for only 8 of Russia’s 83 oblasts and 3 cities during the date range 2011-2013. Second, Google did not provide raw search data. This made direct comparisons between oblasts using Google data impossible. We thus used WordStat as the primary data source. Yandex made publicly available a complete raw search dataset for all Russian regions and oblasts for 6 months before and after the implementation of federal CCM restrictions in June 2012. We used Google Trends as a secondary source of aggregated search results for validation purposes.

    Second, we obtained desomorphine search data for each Russia oblast from September 1, 2011, to August 31, 2013. Yandex provides 2 years of publicly available monthly search pattern data at any time. Additionally, we had 6 months previously downloaded monthly search pattern data for the term desomorphine for each Russian oblast, from February to August 2011.

    Third, we converted raw search figures for the term desomorphine to population prevalences. This allowed direct comparison across regions and oblasts. We used 2010 federal Russian census data [88] for our population prevalence calculation. We then multiplied each result by 100,000 to increase ease of comprehension, and to provide a population prevalence measure.

    Fourth, we analyzed search patterns before and after federal restrictions on CCM sales in June 2012. We obtained the mean search volume for 6 months before the restrictions, as well as 6 and 12 months after (ie, to August 31, 2013). We excluded June 2012 data, as we anticipated atypical search patterns in the immediate post-restriction period. Overall, we segmented the available data to examine the effects of a federal policy change on the relative scale and geographic patterns of krokodil search across the Russia.

    Fifth, we obtained all available Google data for the term desomorphine from September 2011 to August 2012. Google search data for the term desomorphine was available for 8 of 83 oblasts only (see Table 4). We did not consider this sample adequate to conduct correlations. Similar limitations with regional Russian Google search results have been reported in earlier studies [69,89].

    Table 4. All available Google Trends results in Russia from September 2011 to September 2013.
    RegionSearch volume
    Oblast

    		Chelyabinsk100

    		Novosibirsk88

    		Sverdlovsk86

    		Samara85

    		Rostov83

    		Saint Petersburg city71

    		Moscow city68

    		Krasnodar67
    City

    		Yekaterinburg100

    		Nizhny Novgorod98

    		Chelyabinsk89

    		Samara87

    		Novosibirsk87

    		Rostov-on-Don85

    		Saint Petersburg81

    		Moscow77

    		Kazan68

    		Krasnodar61

    RQ2: Can Complementary Data Sources Explain the Observed Regularities for “Desomorphine” Across Russia in 2011-2013?

    To answer this question, we initially reviewed the approaches used to validate search pattern data and drug population data. Search pattern studies have generally validated against an offline measure. For example, the initial search pattern studies established correlations between search patterns and epidemiological surveillance data for influenza [70,90]. Other studies focusing on issue salience, established a correlation between search patterns, traditional media, and opinion polling [91]. Each of these search studies revealed regular patterns of behavior corresponding to a valid offline measure. However, in this case, there was no analogous source of illicit drug use data available. We therefore combined several complementary data sources with a view to providing a plausible explanation for the observed regularities in Internet search patterns.

    First, we obtained first court appearance data available for krokodil-related criminal charges for the 77 of 83 Russian oblast data available from the Rospravosudie website. The site is a publicly available, non-government Russian criminal justice research project displaying criminal court case data across all Russian oblasts [16]. One part of the project is dedicated to court appearance data for popular illicit recreational drugs. In addition to krokodil, Rospravosudie provides arrest data on 24 illicit drugs, including krokodil marijuana, amphetamines, JWH (“spice”), and heroin. The available krokodil data is a single per-oblast figure covering the date range 2010 to 2012. The Rospravosudie website publishers note several limitations. First, the arrest data are based on sentencing documents. Only 50% of complete sentencing data are published, and only 50% of cases appear in courts. Second, the database allows comparison of the relative popularity of various illicit drugs. It is not possible to describe the absolute prevalence of illicit drug use based on these data. Third, there is an assumption that the detection rates for illicit drug crimes were on average the same nationally. Fourth, only the first court appearances for illicit drug cases are recorded. Subsequent appeals and cassations for illicit drugs are excluded. In summary, the site authors suggest that despite these limitations, the data reflect the differences in access to illicit drugs across Russian regions.

    To analyze krokodil-related court data, we first obtained arrest rates for krokodil for 2010-2012 as a single figure for each Russian oblast. We then converted the arrest rates for each oblast to a per 100,000 population measure. This allowed us to investigate the relationship between court appearances and krokodil searches. We used the mean searches for “desomorphine” per 100,000 population from November 2011 to May 2012 to represent pre-CCM restriction searches. We then conducted Spearman correlation between arrest rates and searches per 100,000 population for “desomorphine” for the 77 regions for which court data were available.

    Second, we used Google Trends visual data to provide indicative national search results for popular CCMs and “desomorphine” from January 2009 to January 2013. We identified several popular CCM available in Russia prior to the June 2012 ban [92]. The four CCM we analyzed with Google Trends were kaffetin, solpadeine, pentalgin, and codelac. Historical Yandex data were not available for this complete date range.

    Third, we used Google Trends related searches to analyze several popular CCM available in Russia prior to the June 2012 restrictions. Through analyzing these related searches, we sought to obtain additional information on the characteristics of public interest in CCM and the term desomorphine before and after federal restrictions. Historical Yandex data were not available for this complete date range.

    Fourth, we used Yandex keyword feature nationally to confirm that searches for the term desomorphine were associated with illicit drug use. Yandex provides a keyword function that lists word combinations associated with a specified search term. Keywords are analogous to the Google related terms (Top Searches) feature [93]. We identified 85 Yandex keyword combinations incorporating the term desomorphine. These combinations included “desomorphine prepare” and “desomorphine recipe” (see Multimedia Appendix 1).Yandex keywords are available nationally, for each Russian region and 83 oblasts, and many smaller intra-oblast cities. However, the date range is limited to the preceding 30 days only. As the search patterns from month to month are likely to be volatile within smaller geographic units, we obtained and analyzed the results for Yandex national keywords only. In order to identify the main themes present in keyword results, we hand coded the 85 keyword combinations from the national level Yandex keyword feature in the latest available date range, November 2013. Two Russian-speaking researchers then coded each keyword combination into one of three primary themes.


    RQ1: Were There Regularities in the Internet Search Patterns for “Desomorphine” Across Russia in 2011-13?

    In the 6 months before the CCM restrictions in June 2012, 21 of Russia’s 89 oblasts had Internet search rates higher than the national average (mean) of 16.67 per 100,000 (see Multimedia Appendix 2). In the 6 months immediately after restrictions, national average search rates dropped to 9.65 per 100,000. Further, the number of oblasts with a higher than average search rate dropped from 30 to 16. In the 6-month date range from March to August 2013, search rates dropped further to 8.75 per 100,000, with 11 oblasts recording higher than average search rates. However, there were a number of oblasts where searches for “desomorphine” persisted after the federal restriction on CCM sales. These included Sverdlovsk oblast (146.898 before CCM restrictions vs 81.098 post restrictions), Moscow city (31.245 vs 20.586), and Vologda oblast (34.061 vs 17.998). See Table 5. A further detailed analysis of subnational search pattern results appears in narrative form in Multimedia Appendix 3.

    Table 5. Yandex search patterns for “desomorphine” in selected Russian subregional cities.
    CitiesPre-ban, 6 months, Dec 2011-June 2012Post-ban, 6 months, July-Dec 2012Post-ban, 6 months, Feb-Sept 2013% change post-ban, 6 months% change, Feb-Sept 2013
    Vologda Oblast

    		Vologda city80.91628.38933.85764.91558.157

    		Cherepovets50.32428.33725.82943.69048.674
    Sverdlovsk Oblast

    		Yekaterinburg16.20010.37210.26135.97636.662

    		Kamensk-uralskiy20.22613.2626.58334.43467.453

    		Pervouralsk13.1166.2906.15752.04153.061
    Rostov Oblast

    		Rostov-na-donu56.46043.40942.35323.11724.986

    		Kamensk-Shakhtinsky17.85013.0025.95027.16066.667

    		Shakhty2.7780.7641.87572.50032.500

    		Volgodonsk26.63311.2198.78057.87567.033

    		Taganrog13.3246.0808.86154.36933.495

    		Novocherkassk6.4204.2473.85233.84640.000
    Samara Oblast

    		Samara city25.32916.44224.22735.0854.350

    		Togliatti30.13118.73615.14737.81749.731
    Krasnodar Oblast

    		Sochi16.0689.3208.49541.99447.130

    		Novorossiysk11.98611.1593.5826.89770.115

    		Krasnodar city32.77420.91714.58636.17755.495

    RQ2: Can Complementary Data Sources Explain the Observed Regularities for “Desomorphine” Across Russia in 2011-13?

    To answer this question, we used several complementary sources of krokodil-related data. We found a Spearman correlation of .506 (P≤.001) between searches for the term “desomorphine” and first court appearance data for krokodil related charges for all Russian oblasts. That is a moderately strong positive correlation (see Table 6).

    Table 6. Correlation between searches for the term desomorphine and court appearances.
    No. of subregionsData sourceDate rangeSpearman correlation
    83 (77 correlated)“desomorphine” searches, Yandex WordStatDec 2011-May 12—
    77desomorphine court appearances2010-2012.506 (P≤.001)

    Second, we examined national Google Trends results for four CCMs and “desomorphine”. Overall, search volumes for both CCM decreased in the 6 months before the June 2012 federal restrictions, as did searches for the term “desomorphine”. Public interest in CCM and the term desomorphine was roughly similar in the 6 months before the implementation of restrictions. The exception was an increase in search for the CCM pentalgin immediately before the June 2012 restrictions (see Table 7). We attribute this marked increase in interest due to public concern over access to CCM for therapeutic analgesic purposes.

    Third, we examined Google Trends related terms for CCMs and desomorphine. We found related terms for CCMs consistent with therapeutic and analgesic uses (see Table 7). By contrast, related terms for desomorphine were consistent with an interest in the production and use of krokodil. The Google related terms data did not record all search results. We attribute this to the Google “threshold effect” described in earlier analysis of drug policy [69]. That is, below an unspecified threshold value, Google records a nil value.

    Table 7. Google related search terms for “desomorphine” from 2009-2013.
    Date rangePentalgin (пенталгин)ValueCodelac (коделак)ValueDesomorphine (дезоморфин)Value
    2009-2013Pentalgin N100Codelac broncho100Desomorphine how to prepare100
    Pentalgin instructions65Codelac phyto75Desomorphine krokodil75
    Pentalgin composition50Codelac instructions75Krokodil70
    Pentalgin price45Codelac price65

    Nurofen40Codelac syrup60

    Dec 2011-May 2012Pentalgin N100Codelac phyto100How to prepare desomorphine100
    Pentalgin instructions85Codelac instructions100Krokodil55
    July 2012-Aug 2013Insufficient search volumeNilInsufficient search volumeNilInsufficient search volumeNil

    Fourth, we used the Yandex keyword feature to analyze the word combinations used with the search term desomorphine. We found combinations associated with krokodil preparation and use accounted for 46.613% of searches, images, and general information for 24.175%, and ambiguous terms for 29.212% (see Multimedia Appendix 1 and Table 8). We used Cohen’s Kappa to assess intercoder reliability on all 85 search combinations across three categories using two coders (kappa=.772).

    The preparation and use category included all terms associated with drug preparation and use. Images and entertainment included visual material and terms unlikely to be associated with drug use and preparation (eg, “YouTube desomorphine”, “junkies desomorphine”). In summary, we found the combination of search patterns with complementary methods useful for identifying behaviors consistent with an interest in the production and use of krokodil.

    Table 8. Main themes identified in WordStat keyword combined word searches for “desomorphine” (excluding non-combined word searches for the single term “desomorphine”.
    Code
    		n (N=6338)Percentage
    1Preparation & Use295246.613
    2Images & information153124.175
    3Ambiguous185029.212

    Principal Findings

    We found federal CCM restrictions in June 2012 coincided with changes in the relative scale and spatial patterns of Internet search behaviors consistent with an interest in the production and use of krokodil. These changes in Internet search appeared consistent with behaviors that may be anticipated in the production and use of krokodil in response to changed access to CCM.

    We observed marked reductions in searches for the term desomorphine following CCM sales restrictions in June 2012. By comparison with the 6 months preceding federal restrictions, searches dropped by 42.095% nationally (see Multimedia Appendix 2). However, the patterns of decreased search for “desomorphine” varied considerably. This suggests that CCM restrictions changed but did not extinguish behaviors consistent with an interest in the production and use of krokodil.

    Third, we found the Google data available were inadequate for statistical analysis. Insufficient Google Trends data were available to conduct statistical analysis to identify oblasts where krokodil use may be prevalent. Google Trends data were available for only 8 of 83 regions (see Table 4).

    We identified several complementary data sources that provided a plausible explanation for the observed regularities in Internet search data. First, we found a moderately strong positive correlation (Spearman correlation=.506) between the geographic distribution of court appearances for krokodil-related charges, and Internet searches for the term desomorphine. This result should be treated with some caution. Court appearance data were available for 78 of 83 statistical regions. This may have affected the strength of correlations. More significantly, international researchers generally regard Russian policing as predatory and beyond the rule of law [94,95]. A 2010 study of PWID found reports of evidence planted by police, extortion money, arbitrary arrests, and violence to be widespread. Further, Russian court processes are regarded by researchers and Russian public opinion as likely to produce outcomes favoring police and prosecutors [96-98]. Both policing and judicial practices may be expected to distort court appearance data. It is possible that in the absence of these law enforcement practices the strength of correlation may differ. Conversely, the uncertainty surrounding Russian law enforcement data is consistent with descriptions of other data sources used for indirect drug population estimation by international researchers.

    Second, the available Google Trends data suggested public interest in CCM and the term desomorphine was roughly similar in the 6 months prior to federal restrictions. However, the searches for CCM and desomorphine-related terms were not identical. The interest in CCM and in desomorphine manifested as different national level search patterns over the date range. While we had insufficient Google data to conduct correlations, this difference is evident on visual inspection (see Figure 2). Similarly, Google Trends related terms results suggest different themes for “desomorphine” and CCM (see Table 7). Whereas searches for the term desomorphine were associated with illicit drug use themes, the CCM search themes were primarily associated with therapeutic use of drugs. Finally, there is anecdotal evidence from Russian informants that CCM was also widely consumed orally rather than injected prior to the introduction of federal restrictions (P. Meylakhs, Personal Communication, 2014). The restrictions on CCM sales thus also affected oral use of CCM as a recreational drug.

    Yandex keyword analysis revealed a consistent pattern of behavior that was consistent with an interest in the production and use of krokodil. Yandex keyword data also revealed a strong popular interest in visual images of desomorphine use (see Table 8). Overall, 23.59% of searches were coded as pertaining to the images and general information theme. These graphic images were actively employed in Russian government campaigns aimed at reducing krokodil use. However, the wide distribution of images may also have created a popular demand for viewing necrotic injuries as voyeurism or entertainment. While the available Yandex keyword data were outside of the date range of the study, they reveal persistent interest in behavior consistent with an interest in the production and use of krokodil in Russia.

    In summary, we used complementary data sources in order to investigate behaviors consistent with an interest in the production and use of krokodil. Our analysis suggests that these combined complementary sources, including online news sources, provided a useful addition to the conventional approaches used to analyze krokodil use in Russia. Further, our analysis also suggests it is plausible that Yandex search behavior served as a proxy for krokodil production and use in the date range 2011-2012.

    ‎
    Figure 2. Google Trends results for CCM and desomorphine search 2009 - 2013.
    View this figure

    Further Research and Limitations

    Our research suggests that further research into the use of search patterns for investigating illicit drug use prevalence is warranted. First, search patterns offer researchers and non-government groups an additional source of indirect data with which to track the prevalence of traditional and emerging synthetic drugs at low cost and in near real time. We identified two references to national drug agencies in United Kingdom and Russia using Internet search methods to research patterns of illicit drug use [46,66]. Search pattern methods offer non-government groups similar capabilities. Further, the methods described in this paper are directly applicable to the study of other illicit drugs and in Russian-speaking countries where Yandex is widely used alongside Google.

    Second, the krokodil case represents an example of a broader class of illicit drug policy events. International and Russian researchers have partially attributed increased use of krokodil to decreased heroin supply after 2009. Similarly, in 2012, government policy blocked easy access to CCM. In each case, existing networks of PWID were disrupted, and patterns of illicit drug use rapidly changed [18]. Combining Internet search and offline qualitative methods would extend understanding of rapid shifts in illicit drug markets and potentially improve public health responses to emerging synthetic drugs. This qualitative research may include existing drug use prevalence, strength of the heroin market, and Internet access among PWID in Russia. In particular, this research would assist researchers with discerning rapid shifts in drug use patterns in response to policy changes and other external shocks to existing illicit drug markets. The relationship of searches for "desomorphine" to other illicit drugs appears in Multimedia Appendices 4 and 5.

    Third, media censorship is increasing in contemporary Russia. However, our analysis of online information relied on measures of unobserved population level demand for online information only. By contrast, censorship may be expected to influence the supply of illicit drug-related information. Russian government actions restricting the supply of illicit drug information are well documented in international literature (eg, [51,99]). Future research should investigate the relationship between searches for information and the censored supply of information.

    Finally, search methods do not estimate actual drug user population size. However, our research suggests search methods can complement existing drug-using population estimation methods. For example, the Yandex keywords feature potentially provides a novel data source with which to track monthly shifts in keywords for illicit drug–related terms. Keywords measures provide a low-cost method for identifying spatial shifts in the relative scale of public interest in terms that are consistent with an interest in the production and use of novel and emerging illicit drugs in an increasingly complex environment where the opportunities for conventional field work and surveys in Russia for international researchers are decreasing.

    Conclusions

    Illicit drug use data are generally regarded as difficult to obtain through traditional survey methods. We used complementary methods to explain observed regularities in patterns of Internet search behavior before and after the imposition of Russian federal restrictions on CCM sales in 2012. Our analysis suggests it is plausible that Yandex search behavior served as a proxy for patterns of krokodil production and use during the date range we investigated. More generally, this study demonstrates the application of novel methods recently used by policy makers to both monitor illicit drug use and influence drug policy decision making.

    Acknowledgments

    The work of Peter Meylakhs was funded by the Basic Research Program of the National Research University Higher School of Economics, Russia. The authors would also like to thank Ms Svetlana Chernova in Ukraine for her assistance with data collection and coding, Associate Professor James Gillespie at the Menzies Centre for Health Policy, University of Sydney for his advice and support, and Ms Anya Sarang from the Andrey Rylkov Foundation in Moscow for facilitating contacts within Russia.

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix 1

    Yandex Wordstat Keywords: combinations of words searched for with "desomorphine", November 2013.

    PDF File (Adobe PDF File), 53KB
    ‎

    Multimedia Appendix 2

    Per-capita mean searches for "desomorphine" in all Russian federal regions & subregions (**= region or subregion above national mean).

    PDF File (Adobe PDF File), 55KB
    ‎

    Multimedia Appendix 3

    Analysis of regional Internet search patterns.

    PDF File (Adobe PDF File), 34KB
    ‎

    Multimedia Appendix 4

    Illicit drug search popularity of related terms in Google Trends 2009-2014.

    JPG File, 282KB
    ‎

    Multimedia Appendix 5

    Google searches for popular illicit drugs in the Russian Federation 2009-2014.

    JPG File, 313KB
    1. Gahr M, Freudenmann RW, Hiemke C, Gunst IM, Connemann BJ, Schönfeldt-Lecuona C. Desomorphine goes "crocodile". J Addict Dis 2012;31(4):407-412. [CrossRef] [Medline]
    2. Thekkemuriyi DV, John SG, Pillai U. 'Krokodil'--a designer drug from across the Atlantic, with serious consequences. Am J Med 2014 Mar;127(3):e1-e2. [CrossRef] [Medline]
    3. TNS Web Index December 2011. Moscow: TNS   URL: http:/​/tns-global.​ru/​media/​content/​B7525726-B5E1-4C12-BE25-4C543F42F3EE/​!Web%20Index%20Report%20201112.​zip [accessed 2013-12-13] [WebCite Cache]
    4. Shuster S. Time. 2011 Jun 20. The curse of the crocodile: Russia's deadly designer drug   URL: http://content.time.com/time/world/article/0,8599,2078355,00.html [accessed 2013-12-13] [WebCite Cache]
    5. Regnum.ru. A new illicit drug, never before seen in Russia has been identified in Komi   URL: http://www.regnum.ru/news/accidents/260274.html [accessed 2013-12-13] [WebCite Cache]
    6. FSKN. A film about desomorphine addicts. 2010.   URL: http://www.youtube.com/watch?feature=player_embedded&v=vKHBF_hXits
    7. RIAN. Experts: Russia is ready for the ban on unrestricted sales of codeine containing medications   URL: http://ria.ru/beznarko_law/20120601/662265774.html [accessed 2013-12-10] [WebCite Cache]
    8. ARF. Results of the Internet survey on the heroin situation in Russia. Drug scene in Russia 2010   URL: http://en.rylkov-fond.org/blog/drug-policy-and-russia/drug-policy-in-russia/drugscene-in-russia/ [accessed 2013-12-14] [WebCite Cache]
    9. 1tv. More than 20 Russian oblasts will introduce restrictions on sales of codeine containing medications in advance of a federal ban.   URL: http://www.1tv.ru/news/social/190424 [accessed 2013-12-13] [WebCite Cache]
    10. World Drug Report. Vienna: UNODC; 2010.   URL: http://www.unodc.org/unodc/en/data-and-analysis/WDR-2010.html [accessed 2014-05-31] [WebCite Cache]
    11. World Drug Report. Vienna: UNODC; 2012.   URL: http://www.unodc.org/unodc/en/data-and-analysis/WDR-2012.html [accessed 2014-05-30] [WebCite Cache]
    12. RIAN. FSKN states that desomorphine seizures in the Urals have increased by 5 times since 2008   URL: http://ria.ru/beznarko_danger/20111226/527639443.html [accessed 2013-12-10] [WebCite Cache]
    13. Grund JP, Latypov A, Harris M. Breaking worse: the emergence of krokodil and excessive injuries among people who inject drugs in Eurasia. Int J Drug Policy 2013 Jul;24(4):265-274. [CrossRef] [Medline]
    14. FSKN. Analysis of desomoprhine use prevalence in the Urals Federal Region including volumes of codeine containing medications. 2011.   URL: http://www.ufo.fskn.gov.ru/?articleID=826 [accessed 2013-12-13] [WebCite Cache]
    15. Booth RE. 'Krokodil' and other home-produced drugs for injection: a perspective from Ukraine. Int J Drug Policy 2013 Jul;24(4):277-278. [CrossRef] [Medline]
    16. Rospravosudie. Angel dust on the map of Russia.   URL: https://rospravosudie.com/society/narko [accessed 2013-12-13] [WebCite Cache]
    17. Borzunova K. RIAN. The victims of Krokodil   URL: http://ria.ru/columns/20111220/521480375.html [accessed 2013-12-14] [WebCite Cache]
    18. Heimer R. Patterns of new drug emergence: a comment in light of 'krokodil'. Int J Drug Policy 2013 Jul;24(4):275-277 [FREE Full text] [CrossRef] [Medline]
    19. Eddy NB. Synthetic substances with morphine-like effect: clinical experience; potency, side-effects, addiction liability. Bull World Health Organ 1957;17(4-5):569-863 [FREE Full text] [Medline]
    20. Priymak A. Desomorphine, drug for the poor, kills all of its victims. 2011 Jun 23.   URL: http://english.pravda.ru/hotspots/crimes/23-06-2011/118296-desomorphine-0/ [accessed 2013-12-14] [WebCite Cache]
    21. Skowronek R, Celiński R, Chowaniec C. "Crocodile"--new dangerous designer drug of abuse from the East. Clin Toxicol (Phila) 2012 Apr;50(4):269. [CrossRef] [Medline]
    22. RIAN. 2011 Mar 31. Explosion in a house in Rostov on Don while drugs being prepared   URL: http://ria.ru/antidrugs/20110331/359573834.html [accessed 2013-12-10] [WebCite Cache]
    23. Walker S. The Independent. 2011 Jun 22. Krokodil: the drug that eats junkies   URL: http://www.independent.co.uk/news/world/europe/krokodil-the-drug-that-eats-junkies-2300787.html [accessed 2013-12-14] [WebCite Cache]
    24. WHO. Management of common health problems of drug users. New Delhi: WHO SEARO; 2009.   URL: http://www.who.int/hiv/topics/idu/drug_dependence/hiv_primary_care_guidelines_searo.pdf [accessed 2013-12-16] [WebCite Cache]
    25. Degenhardt L, Mathers B, Vickerman P, Rhodes T, Latkin C, Hickman M. Prevention of HIV infection for people who inject drugs: why individual, structural, and combination approaches are needed. Lancet 2010 Jul 24;376(9737):285-301. [CrossRef] [Medline]
    26. Islam MM, Topp L, Day CA, Dawson A, Conigrave KM. The accessibility, acceptability, health impact and cost implications of primary healthcare outlets that target injecting drug users: a narrative synthesis of literature. Int J Drug Policy 2012 Mar;23(2):94-102. [CrossRef] [Medline]
    27. Niccolai LM, Verevochkin SV, Toussova OV, White E, Barbour R, Kozlov AP, et al. Estimates of HIV incidence among drug users in St. Petersburg, Russia: continued growth of a rapidly expanding epidemic. Eur J Public Health 2011 Oct;21(5):613-619 [FREE Full text] [CrossRef] [Medline]
    28. Amirkhanian YA, Kelly JA, Kuznetsova AV, DiFranceisco WJ, Musatov VB, Pirogov DG. People with HIV in HAART-era Russia: transmission risk behavior prevalence, antiretroviral medication-taking, and psychosocial distress. AIDS Behav 2011 May;15(4):767-777 [FREE Full text] [CrossRef] [Medline]
    29. Wolfe D, Carrieri M, Shepard D. Treatment and care for injecting drug users with HIV infection: a review of barriers and ways forward. Lancet 2010 Jul 31;376(9738):355-366. [CrossRef] [Medline]
    30. Skobeyda Y. Komsomolskaya Pravda. 2011 Jun 03. Pharmacies freely sell the medications from which illicit drugs are made   URL: http://www.kp.md/daily/25696/899094/?cp=0 [accessed 2013-12-14] [WebCite Cache]
    31. kp.ru. Drug police check pharmacies. 2011 Jun 20.   URL: http://www.kp.ru/online/news/916804 [accessed 2013-12-16] [WebCite Cache]
    32. izvmor.ru. Drug police to investigate sales of medications in pharmacies. 2007 Jan 19.   URL: http://old.izvmor.ru/index.php?q=article_981.html [accessed 2014-05-30] [WebCite Cache]
    33. Yermakov O. Ministerial kickbacks or a corrupt tumour in ministerial families?. 2009 Oct 05.   URL: http://www.rospres.com/finance/5240 [accessed 2013-12-14] [WebCite Cache]
    34. Sterligov I. slon.ru. 2010 May 05. The end of codeine innovations   URL: http://slon.ru/business/konec_kodeinovyh_innovaciy-369152.xhtml [accessed 2013-12-14] [WebCite Cache]
    35. RIAN. 2011 Apr 18. Medvedev calls for closure of websites promoting illicit drugs   URL: http://old.rian.ru/society/20110418/365642510.html [accessed 2013-12-10] [WebCite Cache]
    36. RIAN. 2011 May 16. Bryun: codeine-containing medications should not be demonised in Russia   URL: http://ria.ru/beznarko_danger/20110516/377488902.html [accessed 2013-12-10] [WebCite Cache]
    37. WCIOM. Russian Public Opinion Research Centre. 2011 Jun 07. Codeine containing medication by prescription: for and against   URL: http://wciom.ru/index.php?id=459&uid=111674
    38. RIAN. 2011 May 19. FSKN calls for ban on sale of codeine containing medication without a medical prescription   URL: http://ria.ru/society/20110519/376834039.html [accessed 2013-12-10] [WebCite Cache]
    39. Malinina E. kp.ru. 2011 Dec 12. Astrakhan becomes 10th Russian region to restrict sales of codeine-containing medications   URL: http://www.kp.ru/online/news/1039373 [accessed 2013-12-14] [WebCite Cache]
    40. RIAN. 2012 Jan 01. Codeine containing medication will be sold strictly with a medical prescription in Orenburg oblast   URL: http://volga.ria.ru/society/20120101/82047502.html [accessed 2013-12-17] [WebCite Cache]
    41. RIAN. 2011 Sep 28. Drug den numbers fall in regions where codeine sales restricted   URL: http://ria.ru/beznarko_danger/20110928/445240710.html [accessed 2013-12-10] [WebCite Cache]
    42. aktualno.ru. 2102 Jul 23. Sales of codeine containing medications in Chelyabinsk oblast have fallen by 5 times in 6 months   URL: http://aktualno.ru/view2/16359 [accessed 2013-12-14] [WebCite Cache]
    43. Chernaya E. RIAN. 2012 Jul 24. Sales of codeine containing medications in Tomsk oblast have fallen - FSKN   URL: http://ria.ru/beznarko_news/20120724/710654402.html [accessed 2013-12-14] [WebCite Cache]
    44. Kravtsova K. prm.ru. 2013 Nov 11. Perm locals organised a network of desomorphine laboratories   URL: http://prm.ru/accident/292096/ [accessed 2013-12-14] [WebCite Cache]
    45. Yanyshev A. dvnovosti.ru. 2013 Nov 13. Thieves, addicts and hooligans - a day in the life of police on the beat   URL: http://www.dvnovosti.ru/khab/2013/11/13/13491/ [accessed 2013-12-13] [WebCite Cache]
    46. pravda.ru. 2011 Apr 13. Internet users have become more interested in preparation of drugs   URL: http://www.pravda.ru/news/society/13-04-2011/1073604-drugs-0/ [accessed 2013-12-14] [WebCite Cache]
    47. Zvonkaya A. aifudm.net. 2013 Dec 14. Krokodil eats addicts in Udmutriya oblast   URL: http://aifudm.net/news/news31191.html [accessed 2013-12-14] [WebCite Cache]
    48. Bogdanov V. rg.ru. 2011 Aug 05. Pain without a prescription   URL: http://www.rg.ru/2011/08/05/kodein.html [accessed 2013-12-14] [WebCite Cache]
    49. medvestnik.ru. 2012 Mar 11. FSKN: In 20 regions sales of codeine containing medications have decreased up to thirtyfold   URL: http:/​/www.​medvestnik.ru/​news/​fskn_v_20_regionah_rf_prodazhi_kodeinsoderzhaschih_lekarstv_snizilis_do_30_raz/​ [accessed 2014-09-07] [WebCite Cache]
    50. Levada Center. 3013 Sep 03. Which social problems most disturb you, and you consider to be the most important?   URL: http://www.levada.ru/03-09-2013/problemy-i-trevogi-rossiyan [accessed 2013-12-14] [WebCite Cache]
    51. openinform.ru. 2012 May 16. Court case against website closure order by Federal Drug Control Agency begins in Moscow   URL: http://openinform.ru/news/unfreedom/16.05.2012/26828/ [accessed 2013-12-14] [WebCite Cache]
    52. Kolesnikov V. narkotiki.ru. 2009. Weapons of genocide destroying the genofund of the nation   URL: http://www.narkotiki.ru/oinfo_6657.html [accessed 2013-12-14] [WebCite Cache]
    53. Meylakhs P. The Discourse of the Press and the Press of Discourse: The Construction of the Drug Problem in Russian Media. In Critical Readings: Moral Panics and the Media. In: Critcher C, editor. Critical readings: moral panics and the media. Maidenhead, Berkshire: Open University Press; 2006.
    54. Cohen S. Folk Devils and Moral Panics. New York, NY: Routledge; 2011.
    55. Jenkins P. Synthetic panics: the symbolic politics of designer drugs. New York, NY: New York University Press; 1999.
    56. Lancaster AR. What Does Curiosity Really Do to the Cat? A Look at How Message Exposure Can Lead to Illicit Drug Trial Among College Students. Mass Communication and Society 2004 Mar;7(1):77-95. [CrossRef]
    57. Lancaster K, Hughes CE, Spicer B, Matthew-Simmons F, Dillon P. Illicit drugs and the media: models of media effects for use in drug policy research. Drug Alcohol Rev 2011 Jul;30(4):397-402. [CrossRef] [Medline]
    58. Dasgupta N, Mandl KD, Brownstein JS. Breaking the news or fueling the epidemic? Temporal association between news media report volume and opioid-related mortality. PLoS One 2009;4(11):e7758 [FREE Full text] [CrossRef] [Medline]
    59. Davey Z, Corazza O, Schifano F, Deluca P. Mass-information: mephedrone, myths, and the new generation of legal highs. Drugs and Alcohol Today 2010;10(3):24-28. [CrossRef]
    60. Gallagher CT, Assi S, Stair JL, Fergus S, Corazza O, Corkery JM, et al. 5,6-Methylenedioxy-2-aminoindane: from laboratory curiosity to 'legal high'. Hum Psychopharmacol 2012 Mar;27(2):106-112. [CrossRef] [Medline]
    61. Report of the International Narcotics Control Board. Vienna: INCB; 2011.   URL: http://www.incb.org/documents/Publications/AnnualReports/AR2010/AR_2010_English.pdf [accessed 2013-12-15] [WebCite Cache]
    62. EC. Eurobarometer: young people and drugs among 15–24 year olds. Analytical report. Dublin: European Commission; 2008.   URL: http://ec.europa.eu/public_opinion/flash/fl_233_en.pdf [accessed 2013-12-14] [WebCite Cache]
    63. Hillebrand J, Olszewski D, Sedefov R. Legal highs on the Internet. Subst Use Misuse 2010 Feb;45(3):330-340. [CrossRef] [Medline]
    64. Corazza O, Schifano F, Farre M, Deluca P, Davey Z, Torrens M, et al. Designer drugs on the internet: a phenomenon out-of-control? the emergence of hallucinogenic drug Bromo-Dragonfly. Curr Clin Pharmacol 2011 May;6(2):125-129. [Medline]
    65. Corazza O, Assi S, Schifano F. From "Special K" to "Special M": the evolution of the recreational use of ketamine and methoxetamine. CNS Neurosci Ther 2013 Jun;19(6):454-460. [CrossRef] [Medline]
    66. Forsyth AJ. Virtually a drug scare: mephedrone and the impact of the internet on drug news transmission. Int J Drug Policy 2012 May;23(3):198-209. [CrossRef] [Medline]
    67. Eysenbach G. Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. J Med Internet Res 2009;11(1):e11 [FREE Full text] [CrossRef] [Medline]
    68. Granka L. Inferring the Public Agenda from Implicit Query Data. Boston, MA: ACM SIGIR Conference; 2009.   URL: http://ceur-ws.org/Vol-512/paper07.pdf [accessed 2013-11-05] [WebCite Cache]
    69. Zheluk A, Quinn C, Hercz D, Gillespie JA. Internet search patterns of human immunodeficiency virus and the digital divide in the Russian Federation: infoveillance study. J Med Internet Res 2013;15(11):e256 [FREE Full text] [CrossRef] [Medline]
    70. Ayers JW, Ribisl K, Brownstein JS. Using search query surveillance to monitor tax avoidance and smoking cessation following the United States' 2009 "SCHIP" cigarette tax increase. PLoS One 2011;6(3):e16777 [FREE Full text] [CrossRef] [Medline]
    71. Stephens-Davidowitz S. SSRN Journal. 2012. The Effects of Racial Animus on a Black Presidential Candidate: Using Google Search Data to Find What Surveys Miss   URL: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2050673 [accessed 2014-09-05] [WebCite Cache]
    72. Reis BY, Brownstein JS. Measuring the impact of health policies using Internet search patterns: the case of abortion. BMC Public Health 2010;10:514 [FREE Full text] [CrossRef] [Medline]
    73. Eysenbach G. Infodemiology: tracking flu-related searches on the web for syndromic surveillance. AMIA Annu Symp Proc 2006:244-248 [FREE Full text] [Medline]
    74. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L. Detecting influenza epidemics using search engine query data. Nature 2009 Feb 19;457(7232):1012-1014. [CrossRef] [Medline]
    75. Chan EH, Sahai V, Conrad C, Brownstein JS. Using web search query data to monitor dengue epidemics: a new model for neglected tropical disease surveillance. PLoS Negl Trop Dis 2011 May;5(5):e1206 [FREE Full text] [CrossRef] [Medline]
    76. Jena AB, Karaca-Mandic P, Weaver L, Seabury SA. Predicting new diagnoses of HIV infection using internet search engine data. Clin Infect Dis 2013 May;56(9):1352-1353 [FREE Full text] [CrossRef] [Medline]
    77. Netmarketshare.com. 2011. Search Engine Market Share   URL: http://www.netmarketshare.com/report.aspx?qprid=4&qptimeframe=M&qpsp=148
    78. Crisp T. ComScore Voices. 2011 Jun 27. Yandex: From Russia with Love   URL: http://www.comscore.com/Insights/Blog/Yandex-From-Russia-with-Love [accessed 2014-09-07] [WebCite Cache]
    79. WCIOM. Russian Public Opinion Research Center. 2102 Feb 13. Russians networking: rating of social media   URL: http://wciom.ru/index.php?id=459&uid=112476
    80. TNS Web Index: The audience as a whole. Moscow: TNS; 2013.   URL: http:/​/www.​tns-global.ru/​media/​content/​B7525726-B5E1-4C12-BE25-4C543F42F3EE/​!Web%20Index%20Report%20201212_EN.​zip [accessed 2013-12-14] [WebCite Cache]
    81. Degenhardt L, Bucello C, Calabria B, Nelson P, Roberts A, Hall W, GBD illicit drug use writing group, et al. What data are available on the extent of illicit drug use and dependence globally? Results of four systematic reviews. Drug Alcohol Depend 2011 Sep 1;117(2-3):85-101. [CrossRef] [Medline]
    82. Reuter P, Trautmann F. Utrecht Eur Comm. 2009. A report on global illicit drugs markets 1998-2007   URL: http://ec.europa.eu/justice/anti-drugs/files/report-drug-markets-short_en.pdf [accessed 2013-12-15] [WebCite Cache]
    83. Hickman M, Taylor C. Sci Drug Abuse Epidemiol. 2002. Estimating the prevalence of problematic drug use: a review of methods and their application   URL: https://www.unodc.org/pdf/bulletin/bulletin_2002_01_01_Art2.pdf [accessed 2013-12-15] [WebCite Cache]
    84. Law MG, Lynskey M, Ross J, Hall W. Back-projection estimates of the number of dependent heroin users in Australia. Addiction 2001 Mar;96(3):433-443. [CrossRef] [Medline]
    85. Hall WD, Ross JE, Lynskey MT, Law MG, Degenhardt LJ. How many dependent heroin users are there in Australia? Med J Aust 2000 Nov 20;173(10):528-531. [Medline]
    86. Degenhardt L, Hall W. Extent of illicit drug use and dependence, and their contribution to the global burden of disease. Lancet 2012 Jan 7;379(9810):55-70. [CrossRef] [Medline]
    87. Yang AC, Tsai SJ, Huang NE, Peng CK. Association of Internet search trends with suicide death in Taipei City, Taiwan, 2004-2009. J Affect Disord 2011 Jul;132(1-2):179-184. [CrossRef] [Medline]
    88. gks.ru. All-Russian Census. Moscow, Russia: Russ Fed State Stat Serv; 2012.   URL: http://www.gks.ru/free_doc/new_site/perepis2010/croc/perepis_itogi1612.htm [accessed 2013-12-15] [WebCite Cache]
    89. Zheluk A, Gillespie JA, Quinn C. Searching for truth: internet search patterns as a method of investigating online responses to a Russian illicit drug policy debate. J Med Internet Res 2012;14(6):e165 [FREE Full text] [CrossRef] [Medline]
    90. Polgreen PM, Chen Y, Pennock DM, Nelson FD. Using internet searches for influenza surveillance. Clin Infect Dis 2008 Dec 1;47(11):1443-1448 [FREE Full text] [CrossRef] [Medline]
    91. Mellon J. Where and When Can We Use Google Trends to Measure Issue Salience? APSC 2013 Mar 28;46(02):280-290. [CrossRef]
    92. Aleksandrov M. Vechernyaya Moskva. 2011 Feb 23. The codeine itch   URL: http://moskva.bezformata.ru/listnews/kodeinovij-zud/522253/ [accessed 2014-05-30] [WebCite Cache]
    93. Google.com. 2011. What are top searches?   URL: https://support.google.com/trends/answer/4355000?hl=en&rd=1 [accessed 2014-09-05] [WebCite Cache]
    94. Rhodes T, Platt L, Sarang A, Vlasov A, Mikhailova L, Monaghan G. Street policing, injecting drug use and harm reduction in a Russian city: a qualitative study of police perspectives. J Urban Health 2006 Sep;83(5):911-925 [FREE Full text] [CrossRef] [Medline]
    95. Gerber TP, Mendelson SE. Public Experiences of Police Violence and Corruption in Contemporary Russia: A Case of Predatory Policing? Law Soc Rev 2008 Mar;42(1):1-44. [CrossRef]
    96. Kurkchiyan M. The illegitimacy of law in post-Soviet societies. Law and Informal Practices: The Post-Communist Experience 2003:25-46. [CrossRef]
    97. Hendley K. Cardozo Journal of International and Comparative Law. 2006. Assessing the rule of law in Russia   URL: https://media.law.wisc.edu/m/ytdxn/assessing_rol.pdf [accessed 2014-09-06] [WebCite Cache]
    98. ARF. rylkov-fond.org. 2012. Additional information to the Report to the ICESCR on implementation by the RF of article 12 of the International Covenant on ESCR as it relates to access of people who inject drugs to drug treatment and HIV prevention, care and treatment programs   URL: http:/​/en.​rylkov-fond.org/​wp-content/​uploads/​2012/​01/​AndreyRylkovFoundation_RussianFederation_CESCR46-eng.​pdf [accessed 2013-12-15] [WebCite Cache]
    99. Parfitt T. Vladimir Mendelevich: fighting for drug substitution treatment. The Lancet 2006 Jul;368(9532):279. [CrossRef]

    ‎
    CCM: codeine-containing medication
    HIV: human immunodeficiency virus
    PWID: people who inject drugs
    FSKN: Russian Federal Drug Control Service

    Edited by G Eysenbach; submitted 21.12.13; peer-reviewed by R Heimer, G Woody; comments to author 28.04.14; revised version received 03.06.14; accepted 22.08.14; published 18.09.14

    Copyright

    ©Andrey Zheluk, Casey Quinn, Peter Meylakhs. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 18.09.2014.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.