This paper is in the following e-collection/theme issue:

JMIR Theme Issue: COVID-19 Special Issue (2452) Infectious Diseases (non-STD/STI) (1575) Innovative Methods in Public Health and Surveillance (332) Statistical Methods for Surveillance and Population Health (156) Surveillance Systems (462) Theme Issue: Novel Coronavirus (COVID-19) Outbreak Rapid Reports (1517)

Published on in Vol 22, No 10 (2020): October

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/21955, first published .
Dynamic Panel Surveillance of COVID-19 Transmission in the United States to Inform Health Policy: Observational Statistical Study

Dynamic Panel Surveillance of COVID-19 Transmission in the United States to Inform Health Policy: Observational Statistical Study

Dynamic Panel Surveillance of COVID-19 Transmission in the United States to Inform Health Policy: Observational Statistical Study

Authors of this article:

James Francis Oehmke1 Author Orcid Image ;   Charles B Moss2 Author Orcid Image ;   Lauren Nadya Singh1 Author Orcid Image ;   Theresa Bristol Oehmke3 Author Orcid Image ;   Lori Ann Post1 Author Orcid Image
Article Authors Cited by (25) Tweetations (4) Metrics Author Video

    Original Paper

    1Buehler Center for Health Policy and Economics, Feinberg School of Medicine, Northwestern University, Chicago, IL, United States

    2Food and Resource Economics Department, University of Florida, Gainesville, FL, United States

    3Civil and Environmental Engineering, University of California, Berkley, Berkley, CA, United States

    Corresponding Author:

    Lori Ann Post, PhD

    Buehler Center for Health Policy and Economics

    Feinberg School of Medicine

    Northwestern University

    420 E Superior St

    Chicago, IL,

    United States

    Phone: 1 203 980 7107

    Email: lori.post@northwestern.edu


    Background: The Great COVID-19 Shutdown aimed to eliminate or slow the spread of SARS-CoV-2, the virus that causes COVID-19. The United States has no national policy, leaving states to independently implement public health guidelines that are predicated on a sustained decline in COVID-19 cases. Operationalization of “sustained decline” varies by state and county. Existing models of COVID-19 transmission rely on parameters such as case estimates or R0 and are dependent on intensive data collection efforts. Static statistical models do not capture all of the relevant dynamics required to measure sustained declines. Moreover, existing COVID-19 models use data that are subject to significant measurement error and contamination.

    Objective: This study will generate novel metrics of speed, acceleration, jerk, and 7-day lag in the speed of COVID-19 transmission using state government tallies of SARS-CoV-2 infections, including state-level dynamics of SARS-CoV-2 infections. This study provides the prototype for a global surveillance system to inform public health practice, including novel standardized metrics of COVID-19 transmission, for use in combination with traditional surveillance tools.

    Methods: Dynamic panel data models were estimated with the Arellano-Bond estimator using the generalized method of moments. This statistical technique allows for the control of a variety of deficiencies in the existing data. Tests of the validity of the model and statistical techniques were applied.

    Results: The statistical approach was validated based on the regression results, which determined recent changes in the pattern of infection. During the weeks of August 17-23 and August 24-30, 2020, there were substantial regional differences in the evolution of the US pandemic. Census regions 1 and 2 were relatively quiet with a small but significant persistence effect that remained relatively unchanged from the prior 2 weeks. Census region 3 was sensitive to the number of tests administered, with a high constant rate of cases. A weekly special analysis showed that these results were driven by states with a high number of positive test reports from universities. Census region 4 had a high constant number of cases and a significantly increased persistence effect during the week of August 24-30. This change represents an increase in the transmission model R value for that week and is consistent with a re-emergence of the pandemic.

    Conclusions: Reopening the United States comes with three certainties: (1) the “social” end of the pandemic and reopening are going to occur before the “medical” end even while the pandemic is growing. We need improved standardized surveillance techniques to inform leaders when it is safe to open sections of the country; (2) varying public health policies and guidelines unnecessarily result in varying degrees of transmission and outbreaks; and (3) even those states most successful in containing the pandemic continue to see a small but constant stream of new cases daily.

    J Med Internet Res 2020;22(10):e21955

    doi:10.2196/21955

    Keywords

    COVID-19; models; surveillance; reopening America; contagion; metrics; surveillance; health policy; public health 


    Without question, SARS-CoV-2, the novel coronavirus that causes COVID-19 [1,2], has resulted in an unprecedented pandemic in modern history with significant morbidity and mortality [3-7]. Although some countries have had success in controlling COVID-19 [8-11], others have encountered much difficulty [12-17], resulting in significant adverse outcomes [18-21]. Beyond the overall implications related to infection and death [9,11,22-29], the COVID-19 pandemic has a deleterious impact on the global economy [27,30,31], violence [32-37], mental health [38-43], and food security [44-47], and disproportionately affects vulnerable populations such as the elderly [48-52], the poor [53,54], and racial and ethnic minorities [55-61]. We must establish COVID-19 control through good policy [10,12,62-68]; unfortunately, different states have implemented various and inconsistent COVID-19 policies [67,69-76] in the absence of a national plan [77,78]. Without a COVID-19 vaccine [79-81], we need systematic public health surveillance [7,82-89] to inform policies and guidelines for COVID-19 control and prevention such as quarantines, social distancing, face masks, crowd control, and hygiene to prevent viral spread [90-98]. Good surveillance can safely inform our leaders when, how, and where our country can reopen [76,99-103].

    According to Teutsch and Churchill [85], public health surveillance is the “systematic, ongoing assessment of the health of a community, based on the collection, interpretation, and use of health data and information. Surveillance provides information necessary for public health decision making” (pg 1). Surveillance does not rely on a single indicator; it depends on a variety of metrics to identify high-priority COVID-19 health events such as incidence, prevalence, mortality, severity, cost, preventability, and communicability [104]. We need to meet these objectives of a surveillance system to prevent infectious diseases [104]. The United States must address several public health surveillance objectives, specifically to detect outbreaks (eg, the distribution and spread of COVID-19) and evaluate control strategies [104]. A surveillance system also includes “the functional capacity for data collection and analysis, as well as the timely dissemination of data” (pg 1) [87]. To this end, our study aims to create novel, validated metrics of speed, acceleration, and jerk in COVID-19 transmission in the United States.

    The Great COVID-19 Shutdown refers to the variety of “lockdown” [105] public health policies adopted by countries around the globe to prevent the further spread of COVID-19, ranging from strict and complete quarantines [106-108] to disorganized and piecemeal closures [105]. It worked in places when it was implemented properly and in a timely manner, such as China, South Korea, Singapore, and Vietnam [10,11,62,109]. Some countries eliminated COVID-19, defined as achieving zero new cases over 14 days, while others flattened the curve [64,110-113]. Governments that failed to effectively close down public movement and interactions resulted in increases in SARS-CoV-2 infections [50,114-120]. The United States had no national policy and was late in responding to the looming pandemic [105]. In fact, COVID-19 was technically classified as an epidemic by the Centers for Disease Control and Prevention when it accounted for >7.3% of all deaths in the United States. According to the National Center for Health Statistics, this was reached during the week of March 29-April 4 when COVID-19 accounted for 13.87% of all causes of death [121].

    In response to the large death toll exacted by the epidemic, states independently implemented public health guidelines [14,19,70,71,122-125] regarding closures, social distancing, masks, and hand hygiene, which begs the question: when is it safe to reopen [126]? Reopening guidelines are predicated on a sustained decline in COVID-19 cases; however, operationalization of “sustained decline” varies by state [127]. Existing contagion models for COVID-19 rely on parameters such as case estimates or R0 and use intensive data collection efforts [128,129]. “Static” statistical models do not capture all of the relevant dynamics required to measure sustained declines [130-135]. Moreover, existing COVID-19 models use data that are subject to significant measurement error and other contaminants. Estimates of new SARS-CoV-2 infections suffer from undercounts due to asymptomatic carriers [136,137], access to testing [9,138-140], testing delays [141], testing sensitivity and specificity [142-145], and access to health care [60,146-150]. Surveillance systems and any enumeration of COVID-19 cases will err on the side of severity, meaning the most severe cases are more likely to be captured, the consequence of which is a significant undercount [71,104,130,151-156].

    The conventional approach to modeling the spread of diseases such as COVID-19 is to posit an underlying contagion model and then to seek accurate direct measurement of the model parameters such as effective transmission rates or other parameters, often through labor-intensive methods relying on contact tracing to determine the spread of the virus in a sample population. For viral epidemics with an incubation period of up to 14 days, it takes weeks if not months to generate accurate parameter estimates even for simple contagion models [130]. For example, Li et al [157] provided early estimates of contagion parameters for COVID-19 using Wuhan data from contact tracing and methods developed by Lipsitch [158] but with weak statistical properties. It estimated the serial interval distribution and R0 from only six pairs of cases. These models also rely on underlying assumptions about immunity, common propensity for infection, well-mixed populations, etc [159]. Improvements in the models typically focus on relaxing these assumptions, for example, disaggregating the population by geography and modeling within-geography and cross-geographical personal interactions [160]. For example, Martcheva [161] provides an excellent dynamic analysis of a wide variety of contagion models and their possible dynamics. Unfortunately, the study had limited options for the statistical inference of parameter values from actual data.

    In contrast, we take an empirical approach that focuses on statistical modeling of widely available empirical data such as the number of confirmed cases or the number of tests conducted that can inform estimates of the current value of critical parameters like the infection rate or reproduction rate. We explicitly recognize that the data generating process for the reported data contain an underlying contagion component, a political-economic component such as availability of accurate test kits, a social component such as how strongly people adhere to social-distancing and shelter-in-place policies, and a sometimes inaccurate data reporting process that may obscure the underlying contagion process. We therefore seek a statistical approach that can provide meaningful information despite the complex and sometimes obfuscating data generation process. Our approach is consistent with the principles of evidence-based medicine, including controlling for complex pathways that may include socioeconomic factors such as mediating variables, and policy recommendations “based on the best available knowledge, derived from diverse sources and methods” (pg S58) [162].

    There are two primary advantages to this empirical approach. First, we can apply the empirical model relatively quickly to a short data set. This advantage stems from the panel nature of the model. We used US states as the cross-sectional variable, so that a week’s data from all US states provides a reasonable sample size. In addition to enabling parameter estimation early in a pandemic, using this property we tested to see if there has been a shift in the transmission or reproductive rates of the transmission process in the past week, that is, whether there is statistical evidence that the US pandemic is peaking.

    The second advantage is that the approach directly measures and informs policy-relevant variables. For example, the White House issued guidance on reopening the US economy that depends on a decrease in the documented number of cases and in the proportion of positive test results over a 14-day period, among other criteria and considerations [163]. As noted above, the number and proportion of positive test results are the outcome of a data generating process that includes not just the underlying transmission process but a multitude of mediating factors as well as idiosyncrasies of the data collection and reporting process. We specifically modeled the number of positive test results in our empirical model, which provides evidence of direct use in policy dialog.

    This study has two objectives: (1) to create a proof-of-concept COVID-19 surveillance system using the United States as a prototype for a global system; and (2) to validate novel surveillance metrics/techniques including speed, acceleration, and jerk to better inform public health leaders how the pandemic is spreading or changing course.


    Overview of Methodology

    First, we will provide standard surveillance metrics including new counts of SARS-CoV-2 infections, moving 7-day averages of SARS-CoV-2 infections, rates of SARS-CoV-2 infections per 100,000 population, new numbers of COVID-19 deaths, moving 7-day averages of COVID-19 deaths, and rates of COVID-19 deaths per 100,000 population plus testing and positive testing ratios. Standard surveillance metrics are useful and allow us to compare data even though standard techniques are limited to more severe cases and suffer from data contamination.

    Second, to address these data limitations we will validate novel surveillance metrics of (1) speed, (2) acceleration, and (3) jerk (change in acceleration). The basic question we are trying to inform is: how are we doing this week relative to previous weeks? From a public health perspective, in the midst of a pandemic, we would like (at least) three affirmative responses: (1) there are fewer new cases per day this week than last week, (2) the number of new cases is declining from day to day, and (3) the day-to-day decline in the number of cases is even bigger this week than last week. Additionally, we would like some indicative information about significant shifts in how the pandemic is progressing — positive shifts could be the first indicators of the emergence of a new or recurrent hotspot, and positive shifts could be first indicators of successful public health policy.

    This study derives indicators to inform the three questions specified in the study objective above. Next, we provide a regression-based decomposition of the indicators. While it is beyond the scope of this study to determine the underlying causes of the pandemic and its trajectory over time, we provide a decomposition into proximate contributory factors such as whether an acceleration is due to a “natural” progression of the pandemic (eg, due to an increasing infectious population) or to a shift in an underlying model parameter (eg, a parameter shift that could be associated with reopening, other health policy changes, a viral mutation, the end of summer vacation for K-12 schools, or other underlying causes). Other factors can affect acceleration by “shifting” the underlying parameters (eg, the virus can mutate to become more or less infectious, states can impose lockdowns, social pressures can encourage or discourage people from wearing masks and social distancing, etc). Therefore, we use the regression analysis to provide a decomposition of speed, acceleration, and jerk into proximate contributory factors. Finally, this study is an innovation over traditional agnostic surveillancesystems in that we go beyond presenting metrics of the transmission of COVID-19 by providing probable scenarios regarding the context in which the disease is spreading.

    The COVID Tracking Project [164] compiles data from multiple state sources on the web [165]; data for the most recent 36 days were accessed from the GitHub repository [166]. After accounting for lagged and differenced regressors, this resulted in a panel of 50 states plus the District of Columbia with 29 days in each panel (n=1352). Following Oehmke et al [167], an empirical difference equation was specified in which the number of positive cases in each state at each day is a function of the prior number of cases, the level of testing, and weekly shift variables that measure whether the contagion was growing faster, at the same rate, or slower compared to the previous weeks. This resulted in a dynamic panel model that was estimated using the generalized method of moments approach by implementing the Arellano-Bond estimator in STATA/MP, version 16.1 (StataCorp LLC).

    Arellano-Bond estimation of difference equations has several statistical advantages: (1) it allows for statistical examination of the model’s predictive ability and the validity of the model specification; (2) it corrects for autocorrelation and heteroscedasticity; (3) it has good properties for data with a small number of time periods and large number of states; (4) it corrects for omitted variables issues and provides a statistical test of correction validity. With these advantages, the method is applicable to ascertaining and statistically validating changes in the evolution of the pandemic within a period of one week or less, such as changes in the reproduction rate [167-174].

    Speed: New Cases Per Day

    The basic indicator of the pandemic’s status on a given day is the number of new cases on that day. Since new cases per day is a rate (value per unit of time), we will adopt physics nomenclature and refer to this as the speed of the pandemic. This is consistent with heuristic descriptions of the pandemic as spreading rapidly (ie, a large number of new cases per day) or slowly (ie, a small number of new cases per day). The public health ideal is to bring the speed of the pandemic to zero.

    We report the number of new cases for each state both as a number per day and as a number per 100,000 population per day (table and column references).

    For mathematical formality, we write:

    where we have suppressed the i subscript of the previous section. We will be reporting surveillance numbers for each state and for the District of Columbia.

    Acceleration

    We are also interested in whether the number of cases per day is increasing, peaking, or decreasing, and why. Again, we will adopt physics nomenclature and refer to this datum as the acceleration. Since acceleration is difficult to ascertain on a daily basis, and there are weekend effects, etc, in the data, we report the weekly average for the acceleration as:

    where D. is the difference operator. A positive acceleration indicates an increasing number of cases per day, and a negative acceleration (deceleration) indicates a decreasing number of cases per day. An acceleration of 0 is indicative of a peak, valley, or inflection point depending in part on whether the previous acceleration was positive or negative. For example, acceleration in Illinois changed from positive to zero in mid-May, indicating a peak, and from negative to zero toward the end of June, indicating a valley (Figure 1) [69,175].

    ‎
    Figure 1. The number of positives per day in Illinois, according to the COVID-19 Dashboard of the Center for Systems Science and Engineering [175].
    View this figure

    We provide a regression-based decomposition of accelerations into proximate components. That is, this is the systematic component of changes in acceleration, where t denotes the end date for the most recent week. Subtracting Oehmke et al’s [167] equation (3) at time t–1 from the same equation at time t results in:

    where we have suppressed the error terms and added a term for the “weekend effect.” We refer to the term containing Post–1 as the 1-day persistence effect. This, in turn, comprises a natural progression effect measured by β0D.Post–1 that represents the effect of a change over time in the number of new positive results where the magnitude of the effect is calibrated at the prior week’s parameter β0, and a shift effect β2D.Post–1 that measures the effect of the week’s shift in the parameter from β0 to β0 + β2. The second term in this equation is the 7-day persistence effect and is analogous to the 1-day persistence effect, including its decomposition into a natural progression effect y0D.Post–7 and a shift effect y2D.Post–7. The next part of equation 2 represents the portion of acceleration that is composed of changes in the contemporaneous component of the model.

    The analogous expression for 1 week prior and 2 weeks prior are:

    The expression for 2 weeks prior, D.Post–14, represents the baseline and does not contain any shift parameters. The shift parameters β1, β2, y1, and y2 represent shifts in the most recent 2 weeks relative to the week ending at time t–14.

    The expressions for D.Post from equations 3 or 4 are easily adapted from time t to time t–j for each week and averaged over the week to provide a decomposition of acceleration as defined by equation 2.

    Jerk: The Change in Acceleration

    We now address the question of whether the day-to-day increase (or decrease) in new cases the current week is bigger or smaller than the day-to-day increase (or decrease) in new cases of the past week.

    Formally, for the current week we are interested in is:

    The first term to the right of the definitional equality is the average growth in the number of daily positive cases for the current week ending at time t, and the second term is the average increase in the number of daily positive cases for the prior week. Using physics nomenclature, the difference between these two acceleration rates is the “jerk.” A positive jerk indicates that the acceleration in the number of daily cases this week is greater than the average growth last week. Such a finding would be consistent with a scenario in which the pandemic was experiencing explosive growth; where a policy shift such as reopening had augmented the acceleration of the pandemic, possibly including a shift from deceleration to acceleration; or where a megaevent had “jerked” the acceleration upward, among other scenarios.

    Using equation four, for the most recent week ending at time t, we can write:

    The top row contains the 1-day persistence effect’s contribution to the jerk. The first term on the right side of the equation represents the natural progression of the 1-day persistence effect on acceleration due to changes across weeks in the daily change in the number of new cases per day. The last term in the first row represents structural shifts in the 1-day persistence effect. The second row is analogous to the first row, except that it represents the 7-day persistence effect’s contribution to the jerk. The third row represents the contribution of contemporaneous effects to the jerk.

    The analogous equation for the prior week is:

    Equations 6 and 7 are easily averaged over the week to provide a decomposition of jerk as defined by equation 5.


    Regional Regression

    Findings

    We group the states according to Census region and present regression results for each region below. The biweekly surveillance products will be based on these regressions.

    For Region 1 (Northeast), the regression Wald statistic shows that the model was statistically significant (χ210=132, P<.001), and the Sargan test fails to reject the validity of the overidentifying restrictions. (χ2252=258, P=.38) (Table 1).

    Table 1. Arellano-Bond dynamic panel data modeling of the number of daily infections reported by state, August 2-30, 2020.
    VariableRegion 1Region 2Region 3Region 4

    		CoefficientP valueCoefficientP valueCoefficientP valueCoefficientP value
    L1Pos0.084.22–0.102.02–0.012.770.273<.001
    L1shiftAug17–0.129.160.069.240.221.02–0.213.03
    L1shiftAug24–0.112.190.093.10–0.021.84–0.737<.001
    L7Pos0.151.020.288<.0010.269<.0010.006.93
    L7shiftAug17–0.014.87–0.024.67–0.334<.0010.018.79
    L7shiftAug240.004.960.046.49–0.265.0030.397.02
    Tests0.003.120.047<.0010.091<.0010.017.048
    Tests_squared7.12E-09.61–5.05E-07<.001–4.89E-07<.0012.74E-08.48
    Tests_per_10K1.072.048.023.002–15.986<.001—a—
    Weekend–14.751.2023.581.28–33.948.5851.977.34
    Constant124.637<.00146.461.89429.167<.001397.678<.001
    Wald statistic for regressionχ210=132<.001χ210=590<.001χ210=475<.001χ210=316<.001
    Sargan statistic for validityχ2252=258.38χ2338=373.09χ2483=446.89χ2368=370.46

    aRegion 4 did not include the Tests_per_100K variable due to collinearity.

    The coefficient on the first lag of the dependent variable is not statistically significant, nor are the shift parameters for the weeks of August 17 and August 24 for this coefficient. The coefficient on the 7th lag is positive and statistically significant (0.151, P=.02). Neither of the shift parameters for the weeks of August 17 and August 24 are statistically significant. Of the variables representing the number of tests administered, the number per 100,000 population is significant (1.072, P=.04). The weekend variable is not significant. The constant is positive and significant (124.637, P<.001).

    For Region 2 (Midwest), the regression Wald statistic shows that the model was statistically significant (χ210=590, P<.001), and the Sargan test fails to reject the validity of the overidentifying restrictions (χ2338=373, P=.09).

    The coefficient on the first lag of the dependent variable is not statistically significant. The shift for the week of August 17 for this coefficient is positive and statistically significant (0.221, P=.02), but the shift for the week of August 24 is not significant. The coefficient on the 7th lag of the dependent variable is positive and significant (0.269, P<.001). Neither of the weekly shift variables for this coefficient are significant. The tests, tests squared, and tests per 10,000 population are all statistically significant (0.047, P<.001; –5.05E-07, P<.001; 8.023, P=.002). Neither the weekend variable nor the constant are significant.

    For Region 3 (South), the regression Wald statistic shows that the model was statistically significant (χ210=475, P<.001), and the Sargan test fails to reject the validity of the overidentifying restrictions (χ2483=446, P=.89).

    The coefficient on the first lag of the dependent variable is negative and statistically significant (–0.102, P=.02). Neither of the weekly shift variables for this coefficient are significant. The coefficient on the 7th lag of the dependent variable is positive and significant (0.288, P<.001). The shifts for the weeks of August 17 and August 24 are negative and significant (–0.334, P<.001; and –0.265, P=.003, respectively). The tests, tests squared, and tests per 10,000 population are all statistically significant (0.091, P<.001; –4.89E-07, P<.001; and –15.986, P<.001, respectively). The weekend variable is not significant. The constant is positive and significant (429.167, P<.001).

    For Region 4 (West), the regression Wald statistic shows that the model was statistically significant (χ210=316, P<.001), and the Sargan test fails to reject the validity of the overidentifying restrictions (χ2368=370, P=.46).

    The coefficient on the first lag of the dependent variable is negative and statistically significant (0.273, P<.001). The shifts for the week of August 17 and August 24 for this coefficient are negative and statistically significant (–0.213, P=.03; and –0.737, P<.001, respectively). The coefficient on the 7th lag of the dependent variable is not significant. The shift for the week of August 24 for this coefficient is positive and significant (0.397, P=.02), but the shift for the week of August 17 is not significant. Of the test variables, only the coefficient on the number of tests administered is significant (0.017, P=.048). The weekend variable is not significant. The constant is positive and significant (397.678, P<.001).

    Interpretation

    Region 1 appears to be fairly calm, with the only statistically significant persistence effect being a small 7-day lag effect. Region 2 is slightly less calm, but with a larger and statistically significant persistence effect and a noticeable positive effect of both the number of tests and the number of tests per 10,000. Region 3 has the largest constant (average of state-specific effects) and the largest coefficient on tests, suggesting that the number of people newly tested for the virus is an important explanatory factor for the number of new cases. Region 4 has a high constant (average state-specific value) and significant shifts in both the 1-day and 7-day persistence values.

    University Reopenings

    Regression Results

    A significant advantage of the panel data approach is that it can provide statistically valid quantifications of shifts in a fairly short period such as 1 week. Perhaps the biggest pandemic issue during the week of August 24 was the high number of cases reported on university campuses as they reopened. We address this with an additional regression analysis. Six states in Region 3 reported 500 or more cases; at least one other university in these states reported 200 or more cases (Alabama, Florida, Georgia, North Carolina, South Carolina, and Texas). To inform this university effect, we split Region 3 into two groups of states—one with a high prevalence of university COVID-19 positives (denoted as group 3a) and another comprising the remaining Region 3 states (denoted as group 3b)—and then ran the regression analysis on the two groups (Table 2).

    Table 2. Arellano-Bond dynamic panel data modeling of the number of daily infections reported by states in Region 3, grouped by the university effect, August 2-30, 2020.
    VariableGroup 3a (with university effect)Group 3b (without university effect)

    		CoefficientP valueCoefficientP value
    L1Pos–0.023.760.037.34
    L1shiftAug170.249.13–0.029.74
    L1shiftAug24–0.075.690.005.95
    L7Pos0.268<.0010.213<.001
    L7shiftAug17–0.364.007–0.100.22
    L7shiftAug24–0.252.120.092.26
    Tests0.121<.0010.029<.001
    Tests_squared–6.59E-09<.001–5.61E-07<.001
    Tests_per_10K–39.704.005–4.402.06
    Constant910.482.008245.307<.001
    Wald statistic for regressionχ29=169<.001χ29=491<.001
    Sargan statistic for validityχ2165=149.81χ2310=301.63

    For each group, the Wald statistic shows that the model was statistically significant (χ29=169, P<.001; and χ29=491, P<.001, respectively), and the Sargan test fails to reject the validity of the overidentifying restrictions (χ2165=149 P=.81; χ2310=301, P=.63).

    Without belaboring the individual coefficients, there are two important differences between the two groups. First is the coefficient on Tests, which numerically is the most important of the three test coefficients; group 3a (0.121, P<.001) is more than four times the size of the coefficient for group 3b (0.029, P<.001). The second important difference is that the constant for group a is more than three times the size of the constant for group b.

    Interpretation

    The larger coefficient on Tests means that a higher percentage of tests are associated with positive results, possibly as large as 10% for group a (considering only the linear term). The larger value of the constant (which is an average of state-specific effects) means that there are larger state-specific risk factors, possibly related to the degree of “lockdown” and social compliance with recommendations such as social distancing or wearing masks. Coupling these two effects suggests that for the week of August 24, the university effect is mostly due to increases in the number of asymptomatic students who got tested for the first time as they returned to university. This is consistent with the comparison of regional results across regions. It also suggests that the following week may be much worse if a significant fraction of the students are infectious and fail to practice social distancing, etc, thereby infecting others, who will likely show up in that week’s numbers.

    These results may also help to explain spikes in other states, such as Iowa, Kansas, North Dakota, and South Dakota (which is also potentially affected by the Sturgis Motorcycle Rally), which all had significant numbers of COVID-19 cases at universities.

    Surveillance Results

    Surveillance results are presented in Tables 3 and 4. The seven data elements in this proof-of-concept surveillance system are calculated as weekly averages and the speed, acceleration, and jerk are normalized per 100,000 population to compare the transmission of COVID-19 from week to week. These surveillance system data elements include (1) average weekly number of daily tests; (2) average weekly number of daily tests per 100,000 population; (3) average weekly number of daily positive tests; (4) average weekly number of daily positive tests per 100,000 population referred to as speed; (5) weekly average of day-to-day change in the number of positives per day per 100,000 population, referred to as acceleration; (6) change in acceleration, referred to as jerk, which is the acceleration in the current week minus the acceleration in the prior week; a sustained positive jerk is typically associated with explosive growth; and finally, (7) the 7-day lag, which is the number of new cases of COVID-19 reported today per 100,000 population (ie, today’s speed) that are associated with new cases reported 7 days ago (ie, last week’s speed), and measures how much the increase in speed from last week persists into this week. Data are presented according to US Census regions. Data element 1 is reported as a number while 2-7 are reported as a rate, which better allows for comparison between US states.

    The innovation of this study is the novel metrics we derived to measure how COVID-19 is spreading and changes in terms of transmission rates. These measures should be considered in combination with traditional static numbers including transmission rates and death rates. These novel metrics measure how fast the rates are changing, accounting for their data limitations.

    As an example, we tracked the transmission of COVID-19 for the state of Illinois for the week from August 17 to 23, 2020. Illinois had a weekly average of 48,181 COVID-19 tests daily, also expressed as a weekly average of 380 tests per 100,000 population per day. Illinois had a weekly average of 2026 positive tests per day. The speed of the COVID-19 transmission is measured as an increase of 15.99 persons infected per 100,000 population per day. For the week of August 17 to 23 in Illinois, COVID-19 acceleration was 0.37, which means that every day there were .37 more new cases per 100,000 than the day before, or 2.6 more cases per day per 100,000 over the course of the week. The jerk is 0.17, which means that acceleration was increasing: this increased acceleration accounted for 1.4 of the 2.6 additional cases per day per 100,000. Finally, the 7-day lag effect for speed is 3.58, which means that persistence or echo effects accounted for 3.58 or 22% of the 15.99 new daily positive cases per 100,000, which indicates an important but moderate persistence or echo effect for the week of August 17.

    We see significant differences in COVID-19 transmission the following week (August 24-30, 2020). Illinois experienced a decrease in weekly average tests to 44,719 daily COVID-19 tests, also expressed as a weekly average of 353 tests per 100,000 population per day. This is 27 fewer tests per 100,000 population from last week. Illinois had a weekly average of 1923 positive tests per day, a decrease from the prior week, also expressed as a speed of 15.18 persons newly infected per day per 100,000 population. During the week of August 24-30, the acceleration decreased from the previous week to 0.11 and the jerk was negative (–0.26), indicating a leveling off of growth in new cases. Finally, the 7-day lag effect on speed is 5.35, which means that the persistence or echo effects accounted for 5.35 or over one-third of the 15.18 new daily positive cases per 100,000. The increased importance of echo effects rather than new cases from other (new) causes is consistent with a leveling off of COVID-19 growth in Illinois during the week of August 24-30.

    In summary, the week of August 17-23 showed an increasing COVID-19 speed with positive acceleration and jerk. The week of August 24-30 exhibited a moderation in speed with lower acceleration and negative jerk. This is indicative of a leveling off or an inflection point: the pandemic in Illinois may be starting to decline, or this could be simply a pause before a continued increase in COVID-19 speed.

    Table 3. Surveillance metrics for the week of August 17-23, 2020.
    StateTests per day, n (weekly average)Daily tests per 100K people, n (daily average for the week)Positives, n (reported number of new positive test results or confirmed cases per day per 100K people, weekly average)Speed, n (daily positives per 100K people, weekly average)Acceleration (day-to-day change in the number of positives per day, weekly average, per 100K people)Jerk (week-over-week change in acceleration, per 100K people)7-day persistence effect on speed (number of new cases per day per 100K people)
    Region 1




    		CT16,9364751273.560.49–0.160.32

    		ME3068228241.78–0.06–0.150.18

    		MA14,8152153094.48–0.63–0.570.61

    		NH1591117171.250.070.130.23

    		NJ22,6872552913.280.390.930.59

    		NY78,9954066043.11–0.03–0.090.47

    		PA13,7371076555.12–0.050.070.86

    		RI588455510710.100.180.161.12

    		VT127320460.96–0.05–0.070.18
    Region 2




    		IL48,181380202615.990.370.173.58

    		IN10,13615178811.71–0.260.383.41

    		IA439813955017.42–0.43–1.014.35

    		KS465416059420.406.63–2.554.20

    		MI30,3463046506.510.410.492.09

    		MN946716863311.23–0.060.092.85

    		MO9888161108617.69–0.61–3.116.20

    		NE249812922011.37–0.73–1.563.89

    		ND158420818424.16–0.06–1.094.91

    		OH220351899317.960.030.352.40

    		SD114112914316.18–0.24–0.692.85

    		WI851114670812.17–0.54–0.733.51
    Region 3




    		AL10,74921994719.31–0.955.15–1.33

    		AR623620755818.50–1.411.77–1.12

    		DE1637168636.510.180.44–0.83

    		DC3313469537.49–0.100.69–0.61

    		FL28,001130387918.06–0.541.09–1.74

    		GA23,802224241722.76–0.181.58–1.77

    		KY533911960213.472.812.87–0.89

    		LA15,10732571815.440.134.65–1.29

    		MD129272145569.190.141.09–0.72

    		MS20156882327.641.181.88–1.53

    		NC21,975210145213.840.310.59–0.77

    		OK822020868917.410.08–0.13–1.11

    		SC636212478415.240.221.22–1.08

    		TN26,836393146121.40–0.220.12–1.48

    		TX32,712113599420.67–1.16–2.07–1.56

    		VA16,72019689710.51–0.07–0.14–0.71

    		WV58363381015.85–0.170.03–0.46
    Region 4




    		AK3704506719.73–0.82–0.940.28

    		AZ84141166528.96–1.32–1.460.31

    		CA106,128269601515.22–0.40–0.220.59

    		CO10,0601752925.07–0.010.320.15

    		HI241217021915.450.02–0.490.36

    		ID200811231217.47–0.092.060.57

    		MT1261118979.07–0.51–0.880.26

    		NV382412461419.92–0.77–0.240.57

    		NM56962721436.810.440.500.19

    		OR44321052395.67–0.060.000.16

    		UT375811735210.98–0.130.070.27

    		WA11,5871524195.50–0.17–0.080.17

    		WY685118427.23–0.57–1.110.14
    Table 4. Surveillance metrics for the week of August 24-30, 2020.
    StateTests per day, n (weekly average)Daily tests per 100K people, n (daily average for the week)Positives, n (reported number of new positive test results or confirmed cases per day per 100K people, weekly average)Speed, n (daily positives per 100K people, weekly average)Acceleration (day-to-day change in the number of positives per day, weekly average, per 100K people)Jerk (week-over-week change in acceleration, per 100K people)7-day persistence effect on speed (number of new cases per day per 100K people)
    Region 1




    		CT21,0275901955.480.810.330.55

    		ME3994297251.880.050.120.28

    		MA24,3003534105.950.411.040.69

    		NH1890139211.54–0.07–0.150.19

    		NJ26,7623013023.400.05–0.340.51

    		NY82,2334236233.200.090.120.48

    		PA13,7691086374.970.060.100.79

    		RI4963469605.66–1.19–1.361.57

    		VT189030381.350.160.210.15
    Region 2




    		IL44,719353192315.180.11–0.265.35

    		IN12,508186105415.660.560.823.92

    		IA501715992129.181.952.385.83

    		KS736625383828.787.631.006.82

    		MI30,1893028178.180.900.482.18

    		MN882215680114.200.540.603.75

    		MO8486138122619.971.512.115.92

    		NE279814528214.571.201.933.80

    		ND129717026134.231.461.528.08

    		OH30,42426010669.120.350.322.66

    		SD127014429233.043.864.105.41

    		WI846414572812.500.220.764.07
    Region 3




    		AL8485173145429.652.383.330.09

    		AR671222261220.270.491.900.08

    		DE1831188666.81–0.98–1.160.03

    		DC3149446537.47–0.45–0.340.03

    		FL24,425114300213.98–0.260.280.08

    		GA22,229209214620.21–0.69–0.510.10

    		KY948321264314.40–2.59–5.400.06

    		LA14,98732270315.131.231.100.07

    		MD12,3352045278.72–0.19–0.340.04

    		MS498816868322.950.10–1.080.13

    		NC23,543224157315.00–0.57–0.880.06

    		OK743818869417.530.360.290.08

    		SC722014090517.581.060.840.07

    		TN20,545301131119.20–2.13–1.910.10

    		TX36,669126468816.17–0.280.870.09

    		VA14,64917296911.350.070.150.05

    		WV49902891206.920.460.630.03
    Region 4




    		AK27713797510.31–0.250.573.92

    		AZ6939955086.980.331.653.61

    		CA98,685250517713.10–0.260.146.14

    		CO92571613085.35–0.07–0.062.05

    		HI253617925517.990.250.236.23

    		ID243513628816.110.000.097.04

    		MT513048013012.170.480.993.66

    		NV306510047215.34–0.390.378.03

    		NM67663231255.97–0.48–0.932.75

    		OR47891142315.480.120.172.29

    		UT438213739112.200.660.794.42

    		WA11,7601543804.991.801.962.22

    		WY1486257345.950.000.572.92

    Principal Findings

    The dynamic panel data model is a statistically validated analysis of reported COVID-19 transmissions and an important addition to the epidemiological toolkit for understanding the progression of the pandemic. It is important to recognize that surveillance systems require a variety of metrics. Systematic surveillance with standardized measures of decreases and increases in COVID-19 transmission coupled with health policies and guidelines add a critical tool to the epidemiologic arsenal to combat COVID-19.

    The specific findings of the modeling exercise confirm that SARS-CoV-2 infection rates are persistent but changeable, and for most states increasing during the period between June 13-19, 2020. We find that for every 100 new COVID-19 cases from June 13-19, the following day would result in 26 new cases, meaning there is a significant reduction each day. However, it is important to recognize that this is an average across states and that state and local experiences will vary, which we measured. From June 20-26, on average in the United States, every 100 new cases on Monday was associated with 65 new cases on Tuesday, indicating the contagion increased 2.5-fold the rate from the prior week. The American pandemic has been ramping up in the past 2 weeks.

    Remarkably, the US states diverged into three distinct patterns: (1) decline, (2) constant, and (3) increases consistent with outbreaks. In the 30 states with increasing cases, over the course of 2 weeks, there was a 3.6-fold increase in new infections while the states that had sustained declines in cases decreased by 2.5-fold. Again, these are averages among the three classifications of decline, constant, and increases, but these data could be further refined to show how much each state contributed to increases and decreases. Further investigation could usefully model state and local differences in infection rates, as well as ascertain quickly whether the pandemic will continue to re-emerge in the United States, or whether infection rates will reverse track and decline again even though states reopen.

    The strengths of this study are the derived new metrics of the transmission of COVID-19. The limitation of this proof-of-concept surveillance system is that it includes only dynamic cases of COVID-19 infections; a full surveillance system should also include static cases. For example, Table 2 refers only to dynamic, new infections.

    Based on the empirical evidence that our metrics of the COVID-19 contagion is a good standardization of increases and decreases for public health surveillance purposes, our future work will focus on the surveillance of 195 countries in eight global regions as defined by the World Bank. When possible, we will provide subcountry-level metrics of the COVID-19 contagion beginning with US states and Canadian provinces. Our surveillance system will include estimates of speed, acceleration, and jerk in acceleration along with traditional surveillance metrics.

    Conflicts of Interest

    None declared.

    1. Lai C, Shih T, Ko W, Tang H, Hsueh P. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and coronavirus disease-2019 (COVID-19): The epidemic and the challenges. Int J Antimicrob Agents 2020 Mar;55(3):105924 [FREE Full text] [CrossRef] [Medline]
    2. Yuen K, Ye Z, Fung S, Chan C, Jin D. SARS-CoV-2 and COVID-19: The most important research questions. Cell Biosci 2020 Mar 16;10(1):40 [FREE Full text] [CrossRef] [Medline]
    3. Kumari T, Shukla V. COVID-19: Towards confronting an unprecedented pandemic. IJBI 2020;02(01):01-10. [CrossRef]
    4. Yan Z. Unprecedented pandemic, unprecedented shift, and unprecedented opportunity. Hum Behav Emerg Technol 2020 Apr 06;2(2):110-112 [FREE Full text] [CrossRef] [Medline]
    5. Liu Y, Liu B, Cui J. COVID-19 Evolves in Human Hosts. Preprints 2020:e [FREE Full text] [CrossRef]
    6. Velavan TP, Meyer CG. The COVID-19 epidemic. Trop Med Int Health 2020 Mar 16;25(3):278-280 [FREE Full text] [CrossRef] [Medline]
    7. Heymann DL, Shindo N. COVID-19: what is next for public health? The Lancet 2020 Feb;395(10224):542-545. [CrossRef]
    8. Salathé M, Althaus CL, Neher R, Stringhini S, Hodcroft E, Fellay J, et al. COVID-19 epidemic in Switzerland: on the importance of testing, contact tracing and isolation. Swiss Med Wkly 2020 Mar 09;150:w20225 [FREE Full text] [CrossRef] [Medline]
    9. Cohen J, Kupferschmidt K. Countries test tactics in 'war' against COVID-19. Science 2020 Mar 20;367(6484):1287-1288. [CrossRef] [Medline]
    10. La V, Pham T, Ho M, Nguyen M, P. Nguyen K, Vuong T, et al. Policy Response, Social Media and Science Journalism for the Sustainability of the Public Health System Amid the COVID-19 Outbreak: The Vietnam Lessons. Sustainability 2020 Apr 07;12(7):2931. [CrossRef]
    11. Park S, Choi GJ, Ko H. Information Technology-Based Tracing Strategy in Response to COVID-19 in South Korea-Privacy Controversies. JAMA 2020 Jun 02;323(21):2129-2130. [CrossRef] [Medline]
    12. Hellewell J, Abbott S, Gimma A, Bosse NI, Jarvis CI, Russell TW, et al. Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. The Lancet Global Health 2020 Apr;8(4):e488-e496. [CrossRef]
    13. Wu Z, McGoogan JM. Characteristics of and Important Lessons From the Coronavirus Disease 2019 (COVID-19) Outbreak in China: Summary of a Report of 72 314 Cases From the Chinese Center for Disease Control and Prevention. JAMA 2020 Apr 07;323(13):1239-1242. [CrossRef] [Medline]
    14. Parodi SM, Liu VX. From Containment to Mitigation of COVID-19 in the US. JAMA 2020 Apr 21;323(15):1441-1442. [CrossRef] [Medline]
    15. Watkins J. Preventing a covid-19 pandemic. BMJ 2020 Feb 28;368:m810. [CrossRef] [Medline]
    16. Del Rio C, Malani PN. COVID-19-New Insights on a Rapidly Changing Epidemic. JAMA 2020 Apr 14;323(14):1339-1340. [CrossRef] [Medline]
    17. Bedford J, Enria D, Giesecke J, Heymann DL, Ihekweazu C, Kobinger G, et al. COVID-19: towards controlling of a pandemic. The Lancet 2020 Mar;395(10229):1015-1018. [CrossRef]
    18. Cheng VCC, Wong S, Chen JHK, Yip CCY, Chuang VWM, Tsang OTY, et al. Escalating infection control response to the rapidly evolving epidemiology of the coronavirus disease 2019 (COVID-19) due to SARS-CoV-2 in Hong Kong. Infect Control Hosp Epidemiol 2020 May 05;41(5):493-498 [FREE Full text] [CrossRef] [Medline]
    19. Spinelli A, Pellino G. COVID-19 pandemic: perspectives on an unfolding crisis. Br J Surg 2020 Jun 23;107(7):785-787 [FREE Full text] [CrossRef] [Medline]
    20. Grech V. Unknown unknowns - COVID-19 and potential global mortality. Early Hum Dev 2020 May;144:105026 [FREE Full text] [CrossRef] [Medline]
    21. Xu S, Li Y. Beware of the second wave of COVID-19. The Lancet 2020 Apr;395(10233):1321-1322. [CrossRef]
    22. Guo T, Fan Y, Chen M, Wu X, Zhang L, He T, et al. Cardiovascular Implications of Fatal Outcomes of Patients With Coronavirus Disease 2019 (COVID-19). JAMA Cardiol 2020 Jul 01;5(7):811-818 [FREE Full text] [CrossRef] [Medline]
    23. Modes of transmission of virus causing COVID-19: implications for IPC precaution recommendations. World Health Organization. 2020 Mar.   URL: https:/​/www.​who.int/​news-room/​commentaries/​detail/​modes-of-transmission-of-virus-causing-covid-19-implications-for-ipc-precaution-recommendations [accessed 2020-09-17]
    24. Ather A, Patel B, Ruparel NB, Diogenes A, Hargreaves KM. Reply to "Coronavirus Disease 19 (COVID-19): Implications for Clinical Dental Care". J Endod 2020 Sep;46(9):1342 [FREE Full text] [CrossRef] [Medline]
    25. Connors J, Levy J. COVID-19 and its implications for thrombosis and anticoagulation. Blood 2020 Jun 04;135(23):2033-2040 [FREE Full text] [CrossRef] [Medline]
    26. Cao X. COVID-19: immunopathology and its implications for therapy. Nat Rev Immunol 2020 May 9;20(5):269-270 [FREE Full text] [CrossRef] [Medline]
    27. Nicola M, Alsafi Z, Sohrabi C, Kerwan A, Al-Jabir A, Iosifidis C, et al. The socio-economic implications of the coronavirus pandemic (COVID-19): A review. Int J Surg 2020 Jun;78:185-193 [FREE Full text] [CrossRef] [Medline]
    28. Greenhalgh T, Koh GCH, Car J. Covid-19: a remote assessment in primary care. BMJ 2020 Mar 25;368:m1182. [CrossRef] [Medline]
    29. Chew M, Ong L, Koh F, Ng A, Tan Y, Ong BC. Guest post: Lessons in preparedness? The response to the COVID-19 pandemic by a surgical department in Singapore. BJS. 2020 Mar.   URL: https:/​/cuttingedgeblog.​com/​2020/​03/​29/​guest-post-lessons-in-preparedness-the-response-to-the-covid-19-pandemic-by-a-surgical-department-in-singapore/​ [accessed 2020-09-17]
    30. Barro R, Ursúa J, Weng J. The Coronavirus and the Great Influenza Pandemic: Lessons from the “spanish flu” for the coronavirus’s potential effects on mortality and economic activity. National Bureau of Economic Research 2020 Apr:e [FREE Full text] [CrossRef]
    31. Baker S, Bloom N, Davis S, Kost K, Sammon M, Viratyosin T. The unprecedented stock market impact of COVID-19. National Bureau of Economic Research 2020 Jun:e [FREE Full text] [CrossRef]
    32. Bradbury-Jones C, Isham L. The pandemic paradox: The consequences of COVID-19 on domestic violence. J Clin Nurs 2020 Jul 22;29(13-14):2047-2049 [FREE Full text] [CrossRef] [Medline]
    33. Taub A. A New Covid-19 Crisis: Domestic Abuse Rises Worldwide. The New York Times. 2020 Apr.   URL: https://www.nytimes.com/2020/04/06/world/coronavirus-domestic-violence.html [accessed 2020-09-17]
    34. Usher K, Bhullar N, Durkin J, Gyamfi N, Jackson D. Family violence and COVID-19: Increased vulnerability and reduced options for support. Int J Ment Health Nurs 2020 Aug 07;29(4):549-552 [FREE Full text] [CrossRef] [Medline]
    35. Boserup B, McKenney M, Elkbuli A. Alarming trends in US domestic violence during the COVID-19 pandemic. Am J Emerg Med 2020 Apr 28:e [FREE Full text] [CrossRef] [Medline]
    36. COVID-19 and violence against women: what the health sector/system can do. World Health Organization. 2020 Apr.   URL: https://www.who.int/reproductivehealth/publications/vaw-covid-19/en/ [accessed 2020-09-17]
    37. Leslie E, Wilson R. Sheltering in Place and Domestic Violence: Evidence from Calls for Service during COVID-19. SSRN Journal 2020 May:e [FREE Full text] [CrossRef]
    38. Pfefferbaum B, North CS. Mental Health and the Covid-19 Pandemic. N Engl J Med 2020 Aug 06;383(6):510-512. [CrossRef]
    39. Yao H, Chen J, Xu Y. Patients with mental health disorders in the COVID-19 epidemic. The Lancet Psychiatry 2020 Apr;7(4):e21. [CrossRef]
    40. Holmes E, O'Connor R, Perry V, Tracey I, Wessely S, Arseneault L, et al. Multidisciplinary research priorities for the COVID-19 pandemic: a call for action for mental health science. The Lancet Psychiatry 2020 Jun;7(6):547-560. [CrossRef]
    41. Greenberg N, Docherty M, Gnanapragasam S, Wessely S. Managing mental health challenges faced by healthcare workers during covid-19 pandemic. BMJ 2020 Mar 26;368:m1211. [CrossRef] [Medline]
    42. Mental health and psychosocial considerations during the COVID-19 outbreak, 18 March 2020. World Health Organization. 2020 Mar.   URL: https://www.who.int/docs/default-source/coronaviruse/mental-health-considerations.pdf [accessed 2020-09-17]
    43. Duan L, Zhu G. Psychological interventions for people affected by the COVID-19 epidemic. The Lancet Psychiatry 2020 Apr;7(4):300-302. [CrossRef]
    44. Van Lancker W, Parolin Z. COVID-19, school closures, and child poverty: a social crisis in the making. The Lancet Public Health 2020 May;5(5):e243-e244. [CrossRef]
    45. The Lancet. India under COVID-19 lockdown. The Lancet 2020 Apr;395(10233):1315. [CrossRef]
    46. Gostin LO, Hodge JG, Wiley LF. Presidential Powers and Response to COVID-19. JAMA 2020 Apr 28;323(16):1547-1548. [CrossRef] [Medline]
    47. Coronavirus disease 2019 (COVID-19) Situation Report – 72. World Health Organization. 2020 Apr.   URL: https:/​/www.​who.int/​docs/​default-source/​coronaviruse/​situation-reports/​20200401-sitrep-72-covid-19.​pdf?sfvrsn=3dd8971b_2 [accessed 2020-09-17]
    48. Shahid Z, Kalayanamitra R, McClafferty B, Kepko D, Ramgobin D, Patel R, et al. COVID-19 and Older Adults: What We Know. J Am Geriatr Soc 2020 May 20;68(5):926-929 [FREE Full text] [CrossRef] [Medline]
    49. Nikolich-Zugich J, Knox KS, Rios CT, Natt B, Bhattacharya D, Fain MJ. Correction to: SARS-CoV-2 and COVID-19 in older adults: what we may expect regarding pathogenesis, immune responses, and outcomes. GeroScience 2020 May 3;42(3):1013-1013. [CrossRef]
    50. Jordan R, Adab P, Cheng K. Covid-19: risk factors for severe disease and death. BMJ 2020 Mar 26;368:m1198. [CrossRef] [Medline]
    51. Garnier-Crussard A, Forestier E, Gilbert T, Krolak-Salmon P. Novel Coronavirus (COVID-19) Epidemic: What Are the Risks for Older Patients? J Am Geriatr Soc 2020 May 12;68(5):939-940 [FREE Full text] [CrossRef] [Medline]
    52. Lloyd-Sherlock P, Ebrahim S, Geffen L, McKee M. Bearing the brunt of covid-19: older people in low and middle income countries. BMJ 2020 Mar 13;368:m1052. [CrossRef] [Medline]
    53. Ahmed F, Ahmed N, Pissarides C, Stiglitz J. Why inequality could spread COVID-19. The Lancet Public Health 2020 May;5(5):e240. [CrossRef]
    54. Sumner A, Hoy C, Ortiz-Juarez E. Estimates of the Impact of COVID-19 on Global Poverty. United Nations University / UNU-WIDER 2020 Apr:1-14 [FREE Full text] [CrossRef]
    55. Laurencin CT, McClinton A. The COVID-19 Pandemic: a Call to Action to Identify and Address Racial and Ethnic Disparities. J Racial Ethn Health Disparities 2020 Jun 18;7(3):398-402 [FREE Full text] [CrossRef] [Medline]
    56. Mogaji E. Financial Vulnerability During a Pandemic: Insights for Coronavirus Disease (COVID-19). SSRN Journal 2020:e. [CrossRef]
    57. Webb Hooper M, Nápoles AM, Pérez-Stable EJ. COVID-19 and Racial/Ethnic Disparities. JAMA 2020 Jun 23;323(24):2466-2467. [CrossRef] [Medline]
    58. Khunti K, Singh A, Pareek M, Hanif W. Is ethnicity linked to incidence or outcomes of covid-19? BMJ 2020 Apr 20;369:m1548. [CrossRef] [Medline]
    59. Chowkwanyun M, Reed AL. Racial Health Disparities and Covid-19 — Caution and Context. N Engl J Med 2020 Jul 16;383(3):201-203. [CrossRef]
    60. Yancy CW. COVID-19 and African Americans. JAMA 2020 May 19;323(19):1891-1892. [CrossRef] [Medline]
    61. Platt L, Warwick R. Are some ethnic groups more vulnerable to COVID-19 than others. Institute for Fiscal Studies / Nuffield Foundation. 2020 May.   URL: https:/​/www.​ifs.org.uk/​inequality/​chapter/​are-some-ethnic-groups-more-vulnerable-to-covid-19-than-others/​ [accessed 2020-06-19]
    62. Pan A, Liu L, Wang C, Guo H, Hao X, Wang Q, et al. Association of Public Health Interventions With the Epidemiology of the COVID-19 Outbreak in Wuhan, China. JAMA 2020 May 19;323(19):1915-1923 [FREE Full text] [CrossRef] [Medline]
    63. Raoofi A, Takian A, Akbari Sari A, Olyaeemanesh A, Haghighi H, Aarabi M. COVID-19 Pandemic and Comparative Health Policy Learning in Iran. Arch Iran Med 2020 Apr 01;23(4):220-234. [CrossRef] [Medline]
    64. Anderson RM, Heesterbeek H, Klinkenberg D, Hollingsworth TD. How will country-based mitigation measures influence the course of the COVID-19 epidemic? The Lancet 2020 Mar;395(10228):931-934. [CrossRef]
    65. Lee V, Chiew C, Khong W. Interrupting transmission of COVID-19: lessons from containment efforts in Singapore. J Travel Med 2020 May 18;27(3):e [FREE Full text] [CrossRef] [Medline]
    66. Nkengasong JN, Mankoula W. Looming threat of COVID-19 infection in Africa: act collectively, and fast. The Lancet 2020 Mar;395(10227):841-842. [CrossRef]
    67. Dave D, Friedson A, Matsuzawa K, Sabia J. When Do Shelter-in-Place Orders Fight COVID-19 Best? Policy Heterogeneity Across States and Adoption Time. National Bureau of Economic Research 2020 Aug 03:e [FREE Full text] [CrossRef] [Medline]
    68. Loayza N, Pennings S. Macroeconomic policy in the time of COVID-19: A primer for developing countries. Washington, DC: World Bank; Mar 2020.
    69. Adalja AA, Toner E, Inglesby TV. Priorities for the US Health Community Responding to COVID-19. JAMA 2020 Apr 14;323(14):1343-1344. [CrossRef] [Medline]
    70. Raifman J, Nocka K, Jones D, Bor J, Lipson S, Jay J, et al. COVID-19 US State Policy Database. Ann Arbor, MI: Inter-university Consortium for Political and Social Research; Sep 2020.
    71. Fauci A, Lane H, Redfield R. Covid-19 - Navigating the Uncharted. N Engl J Med 2020 Mar 26;382(13):1268-1269 [FREE Full text] [CrossRef] [Medline]
    72. Haffajee RL, Mello MM. Thinking Globally, Acting Locally — The U.S. Response to Covid-19. N Engl J Med 2020 May 28;382(22):e75. [CrossRef]
    73. Liu M, Thomadsen R, Yao S. Forecasting the Spread of COVID-19 under Different Reopening Strategies. SSRN Journal 2020:e. [CrossRef]
    74. Hodge JG. Federal vs. State Powers in Rush to Reopen Amid the Coronavirus Pandemic. SSRN Journal 2020:e. [CrossRef]
    75. Harris J. Reopening Under COVID-19: What to Watch For. National Bureau of Economic Research 2020:e [FREE Full text] [CrossRef]
    76. Alhaery M. A COVID-19 Reopening Readiness Index: The Key to Opening up the Economy. medRxiv 2020:e [FREE Full text] [CrossRef]
    77. Koonin L. Novel coronavirus disease (COVID-19) outbreak: Now is the time to refresh pandemic plans. J Bus Contin Emer Plan 2020 Jan 01;13(4):1-15. [Medline]
    78. Gostic K, Gomez A, Mummah R, Kucharski A, Lloyd-Smith J. Estimated effectiveness of symptom and risk screening to prevent the spread of COVID-19. eLife 2020;9:e55570 [FREE Full text] [CrossRef]
    79. Lurie N, Saville M, Hatchett R, Halton J. Developing Covid-19 Vaccines at Pandemic Speed. N Engl J Med 2020 May 21;382(21):1969-1973. [CrossRef]
    80. Ahn D, Shin H, Kim M, Lee S, Kim H, Myoung J, et al. Current Status of Epidemiology, Diagnosis, Therapeutics, and Vaccines for Novel Coronavirus Disease 2019 (COVID-19). J Microbiol Biotechnol 2020 Mar 28;30(3):313-324 [FREE Full text] [CrossRef] [Medline]
    81. Miller A, Reandelar M, Fasciglione K, Roumenova V, Li Y, Otazu G. Correlation between universal BCG vaccination policy and reduced morbidity and mortality for COVID-19: an epidemiological study. medRxiv 2020:e [FREE Full text] [CrossRef]
    82. Hennessy CH, Moriarty DG, Zack MM, Scherr PA, Brackbill R. Measuring health-related quality of life for public health surveillance. Public Health Rep 1994;109(5):665-672 [FREE Full text] [Medline]
    83. Woodall WH. The Use of Control Charts in Health-Care and Public-Health Surveillance. Journal of Quality Technology 2018 Feb 05;38(2):89-104. [CrossRef]
    84. Wharton M, Chorba T, Vogt R, Morse D, Buehler J. Case definitions for public health surveillance. MMWR Recomm Rep 1990 Oct 19;39(RR-13):1-43 [FREE Full text] [Medline]
    85. Teutsch SM, Churchill RE, editors. Principles and Practice of Public Health Surveillance. 2nd ed. New York, NY: Oxford University Press; 2000.
    86. Lee LM, Teutch SM, Thacker SB, St Louis ME, editors. New York, NY: Oxford University Press; 2010.
    87. Thacker S, Berkelman R. Public health surveillance in the United States. Epidemiol Rev 1988;10(1):164-190. [CrossRef] [Medline]
    88. German R, Lee LM, Horan JM, Milstein B, Pertowski C, Waller MN, Guidelines Working Group Centers for Disease ControlPrevention (CDC). Updated guidelines for evaluating public health surveillance systems: recommendations from the Guidelines Working Group. MMWR Recomm Rep 2001 Jul 27;50(RR-13):1-35; quiz CE1. [Medline]
    89. Declich S, Carter AO. Public health surveillance: historical origins, methods and evaluation. Bull World Health Organ 1994;72(2):285-304 [FREE Full text] [Medline]
    90. Mittal R, Ni R, Seo J. The flow physics of COVID-19. J. Fluid Mech 2020 May 01;894:e. [CrossRef]
    91. Cheng KK, Lam TH, Leung CC. Wearing face masks in the community during the COVID-19 pandemic: altruism and solidarity. The Lancet 2020 Apr:e. [CrossRef]
    92. Cheng VC, Wong S, Chuang VW, So SY, Chen JH, Sridhar S, et al. The role of community-wide wearing of face mask for control of coronavirus disease 2019 (COVID-19) epidemic due to SARS-CoV-2. J Infect 2020 Jul;81(1):107-114 [FREE Full text] [CrossRef] [Medline]
    93. Dalton C, Corbett S, Katelaris A. Pre-Emptive Low Cost Social Distancing and Enhanced Hygiene Implemented before Local COVID-19 Transmission Could Decrease the Number and Severity of Cases. SSRN Journal 2020:e. [CrossRef]
    94. Klompas M, Morris CA, Sinclair J, Pearson M, Shenoy ES. Universal Masking in Hospitals in the Covid-19 Era. N Engl J Med 2020 May 21;382(21):e63. [CrossRef]
    95. Javid B, Weekes M, Matheson N. Covid-19: should the public wear face masks? BMJ 2020 Apr 09;369:m1442. [CrossRef] [Medline]
    96. Mesa Vieira C, Franco OH, Gómez Restrepo C, Abel T. COVID-19: The forgotten priorities of the pandemic. Maturitas 2020 Jun;136:38-41 [FREE Full text] [CrossRef] [Medline]
    97. Greenhalgh T, Schmid MB, Czypionka T, Bassler D, Gruer L. Face masks for the public during the covid-19 crisis. BMJ 2020 Apr 09;369:m1435. [CrossRef] [Medline]
    98. Eikenberry SE, Mancuso M, Iboi E, Phan T, Eikenberry K, Kuang Y, et al. To mask or not to mask: Modeling the potential for face mask use by the general public to curtail the COVID-19 pandemic. Infect Dis Model 2020;5:293-308 [FREE Full text] [CrossRef] [Medline]
    99. Fairchild A, Gostin L, Bayer R. Vexing, Veiled, and Inequitable: Social distancing and the "rights" divide in the age of COVID-19. Am J Bioeth 2020 Jul 19;20(7):55-61. [CrossRef] [Medline]
    100. Bernstein J, Hutler B, Rieder T, Faden R, Han H, Barnhill A. An Ethics Framework for the COVID-19 Reopening Process. Johns Hopkins University. 2020 May.   URL: https://bioethics.jhu.edu/wp-content/uploads/2019/10/FINAL-SNF-Agora-Covid-19.pdf [accessed 2020-07-20]
    101. Halow B. Five Challenges To A Smooth Post-COVID Reopening. 2020.   URL: https://www.bashhalow.com/five-challenges-to-a-smooth-post-covid-reopening/ [accessed 2020-07-20]
    102. O'Dowd A. Covid-19: Papers justifying government's plans to reopen schools are "inconclusive," say union bosses. BMJ 2020 May 27;369:m2108. [CrossRef] [Medline]
    103. Bhatia R, Jeffrey KM. A Step-by-Step Plan to Reopen California. The Bold Italic. 2020.   URL: https://thebolditalic.com/covid-19-next-steps-for-california-c01632c8e8b6 [accessed 2020-07-20]
    104. Teutsch SM. Considerations in Planning a Surveillance System. In: Lee LS, Teutsch SM, Thacker SB, St. Louis ME, editors. New York, NY: Oxford University Press; 2010:18-28.
    105. Ren X. Pandemic and lockdown: a territorial approach to COVID-19 in China, Italy and the United States. Eurasian Geography and Economics 2020 May 08:1-12. [CrossRef]
    106. Maier BF, Brockmann D. Effective containment explains subexponential growth in recent confirmed COVID-19 cases in China. Science 2020 May 15;368(6492):742-746 [FREE Full text] [CrossRef] [Medline]
    107. Peng F, Tu L, Yang Y, Hu P, Wang R, Hu Q, et al. Management and Treatment of COVID-19: The Chinese Experience. Can J Cardiol 2020 Jun;36(6):915-930 [FREE Full text] [CrossRef] [Medline]
    108. Tang B, Xia F, Bragazzi N. Lessons drawn from China and South Korea for managing COVID-19 epidemic: insights from a comparative modeling study. medRxiv 2020:e [FREE Full text] [CrossRef]
    109. Salzberger B, Glück T, Ehrenstein B. Successful containment of COVID-19: the WHO-Report on the COVID-19 outbreak in China. Infection 2020 Apr;48(2):151-153. [CrossRef] [Medline]
    110. Chudik A, Pesaran M, Rebucci A. Voluntary and Mandatory Social Distancing: Evidence on COVID-19 Exposure Rates from Chinese Provinces and Selected Countries. National Bureau of Economic Research. 2020.   URL: https://www.nber.org/papers/w27039 [accessed 2020-06-10]
    111. Saez M, Tobias A, Varga D, Barceló MA. Effectiveness of the measures to flatten the epidemic curve of COVID-19. The case of Spain. Sci Total Environ 2020 Jul 20;727:138761 [FREE Full text] [CrossRef] [Medline]
    112. Kenyon C. Flattening-the-curve associated with reduced COVID-19 case fatality rates - an ecological analysis of 65 countries. J Infect 2020 Jul;81(1):e98-e99 [FREE Full text] [CrossRef] [Medline]
    113. De Leo S. Covid-19 testing strategies and lockdowns: the European closed curves, analysed by "skew-normal" distributions, the forecasts for the UK, Sweden, and the USA, and the ongoing outbreak in Brazil. medRxiv 2020:e [FREE Full text] [CrossRef]
    114. Åslund A. Responses to the COVID-19 crisis in Russia, Ukraine, and Belarus. Eurasian Geography and Economics 2020 Jun 16:1-14. [CrossRef]
    115. Russia's governors seem set up to fail on COVID-19. In: Emerald Expert Briefings. Bingley, United Kingdom: Emerald Publishing Limited; Apr 2020.
    116. Forsyth IC. COVID-19: China’s Chernobyl, China’s Berlin Airlift, or Neither? Washington Headquarters Services. 2020 Jun.   URL: https:/​/www.​whs.mil/​News/​News-Display/​Article/​2210962/​covid-19-chinas-chernobyl-chinas-berlin-airlift-or-neither/​ [accessed 2020-07-20]
    117. Mækelæ M, Reggev N, Dutra N, Tamayo R, Silva-Sobrinho R, Klevjer K, et al. Perceived efficacy of COVID-19 restrictions, reactions and their impact on mental health during the early phase of the outbreak in six countries. R Soc Open Sci 2020 Aug 12;7(8):200644. [CrossRef]
    118. Belarus leader politically isolated by COVID-19 denial. In: Emerald Expert Briefings. Bingley, United Kingdom: Emerald Publishing Limited; Apr 2020.
    119. Ukraine and Belarus seek loans to ride out COVID-19. In: Emerald Expert Briefings. Bingley, United Kingdom: Emerald Publishing Limited; May 2020.
    120. COVID-19 forces difficult political choices on Ukraine. In: Emerald Expert Briefings. Bingley, United Kingdom: Emerald Publishing Limited; Mar 2020.
    121. CDC. Provisional COVID-19 Death Counts by Week. National Center for Health Statistics. 2020.   URL: https://www.cdc.gov/nchs/nvss/vsrr/covid19/index.htm [accessed 2020-07-20]
    122. Dorn AV, Cooney RE, Sabin ML. COVID-19 exacerbating inequalities in the US. The Lancet 2020 Apr;395(10232):1243-1244. [CrossRef]
    123. McKibbin W, Fernando R. The Global Macroeconomic Impacts of COVID-19: Seven Scenarios. Asian Economic Papers 2020 Aug 21:1-55. [CrossRef]
    124. Baker S, Bloom N, Davis S, Terry S. Covid-induced economic uncertainty. National Bureau of Economic Research; 2020:e [FREE Full text] [CrossRef]
    125. Omer SB, Malani P, Del Rio C. The COVID-19 Pandemic in the US: A Clinical Update. JAMA 2020 May 12;323(18):1767-1768. [CrossRef] [Medline]
    126. Brzezinski A, Deiana G, Kecht V, Van DD. The COVID-19 pandemic: government vs community action across the United States. Covid Economics 2020:7-156 [FREE Full text]
    127. Ganz S. Does your state have 14-days of declining COVID-19 cases? Finding straightforward answers to a surprisingly tricky question. American Enterprise Institute 2020 May:e [FREE Full text]
    128. Fox G, Trauer J, McBryde E. Modelling the impact of COVID-19 upon intensive care services in New South Wales. Med J Aust 2020:e [FREE Full text]
    129. Choi S, Ki M. Estimating the reproductive number and the outbreak size of COVID-19 in Korea. Epidemiol Health 2020 Mar 12;42:e2020011 [FREE Full text] [CrossRef] [Medline]
    130. Lauer SA, Grantz KH, Bi Q, Jones FK, Zheng Q, Meredith HR, et al. The Incubation Period of Coronavirus Disease 2019 (COVID-19) From Publicly Reported Confirmed Cases: Estimation and Application. Annals of Internal Medicine 2020 May 05;172(9):577-582. [CrossRef]
    131. Calafiore G, Novara C, Possieri C. A modified sir model for the COVID-19 contagion in Italy. arXiv 2020:e [FREE Full text]
    132. Korolev I. Identification and estimation of the SEIRD epidemic model for COVID-19. J Econom 2020 Jul 30:e [FREE Full text] [CrossRef] [Medline]
    133. Pindyck R. COVID-19 and the welfare effects of reducing contagion. National Bureau of Economic Research 2020:e [FREE Full text] [CrossRef]
    134. Stock J. Data gaps and the policy response to the novel coronavirus. National Bureau of Economic Research 2020:e [FREE Full text] [CrossRef]
    135. He S, Tang S, Rong L. A discrete stochastic model of the COVID-19 outbreak: Forecast and control. Math Biosci Eng 2020:17-2804 [FREE Full text] [CrossRef]
    136. Gandhi M, Yokoe D, Havlir D. Asymptomatic Transmission, the Achilles' Heel of Current Strategies to Control Covid-19. N Engl J Med 2020 May 28;382(22):2158-2160 [FREE Full text] [CrossRef] [Medline]
    137. Mani N, Budak J, Lan K, Bryson-Cahn C, Zelikoff A, Barker GEC, et al. Prevalence of COVID-19 Infection and Outcomes Among Symptomatic Healthcare Workers in Seattle, Washington. Clin Infect Dis 2020 Jun 16:2020 [FREE Full text] [CrossRef] [Medline]
    138. Dodds C, Fakoya I. Covid-19: ensuring equality of access to testing for ethnic minorities. BMJ 2020 May 29;369:m2122. [CrossRef] [Medline]
    139. Schmitt-Grohé S, Teoh K, Uribe M. Testing Inequality in New York City. National Bureau of Economic Research 2020:e [FREE Full text] [CrossRef]
    140. Voo T, Clapham H, Tam C. Ethical Implementation of Immunity Passports During the COVID-19 Pandemic. J Infect Dis 2020 Aug 04;222(5):715-718 [FREE Full text] [CrossRef] [Medline]
    141. Beeching N, Fletcher T, Beadsworth M. Covid-19: testing times. BMJ 2020 Apr 08;369:m1403. [CrossRef] [Medline]
    142. West CP, Montori VM, Sampathkumar P. COVID-19 Testing: The Threat of False-Negative Results. Mayo Clin Proc 2020 Jun;95(6):1127-1129 [FREE Full text] [CrossRef] [Medline]
    143. Kumleben N, Bhopal R, Czypionka T, Gruer L, Kock R, Stebbing J, et al. Test, test, test for COVID-19 antibodies: the importance of sensitivity, specificity and predictive powers. Public Health 2020 Aug;185:88-90 [FREE Full text] [CrossRef] [Medline]
    144. Cassaniti I, Novazzi F, Giardina F, Salinaro F, Sachs M, Perlini S, Members of the San Matteo Pavia COVID-19 Task Force. Performance of VivaDiag COVID-19 IgM/IgG Rapid Test is inadequate for diagnosis of COVID-19 in acute patients referring to emergency room department. J Med Virol 2020 Mar 30:e [FREE Full text] [CrossRef] [Medline]
    145. Esbin MN, Whitney ON, Chong S, Maurer A, Darzacq X, Tjian R. Overcoming the bottleneck to widespread testing: a rapid review of nucleic acid testing approaches for COVID-19 detection. RNA 2020 Jul 01;26(7):771-783 [FREE Full text] [CrossRef] [Medline]
    146. Patel J, Nielsen F, Badiani A, Assi S, Unadkat V, Patel B, et al. Poverty, inequality and COVID-19: the forgotten vulnerable. Public Health 2020 Jun;183:110-111 [FREE Full text] [CrossRef] [Medline]
    147. Ji Y, Ma Z, Peppelenbosch MP, Pan Q. Potential association between COVID-19 mortality and health-care resource availability. The Lancet Global Health 2020 Apr;8(4):e480. [CrossRef]
    148. Cafer A, Rosenthal M. COVID-19 in the Rural South: A Perfect Storm of Disease, Health Access, and Co-Morbidity. APCRL Policy Briefs 2020;2:e [FREE Full text]
    149. Tsai J, Wilson M. COVID-19: a potential public health problem for homeless populations. The Lancet Public Health 2020 Apr;5(4):e186-e187. [CrossRef]
    150. Harlem G. Corrigendum to: Descriptive analysis of social determinant factors in urban communities affected by COVID-19. J Public Health (Oxf) 2020 Sep 07:2020. [CrossRef] [Medline]
    151. Vetter P, Eckerle I, Kaiser L. Covid-19: a puzzle with many missing pieces. BMJ 2020 Feb 19;368:m627. [CrossRef] [Medline]
    152. Giamello J, Abram S, Bernardi S, Lauria G. The emergency department in the COVID-19 era. Who are we missing? Eur J Emerg Med 2020 Aug;27(4):305-306 [FREE Full text] [CrossRef] [Medline]
    153. Centers for Disease Control (CDC). Guidelines for evaluating surveillance systems. MMWR Suppl 1988 May 06;37(5):1-18 [FREE Full text] [Medline]
    154. Post LA, Balsen Z, Spano R, Vaca FE. Bolstering gun injury surveillance accuracy using capture-recapture methods. J Behav Med 2019 Aug 1;42(4):674-680. [CrossRef] [Medline]
    155. Piltch-Loeb R, Kraemer J, Lin KW, Stoto MA. Public Health Surveillance for Zika Virus: Data Interpretation and Report Validity. Am J Public Health 2018 Oct;108(10):1358-1362. [CrossRef]
    156. Gilman M, Green R. The surveillance gap: The harms of extreme privacy and data marginalization. Faculty Publications 2018:253-307 [FREE Full text]
    157. Li Q, Guan X, Wu P, Wang X, Zhou L, Tong Y, et al. Early Transmission Dynamics in Wuhan, China, of Novel Coronavirus-Infected Pneumonia. N Engl J Med 2020 Mar 26;382(13):1199-1207 [FREE Full text] [CrossRef] [Medline]
    158. Lipsitch M, Cohen T, Cooper B, Robins JM, Ma S, James L, et al. Transmission dynamics and control of severe acute respiratory syndrome. Science 2003 Jun 20;300(5627):1966-1970 [FREE Full text] [CrossRef] [Medline]
    159. Kucharski A, Russell T, Diamond C. Early dynamics of transmission and control of COVID-19: a mathematical modelling study. medRxiv 2020:e [FREE Full text] [CrossRef]
    160. Jones JH. Models of Infectious Disease. Stanford Spring Workshop in Formal Demography / Stanford University. 2008.   URL: https://web.stanford.edu/~jhj1/teachingdocs/Jones-Epidemics050308.pdf [accessed 2020-06-19]
    161. Martcheva M. An Introduction to Mathematical Epidemiology. New York, NY: Springer; 2015.
    162. Braveman PA, Egerter SA, Woolf SH, Marks JS. When do we know enough to recommend action on the social determinants of health? Am J Prev Med 2011 Jan;40(1 Suppl 1):S58-S66. [CrossRef] [Medline]
    163. Guidelines: Opening Up America Again. White House / Centers for Disease Control and Prevention. 2020.   URL: https://www.whitehouse.gov/openingamerica/ [accessed 2020-09-21]
    164. The COVID Tracking Project. The Atlantic. 2020.   URL: https://covidtracking.com/ [accessed 2020-08-31]
    165. Brownstein JS, Freifeld CC, Madoff LC. Digital Disease Detection — Harnessing the Web for Public Health Surveillance. N Engl J Med 2009 May 21;360(21):2153-2157. [CrossRef]
    166. COVID 19 Tracking. GitHub. 2020.   URL: https://github.com/COVID19Tracking/covid-tracking-data [accessed 2020-08-31]
    167. Oehmke J, Oehmke T, Singh L, Post L. Dynamic Panel Estimates of SARS-CoV-2 Infection Rates: Health Surveillance Informs Public Health Policy. J Med Internet Res 2020 Sep 09:e [FREE Full text] [CrossRef] [Medline]
    168. Hansen LP, Singleton KJ. Generalized Instrumental Variables Estimation of Nonlinear Rational Expectations Models. Econometrica 1982 Sep;50(5):1269. [CrossRef]
    169. Hansen LP. Large Sample Properties of Generalized Method of Moments Estimators. Econometrica 1982 Jul;50(4):1029. [CrossRef]
    170. Roodman D. xtabond2: Stata module to extend xtabond dynamic panel data estimator. Statistical Software Components S435901, Boston College Department of Economics. 2018.   URL: https://ideas.repec.org/c/boc/bocode/s435901.html [accessed 2020-07-20]
    171. Roodman D. How to do Xtabond2: An Introduction to Difference and System GMM in Stata. The Stata Journal 2018 Nov 19;9(1):86-136. [CrossRef]
    172. Blundell R, Bond S. GMM Estimation with persistent panel data: an application to production functions. Econometric Reviews 2000 Jan;19(3):321-340. [CrossRef]
    173. Bond S, Hoeffler A, Temple J. GMM estimation of empirical growth models. Economics Papers 2001-W21, Economics Group, Nuffield College, University of Oxford. 2001.   URL: https://ideas.repec.org/p/nuf/econwp/0121.html [accessed 2020-07-20]
    174. Arellano M. Dynamic Panel Data Estimation Using DPD: A Guide for Users. Great Britain: Institute for Fiscal Studies London; 1988.
    175. COVID-19 Dashboard. Johns Hopkins University. 2020.   URL: https://coronavirus.jhu.edu/us-map [accessed 2020-09-18]

    Edited by G Eysenbach; submitted 29.06.20; peer-reviewed by A Khurshid, E Paskett; comments to author 15.07.20; revised version received 03.09.20; accepted 13.09.20; published 05.10.20

    Copyright

    ©James Francis Oehmke, Charles B Moss, Lauren Nadya Singh, Theresa Bristol Oehmke, Lori Ann Post. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 05.10.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.