This paper is in the following e-collection/theme issue:

Crowdsourcing and Mechanical Turks (98) New Methods (944) Search Strategies and Retrieval for Systematic Reviews (13)

Published on in Vol 21, No 4 (2019): April

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/12953, first published .
Crowdsourcing the Citation Screening Process for Systematic Reviews: Validation Study

Crowdsourcing the Citation Screening Process for Systematic Reviews: Validation Study

Crowdsourcing the Citation Screening Process for Systematic Reviews: Validation Study

Authors of this article:

Nassr Nama1, 2, 3, 4 Author Orcid Image ;   Margaret Sampson2 Author Orcid Image ;   Nicholas Barrowman1, 2, 5 Author Orcid Image ;   Ryan Sandarage3 Author Orcid Image ;   Kusum Menon1, 2 Author Orcid Image ;   Gail Macartney2 Author Orcid Image ;   Kimmo Murto1, 6 Author Orcid Image ;   Jean-Philippe Vaccani1, 7 Author Orcid Image ;   Sherri Katz1, 2 Author Orcid Image ;   Roger Zemek1, 2, 8 Author Orcid Image ;   Ahmed Nasr1, 9 Author Orcid Image ;   James Dayre McNally1, 2 Author Orcid Image
Article Authors Cited by (31) Tweetations (12) Metrics

Journals

  1. Menon K, Schlapbach L, Akech S, Argent A, Chiotos K, Chisti M, Hamid J, Ishimine P, Kissoon N, Lodha R, Oliveira C, Peters M, Tissieres P, Watson R, Wiens M, Wynn J, Sorce L. Pediatric Sepsis Definition—A Systematic Review Protocol by the Pediatric Sepsis Definition Taskforce. Critical Care Explorations 2020;2(6):e0123 View
  2. Ashkanase J, Nama N, Sandarage R, Penslar J, Gupta R, Ly S, Wan M, Tsang P, Nantsios A, Jacques E, Yang H, Tsang C, Mazhar H, Xu G, Rodriguez M, Gerber S, Laird L, Sampson M, Wong D, McNally J. Identification and Evaluation of Controlled Trials in Pediatric Cardiology: Crowdsourced Scoping Review and Creation of Accessible Searchable Database. Canadian Journal of Cardiology 2020;36(11):1795 View
  3. Nama N, Barrowman N, O'Hearn K, Sampson M, Zemek R, McNally J. Quality control for crowdsourcing citation screening: the importance of assessment number and qualification set size. Journal of Clinical Epidemiology 2020;122:160 View
  4. Zhou L, Parmanto B. Development and Validation of a Comprehensive Well-Being Scale for People in the University Environment (Pitt Wellness Scale) Using a Crowdsourcing Approach: Cross-Sectional Study. Journal of Medical Internet Research 2020;22(4):e15075 View
  5. Page M, Moher D, Fidler F, Higgins J, Brennan S, Haddaway N, Hamilton D, Kanukula R, Karunananthan S, Maxwell L, McDonald S, Nakagawa S, Nunan D, Tugwell P, Welch V, McKenzie J. The REPRISE project: protocol for an evaluation of REProducibility and Replicability In Syntheses of Evidence. Systematic Reviews 2021;10(1) View
  6. Sampson M, Nama N, O'Hearn K, Murto K, Nasr A, Katz S, Macartney G, Momoli F, McNally J. Creating enriched training sets of eligible studies for large systematic reviews: the utility of PubMed's Best Match algorithm. International Journal of Technology Assessment in Health Care 2021;37(1) View
  7. Page M, Moher D, Bossuyt P, Boutron I, Hoffmann T, Mulrow C, Shamseer L, Tetzlaff J, Akl E, Brennan S, Chou R, Glanville J, Grimshaw J, Hróbjartsson A, Lalu M, Li T, Loder E, Mayo-Wilson E, McDonald S, McGuinness L, Stewart L, Thomas J, Tricco A, Welch V, Whiting P, McKenzie J. PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ 2021:n160 View
  8. Noel-Storr A, Dooley G, Elliott J, Steele E, Shemilt I, Mavergames C, Wisniewski S, McDonald S, Murano M, Glanville J, Foxlee R, Beecher D, Ware J, Thomas J. An evaluation of Cochrane Crowd found that crowdsourcing produced accurate results in identifying randomized trials. Journal of Clinical Epidemiology 2021;133:130 View
  9. Allin E, Nama N, Irvine M, Pawliuk C, Wright M, Carwana M. Conservative and surgical modalities in the management of paediatric parapneumonic effusion and empyema: a protocol for a living systematic review and network meta-analysis. BMJ Open 2021;11(3):e045010 View
  10. Noel-Storr A, Dooley G, Affengruber L, Gartlehner G. Citation screening using crowdsourcing and machine learning produced accurate results: Evaluation of Cochrane's modified Screen4Me service. Journal of Clinical Epidemiology 2021;130:23 View
  11. Noel-Storr A, Redmond P, Lamé G, Liberati E, Kelly S, Miller L, Dooley G, Paterson A, Burt J. Crowdsourcing citation-screening in a mixed-studies systematic review: a feasibility study. BMC Medical Research Methodology 2021;21(1) View
  12. Nussbaumer-Streit B, Ellen M, Klerings I, Sfetcu R, Riva N, Mahmić-Kaknjo M, Poulentzas G, Martinez P, Baladia E, Ziganshina L, Marqués M, Aguilar L, Kassianos A, Frampton G, Silva A, Affengruber L, Spjker R, Thomas J, Berg R, Kontogiani M, Sousa M, Kontogiorgis C, Gartlehner G. Resource use during systematic review production varies widely: a scoping review. Journal of Clinical Epidemiology 2021;139:287 View
  13. O’Hearn K, MacDonald C, Tsampalieros A, Kadota L, Sandarage R, Jayawarden S, Datko M, Reynolds J, Bui T, Sultan S, Sampson M, Pratt M, Barrowman N, Nama N, Page M, McNally J. Evaluating the relationship between citation set size, team size and screening methods used in systematic reviews: a cross-sectional study. BMC Medical Research Methodology 2021;21(1) View
  14. Palermo M, Policarpo L, Costa C, Righi R. Tracking machine learning models for pandemic scenarios: a systematic review of machine learning models that predict local and global evolution of pandemics. Network Modeling Analysis in Health Informatics and Bioinformatics 2022;11(1) View
  15. Aggarwal S, Cepalo T, Gill S, Thipse M, Clifton K, Higginson A, Vu J, Bijelić V, Barrowman N, Giangioppo S, Radhakrishnan D. Factors associated with future hospitalization among children with asthma: a systematic review. Journal of Asthma 2023;60(3):425 View
  16. Menon K, Schlapbach L, Akech S, Argent A, Biban P, Carrol E, Chiotos K, Jobayer Chisti M, Evans I, Inwald D, Ishimine P, Kissoon N, Lodha R, Nadel S, Oliveira C, Peters M, Sadeghirad B, Scott H, de Souza D, Tissieres P, Watson R, Wiens M, Wynn J, Zimmerman J, Sorce L. Criteria for Pediatric Sepsis—A Systematic Review and Meta-Analysis by the Pediatric Sepsis Definition Taskforce*. Critical Care Medicine 2022;50(1):21 View
  17. Zorko D, McNally J, Rochwerg B, Pinto N, Couban R, O’Hearn K, Choong K. Pediatric Chronic Critical Illness: Protocol for a Scoping Review. JMIR Research Protocols 2021;10(10):e30582 View
  18. Hernandez-Garcia E, Chrysikou E, Nekhlyudov L, Gilroy D, Ordóñez-Mena J. Home-built environment interventions and inflammation biomarkers: a systematic review and meta-analysis protocol. BJGP Open 2022;6(4):BJGPO.2022.0104 View
  19. Cayouette F, O’Hearn K, Gertsman S, Menon K. Operationalization of assent for research participation in pre-adolescent children: a scoping review. BMC Medical Ethics 2022;23(1) View
  20. Zorko D, McNally J, Rochwerg B, Pinto N, O’Hearn K, Almazyad M, Ames S, Brooke P, Cayouette F, Chow C, Junior J, Francoeur C, Heneghan J, Kazzaz Y, Killien E, Jayawarden S, Lasso R, Lee L, O’Mahony A, Perry M, Rodríguez-Rubio M, Sandarage R, Smith H, Welten A, Yee B, Choong K. Defining Pediatric Chronic Critical Illness: A Scoping Review*. Pediatric Critical Care Medicine 2023;24(2):e91 View
  21. Noel‐Storr A, Gartlehner G, Dooley G, Persad E, Nussbaumer‐Streit B. Crowdsourcing the identification of studies for COVID‐19‐related Cochrane Rapid Reviews. Research Synthesis Methods 2022;13(5):585 View
  22. Kuenzig M, Fung S, Marderfeld L, Mak J, Kaplan G, Ng S, Wilson D, Cameron F, Henderson P, Kotze P, Bhatti J, Fang V, Gerber S, Guay E, Kotteduwa Jayawarden S, Kadota L, Maldonado D. F, Osei J, Sandarage R, Stanton A, Wan M, Benchimol E, Jayawarden S, Maldonado F, Maltus E, Bhattacharya S, Osei J. Twenty-first Century Trends in the Global Epidemiology of Pediatric-Onset Inflammatory Bowel Disease: Systematic Review. Gastroenterology 2022;162(4):1147 View
  23. Nama N, Donken R, Pawliuk C, Leache L, Sadarangani M, Carwana M. Treatment of UTIs in Infants <2 Months: A Living Systematic Review. Hospital Pediatrics 2021;11(9):1017 View
  24. Zorko D, Shemie J, Hornby L, Singh G, Matheson S, Sandarage R, Wollny K, Kongkiattikul L, Dhanani S. Autoresuscitation after circulatory arrest: an updated systematic review. Canadian Journal of Anesthesia/Journal canadien d'anesthésie 2023;70(4):699 View
  25. Zhang D, Jia N, Xiang J, Zhong Y, Chen W, Hu Y. Future perspectives and trends in inflammation in cerebral ischemia-reperfusion injury: Based on bibliometric analysis. Brain Disorders 2023;11:100087 View
  26. Haby M, Barreto J, Kim J, Peiris S, Mansilla C, Torres M, Guerrero‐Magaña D, Reveiz L. What are the best methods for rapid reviews of the research evidence? A systematic review of reviews and primary studies. Research Synthesis Methods 2024;15(1):2 View
  27. Guo Q, Jiang G, Zhao Q, Long Y, Feng K, Gu X, Xu Y, Li Z, Huang J, Du L. Rapid review: A review of methods and recommendations based on current evidence. Journal of Evidence-Based Medicine 2024;17(2):434 View
  28. Khalil H, Pollock D, McInerney P, Evans C, Moraes E, Godfrey C, Alexander L, Tricco A, Peters M, Pieper D, Saran A, Ameen D, Taneri P, Munn Z. Automation tools to support undertaking scoping reviews. Research Synthesis Methods 2024;15(6):839 View
  29. Affengruber L, van der Maten M, Spiero I, Nussbaumer-Streit B, Mahmić-Kaknjo M, Ellen M, Goossen K, Kantorova L, Hooft L, Riva N, Poulentzas G, Lalagkas P, Silva A, Sassano M, Sfetcu R, Marqués M, Friessova T, Baladia E, Pezzullo A, Martinez P, Gartlehner G, Spijker R. An exploration of available methods and tools to improve the efficiency of systematic review production: a scoping review. BMC Medical Research Methodology 2024;24(1) View