This is a version of the LibGuide I started while employed at Temple University Health Sciences Library from July 2015-September 12, 2022. I plan to maintain it here going forward.
Critical Appraisal Checklists
“Critical appraisal skills enable you to assess the trustworthiness, relevance and results of published papers so that you can decide if they are believable and useful.”
(http://www.casp-uk.net/criticalappraisal)
Learn more about Critical Appraisal
- Critical Appraisal article by Tod, Booth, Smith (2021)
- International Centre for Allied Health Evidence-A Guide to Critical Appraisal ToolsA list of critical appraisal tools, linked to the websites where they were developed.
- JBI Reviewer’s Manual-Critical Appraisal Checklists for Systematic Reviews typesThere are various types of systematic reviews, refer to the Joanna Briggs Institute Reviewer’s Manual to locate the critical appraisal checklist located in the appendix section of each review type in the manual.
- How to Use the Evidence-EbookAssessment and application of scientific
evidence. [2000] - You Tube video about Critical AppraisalThis session looks briefly at how and why we appraise literature.
- AHRQ-Assessing the Risk of Bias in Systematic Reviews of Healthcare Interventions
How to Read a Paper by Trisha GreenhalghISBN: 9781119484745Publication Date: 2019-05-06
Critical Appraisal Checklists by specific Study Design type
Randomized Controlled Trials
ROB 2.0 Risk Of Bias Tool
There are 3 variations of the tool based on trial design. Choose the appropriate version.
1. Individually randomized, parallel group trials (traditional RCT)
2. Cluster randomized, parallel group trials (like traditional but randomized by groups)
3. Individual randomized, cross-over trials (randomization occurs to determine the order the patient receives both treatments)
https://www.riskofbias.info/welcome/rob-2-0-tool
CASP: Randomised Controlled Trial Appraisal Tool
Summary: Critical Appraisal Skills Program (CASP): RCT CAT is a methodological checklist which provides key criteria relevant to randomised controlled trials.
Authors: Public Health Resource Unit, NHS, England
http://media.wix.com/ugd/dded87_40b9ff0bf53840478331915a8ed8b2fb.pdf
Non-randomized Studies or Observational Studies:
ROBINS-I Risk of Bias for non-randomized (observational) studies or cohorts of Interventions
http://www.bristol.ac.uk/population-health-sciences/centres/cresyda/barr/riskofbias/robins-i/
ROBINS-E Risk of Bias for non-randomized (observational) studies or cohorts of Exposures other than interventions, including environmental and occupational exposures
http://www.bristol.ac.uk/population-health-sciences/centres/cresyda/barr/riskofbias/robins-e/
Newcastle-Ottawa scale (NOS) -most widely used for case control or cohort studies
http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp
IHE Case Series Studies Critical Appraisal Checklist
https://www.ihe.ca/research-programs/rmd/cssqac/cssqac-about
JBI Critical Appraisal Checklist for Case Series
JBI Critical Appraisal Checklist for Case Reports
The Methodological Index for Non-Randomized Studies (MINOR) is a tool for assessing non-randomized interventional studies
This link will open a PDF document. http://cobe.paginas.ufsc.br/files/2014/10/MINORS.pdf
Agency for Healthcare Research and Quality (AHRQ) methodological checklist for cross-sectional/prevalence studies
https://www.ncbi.nlm.nih.gov/books/NBK35156/#_A157879_
AXIS-To assess the quality of cross-sectional/prevalence studies
This link will open a PDF document. http://bmjopen.bmj.com/content/bmjopen/6/12/e011458.full.pdf
The TREND Statement
Summary: The TREND (Transparent Reporting of Evaluations with Nonrandomized Designs) statement is a 22-item checklist specifically developed to guide standardized reporting of nonrandomized controlled trials.
http://www.cdc.gov/trendstatement/
The STROBE Statement
Strengthening the reporting of observational studies (cohort, case-control, and cross-sectional)
http://www.strobe-statement.org/index.php?id=available-checklists
Mixed Methods Appraisal Tool (MMAT)-used for qualitative, quantitative, and/or mixed methods studies. Helpful for those working on a Mixed Methods Review.
This link will open a PDF document. http://mixedmethodsappraisaltoolpublic.pbworks.com/
w/file/fetch/127916259/MMAT_2018_criteria-manual_2018-08-01_ENG.pdf
Public Health:
MetaQat – Meta-Tool for appraising all types of public health evidence
http://www.publichealthontario.ca/en/ServicesAndTools/Pages/Critical-Appraisal-Tool.aspx
Qualitative:
CanChild for qualitative reviews
These links will open a PDF document. Guidelines and Form
Quantitative Research (Public Health Research)
EPHPP- Quality Assessment tool for Quantitative Studies
Animal Research:
Systematic Review Centre for Laboratory Animal Experimentation (SYRCLE) risk of bias assessment tool for assessing animal studies
Article: http://www.ncbi.nlm.nih.gov/pubmed/24667063
(invivo studies) Review the ARRIVE guidelines
https://www.nc3rs.org.uk/arrive-guidelines
Critical Appraisal of Studies using Animal Models
http://ilarjournal.oxfordjournals.org/content/55/3/405.full.pdf+html
Diagnostic Accuracy
QUADAS-2
To evaluate the risk of bias and applicability of primary diagnostic accuracy studies.
This link will open a PDF document. http://www.bristol.ac.uk/media-library/sites/quadas/migrated/documents/quadas2.pdf
CASP: Diagnostic Test Studies
This link will open a PDF document. http://media.wix.com/ugd/dded87_3815f02af1b34c21b8c3b2b5020024c3.pdf
Centre for Evidence Based Medicine (CEBM) Diagnosis Critical Appraisal Worksheet
This link will open a PDF document. http://media.wix.com/ugd/dded87_3815f02af1b34c21b8c3b2b5020024c3.pdf
- SIGN checklist for diagnostic accuracy studiesThis link will open a PDF document.
Library and Information Science Research
https://librarysearch.temple.edu/articles/emerald_s10-dot-1108-slash-07378830610692154
Grey Literature
Critical Appraisal of Clinical Practice Guidelines
AGREE II
International tool for the assessment of practice guidelines
Critical Appraisal of Systematic Reviews
ROBIS- A tool for assessing the risk of bias in systematic reviews.
http://www.bristol.ac.uk/social-community-medicine/projects/robis/robis-tool/
Joanna Briggs Critical Appraisal for Systematic Reviews Checklist-
This link will open a PDF document. https://joannabriggs.org/sites/default/files/2019-05/JBI_Critical_Appraisal-Checklist_for_Systematic_Reviews2017_0.pdf
AMSTAR 2-A Measurement Tool to Assess (quality assessment) of Systematic Reviews
Health-Evidence Appraisal Tool for Reviews
This link will open a PDF document. http://healthevidence.org/documents/our-appraisal-tools/QATool&Dictionary_01Jun16.pdf
AHRQ-Assessing the Risk of Bias in Systematic Reviews of Healthcare Interventions
https://effectivehealthcare.ahrq.gov/topics/methods-bias-update/methods
Critical Appraisal of a Mixed Methods Systematic ReviewThis link will open a PDF document.
Oops, if you find any broken links, please contact me!
Systematic Review (Evidence Synthesis) Librarian 