Systematic Literature Review (PRISMA)

Assumptions

IRON LAW: A systematic review must be REPRODUCIBLE — every search
decision, inclusion criterion, and quality assessment must be documented
so another researcher can replicate the process. If your review cannot
be replicated, it is a narrative review, NOT a systematic review.

Key assumptions:

1. Transparency and reproducibility distinguish systematic from narrative reviews
2. A pre-registered protocol reduces bias in study selection and analysis
3. At least two independent reviewers should screen and assess studies to reduce subjective bias
4. Quality assessment of included studies is mandatory — not all evidence is equal

Methodology

Step 1: Define the Research Question and Protocol

Formulate a focused question using a framework (PICO for interventions, PEO for qualitative, SPIDER for mixed methods). Register the protocol (e.g., PROSPERO). Define databases, search terms, date ranges, and language restrictions.

Step 2: Execute the Search Strategy

Search at least 3 databases (e.g., Scopus, Web of Science, PubMed). Use Boolean operators (AND, OR, NOT) with controlled vocabulary and free-text terms. Document every search string and date. Supplement with citation chaining (forward and backward), grey literature, and hand-searching key journals.

Step 3: Screen and Select Studies

Apply inclusion/exclusion criteria in two phases:

1. Title and abstract screening — two reviewers independently; resolve disagreements by discussion or third reviewer
2. Full-text screening — apply criteria to full papers; record reasons for exclusion

Document the process in a PRISMA flow diagram:

• Records identified → duplicates removed → screened → eligible → included

Step 4: Extract Data, Assess Quality, and Synthesize

Extract data into a standardized form. Assess quality using appropriate tools (e.g., Cochrane RoB for RCTs, CASP for qualitative, JBI checklists). Synthesize via meta-analysis (quantitative), thematic synthesis (qualitative), or narrative synthesis. Report per PRISMA 2020 checklist.

Output Format

## Systematic Review: [Research Question]

### Protocol
- Question framework: [PICO/PEO/SPIDER]
- Registration: [PROSPERO ID or equivalent]
- Databases searched: [list]
- Date range: [start-end]

### Search Strategy
| Database | Search String | Records Found |
|----------|--------------|---------------|
| [name] | [Boolean query] | [N] |

### PRISMA Flow
- Identified: [N] records
- Duplicates removed: [N]
- Screened (title/abstract): [N]
- Excluded at screening: [N]
- Full-text assessed: [N]
- Excluded at full-text: [N] (reasons: ...)
- Included in synthesis: [N]

### Inclusion/Exclusion Criteria
| Criterion | Include | Exclude |
|-----------|---------|---------|
| Population | [specification] | [specification] |
| Study type | [specification] | [specification] |
| Language | [specification] | [specification] |
| Date | [specification] | [specification] |

### Quality Assessment Summary
| Study | Tool Used | Overall Rating | Key Concerns |
|-------|-----------|---------------|--------------|
| [author, year] | [RoB/CASP/JBI] | [high/moderate/low] | [specific issues] |

### Synthesis
- [Key finding 1 with evidence strength]
- [Key finding 2 with evidence strength]
- Gaps identified: [what remains unknown]

### Limitations
- [Search limitations]
- [Assessment limitations]

Gotchas

• A systematic review without a PRISMA flow diagram is incomplete — the flow diagram is not optional
• Pre-registering the protocol prevents post-hoc changes to inclusion criteria that introduce bias
• Grey literature (theses, conference papers, reports) must be considered to reduce publication bias
• Quality assessment is NOT pass/fail — it informs how much weight to give each study in the synthesis
• Do NOT conflate systematic review with meta-analysis; meta-analysis (statistical pooling) is one possible synthesis method within a systematic review
• Inter-rater reliability for screening and quality assessment should be reported (e.g., Cohen's kappa)

References

• Page, M. J., et al. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71.
• Higgins, J. P. T., et al. (Eds.). (2023). Cochrane Handbook for Systematic Reviews of Interventions (Version 6.4). Cochrane.
• Booth, A., Sutton, A., & Papaioannou, D. (2016). Systematic Approaches to a Successful Literature Review (2nd ed.). Sage.