Literature Review

Literature reviews follow a structured, multi-phase workflow:

Phase 1: Planning and Scoping

1. Define Research Question: Use PICO framework (Population, Intervention, Comparison, Outcome) for clinical/biomedical reviews

   • Example: "What is the efficacy of CRISPR-Cas9 (I) for treating sickle cell disease (P) compared to standard care (C)?"

2. Establish Scope and Objectives:

   • Define clear, specific research questions
   • Determine review type (narrative, systematic, scoping, meta-analysis)
   • Set boundaries (time period, geographic scope, study types)

3. Develop Search Strategy:

   • Identify 2-4 main concepts from research question
   • List synonyms, abbreviations, and related terms for each concept
   • Plan Boolean operators (AND, OR, NOT) to combine terms
   • Select minimum 3 complementary databases

4. Set Inclusion/Exclusion Criteria:

   • Date range (e.g., last 10 years: 2015-2024)
   • Language (typically English, or specify multilingual)
   • Publication types (peer-reviewed, preprints, reviews)
   • Study designs (RCTs, observational, in vitro, etc.)
   • Document all criteria clearly

Phase 2: Systematic Literature Search

1. Multi-Database Search:

   Select databases appropriate for the domain:

   Biomedical & Life Sciences:

   • PubMed/PMC via NCBI E-utilities API
   • bioRxiv/medRxiv for preprints

   General Scientific Literature:

   • Search arXiv via direct API (preprints in physics, math, CS, q-bio)
   • Search Semantic Scholar via API (200M+ papers, cross-disciplinary)
   • Search OpenAlex (240M+ works, fully open, no API key required)

   Specialized Databases:

   • Domain-specific databases as appropriate for the field

2. Document Search Parameters:

   ## Search Strategy
   
   ### Database: PubMed
   - **Date searched**: 2024-10-25
   - **Date range**: 2015-01-01 to 2024-10-25
   - **Search string**:
   

   ("CRISPR"[Title] OR "Cas9"[Title]) AND ("sickle cell"[MeSH] OR "SCD"[Title/Abstract]) AND 2015:2024[Publication Date]

   - **Results**: 247 articles
   

   Repeat for each database searched.

3. Export and Aggregate Results:

   • Export results in JSON format from each database
   • Combine all results into a single file
   • Deduplicate by DOI (primary) or title (fallback)

Phase 3: Screening and Selection

1. Deduplication:

   • Remove duplicates by DOI (primary) or title (fallback)
   • Document number of duplicates removed

2. Title Screening:

   • Review all titles against inclusion/exclusion criteria
   • Exclude obviously irrelevant studies
   • Document number excluded at this stage

3. Abstract Screening:

   • Read abstracts of remaining studies
   • Apply inclusion/exclusion criteria rigorously
   • Document reasons for exclusion

4. Full-Text Screening:

   • Obtain full texts of remaining studies
   • Conduct detailed review against all criteria
   • Document specific reasons for exclusion
   • Record final number of included studies

5. Create PRISMA Flow Diagram:

   Initial search: n = X
   +-- After deduplication: n = Y
   +-- After title screening: n = Z
   +-- After abstract screening: n = A
   +-- Included in review: n = B
   

Phase 4: Data Extraction and Quality Assessment

1. Extract Key Data from each included study:

   • Study metadata (authors, year, journal, DOI)
   • Study design and methods
   • Sample size and population characteristics
   • Key findings and results
   • Limitations noted by authors
   • Funding sources and conflicts of interest

2. Assess Study Quality:

   • For RCTs: Use Cochrane Risk of Bias tool
   • For observational studies: Use Newcastle-Ottawa Scale
   • For systematic reviews: Use AMSTAR 2
   • Rate each study: High, Moderate, Low, or Very Low quality
   • Consider excluding very low-quality studies

3. Organize by Themes:

   • Identify 3-5 major themes across studies
   • Group studies by theme (studies may appear in multiple themes)
   • Note patterns, consensus, and controversies

Phase 5: Synthesis and Analysis

1. Write Thematic Synthesis (NOT study-by-study summaries):

   • Organize Results section by themes or research questions
   • Synthesize findings across multiple studies within each theme
   • Compare and contrast different approaches and results
   • Identify consensus areas and points of controversy
   • Highlight the strongest evidence

   Example structure:

   #### 3.3.1 Theme: CRISPR Delivery Methods
   
   Multiple delivery approaches have been investigated for therapeutic
   gene editing. Viral vectors (AAV) were used in 15 studies^1-15^ and
   showed high transduction efficiency (65-85%) but raised immunogenicity
   concerns^3,7,12^. In contrast, lipid nanoparticles demonstrated lower
   efficiency (40-60%) but improved safety profiles^16-23^.
   

2. Critical Analysis:

   • Evaluate methodological strengths and limitations across studies
   • Assess quality and consistency of evidence
   • Identify knowledge gaps and methodological gaps
   • Note areas requiring future research

3. Write Discussion:

   • Interpret findings in broader context
   • Discuss clinical, practical, or research implications
   • Acknowledge limitations of the review itself
   • Compare with previous reviews if applicable
   • Propose specific future research directions

Phase 6: Citation Verification

CRITICAL: All citations must be verified for accuracy before final submission.

1. Verify All DOIs:

   • Extract all DOIs from the document
   • Verify each DOI resolves correctly
   • Retrieve metadata from CrossRef
   • Generate verification report
   • Output properly formatted citations

2. Review Verification Report:

   • Check for any failed DOIs
   • Verify author names, titles, and publication details match
   • Correct any errors in the original document
   • Re-run verification until all citations pass

3. Format Citations Consistently:

   • Choose one citation style and use throughout
   • Common styles: APA, Nature, Vancouver, Chicago, IEEE
   • Ensure in-text citations match reference list format

Phase 7: Document Generation

1. Generate PDF (if using pandoc/LaTeX):

   pandoc my_literature_review.md -o my_review.pdf \
     --pdf-engine=xelatex \
     --toc
   

2. Review Final Output:

   • Check PDF formatting and layout
   • Verify all sections are present
   • Ensure citations render correctly
   • Check that figures/tables appear properly
   • Verify table of contents is accurate

3. Quality Checklist:

   • All DOIs verified
   • Citations formatted consistently
   • PRISMA flow diagram included (for systematic reviews)
   • Search methodology fully documented
   • Inclusion/exclusion criteria clearly stated
   • Results organized thematically (not study-by-study)
   • Quality assessment completed
   • Limitations acknowledged
   • References complete and accurate

Database-Specific Search Guidance

PubMed / PubMed Central

Access via NCBI E-utilities API or web interface.

Search tips:

• Use MeSH terms: "sickle cell disease"[MeSH]
• Field tags: [Title], [Title/Abstract], [Author]
• Date filters: 2020:2024[Publication Date]
• Boolean operators: AND, OR, NOT
• See MeSH browser: https://meshb.nlm.nih.gov/search

bioRxiv / medRxiv

Important considerations:

• Preprints are not peer-reviewed
• Verify findings with caution
• Check if preprint has been published (CrossRef)
• Note preprint version and date

arXiv

Access via direct API:

# Example search categories:
# q-bio.QM (Quantitative Methods)
# q-bio.GN (Genomics)
# q-bio.MN (Molecular Networks)
# cs.LG (Machine Learning)
# stat.ML (Machine Learning Statistics)

# Search format: category AND terms
search_query = "cat:q-bio.QM AND ti:\"single cell sequencing\""

Semantic Scholar

Access via API (free tier available):

• 200M+ papers across all fields
• Excellent for cross-disciplinary searches
• Provides citation graphs and paper recommendations
• Use for finding highly influential papers

OpenAlex

Access via REST API (no API key required):

• 240M+ scholarly works, fully open
• Provides author disambiguation, institution mapping, topic classification
• Use for bibliometric analysis, publication trends, citation tracking
• See the openalex-database skill for detailed API usage

Citation Chaining

Expand search via citation networks:

1. Forward citations (papers citing key papers):

   • Use Semantic Scholar or OpenAlex APIs
   • Identifies newer research building on seminal work

2. Backward citations (references from key papers):

   • Extract references from included papers
   • Identify highly cited foundational work
   • Find papers cited by multiple included studies

Citation Style Guide

Quick reference for common styles:

APA (7th Edition)

• In-text: (Smith et al., 2023)
• Reference: Smith, J. D., Johnson, M. L., & Williams, K. R. (2023). Title. Journal, 22(4), 301-318. https://doi.org/10.xxx/yyy

Nature

• In-text: Superscript numbers^1,2^
• Reference: Smith, J. D., Johnson, M. L. & Williams, K. R. Title. Nat. Rev. Drug Discov. 22, 301-318 (2023).

Vancouver

• In-text: Superscript numbers^1,2^
• Reference: Smith JD, Johnson ML, Williams KR. Title. Nat Rev Drug Discov. 2023;22(4):301-18.

Always verify citations before finalizing.

Prioritizing High-Impact Papers (CRITICAL)

Always prioritize influential, highly-cited papers from reputable authors and top venues. Quality matters more than quantity in literature reviews.

Citation Count Thresholds

Use citation counts to identify the most impactful papers:

Journal and Venue Tiers

Prioritize papers from higher-tier venues:

• Tier 1 (Always Prefer): Nature, Science, Cell, NEJM, Lancet, JAMA, PNAS, Nature Medicine, Nature Biotechnology
• Tier 2 (Strong Preference): High-impact specialized journals (IF>10), top conferences (NeurIPS, ICML for ML/AI)
• Tier 3 (Include When Relevant): Respected specialized journals (IF 5-10)
• Tier 4 (Use Sparingly): Lower-impact peer-reviewed venues

Author Reputation Assessment

Prefer papers from:

• Senior researchers with high h-index (>40 in established fields)
• Leading research groups at recognized institutions
• Authors with multiple Tier-1 publications in the relevant field
• Researchers with recognized expertise (awards, editorial positions, society fellows)

Identifying Seminal Papers

For any topic, identify foundational work by:

1. High citation count (typically 500+ for papers 5+ years old)
2. Frequently cited by other included studies (appears in many reference lists)
3. Published in Tier-1 venues (Nature, Science, Cell family)
4. Written by field pioneers (often cited as establishing concepts)

Best Practices

Search Strategy

1. Use multiple databases (minimum 3): Ensures comprehensive coverage
2. Include preprint servers: Captures latest unpublished findings
3. Document everything: Search strings, dates, result counts for reproducibility
4. Test and refine: Run pilot searches, review results, adjust search terms
5. Sort by citations: When available, sort search results by citation count to surface influential work first

Screening and Selection

1. Use clear criteria: Document inclusion/exclusion criteria before screening
2. Screen systematically: Title -> Abstract -> Full text
3. Document exclusions: Record reasons for excluding studies
4. Consider dual screening: For systematic reviews, have two reviewers screen independently

Synthesis

1. Organize thematically: Group by themes, NOT by individual studies
2. Synthesize across studies: Compare, contrast, identify patterns
3. Be critical: Evaluate quality and consistency of evidence
4. Identify gaps: Note what's missing or understudied

Quality and Reproducibility

1. Assess study quality: Use appropriate quality assessment tools
2. Verify all citations: Use DOI verification against CrossRef
3. Document methodology: Provide enough detail for others to reproduce
4. Follow guidelines: Use PRISMA for systematic reviews

Writing

1. Be objective: Present evidence fairly, acknowledge limitations
2. Be systematic: Follow structured template
3. Be specific: Include numbers, statistics, effect sizes where available
4. Be clear: Use clear headings, logical flow, thematic organization

Common Pitfalls to Avoid

1. Single database search: Misses relevant papers; always search multiple databases
2. No search documentation: Makes review irreproducible; document all searches
3. Study-by-study summary: Lacks synthesis; organize thematically instead
4. Unverified citations: Leads to errors; always verify DOIs
5. Too broad search: Yields thousands of irrelevant results; refine with specific terms
6. Too narrow search: Misses relevant papers; include synonyms and related terms
7. Ignoring preprints: Misses latest findings; include bioRxiv, medRxiv, arXiv
8. No quality assessment: Treats all evidence equally; assess and report quality
9. Publication bias: Only positive results published; note potential bias
10. Outdated search: Field evolves rapidly; clearly state search date

Example Workflow

Complete workflow for a biomedical literature review:

# 1. Search multiple databases
# - Use PubMed E-utilities API
# - Use arXiv API
# - Use Semantic Scholar API
# - Use OpenAlex API
# - Export results in JSON format

# 2. Aggregate and deduplicate results
# - Combine JSON outputs
# - Deduplicate by DOI or title

# 3. Screen results and extract data
# - Screen titles, abstracts, full texts
# - Extract key data into the review document
# - Organize by themes

# 4. Write the review following template structure
# - Introduction with clear objectives
# - Detailed methodology section
# - Results organized thematically
# - Critical discussion
# - Clear conclusions

# 5. Verify all citations
# - Check all DOIs resolve via CrossRef
# - Fix any failed citations and re-verify

# 6. Generate professional PDF (optional)
pandoc review.md -o review.pdf --pdf-engine=xelatex --toc

# 7. Review final outputs

Integration with Other Skills

This skill works with other literature-related skills:

Database Access

• openalex-database: OpenAlex API for 240M+ works, bibliometric analysis
• citation-management: Metadata extraction, BibTeX management, citation validation

External APIs

• Semantic Scholar API: Citation graphs, paper recommendations
• CrossRef API: DOI resolution, metadata verification
• PubMed E-utilities: Biomedical literature search
• arXiv API: Preprint access

Resources

External Resources

Guidelines:

• PRISMA (Systematic Reviews): http://www.prisma-statement.org/
• Cochrane Handbook: https://training.cochrane.org/handbook
• AMSTAR 2 (Review Quality): https://amstar.ca/

Tools:

• MeSH Browser: https://meshb.nlm.nih.gov/search
• PubMed Advanced Search: https://pubmed.ncbi.nlm.nih.gov/advanced/
• Boolean Search Guide: https://www.ncbi.nlm.nih.gov/books/NBK3827/

Citation Styles:

• APA Style: https://apastyle.apa.org/
• Nature Portfolio: https://www.nature.com/nature-portfolio/editorial-policies/reporting-standards
• NLM/Vancouver: https://www.nlm.nih.gov/bsd/uniform_requirements.html

Dependencies

Required Python Packages

pip install requests  # For API access and citation verification

Required System Tools (for PDF generation)

# For PDF generation (optional)
apt-get install pandoc       # Linux
apt-get install texlive-xetex  # Linux
# or on macOS:
brew install pandoc
brew install --cask mactex

Summary

This literature-review skill provides:

1. Systematic methodology following PRISMA and academic best practices
2. Multi-database integration via open APIs (OpenAlex, Semantic Scholar, PubMed, arXiv)
3. Citation verification ensuring accuracy and credibility
4. Professional output in markdown and PDF formats
5. Comprehensive guidance covering the entire review process
6. Quality assurance with verification and validation workflows
7. Reproducibility through detailed documentation requirements

Conduct thorough, rigorous literature reviews that meet academic standards and provide comprehensive synthesis of current knowledge in any domain.