Search and retrieve preprints from arXiv via the Atom API. Use this skill when searching for papers in physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering, or economics by keywords, authors, arXiv IDs, date ranges, or categories.
This skill provides Python tools for searching and retrieving preprints from arXiv.org via its public Atom API. It supports keyword search, author search, category filtering, arXiv ID lookup, and PDF download. Results are returned as structured JSON with titles, abstracts, authors, categories, and links.
Use this skill when:
2309.10668)cs.LG, cs.CL, stat.ML)Consider alternatives when:
Search for papers by keywords in titles, abstracts, or all fields.
python scripts/arxiv_search.py \
--keywords "sparse autoencoders" "mechanistic interpretability" \
--max-results 20 \
--output results.json
With category filter:
python scripts/arxiv_search.py \
--keywords "transformer" "attention mechanism" \
--category cs.LG \
--max-results 50 \
--output transformer_papers.json
Search specific fields:
# Title only
python scripts/arxiv_search.py \
--keywords "GRPO" \
--search-field ti \
--max-results 10
# Abstract only
python scripts/arxiv_search.py \
--keywords "reward model" "RLHF" \
--search-field abs \
--max-results 30
python scripts/arxiv_search.py \
--author "Anthropic" \
--max-results 50 \
--output anthropic_papers.json
python scripts/arxiv_search.py \
--author "Ilya Sutskever" \
--category cs.LG \
--max-results 20
Retrieve metadata for specific papers:
python scripts/arxiv_search.py \
--ids 2309.10668 2406.04093 2310.01405 \
--output sae_papers.json
Full arXiv URLs also accepted:
python scripts/arxiv_search.py \
--ids "https://arxiv.org/abs/2309.10668"
List recent papers in a category:
python scripts/arxiv_search.py \
--category cs.AI \
--max-results 100 \
--sort-by submittedDate \
--output recent_cs_ai.json
python scripts/arxiv_search.py \
--ids 2309.10668 \
--download-pdf papers/
Batch download from search results:
import json
from scripts.arxiv_search import ArxivSearcher
searcher = ArxivSearcher()
# Search first
results = searcher.search(query="ti:sparse autoencoder", max_results=5)
# Download all
for paper in results:
arxiv_id = paper["arxiv_id"]
searcher.download_pdf(arxiv_id, f"papers/{arxiv_id.replace('/', '_')}.pdf")
| Category | Description |
|---|---|
cs.AI | Artificial Intelligence |
cs.CL | Computation and Language (NLP) |
cs.CV | Computer Vision |
cs.LG | Machine Learning |
cs.NE | Neural and Evolutionary Computing |
cs.RO | Robotics |
cs.CR | Cryptography and Security |
cs.DS | Data Structures and Algorithms |
cs.IR | Information Retrieval |
cs.SE | Software Engineering |
| Category | Description |
|---|---|
stat.ML | Machine Learning (Statistics) |
stat.ME | Methodology |
math.OC | Optimization and Control |
math.ST | Statistics Theory |
| Category | Description |
|---|---|
q-bio.BM | Biomolecules |
q-bio.GN | Genomics |
q-bio.QM | Quantitative Methods |
q-fin.ST | Statistical Finance |
eess.SP | Signal Processing |
physics.comp-ph | Computational Physics |
Full list: see references/api_reference.md.
The arXiv API uses prefix-based field searches combined with Boolean operators.
Field prefixes:
ti: - Titleau: - Authorabs: - Abstractcat: - Categoryall: - All fields (default)co: - Commentjr: - Journal referenceid: - arXiv IDBoolean operators (must be UPPERCASE):