PyPI Metadata API Scraper

What this Actor scrapes

PyPI's metadata API (pypi.org/pypi/<package>/json) returns a full metadata record for every published package. This Actor accepts a list of package names, fans the requests out in parallel, and writes one typed dataset row per package — version, requires_dist, classifiers (Python versions, OS, license, framework), author, project URLs, and the latest 10 release timestamps. Bulk PyPI data export in a single run.

What we handle for you

• 🛡️ Browser fingerprint rotation — curl-cffi impersonates real Chrome, Firefox, and Safari TLS handshakes so the endpoint sees a browser, not a Python script. Profiles rotate across requests.
• 🌐 Residential proxy rotation via Apify Proxy — fresh session and exit IP on every block or rate-limit response.
• 🔁 Retries with exponential backoff on 408 / 429 / 5xx — up to 5 attempts per package, Retry-After respected.
• 🧱 Rate-limit-aware pacing — when the API pushes back we throttle automatically; you never get silently blocked or handed an empty dataset.
• 🧊 Clean, typed rows — Pydantic-validated, ISO-8601 timestamps, stable field names. Export to JSON, CSV, or Excel straight from the Apify Console.
• 💰 Pay-Per-Event pricing — you pay only for rows that hit your dataset. No data, no charge.

Use cases

• Dependency intel — feed your dependency tree to surface outdated or yanked packages across a full monorepo.
• Compliance audit — pull license classifier and Python-version bounds for every direct dependency in one bulk PyPI data export.
• Maintainer mapping — correlate your stack to authors and maintainers for supply-chain analysis.
• Release monitoring — schedule a daily run on a watch list; alert your team when a new version lands.
• RAG corpus — pull PyPI package READMEs in bulk for AI retrieval pipelines or language-model fine-tuning datasets.

Input

Paste this into the Apify Console, or send it as the run input over the API. Proxy settings are on by default; you rarely need to touch them.

{
  "packages": [
    "httpx"
  ],
  "includeReleases": true,
  "concurrency": 4,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Output

One row per result, schema-validated before it is written. Export JSON, CSV, Excel or XML from the run, or read it over the API.

nameversionsummarydescriptiondescription_content_typeauthorauthor_emailmaintainerlicensehome_pageproject_urlproject_urlsrequires_pythonrequires_distclassifierskeywords

{
  "name": "httpx",
  "version": "0.27.0",
  "summary": "The next generation HTTP client.",
  "requires_python": ">=3.9",
  "license": "BSD-3-Clause",
  "home_page": null,
  "project_url": "https://pypi.org/project/httpx/"
}

Pricing

You pay only for results that land. Cap any run with maxTotalChargeUsd. See pricing & billing for worked examples.