Vinta ChenandClaude fc88ebb899 feat: add BigQuery-based PyPI downloads fetcher ...

Provides per-sitting download evidence for prune sweeps, per the
shortlist-reform tooling plan. Shells out to the bq CLI against
bigquery-public-data.pypi.file_downloads, parses entry names from
README.md via readme_parser, and supports --dry-run and --names-file.
Merges results into the gitignored cache at
website/data/pypi_downloads.tsv.

The table is clustered on file.project, so scanned bytes grow with the
IN-list size: a dry run against the full README (~530 names) scanned
1.21 TB, past the 1 TB/month free tier. Per-sitting --names-file
fetches are used instead of one big query.

Co-Authored-By: Claude <noreply@anthropic.com>

2026-08-15 15:41:55 +08:00

..

static

fix: surface sponsorship link in header

2026-06-07 03:22:28 +08:00

templates

fix: surface sponsorship link in header

2026-06-07 03:22:28 +08:00

tests

fix: surface sponsorship link in header

2026-06-07 03:22:28 +08:00

build.py

fix: improve website SEO metadata

2026-06-07 03:08:43 +08:00

fetch_github_stars.py

…

fetch_pypi_downloads.py

feat: add BigQuery-based PyPI downloads fetcher

2026-08-15 15:41:55 +08:00

readme_parser.py

…