Commit Graph

6802 Commits

Author SHA1 Message Date
Nick Sweeting
92a939a6a2
Merge remote-tracking branch 'origin/dev' into audit-pr1850 2026-09-01 11:38:24 -07:00
Nick Sweeting
c817da7af6
Merge remote-tracking branch 'origin/dev' into audit-pr1846 2026-09-01 11:38:24 -07:00
Nick Sweeting
39c64b21d0
Expand MCP integration coverage 2026-09-01 11:38:09 -07:00
ArchiveBox Release Bot
2f4bb5326b Bump release version to 0.9.35rc365 2026-09-01 18:35:36 +00:00
Nick Sweeting
70e477c1c8
Clarify startup and local runner ownership 2026-09-01 11:35:12 -07:00
ArchiveBox Release Bot
fedb091b87 Bump release version to 0.9.35rc364 2026-09-01 18:29:35 +00:00
Nick Sweeting
7100ac1fd0
Add TTFB timings to screenshot gallery 2026-09-01 11:29:10 -07:00
Nick Sweeting
3fc67705a5
Unify plugin runtime and queue lifecycle boundaries 2026-09-01 01:07:04 -07:00
ArchiveBox Release Bot
dfdebf0eaf Bump release version to 0.9.35rc363
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
Release candidate / prepare (push) Waiting to run
Release candidate / python-artifacts (push) Blocked by required conditions
Release candidate / docker-digests (push) Blocked by required conditions
2026-09-01 06:44:04 +00:00
Nick Sweeting
fe967c8a96
fix: simplify cross-machine runner handling 2026-08-31 23:43:33 -07:00
ArchiveBox Release Bot
402c983f61 Bump release version to 0.9.35rc362 2026-09-01 06:12:11 +00:00
ArchiveBox Release Bot
be98ceae5c Bump for abx-dl 1.12.225 2026-09-01 06:11:55 +00:00
ArchiveBox Release Bot
16a5a710da Bump release version to 0.9.35rc361 2026-09-01 05:48:59 +00:00
ArchiveBox Release Bot
cae35ebe89 Bump for abx-dl 1.12.223 2026-09-01 05:48:42 +00:00
ArchiveBox Release Bot
9731919108 Bump release version to 0.9.35rc360 2026-09-01 05:37:31 +00:00
Nick Sweeting
bc243ea1d9
Fix final installer and Docker CI regressions 2026-08-31 22:37:05 -07:00
ArchiveBox Release Bot
bbdbf0d9e7 Bump release version to 0.9.35rc359 2026-09-01 05:32:37 +00:00
ArchiveBox Release Bot
1d84296123 Bump for abx-dl 1.12.222 2026-09-01 05:30:43 +00:00
ArchiveBox Release Bot
3a1d646b8b Bump release version to 0.9.35rc358 2026-09-01 05:30:05 +00:00
Nick Sweeting
c1dda18443
Document daemon shutdown ownership 2026-08-31 22:26:06 -07:00
ArchiveBox Release Bot
4fc4df9da8 Bump release version to 0.9.35rc357 2026-09-01 05:23:42 +00:00
Nick Sweeting
1a851342fd
Fix complete static exports and supervised crawl progress (#1848)
## Summary

- make `archivebox list --html` write every snapshot detail page from
the same `core/snapshot.html` Django template used for live admin site
- create canonical UUID detail directories for pending/unarchived
snapshots too, without embedding live admin routes
- omit stale/nonexistent output targets, suppress bogus `/None` icons,
and correctly URL-encode literal `%` filenames
- create non-TTY crawl progress reporters and relay supervised worker
output on stderr so JSONL stdout stays valid
- replace both public-site Docker examples of `init --install` with
plain `init` and remove their false install output

Closes #1847.

## Issue reproduction

Built 0.9.35rc352 from source, ran a fresh Docker collection with only
`archivebox init`, then archived `https://sweeting.me/` at depth 1. The
completed collection has 75 snapshots, 14.0 GB, and only canonical
`archive/users/system/snapshots/<date>/<domain>/<uuid>/` roots—zero
legacy timestamp directories.

Before this PR, the exported index linked to 75 missing snapshot detail
pages. After the fix, it contains 76 static HTML pages total. A
filesystem-aware HTML traversal checked 11,286 local href/src targets:
zero missing and zero live `/snapshot`, `/web`, or `/static` routes.

## Verification

- `archivebox/tests/test_cli_list.py`: 23 passed
- `archivebox/tests/test_ui_admin_snapshot.py`: 61 passed
- crawl runner + CLI piping suites: 37 passed
- changed-file prek hooks: passed
- real non-TTY Docker add emitted process STARTED and succeeded rows
while preserving stdout/stderr separation
- unarchived-snapshot regression starts with a missing output directory
and proves export creates a portable detail page with no live admin URL

## Dependency PRs

- ArchiveBox/abx-dl#18 supplies the shared non-TTY lifecycle renderer
- ArchiveBox/abxpkg#44 fixes the warm installer cache identity/version
bugs found during this reproduction

No installer concurrency or skip branches were added. The non-Docker
development/CLI `init --install` examples and its real fuzz test are
intentionally unchanged.
2026-08-31 22:21:20 -07:00
Nick Sweeting
72955a08af
Merge branch 'dev' into fix/static-archive-install-cache 2026-08-31 22:11:02 -07:00
ArchiveBox Release Bot
9e43a3c815 Bump release version to 0.9.35rc356 2026-09-01 04:06:35 +00:00
Nick Sweeting
b28a4e1a55
Fix runner recovery across PID namespaces 2026-08-31 21:06:06 -07:00
ArchiveBox Release Bot
c142896e0c Bump release version to 0.9.35rc355
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
Release candidate / prepare (push) Waiting to run
Release candidate / python-artifacts (push) Blocked by required conditions
Release candidate / docker-digests (push) Blocked by required conditions
2026-08-31 02:24:15 +00:00
ArchiveBox Release Bot
b4c56b52cd Bump for abx-dl 1.12.221 2026-08-31 02:23:49 +00:00
ArchiveBox Release Bot
816c712c41 Bump release version to 0.9.35rc354 2026-08-31 01:59:26 +00:00
ArchiveBox Release Bot
e2dc7d3a13 Bump for abx-dl 1.12.220 2026-08-31 01:59:06 +00:00
ArchiveBox Release Bot
15fff6045b Bump release version to 0.9.35rc353 2026-08-31 01:36:37 +00:00
ArchiveBox Release Bot
b864535dc1 Bump for abx-dl 1.12.219 2026-08-31 01:36:19 +00:00
Nick Sweeting
c498fc174c
Keep static manifest schema consistent 2026-08-30 16:11:48 -07:00
Nick Sweeting
e874ee4201
Write linked static JSONL manifest 2026-08-30 16:02:27 -07:00
Nick Sweeting
84b3607771
Align ArchiveResult CLI tests with plugin projection 2026-08-30 15:55:03 -07:00
Nick Sweeting
57f15284b4
Link static export JSONL manifest 2026-08-30 15:42:42 -07:00
Nick Sweeting
b06f2ca7ae
Keep static snapshot links offline-safe 2026-08-30 15:39:35 -07:00
Nick Sweeting
dccd7fd0a3
Scope Docker WAL guard to SQLite 2026-08-30 15:20:04 -07:00
Nick Sweeting
654f07e579
Prevent Docker bind-mount SQLite corruption 2026-08-30 15:00:37 -07:00
Nick Sweeting
a1b763974e
Handle unarchived static snapshot details 2026-08-30 13:01:34 -07:00
Nick Sweeting
6d564c14ee
Fix Docker init command on public site 2026-08-30 12:43:27 -07:00
Nick Sweeting
920826b1cb
Fix complete static exports and crawl progress 2026-08-30 12:39:54 -07:00
ArchiveBox Release Bot
ccf34308a2 Bump release version to 0.9.35rc352
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
Release candidate / prepare (push) Waiting to run
Release candidate / python-artifacts (push) Blocked by required conditions
Release candidate / docker-digests (push) Blocked by required conditions
2026-08-30 18:23:09 +00:00
Nick Sweeting
2c901aaa44
fix: rename Archive Results admin label 2026-08-30 11:22:49 -07:00
ArchiveBox Release Bot
e888587293 Bump release version to 0.9.35rc351
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
Release candidate / prepare (push) Waiting to run
Release candidate / python-artifacts (push) Blocked by required conditions
Release candidate / docker-digests (push) Blocked by required conditions
2026-08-30 06:07:40 +00:00
Nick Sweeting
338fbae8d1
chore: refresh rc350 docs inventory 2026-08-29 23:07:26 -07:00
ArchiveBox Release Bot
ba8e71dd11 Bump release version to 0.9.35rc350 2026-08-30 06:03:30 +00:00
Nick Sweeting
c8ef576235
fix: secure snapshot output deletion handoff 2026-08-29 23:03:08 -07:00
ArchiveBox Release Bot
b5560f77ff Bump release version to 0.9.35rc349
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
Release candidate / prepare (push) Waiting to run
Release candidate / python-artifacts (push) Blocked by required conditions
Release candidate / docker-digests (push) Blocked by required conditions
2026-08-29 23:04:00 +00:00
Nick Sweeting
6906edc076
fix: make portable exports and screenshot deploys reliable 2026-08-29 16:03:29 -07:00
ArchiveBox Release Bot
2d37ab29e4 Bump release version to 0.9.35rc348 2026-08-29 22:07:04 +00:00