Commit Graph

349 Commits

Author SHA1 Message Date
ArchiveBox Release Bot
f384cd0bd0 Bump for abx-dl 1.12.92 2026-08-12 23:35:19 +00:00
ArchiveBox Release Bot
2ee3181bfa Bump for abx-dl 1.12.90 2026-08-12 18:59:20 +00:00
ArchiveBox Release Bot
cdaed9a13d Bump for abx-dl 1.12.89 2026-08-12 02:41:51 +00:00
Nick Sweeting
0671dfd794
Bump release to 0.9.35rc220 2026-08-11 19:12:30 -07:00
Nick Sweeting
35157fa0d0
Bump release to 0.9.35rc219 2026-08-11 18:33:14 -07:00
ArchiveBox Release Bot
dc722a2ffa Bump for abx-dl 1.12.88 2026-08-11 22:54:34 +00:00
ArchiveBox Release Bot
ffcdf43fd5 Bump for abx-dl 1.12.87 2026-08-11 22:03:25 +00:00
ArchiveBox Release Bot
0bbd10613a Bump for abx-dl 1.12.86 2026-08-11 19:38:25 +00:00
ArchiveBox Release Bot
3def69ef31 Bump for abx-dl 1.12.85 2026-08-11 18:03:16 +00:00
ArchiveBox Release Bot
2e1a107068 Bump for abx-dl 1.12.84 2026-08-11 17:15:54 +00:00
ArchiveBox Release Bot
de435d5314 Bump for abx-dl 1.12.82
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
2026-08-11 12:08:21 +00:00
ArchiveBox Release Bot
f8738d69fd Bump for abx-dl 1.12.81 2026-08-11 11:36:43 +00:00
ArchiveBox Release Bot
b78b02dc56 Bump for abx-dl 1.12.80
Some checks failed
CI / Linters (push) Has been cancelled
CI / Install and CLI platform compatibility (push) Has been cancelled
CI / Discovered test matrix (push) Has been cancelled
CI / Documentation and root tests (push) Has been cancelled
CI / CodeQL (push) Has been cancelled
CI / Tested Python artifacts (push) Has been cancelled
CI / Tested Docker images (push) Has been cancelled
Deploy Publicsite to GitHub Pages / deploy (push) Has been cancelled
CI / All required CI lanes (push) Has been cancelled
2026-08-10 02:59:20 +00:00
ArchiveBox Release Bot
d9544a970d Bump for abx-dl 1.12.79 2026-08-10 00:54:31 +00:00
ArchiveBox Release Bot
8d46bcc2d6 Bump for abx-dl 1.12.78 2026-08-10 00:43:45 +00:00
ArchiveBox Release Bot
d8e8e5bb0f Bump for abx-dl 1.12.77 2026-08-09 23:16:42 +00:00
ArchiveBox Release Bot
0c2b22bb90 Bump for abx-dl 1.12.76 2026-08-09 21:52:18 +00:00
Nick Sweeting
7e124f9472
Bump version 0.9.35rc205 to 0.9.35rc206 2026-08-09 16:18:58 -04:00
ArchiveBox Release Bot
f264c22d5d Bump for abx-dl 1.12.75 2026-08-09 19:57:16 +00:00
ArchiveBox Release Bot
6eaf3d3f9b Bump for abx-dl 1.12.74 2026-08-09 17:44:17 +00:00
ArchiveBox Release Bot
5039a1df4f Bump for abx-dl 1.12.73 2026-08-02 12:54:32 +00:00
ArchiveBox Release Bot
c0cd329bc1 Bump for abx-dl 1.12.72 2026-08-02 09:42:25 +00:00
ArchiveBox Release Bot
879b6d7397 Bump for abx-dl 1.12.71 2026-08-02 07:46:19 +00:00
ArchiveBox Release Bot
d87c547e7d Bump for abx-dl 1.12.70 2026-08-02 06:55:38 +00:00
ArchiveBox Release Bot
7afd0e6cf7 Bump for abx-dl 1.12.69 2026-08-02 04:34:30 +00:00
ArchiveBox Release Bot
783cb69694 Bump for abx-dl 1.12.68 2026-08-01 20:20:24 +00:00
Nick Sweeting
5423f12474
bump version 0.9.35rc196 -> 0.9.35rc197 2026-08-01 11:36:56 -07:00
ArchiveBox Release Bot
d662e5f001 Bump for abx-dl 1.12.67 2026-08-01 14:22:10 +00:00
ArchiveBox Release Bot
5dc8725077 Bump for abx-dl 1.12.66 2026-08-01 13:26:22 +00:00
ArchiveBox Release Bot
4766021c18 Bump for abx-dl 1.12.63 2026-08-01 11:50:54 +00:00
ArchiveBox Release Bot
8c036ecf19 Bump for abx-dl 1.12.62 2026-08-01 10:28:22 +00:00
ArchiveBox Release Bot
d2ad62edd4 Bump for abx-dl 1.12.61 2026-08-01 08:17:35 +00:00
ArchiveBox Release Bot
5dabe9f4e9 Bump for abx-dl 1.12.60 2026-08-01 06:20:13 +00:00
Nick Sweeting
c825cdb1cc
Verify releases through normal PyPI installs
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
2026-07-31 00:26:56 -07:00
ArchiveBox Release Bot
3a05d880a9 Bump for abx-dl 1.12.59 2026-07-31 06:48:47 +00:00
ArchiveBox Release Bot
59ce3d211b Bump for abx-dl 1.12.58 2026-07-30 22:22:41 +00:00
Nick Sweeting
271cdeb2c8
Bump ArchiveBox RC for abx-dl 1.12.57 2026-07-30 13:05:36 -07:00
ArchiveBox Release Bot
01785867bc Bump for abx-dl 1.12.53 2026-07-30 04:37:04 +00:00
ArchiveBox Release Bot
2acbcd40f5 Bump for abx-dl 1.12.52 2026-07-30 03:00:49 +00:00
ArchiveBox Release Bot
364d3685b3 Bump for abx-dl 1.12.51 2026-07-30 02:06:32 +00:00
ArchiveBox Release Bot
515a04a849 Bump for abx-dl 1.12.46 2026-07-30 00:43:34 +00:00
ArchiveBox Release Bot
cc7cde1990 Bump for abx-dl 1.12.45
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
2026-07-30 00:14:35 +00:00
Nick Sweeting
f8b7dad645
Reuse abxpkg installs across ArchiveBox tests 2026-07-29 13:29:37 -07:00
ArchiveBox Release Bot
3d4bae4ba2 Bump for abx-dl 1.12.43 2026-07-29 19:52:22 +00:00
Nick Sweeting
dc9dc92aee
Fix ArchiveBox prerelease publishing validation 2026-07-29 12:24:25 -07:00
Nick Sweeting
a6af6f0c3f
Bump ArchiveBox prerelease to 0.9.35rc177 2026-07-29 12:07:31 -07:00
ArchiveBox Release Bot
00a615dd5a Bump for abx-dl 1.12.42 2026-07-29 18:50:24 +00:00
Nick Sweeting
b35fae85b3
Let abx-dl own internal version constraints 2026-07-29 07:30:35 -07:00
Nick Sweeting
1030d34b98
Bump abx-dl to 1.12.40 2026-07-29 05:05:20 -07:00
Nick Sweeting
2bd7193b2c
Bump abx-dl to 1.12.39 2026-07-29 03:45:59 -07:00
Nick Sweeting
6d95287ba4
Bump abx-dl dependency to 1.12.37 2026-07-29 02:58:29 -07:00
Nick Sweeting
01fea0adea
Bump abx-dl dependency to 1.12.35 2026-07-29 02:05:03 -07:00
Nick Sweeting
e6d0e69146
Bump abx-dl dependency to 1.12.34 2026-07-29 00:03:13 -07:00
Nick Sweeting
983708f230
Package ArchiveBox commit metadata safely 2026-07-28 22:14:13 -07:00
Nick Sweeting
97d82c2615
Use uv no-cache in Docker build 2026-07-28 21:27:52 -07:00
Nick Sweeting
07c000207d
Install raw binary targets through Binary lifecycle 2026-07-28 21:22:01 -07:00
Nick Sweeting
8c68b43f46
Resolve install targets from provider package args 2026-07-28 21:01:12 -07:00
Nick Sweeting
491f5d43db
Require current branch head for ArchiveBox release 2026-07-28 20:53:25 -07:00
Nick Sweeting
2246f0d6ff
Use abx-dl 1.12.32 Docker artifacts 2026-07-28 20:47:27 -07:00
Nick Sweeting
a3ca0f68c0
Resolve install binary names through plugins 2026-07-28 20:22:50 -07:00
Nick Sweeting
3d680b5379
Bump dev release after downstream gating fix 2026-07-28 18:30:44 -07:00
Nick Sweeting
692dc6658f
Bump dev prerelease and skip duplicate releases 2026-07-28 13:02:09 -07:00
Nick Sweeting
eec8e63a76
Use shared binary dependency table renderer 2026-07-28 10:54:48 -07:00
Nick Sweeting
727b6c20f9
Bump abx-dl to 1.12.28
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
2026-07-28 08:36:52 -07:00
Nick Sweeting
292f2f283f
Bump ArchiveBox dev to abx-dl 1.12.27 2026-07-28 03:05:06 -07:00
Nick Sweeting
795ba60f62
Bump abx-dl to 1.12.26 2026-07-28 02:02:01 -07:00
Nick Sweeting
dea52b3449
Bump abx-dl to 1.12.25 2026-07-28 01:26:13 -07:00
Nick Sweeting
f075a2a4db
Bump abx-dl to 1.12.21 2026-07-27 23:02:30 -07:00
Nick Sweeting
227a2a46a7
Require prerelease versions outside ArchiveBox main 2026-07-27 21:57:08 -07:00
Nick Sweeting
c3cfb312f0
Align ArchiveBox release publisher workflow 2026-07-27 21:54:51 -07:00
Nick Sweeting
dd1f089c5c
Bump abx-dl to 1.12.20 2026-07-27 20:31:33 -07:00
Nick Sweeting
297d71a720
Bump abx-dl to 1.12.19 2026-07-27 17:50:38 -07:00
Nick Sweeting
cd0f110ab2
Bump abx-dl dependency to 1.12.18 2026-07-27 16:15:03 -07:00
Nick Sweeting
47becdc063
Declare direct plugin dependency without pin 2026-07-27 15:26:23 -07:00
Nick Sweeting
dc6c2118e1
Relax direct abxpkg dependency 2026-07-27 15:16:17 -07:00
Nick Sweeting
838be70ebb
Bump downloader stack to abx-dl 1.12.16 2026-07-26 22:47:21 -07:00
Nick Sweeting
8267d757aa
Bump downloader dependency stack 2026-07-26 21:50:23 -07:00
Nick Sweeting
e6c3dc8a64
Fix docs root install ownership and live progress rows 2026-07-26 20:59:08 -07:00
Nick Sweeting
eb1689796f
Bump downloader deps for dev CI 2026-07-26 20:31:10 -07:00
Nick Sweeting
f4ed0699f0 Rely on abx-dl for plugin dependency 2026-07-26 19:34:06 -07:00
Nick Sweeting
14d14b0096 Bump downloader plugin dependencies 2026-07-26 19:32:00 -07:00
Nick Sweeting
4fbcf3c88f Bump downloader dependency for ordered installs 2026-07-26 16:45:44 -07:00
Nick Sweeting
50939fdbcb Resolve binaries through abxpkg hook projections 2026-07-26 16:17:16 -07:00
Nick Sweeting
883c4f3c93 Bump downloader dependencies for dev 2026-07-26 12:07:05 -07:00
Nick Sweeting
d49abf3f79
Release ArchiveBox 0.9.35rc145
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
2026-07-26 01:15:09 -07:00
Nick Sweeting
9132b26812
Bump ArchiveBox deps for uv package path fix 2026-07-26 00:19:19 -07:00
Nick Sweeting
f3ac229026
Bump ArchiveBox deps for opencode install 2026-07-25 23:12:53 -07:00
Nick Sweeting
0a7d6b3104
Run ArchiveBox tests one file per CI job 2026-07-25 21:35:33 -07:00
Nick Sweeting
68c53d5934
Fix CI runtime binary resolution and docs install drift 2026-07-25 21:32:09 -07:00
Nick Sweeting
72bb79f8dd
Bump ArchiveBox rc140 for abx-dl 1.12.4 2026-07-25 21:03:54 -07:00
Nick Sweeting
38837ec5a8
Bump ArchiveBox prerelease for plugin install fix 2026-07-25 19:54:30 -07:00
Nick Sweeting
8254f962ba
Fix CI runtime resolution and host policy regressions 2026-07-25 18:35:25 -07:00
Nick Sweeting
ca0ce8c23f
Update ArchiveBox package pins to 1.12.0 2026-07-25 15:49:09 -07:00
Nick Sweeting
13c3a4aaf3 Update downloader deps and docs CI snippets 2026-07-25 13:38:35 -07:00
Nick Sweeting
c89f6b0542
Fix ArchiveBox CI runtime regressions 2026-07-25 12:26:20 -07:00
Claude
f7c182d76c
Merge remote-tracking branch 'origin/dev' into claude/archivebox-postgresql-support-xrlgim
# Conflicts:
#	.github/workflows/test-parallel.yml
#	.github/workflows/test.yml
#	uv.lock
2026-07-24 10:30:55 +00:00
Nick Sweeting
eacfae5d6c
Run all ArchiveBox tests through unified CI 2026-07-24 00:50:40 -07:00
Claude
35145d282c
Regenerate lockfile with pinned uv and slim DB adapter helpers
Re-lock uv.lock with the CI-pinned uv version so the diff is limited to the
psycopg addition (a newer local uv had rewritten platform markers and
exclude-newer, breaking `uv sync --locked` in CI).

Consolidate the misc/db.py adapter surface: fold database_backend() into
is_postgres(), drop the redundant vendor-name constants, remove the unused
migration_table_exists() helper, and inline the single-use missing-table check.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019YHSjZM6TstSAMN2PhgfUg
2026-07-24 07:23:44 +00:00
Claude
7167c5dd8a
Add native PostgreSQL support alongside SQLite
Add DATABASE_ENGINE=postgres (plus DATABASE_HOST/PORT/USER/PASSWORD/NAME)
config and centralize all sqlite-vs-postgres branching in
archivebox.misc.db:

- get_database_settings() builds DATABASES for either backend; the sqlite
  path is unchanged (custom lock-retry backend, same PRAGMAs).
- database_exists()/ensure_database_ready() replace index.sqlite3 file
  checks; init auto-creates the postgres database when missing.
- approximate_row_counts() serves admin index counts from sqlite_stat1 or
  pg_class.reltuples; missing-table detection covers both vendors.
- rebuild_models_from_migration_state() lets historical sqlite-only raw
  SQL migrations resync postgres schema from Django migration state at
  every divergence point (postgres can never hold legacy data, so
  affected tables are empty when these run). All raw-DDL and PRAGMA
  migrations are now vendor-gated with sqlite behavior byte-for-byte
  unchanged.
- A pre_save clamp truncates CharField values to max_length: sqlite
  never enforced varchar(n) but postgres does (e.g. long crawl labels).
- Collation-sensitive URL range scans branch to escaped LIKE on postgres
  (with a text_pattern_ops index) since linguistic collations break
  bytewise range tricks; the crawl-config JSON search wave gets a
  jsonb-text implementation.

Verified on real PostgreSQL 16: fresh init applies the entire migration
graph, schema matches models exactly (column-level parity check +
makemigrations --check), and add/run/list/search/status/remove all work
end-to-end. New test_postgres_backend.py suite boots a real throwaway
postgres cluster (initdb + pg_ctl); CI workflows install postgres server
binaries.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019YHSjZM6TstSAMN2PhgfUg
2026-07-23 17:08:47 +00:00
Nick Sweeting
a3c5e13ff8 Release ArchiveBox through complete CI coverage
Some checks failed
CI / Linters (push) Waiting to run
CI / Complete test suite (push) Waiting to run
CI / Sharded and plugin tests (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Has been cancelled
2026-07-23 07:00:05 -07:00