Claude
e4df2d6bf2
Keep MAX_URL_LENGTH at 65535; only switch url storage to TextField
...
The column change to a variable-length, still-indexed TextField is what
matters for supporting long URLs efficiently — no reason to lower the
supported limit. Adjust the long-URL tests to the real 65535 boundary.
2026-06-05 04:10:41 +00:00
Claude
b74861ef1e
Support URLs up to 8000 chars via variable-length indexed TextField
...
Snapshot.url was a CharField(max_length=65535) which reserves a fixed-width
column and is too long to index or constrain on real DB backends. Store it as a
variable-length TextField instead, so short URLs don't waste space and very long
URLs (up to MAX_URL_LENGTH=8000) are supported, while keeping a normal index on
the field so exact, prefix, and substring (icontains) URL lookups all stay fast.
- misc/util.py: MAX_URL_LENGTH 65535 -> 8000 (the practical web-server limit)
- core/models.py: Snapshot.url CharField -> TextField(db_index=True)
- migration 0049_alter_snapshot_url
- tests covering 8000-char persistence, exact/prefix/substring lookups,
over-length rejection, and per-crawl uniqueness for long URLs
https://claude.ai/code/session_01BLnGTL5GSoouD4ihaYp55n
2026-06-04 22:35:27 +00:00
Nick Sweeting
bdff741c85
release: archivebox 0.9.34rc59
CodeQL / Analyze (${{ matrix.language }}) (none, python) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-amd64, docker-amd64, linux/amd64, ubuntu-24.04) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-arm64, docker-arm64, linux/arm64, ubuntu-24.04-arm) (push) Waiting to run
Build Docker image / publish multiarch tags (push) Blocked by required conditions
Run linters / lint (push) Waiting to run
Build Pip package / build (push) Waiting to run
Release State / release-state (push) Waiting to run
Parallel Tests / Discover test files (push) Waiting to run
Parallel Tests / ${{ matrix.test.name }} (push) Blocked by required conditions
Parallel Tests / ${{ matrix.plugin.name }} (push) Blocked by required conditions
Run tests / python_tests (ubuntu-22.04, 3.13) (push) Waiting to run
Run tests / docker_tests (push) Waiting to run
Update Homebrew tap / dispatch (push) Waiting to run
2026-06-04 10:05:16 -07:00
Nick Sweeting
ba895db80e
release: archivebox 0.9.34rc58
2026-06-04 09:20:18 -07:00
Nick Sweeting
364efdf409
fix release pypi retry loop
2026-06-04 09:17:34 -07:00
Nick Sweeting
9a1919c2f4
fix docker env syntax
2026-06-04 09:15:16 -07:00
Nick Sweeting
91f6106434
release: archivebox 0.9.34rc56
2026-06-04 09:14:36 -07:00
Nick Sweeting
cf4bd959c0
fix private snapshot replay auth
2026-06-04 09:12:56 -07:00
Nick Sweeting
8367578f9b
Update snapshot admin selection behavior
2026-06-04 08:00:25 -07:00
Nick Sweeting
5de536e06d
release: archivebox 0.9.34rc55
CodeQL / Analyze (${{ matrix.language }}) (none, python) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-amd64, docker-amd64, linux/amd64, ubuntu-24.04) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-arm64, docker-arm64, linux/arm64, ubuntu-24.04-arm) (push) Waiting to run
Build Docker image / publish multiarch tags (push) Blocked by required conditions
Run linters / lint (push) Waiting to run
Build Pip package / build (push) Waiting to run
Release State / release-state (push) Waiting to run
Parallel Tests / Discover test files (push) Waiting to run
Parallel Tests / ${{ matrix.test.name }} (push) Blocked by required conditions
Parallel Tests / ${{ matrix.plugin.name }} (push) Blocked by required conditions
Run tests / python_tests (ubuntu-22.04, 3.13) (push) Waiting to run
Run tests / docker_tests (push) Waiting to run
Update Homebrew tap / dispatch (push) Waiting to run
2026-06-04 01:26:32 -07:00
Nick Sweeting
caf0acdec8
release: archivebox 0.9.34rc54
2026-06-04 00:48:47 -07:00
Nick Sweeting
70b325f959
release: archivebox 0.9.34rc53
2026-06-04 00:19:42 -07:00
Nick Sweeting
083ee8cb7d
Remove abx-plugins Docker commit pin
2026-06-04 00:01:29 -07:00
Nick Sweeting
79b59945e5
release: v0.9.34rc52
2026-06-03 23:55:32 -07:00
Nick Sweeting
3c6d94d03a
release: v0.9.34rc51
2026-06-03 23:54:12 -07:00
Nick Sweeting
2e9686b901
release: v0.9.34rc51
2026-06-03 23:21:37 -07:00
Nick Sweeting
40d5dc06a4
release: v0.9.34rc50
2026-06-03 22:59:35 -07:00
Nick Sweeting
bb0bf81e02
release: v0.9.34rc49
2026-06-03 22:58:26 -07:00
Nick Sweeting
d26e27d139
release: archivebox 0.9.34rc49
2026-06-03 22:37:51 -07:00
Nick Sweeting
327e378a9e
release: archivebox 0.9.34rc48
2026-06-03 22:07:19 -07:00
Nick Sweeting
77ee827a58
release: archivebox 0.9.34rc47
2026-06-03 21:37:13 -07:00
Nick Sweeting
5b74eb5238
fix: publish pip builds from pypi environment
CodeQL / Analyze (${{ matrix.language }}) (none, python) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-amd64, docker-amd64, linux/amd64, ubuntu-24.04) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-arm64, docker-arm64, linux/arm64, ubuntu-24.04-arm) (push) Waiting to run
Build Docker image / publish multiarch tags (push) Blocked by required conditions
Run linters / lint (push) Waiting to run
Build Pip package / build (push) Waiting to run
Release State / release-state (push) Waiting to run
Parallel Tests / Discover test files (push) Waiting to run
Parallel Tests / ${{ matrix.test.name }} (push) Blocked by required conditions
Parallel Tests / ${{ matrix.plugin.name }} (push) Blocked by required conditions
Run tests / python_tests (ubuntu-22.04, 3.13) (push) Waiting to run
Run tests / docker_tests (push) Waiting to run
Build Debian package / build (amd64) (push) Has been cancelled
Build Debian package / build (arm64) (push) Has been cancelled
Build Debian package / test (amd64, ubuntu-24.04) (push) Has been cancelled
Build Debian package / test (arm64, ubuntu-24.04-arm) (push) Has been cancelled
Build Debian package / release (push) Has been cancelled
2026-06-03 20:01:42 -07:00
Nick Sweeting
8e1c7dccaa
fix: wait for released deps before docker build
2026-06-03 19:45:43 -07:00
Nick Sweeting
50ff26b524
release: archivebox 0.9.34rc46
2026-06-03 19:42:16 -07:00
Nick Sweeting
9e06c32c18
fix: install archivebox extras explicitly in ci
2026-06-03 19:34:08 -07:00
Nick Sweeting
bcd10ea139
fix: resolve local package deps in archivebox ci
2026-06-03 19:30:42 -07:00
Nick Sweeting
b8b70f3525
release: archivebox 0.9.34rc45
2026-06-03 19:13:11 -07:00
Nick Sweeting
74690eb52b
fix: wait for released deps before pip build
2026-06-03 19:02:35 -07:00
Nick Sweeting
afa958a6d5
release: archivebox 0.9.34rc44
2026-06-03 18:57:23 -07:00
Nick Sweeting
1cf0d18444
release: archivebox 0.9.34rc43
2026-06-03 18:24:54 -07:00
Nick Sweeting
7698155cb9
release: archivebox 0.9.34rc42
2026-06-03 17:54:41 -07:00
Nick Sweeting
1ab99027d8
release: archivebox 0.9.34rc41
2026-06-03 17:41:51 -07:00
Nick Sweeting
e0c3ca67e4
release: archivebox 0.9.34rc40
2026-06-03 17:32:17 -07:00
Nick Sweeting
c0fb8eb532
release: archivebox 0.9.34rc39
2026-06-03 17:19:48 -07:00
Nick Sweeting
6da1d3f5af
ci: give archivebox chrome install a real timeout
CodeQL / Analyze (${{ matrix.language }}) (none, python) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-amd64, docker-amd64, linux/amd64, ubuntu-24.04) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-arm64, docker-arm64, linux/arm64, ubuntu-24.04-arm) (push) Waiting to run
Build Docker image / publish multiarch tags (push) Blocked by required conditions
Run linters / lint (push) Waiting to run
Build Pip package / build (push) Waiting to run
Release State / release-state (push) Waiting to run
Parallel Tests / Discover test files (push) Waiting to run
Parallel Tests / ${{ matrix.test.name }} (push) Blocked by required conditions
Parallel Tests / ${{ matrix.plugin.name }} (push) Blocked by required conditions
Run tests / python_tests (ubuntu-22.04, 3.13) (push) Waiting to run
Run tests / docker_tests (push) Waiting to run
2026-06-03 00:02:26 -07:00
Nick Sweeting
83a2099851
fix: scope update search backfill runner
2026-06-02 21:54:25 -07:00
Nick Sweeting
3669133a05
fix: allow install to initialize collections
2026-06-02 21:25:20 -07:00
Nick Sweeting
4e9c8b1475
ci: install chrome through archivebox
2026-06-02 21:21:39 -07:00
Nick Sweeting
9f0544857c
test: require success in cli workflows
2026-06-02 21:19:21 -07:00
Nick Sweeting
acc830d30f
test: exercise extract cli with real outputs
2026-06-02 21:07:52 -07:00
Nick Sweeting
43606e17a0
test: let recursive crawl finish before assertions
CodeQL / Analyze (${{ matrix.language }}) (none, python) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-amd64, docker-amd64, linux/amd64, ubuntu-24.04) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-arm64, docker-arm64, linux/arm64, ubuntu-24.04-arm) (push) Waiting to run
Build Docker image / publish multiarch tags (push) Blocked by required conditions
Run linters / lint (push) Waiting to run
Build Pip package / build (push) Waiting to run
Release State / release-state (push) Waiting to run
Parallel Tests / Discover test files (push) Waiting to run
Parallel Tests / ${{ matrix.test.name }} (push) Blocked by required conditions
Parallel Tests / ${{ matrix.plugin.name }} (push) Blocked by required conditions
Run tests / python_tests (ubuntu-22.04, 3.13) (push) Waiting to run
Run tests / docker_tests (push) Waiting to run
2026-06-02 20:27:44 -07:00
Nick Sweeting
cd7e7cd132
test: make extract cli setup deterministic
2026-06-02 20:11:37 -07:00
Nick Sweeting
f4ec16c3c8
test: create extract snapshots via cli
2026-06-02 19:56:25 -07:00
Nick Sweeting
9b5aa6861d
test: stabilize api workflow and chrome title checks
2026-06-02 19:41:37 -07:00
Nick Sweeting
81de752456
test: provision chrome for title config check
2026-06-02 19:30:22 -07:00
Nick Sweeting
ad43842691
test: stabilize update api and title ci checks
2026-06-02 19:11:54 -07:00
Nick Sweeting
e4ec848da8
fix: keep background add crawls runnable
2026-06-02 18:53:59 -07:00
Nick Sweeting
39eac65ed0
Stabilize frozen config CLI test flows
...
(cherry picked from commit 2bca869e32
2026-06-02 18:44:57 -07:00
Nick Sweeting
e9968b75f2
test: rely on archivewebpage plugin dependencies
2026-06-02 18:42:34 -07:00
Nick Sweeting
cdec5ea440
test: stabilize archivewebpage browser preview
2026-06-02 18:32:13 -07:00
