Commit Graph

496 Commits

Author SHA1 Message Date
Nick Sweeting
597837f88c
Install published dev releases by default 2026-08-12 22:24:18 -07:00
Nick Sweeting
bd45a3a476
Use current abxpkg in setup script 2026-08-12 21:43:42 -07:00
Nick Sweeting
8e91bcc4db
Align setup bootstrap with packaged abxpkg 2026-08-12 17:21:54 -07:00
Nick Sweeting
d08c4ec35d
Install extractors before screenshot crawls 2026-08-12 16:42:14 -07:00
Nick Sweeting
4b4cd5dacd
Use current abxpkg in setup bootstrap 2026-08-11 16:24:39 -07:00
Nick Sweeting
be20f8c8e2
Repair Chrome extension cache ownership 2026-08-11 13:19:04 -07:00
Nick Sweeting
65b673d10e
Harden RC release and install guidance 2026-08-11 10:04:10 -07:00
Nick Sweeting
d9c57d0d7d
Use current abxpkg bootstrap release 2026-08-11 04:30:11 -07:00
Nick Sweeting
4bb81dbda3 Repair nested abxpkg projections after UID remap 2026-08-09 22:04:25 -04:00
Nick Sweeting
95065fb8cc Repair all abxpkg provider projections after UID remap 2026-08-09 21:30:12 -04:00
Nick Sweeting
02ed8a4991 Repair abxpkg env directories after Docker UID remap 2026-08-09 21:06:41 -04:00
Nick Sweeting
08e998f7d1 Repair abxpkg cache ownership after Docker UID remap 2026-08-09 20:13:43 -04:00
Nick Sweeting
1369fe63f2
Avoid recursive dependency chown on container start 2026-08-09 18:31:52 -04:00
Nick Sweeting
d9e82d9378
Tolerate unavailable terminal clear during setup 2026-08-09 13:34:27 -04:00
Nick Sweeting
dd4b708cb4
Polish setup and migration validation 2026-08-02 05:56:11 -07:00
Nick Sweeting
7a30b8a8bb
Bootstrap corrected abxpkg release
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
2026-08-02 02:43:42 -07:00
Nick Sweeting
d327c027ef Print the actual setup data directory 2026-08-01 23:15:18 -07:00
Nick Sweeting
df0bb25540
Create service user for direct root runs 2026-08-01 21:58:07 -07:00
Nick Sweeting
04e97abae8
Fix focused CI readiness checks 2026-08-01 20:37:02 -07:00
Nick Sweeting
cbd373fbac
Persist Docker persona profiles in collection data 2026-08-01 19:32:50 -07:00
Nick Sweeting
f655cbe574
Bootstrap released abxpkg lock fix
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
2026-08-01 07:23:30 -07:00
Nick Sweeting
25a884a02c
Consume setup config output without broken pipes 2026-08-01 05:41:05 -07:00
Nick Sweeting
cf9d2a5fa9
Preserve configured dependency library on setup reruns 2026-08-01 05:38:24 -07:00
Nick Sweeting
1df7a4538c
Persist setup dependency library path 2026-08-01 05:13:54 -07:00
Nick Sweeting
119e63cd46
Skip browser opening in headless setup 2026-08-01 05:08:56 -07:00
Nick Sweeting
83ee111dcc
Keep setup config parent user-writable 2026-08-01 05:02:19 -07:00
Nick Sweeting
9bc86484d6
Use cross-user-safe setup bootstrap 2026-08-01 04:18:53 -07:00
Nick Sweeting
de75fc83d8
Handle macOS root setup paths 2026-08-01 04:03:14 -07:00
Nick Sweeting
5fc318de38
Complete direct setup prerequisites 2026-08-01 04:01:00 -07:00
Nick Sweeting
e82410eaa9
Keep optional setup probes quiet 2026-08-01 03:51:46 -07:00
Nick Sweeting
3cf5123664
Keep setup runtime parents user-writable 2026-08-01 03:43:03 -07:00
Nick Sweeting
7aaf4dabaf
Allow setup through noninteractive SSH 2026-08-01 03:35:40 -07:00
Nick Sweeting
f3e4459fb8
Make direct setup reruns preserve user state 2026-08-01 03:13:26 -07:00
Nick Sweeting
e086f01d74
Refresh setup bootstrap provider pin 2026-08-01 03:01:22 -07:00
Nick Sweeting
58d517d2d1
Correct first-run install instructions 2026-08-01 00:04:22 -07:00
Nick Sweeting
ddc684f530
Handle root setup with archivebox account 2026-07-31 22:41:05 -07:00
Nick Sweeting
ac4b835781
Fix AI agent screenshot readiness 2026-07-30 14:34:18 -07:00
Nick Sweeting
f0bb89ab0c
Prefer non-root providers before apt 2026-07-29 15:38:45 -07:00
Nick Sweeting
c1186508bb
Bootstrap monorepo without a root lock 2026-07-29 15:11:53 -07:00
Nick Sweeting
da045b7850
Use native uv workspace setup path 2026-07-29 15:10:02 -07:00
Nick Sweeting
f3b457b88d
Disable uv cache for release publication 2026-07-29 11:50:51 -07:00
Nick Sweeting
c8c4a66144
Keep ArchiveBox version sources aligned 2026-07-29 06:59:04 -07:00
Nick Sweeting
90e726b75e
Make version bumps isolated and cache-free 2026-07-29 06:56:18 -07:00
Nick Sweeting
2bd7193b2c
Bump abx-dl to 1.12.39 2026-07-29 03:45:59 -07:00
Nick Sweeting
491f5d43db
Require current branch head for ArchiveBox release 2026-07-28 20:53:25 -07:00
Nick Sweeting
a3ca0f68c0
Resolve install binary names through plugins 2026-07-28 20:22:50 -07:00
Nick Sweeting
692dc6658f
Bump dev prerelease and skip duplicate releases 2026-07-28 13:02:09 -07:00
Nick Sweeting
e39ee82ead
Restore automated dev releases 2026-07-28 10:29:16 -07:00
Nick Sweeting
f188812381
Use GitHub release API for ArchiveBox tags 2026-07-28 09:03:21 -07:00
Nick Sweeting
5a0e016de1
Restrict stable ArchiveBox releases to main 2026-07-28 02:17:23 -07:00
Nick Sweeting
8a06218852
Allow stable ArchiveBox releases only from main
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
2026-07-27 23:35:57 -07:00
Nick Sweeting
227a2a46a7
Require prerelease versions outside ArchiveBox main 2026-07-27 21:57:08 -07:00
Nick Sweeting
f6edf69d54
Resolve CI tools through normal abxpkg paths 2026-07-27 14:54:27 -07:00
Nick Sweeting
f58301b70c Improve setup wizard sections 2026-07-26 12:23:13 -07:00
Nick Sweeting
412bd144f0
Stabilize rewritten preview screenshots 2026-07-25 22:54:35 -07:00
Nick Sweeting
7781f306f3
Install OpenCode before screenshot capture 2026-07-25 16:20:07 -07:00
Nick Sweeting
61d3aae6c6
Enable OpenCode for screenshot gallery 2026-07-25 15:51:03 -07:00
Nick Sweeting
b9b0e0e808
Accept live progress placeholder in screenshots
Some checks are pending
CI / Linters (push) Waiting to run
CI / Install and CLI platform compatibility (push) Waiting to run
CI / Discovered test matrix (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Waiting to run
2026-07-25 15:34:59 -07:00
Nick Sweeting
28d3392291
Fix screenshot deploy sequencing 2026-07-25 15:26:08 -07:00
Nick Sweeting
002e348672
Disable sandbox for UI setup screenshots without display 2026-07-25 15:09:35 -07:00
Nick Sweeting
32031b17f7
Use projected Chrome for UI screenshots 2026-07-25 15:04:29 -07:00
Nick Sweeting
05350846ab
Sync ArchiveBox UI and setup updates 2026-07-25 14:50:15 -07:00
Nick Sweeting
c89f6b0542
Fix ArchiveBox CI runtime regressions 2026-07-25 12:26:20 -07:00
Claude
f7c182d76c
Merge remote-tracking branch 'origin/dev' into claude/archivebox-postgresql-support-xrlgim
# Conflicts:
#	.github/workflows/test-parallel.yml
#	.github/workflows/test.yml
#	uv.lock
2026-07-24 10:30:55 +00:00
Nick Sweeting
eacfae5d6c
Run all ArchiveBox tests through unified CI 2026-07-24 00:50:40 -07:00
Claude
c2191f9e74
Fix lint: settings import placement and benchmark script exec bit
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019YHSjZM6TstSAMN2PhgfUg
2026-07-23 17:18:54 +00:00
Claude
7167c5dd8a
Add native PostgreSQL support alongside SQLite
Add DATABASE_ENGINE=postgres (plus DATABASE_HOST/PORT/USER/PASSWORD/NAME)
config and centralize all sqlite-vs-postgres branching in
archivebox.misc.db:

- get_database_settings() builds DATABASES for either backend; the sqlite
  path is unchanged (custom lock-retry backend, same PRAGMAs).
- database_exists()/ensure_database_ready() replace index.sqlite3 file
  checks; init auto-creates the postgres database when missing.
- approximate_row_counts() serves admin index counts from sqlite_stat1 or
  pg_class.reltuples; missing-table detection covers both vendors.
- rebuild_models_from_migration_state() lets historical sqlite-only raw
  SQL migrations resync postgres schema from Django migration state at
  every divergence point (postgres can never hold legacy data, so
  affected tables are empty when these run). All raw-DDL and PRAGMA
  migrations are now vendor-gated with sqlite behavior byte-for-byte
  unchanged.
- A pre_save clamp truncates CharField values to max_length: sqlite
  never enforced varchar(n) but postgres does (e.g. long crawl labels).
- Collation-sensitive URL range scans branch to escaped LIKE on postgres
  (with a text_pattern_ops index) since linguistic collations break
  bytewise range tricks; the crawl-config JSON search wave gets a
  jsonb-text implementation.

Verified on real PostgreSQL 16: fresh init applies the entire migration
graph, schema matches models exactly (column-level parity check +
makemigrations --check), and add/run/list/search/status/remove all work
end-to-end. New test_postgres_backend.py suite boots a real throwaway
postgres cluster (initdb + pg_ctl); CI workflows install postgres server
binaries.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019YHSjZM6TstSAMN2PhgfUg
2026-07-23 17:08:47 +00:00
Nick Sweeting
a3c5e13ff8 Release ArchiveBox through complete CI coverage
Some checks failed
CI / Linters (push) Waiting to run
CI / Complete test suite (push) Waiting to run
CI / Sharded and plugin tests (push) Waiting to run
CI / Documentation and root tests (push) Waiting to run
CI / CodeQL (push) Waiting to run
CI / Tested Python artifacts (push) Waiting to run
CI / Tested Docker images (push) Waiting to run
CI / All required CI lanes (push) Blocked by required conditions
Deploy Publicsite to GitHub Pages / deploy (push) Has been cancelled
2026-07-23 07:00:05 -07:00
Nick Sweeting
c36d3c1575
Make release publication atomic and CI-only 2026-07-21 19:26:42 -07:00
Nick Sweeting
6592af0d19
Exercise ArchiveBox through unified runtime lifecycles 2026-07-21 19:26:42 -07:00
Nick Sweeting
582499be86
Deduplicate ArchiveBox release CI 2026-07-20 15:19:32 -07:00
Nick Sweeting
01f5666dbc
Route runtime binaries through abxpkg 2026-07-20 12:50:14 -07:00
Nick Sweeting
11d962406d
Update setup script for dev uv installs 2026-06-24 09:28:32 -07:00
Nick Sweeting
095c0e5112
fix admin snapshot changelist preview summaries 2026-06-21 21:33:14 -07:00
Nick Sweeting
8b57085827
chore: commit local archivebox changes 2026-06-14 11:44:38 -07:00
Nick Sweeting
f3c8460767
ci: use pypi version for archivebox rc bumps 2026-06-14 11:43:38 -07:00
Nick Sweeting
e63f24dc71
ci: require trusted publishing for pypi 2026-06-14 11:19:03 -07:00
Nick Sweeting
cb5c822eb4
ci: use pypi trusted publishing in release state 2026-06-14 10:47:44 -07:00
Nick Sweeting
b768e1767e
release: archivebox 0.9.35rc34 2026-06-14 08:41:37 -07:00
Nick Sweeting
9a6d1b0410
fix: wait for abx-dl docker base in dev release 2026-06-14 01:43:20 -07:00
Nick Sweeting
d3ee9512e5
fix: pin archivebox docker base to abx-dl dependency 2026-06-14 01:07:24 -07:00
Nick Sweeting
18e3580dcd
fix: harden reflected metadata rendering 2026-06-14 00:06:35 -07:00
Nick Sweeting
6ae56b7366
release: archivebox 0.9.35rc28 2026-06-13 23:53:45 -07:00
Nick Sweeting
73ec255855
fix: harden admin metadata surfaces 2026-06-13 23:44:59 -07:00
Nick Sweeting
426e23f33c
Prevent deploy exec from consuming script input
Some checks are pending
CodeQL / Analyze (${{ matrix.language }}) (none, python) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-amd64, docker-amd64, linux/amd64, ubuntu-24.04) (push) Waiting to run
Build Docker image / build ${{ matrix.platform }} (digest-linux-arm64, docker-arm64, linux/arm64, ubuntu-24.04-arm) (push) Waiting to run
Build Docker image / publish multiarch tags (push) Blocked by required conditions
Run linters / lint (push) Waiting to run
Build Pip package / build (push) Waiting to run
Release State / release-state (push) Waiting to run
Parallel Tests / Discover test files (push) Waiting to run
Parallel Tests / ${{ matrix.test.name }} (push) Blocked by required conditions
Parallel Tests / ${{ matrix.plugin.name }} (push) Blocked by required conditions
Run tests / python_tests (ubuntu-22.04, 3.13) (push) Waiting to run
Run tests / docker_tests (push) Waiting to run
Update Homebrew tap / dispatch (push) Waiting to run
2026-06-11 01:02:09 -07:00
Nick Sweeting
e6091cf50e
Capture deploy version warnings 2026-06-11 00:59:55 -07:00
Nick Sweeting
77500bfac8
Fix dev deploy image selection 2026-06-11 00:56:28 -07:00
Nick Sweeting
bb598b9710
release: archivebox 0.9.35rc23 2026-06-11 00:41:34 -07:00
Nick Sweeting
9d5ed1bc42
release: archivebox 0.9.35rc21 2026-06-11 00:08:54 -07:00
Nick Sweeting
585c951aa7
release: archivebox 0.9.35rc20 2026-06-11 00:00:21 -07:00
Nick Sweeting
635e318647
Use PyPI version endpoint in release wait 2026-06-10 23:45:16 -07:00
Nick Sweeting
1da4b79e9d
Make dev stack release resumable after PyPI lag 2026-06-10 23:43:27 -07:00
Nick Sweeting
303e99258c
Simplify Docker data ownership detection 2026-06-10 09:13:02 -07:00
Nick Sweeting
9c29724efa
Allow selecting Docker release registries 2026-06-09 23:31:07 -07:00
Nick Sweeting
98aecfaf91
release: archivebox 0.9.35rc8 2026-06-09 23:12:22 -07:00
Nick Sweeting
a5e419ca3f
release: archivebox 0.9.35rc6 2026-06-09 22:45:25 -07:00
Nick Sweeting
2b71254fe9
Restore Docker lib root under opt archivebox 2026-06-08 04:44:40 -07:00
Nick Sweeting
1bb51ca9ee
Repair abxbus cache ownership at Docker startup 2026-06-08 04:30:12 -07:00
Nick Sweeting
4fa90e484a
release: archivebox 0.9.34rc71 2026-06-07 20:51:28 -07:00
Nick Sweeting
87b518314a
release: archivebox 0.9.34rc67 2026-06-07 04:06:45 -07:00