Commit Graph

3406 Commits

Author SHA1 Message Date
Nick Sweeting
3830544e13
Update Docker runtime dependencies
Some checks failed
Build Debian package / build (push) Has been cancelled
Build Docker image / buildx (push) Has been cancelled
Build Homebrew package / build (push) Has been cancelled
Run linters / lint (push) Has been cancelled
Build Pip package / build (push) Has been cancelled
Run tests / python_tests (ubuntu-22.04, 3.11) (push) Has been cancelled
Run tests / docker_tests (push) Has been cancelled
2026-05-18 02:24:38 -07:00
Nick Sweeting
913542c19f
Release v0.7.4 2026-05-18 02:00:33 -07:00
Nick Sweeting
f603a0dfff
fix: skip URL entries in save_text_as_source to prevent Path() errors (#1787)
Some checks failed
Build Debian package / build (push) Has been cancelled
Build Docker image / buildx (push) Has been cancelled
Build Homebrew package / build (push) Has been cancelled
Run linters / lint (push) Has been cancelled
Build Pip package / build (push) Has been cancelled
Run tests / python_tests (ubuntu-22.04, 3.11) (push) Has been cancelled
Run tests / docker_tests (push) Has been cancelled
## Fix for Issue #1000

When using `archivebox add --parser=wallabag_atom <feed_url>`, the raw
feed URL was being processed by `save_text_as_source()` which splits on
whitespace and passes each token to `Path()`. URLs get broken and
treated as local file paths, causing spurious "No such file" errors and
random file paths to be accessed.

### Root Cause
Commit a676767 added file-referencing logic to `save_text_as_source()`.
URLs in the raw text (like wallabag feed URLs) get split into fragments
that `Path()` then tries to read as local files.

### Fix
Skip entries that look like URLs (`http://`, `https://`, `ftp://`)
before calling `Path().exists()`.

### Testing
Run: `curl <wallabag_feed_url> | archivebox add --parser=wallabag_atom`

Fixes #1000


<!-- This is an auto-generated description by cubic. -->
---
## Summary by cubic
Skip URL tokens (`http://`, `https://`, `ftp://`) in
`save_text_as_source()` to avoid passing them to `Path()`, preventing
"No such file" errors when adding Wallabag Atom feeds. Fixes #1000.

<sup>Written for commit 5e47e055a2.
Summary will update on new commits.</sup>

<!-- End of auto-generated description by cubic. -->
2026-04-17 10:11:22 -07:00
zkksdk
5e47e055a2 fix: skip URL entries in save_text_as_source to prevent Path() errors
When raw_text contains URLs (e.g. from wallabag_atom parser), split()
breaks them into fragments that Path() tries to read as local files.
This causes spurious "No such file" errors and random paths to be
accessed. Skip entries that look like URLs before checking Path.exists().

Fixes #1000
2026-04-18 00:25:10 +08:00
Nick Sweeting
d1136d74cb
fix docker release script 2024-12-15 02:06:49 -08:00
Nick Sweeting
54f598789e
bump more js and py dependency lockfiles 2024-12-15 00:33:03 -08:00
Nick Sweeting
5171eaf31e
bump dependencies and metadata for 0.7.3 2024-12-15 00:25:35 -08:00
Nick Sweeting
315c9f3844
0.7.2 Release Candidate (#1297) 2024-01-04 19:27:19 -08:00
Nick Sweeting
2ef3655d21
fix python version in build tests 2024-01-04 19:26:54 -08:00
Nick Sweeting
fc2bd4a2d5
Update pip.yml 2024-01-04 19:23:26 -08:00
Nick Sweeting
79979d4d05
Update pip.yml 2024-01-04 19:20:03 -08:00
Nick Sweeting
310dede977 limit python version upper bound to 3.11 2024-01-04 19:18:49 -08:00
Nick Sweeting
0353d6b316
Update pip.yml 2024-01-04 19:02:46 -08:00
Nick Sweeting
f695b30d36
Update pip.yml 2024-01-04 18:59:34 -08:00
Nick Sweeting
df56e993f2
Update pip.yml 2024-01-04 18:51:59 -08:00
Nick Sweeting
41e6a0f215
Update debian.yml 2024-01-04 18:50:41 -08:00
Nick Sweeting
e4f1503965
Update test.yml 2024-01-04 18:34:00 -08:00
Nick Sweeting
d23fe6a594
Update test.yml 2024-01-04 18:28:03 -08:00
Nick Sweeting
3840265cef
Update test.yml 2024-01-04 18:21:27 -08:00
Nick Sweeting
7842ca49d1
Update test.yml 2024-01-04 17:59:18 -08:00
Nick Sweeting
c43f861f6f
Update test.yml 2024-01-04 17:55:52 -08:00
Nick Sweeting
10dc9922de
Update test.yml 2024-01-04 17:39:45 -08:00
Nick Sweeting
ffcd1640da
Update test.yml 2024-01-04 17:34:37 -08:00
Nick Sweeting
3247866d3a
Update test.yml to install packages needed by ldap 2024-01-04 17:30:59 -08:00
Nick Sweeting
490b765d5b add dev deps to lockfile 2024-01-04 17:24:31 -08:00
Nick Sweeting
3ddc0c7f7a fix free space calculation and make it based on absolute values instead of pcts 2024-01-04 17:24:31 -08:00
Nick Sweeting
3ee3916b29
Update test.yml to fix python builds 2024-01-04 17:24:10 -08:00
Nick Sweeting
2bb6dca294 check for available disk space on docker root fs and data volume and improve shell requoting 2024-01-04 15:58:45 -08:00
Nick Sweeting
48c9a49d56 fix shell re-quoting in docker_entrypoint.sh so that quoted subcommands can be passed in 2024-01-04 15:10:10 -08:00
Nick Sweeting
83eede54da fix docker image in compose file 2024-01-04 14:59:08 -08:00
Nick Sweeting
a0f01a543d minor readme tweaks 2024-01-04 14:58:41 -08:00
Nick Sweeting
30fd005605 more minor README tweaks 2024-01-04 13:58:33 -08:00
Nick Sweeting
71ca0b27a8 minor formatting and wording improvements to README 2024-01-04 13:47:21 -08:00
Nick Sweeting
4479d3fb17 add Learn More sections to README 2024-01-04 13:32:08 -08:00
Nick Sweeting
64ddab3750 add more data to archive layout section 2024-01-04 12:44:27 -08:00
Nick Sweeting
1532186283 Merge branch 'main' into dev 2024-01-04 12:30:46 -08:00
Nick Sweeting
64bfd7667e collapse README sections to reduce length and link to PUID PGID and root_squash info 2024-01-04 12:30:21 -08:00
Nick Sweeting
6f1d4e477b move README images from imgur to Github assets hosting 2024-01-04 12:29:38 -08:00
Nick Sweeting
a215b38681 update dompurify version 2024-01-04 11:43:50 -08:00
Nick Sweeting
94b132818d fix lint errors 2024-01-04 11:41:12 -08:00
Nick Sweeting
5df7b258bd bump version of dev build to 0.7.2 2024-01-03 20:37:00 -08:00
Nick Sweeting
c1fd2cfa42 tag URLs immediately once added instead of waiting until archival completes 2024-01-03 20:31:46 -08:00
Nick Sweeting
8ab17f0561 add tag support to schedule command 2024-01-03 20:31:14 -08:00
Nick Sweeting
f775da299a show command to enter docker container in failed command output hint when IN_DOCKER=True 2024-01-03 20:12:03 -08:00
Nick Sweeting
b9e05b2abe quote URLs in failure message hint output to make copy-pasting easier 2024-01-03 20:11:30 -08:00
Nick Sweeting
db2984e47b prefer dom dump to singlefile for generating readability output 2024-01-03 20:11:06 -08:00
Nick Sweeting
78d942ac22 show more detail in readabiliity error messages 2024-01-03 20:09:31 -08:00
Nick Sweeting
c26d9dc1bb link to exact build commit hash in public index footer 2024-01-03 20:09:04 -08:00
Nick Sweeting
ceabc4e12e fix CHROME_USER_AGENT not interpolating inline config variables 2024-01-03 20:08:39 -08:00
Nick Sweeting
5b07a1126c add comment about why DOM is preferred over singlefile for readability parsing 2024-01-03 19:09:24 -08:00