Commit Graph

59 Commits

Author SHA1 Message Date
yflory
358ef47319 Fix eviction with large pin logs 2025-04-02 17:10:23 +02:00
yflory
07096a9e25 Reduce server memory usage when accessing document history 2025-02-19 18:35:32 +01:00
yflory
f9e3ae1a8d
Merge pull request #1566 from cryptpad/better-metadata
Server optimization when computing metadata
2024-09-09 13:27:52 +02:00
yflory
44aee13a56 Compute new metadata first and fallback to old system if needed 2024-07-15 12:02:07 +02:00
yflory
5383f9ef1c Fix potential memory leak 2024-07-04 11:33:43 +02:00
Wolfgang Ginolas
1f54b8b26d Tighten eslint rules 2024-04-05 08:35:01 +02:00
Wolfgang Ginolas
fdc86ab130 Remove jshint 2024-03-01 07:44:00 +01:00
Wolfgang Ginolas
158164fbbe Added eslint and ignored most of the warnings and fixed some 2024-03-01 07:44:00 +01:00
David Benque
fde1edd508 Clean old // XXX comments
- either removed or changed the comment type
2023-12-08 15:10:19 +00:00
David Benque
8f0a6319a5 Apply headers 2023-10-20 15:35:26 +01:00
yflory
f282db9121 Add new placeholder data and account script to admin panel 2023-09-14 17:49:16 +02:00
yflory
235d5594f7 Detect placeholder when reading metadata 2023-09-13 16:54:05 +02:00
yflory
91af47994b Placeholder on file deletion 2023-09-07 17:03:20 +02:00
yflory
5807b4dddf Reduce memory usage for the eviction script 2023-08-21 12:45:18 +02:00
yflory
cf17b6924a Fix typo in regex when listing channels 2023-07-20 16:28:31 +02:00
yflory
5d350f1c45 Merge branch 'form' into form-del 2022-10-26 17:51:10 +02:00
yflory
bde6bb0032 Clean server code 2022-10-14 16:53:38 +02:00
yflory
8a3be878e8 Merge branch 'staging' into form-del 2022-10-12 17:19:22 +02:00
yflory
c3df1bb0ec Use flag in pad metadata to allow line deletion in file 2022-10-12 17:17:58 +02:00
yflory
6a1c64fe9a Delete your own form answers 2022-10-06 17:12:23 +02:00
ansuz
863ab4f380 Merge branch 'soon' into absolute-paths 2022-10-06 15:34:05 +05:30
ansuz
333ba82970 allow admins to overwrite live data with archived data when both exist 2022-09-13 18:32:50 +05:30
ansuz
a93ab05310 handle absolute paths in a few obviously problematic cases 2021-11-22 18:16:35 +05:30
ansuz
caece0123e archive pin logs instead of removing them outright 2021-06-25 20:22:16 +05:30
yflory
7971a6d267 Major broadcast refactoring 2021-03-16 17:00:23 +01:00
ansuz
de90949e3e suppress ENOENT on metadata when restoring archived files 2020-12-11 20:12:36 +05:30
David Benqué
5e7eb4cbf8 Merge branch 'soon' into staging 2020-12-04 13:39:47 +00:00
ansuz
d4e6d86961 enforce asynchrony in new database offset methods 2020-11-27 08:21:51 +05:30
ansuz
466072d03b read files starting from the oldest known point of relevance when computing indices 2020-11-26 12:15:02 +05:30
yflory
bd4b44476d Archive and restore UI in the admin panel 2020-11-18 16:49:40 +01:00
ansuz
d72e053560 make a note to improve stream timeout error handling 2020-10-22 11:24:58 +05:30
ansuz
67430de7ff Make efforts to avoid closing streams mid-read
1. Close streams when you're done with them
2. Close streams if they seem to have been abandoned
2020-10-22 11:17:03 +05:30
ansuz
6e57366b7f address a file descriptor leak 2020-10-13 13:14:39 +05:30
ansuz
46ebd7b40b remove unsupported storage configuration parameters 2020-10-12 17:40:21 +05:30
ansuz
5358fab615 more WIP inactive account eviction 2020-09-29 18:04:51 +05:30
ansuz
d794e0b48f include inactive accounts in the archival script 2020-09-24 19:02:22 +05:30
ansuz
b04133e6c3 remove some dead code 2020-07-23 09:28:00 -04:00
ansuz
fd169ff39c close streams after 2 minutes instead of 5
Hopefully this helps to even out our memory and CPU usage.
There's also some improved labels so that IF streams time out
we will know the exact origin of the offending call.
2020-04-17 15:05:48 -04:00
ansuz
7fac997e93 increase some file storage timeouts related to streams 2020-04-08 09:38:48 -04:00
ansuz
d802173325 remove an invalid line 2020-04-06 10:18:11 -04:00
ansuz
adfd1eaaa2 avoid a silly typeError in the event of an error 2020-04-02 22:57:57 -04:00
ansuz
bc13a21796 give fileStreams a little bit more time before closing them 2020-03-25 11:50:45 -04:00
ansuz
c2fcba31e3 remove an XXX 2020-03-24 15:02:46 -04:00
ansuz
e128683ffb call back with errors instead of throwing within the Storage module 2020-03-24 13:31:03 -04:00
yflory
dc0b26da0b Merge branch 'soon' into staging 2020-03-23 12:33:17 +01:00
ansuz
ed63d98ab0 Merge branch 'scaling-index' into soon 2020-03-20 18:57:51 -04:00
ansuz
590e249500 resolve merge conflict 2020-03-20 13:07:35 -04:00
ansuz
31c7cecaf9 add a few checks for safety 2020-03-20 10:54:01 -04:00
ansuz
d386e223e4 simplify open/close of writeStreams 2020-03-19 17:33:22 -04:00
ansuz
32cd0f3c4d increase timeout value from 15s to 45. ought to be enough for anybody 2020-03-19 16:13:24 -04:00