Commit Graph

127 Commits

Author SHA1 Message Date
yflory
975a177cbb Add UI/UX when reading a placeholder 2023-09-08 18:10:02 +02:00
yflory
91af47994b Placeholder on file deletion 2023-09-07 17:03:20 +02:00
yflory
c09e191a16 Blob activity archive 2023-08-30 15:59:15 +02:00
yflory
27b9c9bac3 Update blob activity when loaded 2023-08-29 17:50:39 +02:00
yflory
9be21c21c4 WIP blob metadata 2023-08-29 15:19:34 +02:00
yflory
5807b4dddf Reduce memory usage for the eviction script 2023-08-21 12:45:18 +02:00
yflory
cf17b6924a Fix typo in regex when listing channels 2023-07-20 16:28:31 +02:00
yflory
deb14c412f Fix XXX 2023-07-13 14:12:47 +02:00
yflory
d6bf625733 SSO: prototype improvements 2023-06-29 12:32:45 +02:00
yflory
b93b5eae4e SSO: OIDC login and register 2023-06-27 16:04:32 +02:00
yflory
18d6ccdfd3 SSO: OIDC auth 2023-06-23 19:06:29 +02:00
yflory
9aac9d1c2f TOTP: Use HTTP challenges to write and remove blocks 2023-06-09 15:06:17 +02:00
yflory
36a1c604d8 Auth: Disable TOTP/MFA from the admin panel 2023-05-16 15:11:43 +02:00
yflory
d789627920 TOTP setup and revocation in settings 2023-05-12 18:21:19 +02:00
ansuz
bd19288869 notes on pending improvements to add before merge/release 2023-05-11 16:42:47 +05:30
ansuz
06232ab6d7 overwriting basic storage should fail with an error 2023-05-05 18:18:46 +05:30
ansuz
3c6a35b713 new types of storage for challenges, MFA settings, and sessions 2023-05-02 23:42:09 +05:30
ansuz
0bf26588e5 Merge branch 'soon' into 5.3-storage 2023-01-19 09:57:16 +05:30
ansuz
911c15df25 fix incorrectly constructed archival path for blobs 2023-01-19 08:56:32 +05:30
ansuz
4968bbf961 WIP limit on block size 2023-01-11 14:50:16 +05:30
yflory
5d350f1c45 Merge branch 'form' into form-del 2022-10-26 17:51:10 +02:00
yflory
bde6bb0032 Clean server code 2022-10-14 16:53:38 +02:00
yflory
8a3be878e8 Merge branch 'staging' into form-del 2022-10-12 17:19:22 +02:00
yflory
c3df1bb0ec Use flag in pad metadata to allow line deletion in file 2022-10-12 17:17:58 +02:00
yflory
6a1c64fe9a Delete your own form answers 2022-10-06 17:12:23 +02:00
ansuz
863ab4f380 Merge branch 'soon' into absolute-paths 2022-10-06 15:34:05 +05:30
ansuz
333ba82970 allow admins to overwrite live data with archived data when both exist 2022-09-13 18:32:50 +05:30
ansuz
60e58e8f7a first version of admin 'database' tab 2022-08-11 11:53:03 +05:30
ansuz
dae6d7fc1e add hints for translation linting and remove notes 2022-03-25 16:53:10 +05:30
ansuz
c111364024 add two new tests to diagnose unavailability of uploaded blocks and blobs 2022-03-08 18:20:11 +05:30
ansuz
ef398de4a1 disable measurement 2022-03-08 11:03:32 +05:30
ansuz
b65730b853 allow admins to enable configurable disk I/O profiling 2022-03-07 18:42:00 +05:30
ansuz
a93ab05310 handle absolute paths in a few obviously problematic cases 2021-11-22 18:16:35 +05:30
ansuz
7bdabb5cbc archive blocks before overwriting them 2021-07-06 15:42:37 +05:30
ansuz
f7f2146fa5 miscellaneous cleanup and notes 2021-06-30 19:09:53 +05:30
ansuz
ba1a7b37e1 separate validation and storage methods for blocks 2021-06-28 14:39:26 +05:30
ansuz
caece0123e archive pin logs instead of removing them outright 2021-06-25 20:22:16 +05:30
ansuz
729d51fb9b update block storage APIs 2021-04-29 13:32:19 +05:30
yflory
7971a6d267 Major broadcast refactoring 2021-03-16 17:00:23 +01:00
ansuz
de90949e3e suppress ENOENT on metadata when restoring archived files 2020-12-11 20:12:36 +05:30
David Benqué
5e7eb4cbf8 Merge branch 'soon' into staging 2020-12-04 13:39:47 +00:00
ansuz
d4e6d86961 enforce asynchrony in new database offset methods 2020-11-27 08:21:51 +05:30
ansuz
466072d03b read files starting from the oldest known point of relevance when computing indices 2020-11-26 12:15:02 +05:30
ansuz
cd77b5ffc8 Merge branch 'soon' into staging 2020-11-19 13:18:08 +05:30
yflory
bd4b44476d Archive and restore UI in the admin panel 2020-11-18 16:49:40 +01:00
ansuz
e185008846 complete uploads in child processes
also fix a nasty race condition for unowned file uploads
2020-11-18 18:26:21 +05:30
ansuz
d72e053560 make a note to improve stream timeout error handling 2020-10-22 11:24:58 +05:30
ansuz
67430de7ff Make efforts to avoid closing streams mid-read
1. Close streams when you're done with them
2. Close streams if they seem to have been abandoned
2020-10-22 11:17:03 +05:30
ansuz
e8428a2a73 prevent a case of multiple callbacks 2020-10-21 18:13:10 +05:30
ansuz
6e57366b7f address a file descriptor leak 2020-10-13 13:14:39 +05:30
ansuz
46ebd7b40b remove unsupported storage configuration parameters 2020-10-12 17:40:21 +05:30
ansuz
5358fab615 more WIP inactive account eviction 2020-09-29 18:04:51 +05:30
ansuz
d794e0b48f include inactive accounts in the archival script 2020-09-24 19:02:22 +05:30
ansuz
b04133e6c3 remove some dead code 2020-07-23 09:28:00 -04:00
ansuz
fd169ff39c close streams after 2 minutes instead of 5
Hopefully this helps to even out our memory and CPU usage.
There's also some improved labels so that IF streams time out
we will know the exact origin of the offending call.
2020-04-17 15:05:48 -04:00
ansuz
7fac997e93 increase some file storage timeouts related to streams 2020-04-08 09:38:48 -04:00
ansuz
d802173325 remove an invalid line 2020-04-06 10:18:11 -04:00
ansuz
adfd1eaaa2 avoid a silly typeError in the event of an error 2020-04-02 22:57:57 -04:00
ansuz
bc13a21796 give fileStreams a little bit more time before closing them 2020-03-25 11:50:45 -04:00
ansuz
c2fcba31e3 remove an XXX 2020-03-24 15:02:46 -04:00
ansuz
e128683ffb call back with errors instead of throwing within the Storage module 2020-03-24 13:31:03 -04:00
yflory
dc0b26da0b Merge branch 'soon' into staging 2020-03-23 12:33:17 +01:00
ansuz
ed63d98ab0 Merge branch 'scaling-index' into soon 2020-03-20 18:57:51 -04:00
ansuz
590e249500 resolve merge conflict 2020-03-20 13:07:35 -04:00
ansuz
31c7cecaf9 add a few checks for safety 2020-03-20 10:54:01 -04:00
ansuz
d386e223e4 simplify open/close of writeStreams 2020-03-19 17:33:22 -04:00
ansuz
32cd0f3c4d increase timeout value from 15s to 45. ought to be enough for anybody 2020-03-19 16:13:24 -04:00
ansuz
05a4e86cdb close streams whenever we finish using them. time out if necessary 2020-03-19 16:11:24 -04:00
ansuz
4522ffa18a compute indexes in child processes 2020-03-19 10:46:18 -04:00
ansuz
f345998956 fix undefined reference 2020-03-17 10:10:20 -04:00
ansuz
30f17040ac close streams when possible, simplify some code, enforce asynchrony 2020-03-16 16:13:38 -04:00
ansuz
e1a0daac9c possible server fixes 2020-03-12 11:23:43 -04:00
ansuz
d4038344ba stop iterating over tasks if you can't read the root directory 2020-03-11 16:34:00 -04:00
ansuz
32d769447a begin standardizing our method of streaming lines from files 2020-03-04 11:38:14 -05:00
ansuz
35eca2c5d2 pull file streaming out into its own file, leave a few notes 2020-03-04 11:38:14 -05:00
ansuz
ff73e96cb8 reimplement the trim history fix from staging 2020-02-17 12:02:49 -05:00
ansuz
725d10fc60 nest storage directory inside './lib' 2020-02-14 16:29:30 -05:00