58 Commits

Author	SHA1	Message	Date
ansuz	911c15df25	fix incorrectly constructed archival path for blobs	2023-01-19 08:56:32 +05:30
yflory	5d350f1c45	Merge branch 'form' into form-del	2022-10-26 17:51:10 +02:00
yflory	bde6bb0032	Clean server code	2022-10-14 16:53:38 +02:00
yflory	8a3be878e8	Merge branch 'staging' into form-del	2022-10-12 17:19:22 +02:00
yflory	c3df1bb0ec	Use flag in pad metadata to allow line deletion in file	2022-10-12 17:17:58 +02:00
yflory	6a1c64fe9a	Delete your own form answers	2022-10-06 17:12:23 +02:00
ansuz	863ab4f380	Merge branch 'soon' into absolute-paths	2022-10-06 15:34:05 +05:30
ansuz	333ba82970	allow admins to overwrite live data with archived data when both exist	2022-09-13 18:32:50 +05:30
ansuz	60e58e8f7a	first version of admin 'database' tab	2022-08-11 11:53:03 +05:30
ansuz	dae6d7fc1e	add hints for translation linting and remove notes	2022-03-25 16:53:10 +05:30
ansuz	c111364024	add two new tests to diagnose unavailability of uploaded blocks and blobs	2022-03-08 18:20:11 +05:30
ansuz	ef398de4a1	disable measurement	2022-03-08 11:03:32 +05:30
ansuz	b65730b853	allow admins to enable configurable disk I/O profiling	2022-03-07 18:42:00 +05:30
ansuz	a93ab05310	handle absolute paths in a few obviously problematic cases	2021-11-22 18:16:35 +05:30
ansuz	7bdabb5cbc	archive blocks before overwriting them	2021-07-06 15:42:37 +05:30
ansuz	f7f2146fa5	miscellaneous cleanup and notes	2021-06-30 19:09:53 +05:30
ansuz	ba1a7b37e1	separate validation and storage methods for blocks	2021-06-28 14:39:26 +05:30
ansuz	caece0123e	archive pin logs instead of removing them outright	2021-06-25 20:22:16 +05:30
ansuz	729d51fb9b	update block storage APIs	2021-04-29 13:32:19 +05:30
yflory	7971a6d267	Major broadcast refactoring	2021-03-16 17:00:23 +01:00
ansuz	de90949e3e	suppress ENOENT on metadata when restoring archived files	2020-12-11 20:12:36 +05:30
David Benqué	5e7eb4cbf8	Merge branch 'soon' into staging	2020-12-04 13:39:47 +00:00
ansuz	d4e6d86961	enforce asynchrony in new database offset methods	2020-11-27 08:21:51 +05:30
ansuz	466072d03b	read files starting from the oldest known point of relevance when computing indices	2020-11-26 12:15:02 +05:30
ansuz	cd77b5ffc8	Merge branch 'soon' into staging	2020-11-19 13:18:08 +05:30
yflory	bd4b44476d	Archive and restore UI in the admin panel	2020-11-18 16:49:40 +01:00
ansuz	e185008846	complete uploads in child processes ... also fix a nasty race condition for unowned file uploads	2020-11-18 18:26:21 +05:30
ansuz	d72e053560	make a note to improve stream timeout error handling	2020-10-22 11:24:58 +05:30
ansuz	67430de7ff	Make efforts to avoid closing streams mid-read ... 1. Close streams when you're done with them 2. Close streams if they seem to have been abandoned	2020-10-22 11:17:03 +05:30
ansuz	e8428a2a73	prevent a case of multiple callbacks	2020-10-21 18:13:10 +05:30
ansuz	6e57366b7f	address a file descriptor leak	2020-10-13 13:14:39 +05:30
ansuz	46ebd7b40b	remove unsupported storage configuration parameters	2020-10-12 17:40:21 +05:30
ansuz	5358fab615	more WIP inactive account eviction	2020-09-29 18:04:51 +05:30
ansuz	d794e0b48f	include inactive accounts in the archival script	2020-09-24 19:02:22 +05:30
ansuz	b04133e6c3	remove some dead code	2020-07-23 09:28:00 -04:00
ansuz	fd169ff39c	close streams after 2 minutes instead of 5 ... Hopefully this helps to even out our memory and CPU usage. There's also some improved labels so that IF streams time out we will know the exact origin of the offending call.	2020-04-17 15:05:48 -04:00
ansuz	7fac997e93	increase some file storage timeouts related to streams	2020-04-08 09:38:48 -04:00
ansuz	d802173325	remove an invalid line	2020-04-06 10:18:11 -04:00
ansuz	adfd1eaaa2	avoid a silly typeError in the event of an error	2020-04-02 22:57:57 -04:00
ansuz	bc13a21796	give fileStreams a little bit more time before closing them	2020-03-25 11:50:45 -04:00
ansuz	c2fcba31e3	remove an XXX	2020-03-24 15:02:46 -04:00
ansuz	e128683ffb	call back with errors instead of throwing within the Storage module	2020-03-24 13:31:03 -04:00
yflory	dc0b26da0b	Merge branch 'soon' into staging	2020-03-23 12:33:17 +01:00
ansuz	ed63d98ab0	Merge branch 'scaling-index' into soon	2020-03-20 18:57:51 -04:00
ansuz	590e249500	resolve merge conflict	2020-03-20 13:07:35 -04:00
ansuz	31c7cecaf9	add a few checks for safety	2020-03-20 10:54:01 -04:00
ansuz	d386e223e4	simplify open/close of writeStreams	2020-03-19 17:33:22 -04:00
ansuz	32cd0f3c4d	increase timeout value from 15s to 45. ought to be enough for anybody	2020-03-19 16:13:24 -04:00
ansuz	05a4e86cdb	close streams whenever we finish using them. time out if necessary	2020-03-19 16:11:24 -04:00
ansuz	4522ffa18a	compute indexes in child processes	2020-03-19 10:46:18 -04:00