ansuz
b56c73be6e
delegate more work from getOlderHistory to the worker
2020-04-17 17:01:47 -04:00
ansuz
fd169ff39c
close streams after 2 minutes instead of 5
...
Hopefully this helps to even out our memory and CPU usage.
There's also some improved labels so that IF streams time out
we will know the exact origin of the offending call.
2020-04-17 15:05:48 -04:00
ansuz
bac8ef3c6e
lint compliance
2020-04-17 11:43:54 -04:00
ansuz
4e57e390da
write tasks inside of workers
2020-04-16 16:37:24 -04:00
ansuz
ba6faca02e
make the number of workers configurable
2020-04-16 13:53:45 -04:00
ansuz
0465f31a45
add a FIXME note
2020-04-16 13:02:27 -04:00
ansuz
04ab7f538a
recover from worker faults and unify worker types
2020-04-16 13:02:07 -04:00
ansuz
e0a6852b79
correctly serialize an error log
2020-04-16 10:45:18 -04:00
ansuz
9ed82640bf
Merge branch 'worker-queue' into staging
2020-04-15 19:32:42 -04:00
ansuz
e8b1fcf710
solve some cases where crashing workers could result in an invalid state for the queue
2020-04-15 13:59:54 -04:00
ansuz
9ed26cfeb0
lint compliance
2020-04-15 12:40:18 -04:00
ansuz
dc0460780f
Merge branch 'soon' into staging
2020-04-15 09:44:30 -04:00
ansuz
74567e0cf4
return process memory usage in GET CACHE STATS RPC
2020-04-14 15:53:58 -04:00
Martin Alexander Neumann
e3f42cbc20
Allow config.defaultStorageLimit to be zero bytes
2020-04-11 20:46:09 +02:00
ansuz
89262cd29e
resolve silly conflict and merge staging
2020-04-09 16:35:24 -04:00
ansuz
e527867e2e
queue blob and channel deletions per-user
2020-04-09 16:29:52 -04:00
ansuz
bd3e18d1a8
only cache a user's pinned channels if there are no errors when loading them
2020-04-08 12:08:26 -04:00
ansuz
bef18a9320
hotfix
2020-04-08 10:28:26 -04:00
ansuz
7fac997e93
increase some file storage timeouts related to streams
2020-04-08 09:38:48 -04:00
ansuz
95965c1dee
keep a parallel implementation of the pin loader to validate the new one
2020-04-07 20:03:41 -04:00
ansuz
a57bf94058
remove XXX note
2020-04-06 11:31:31 -04:00
ansuz
c53675c9d5
WIP worker rpc call queue
2020-04-06 10:28:26 -04:00
ansuz
d802173325
remove an invalid line
2020-04-06 10:18:11 -04:00
ansuz
2b3f6e3464
Merge branch 'soon' into staging
2020-04-03 10:49:51 -04:00
ansuz
adfd1eaaa2
avoid a silly typeError in the event of an error
2020-04-02 22:57:57 -04:00
yflory
32406a5995
Merge branch 'master' into staging
2020-04-02 10:23:09 +02:00
ansuz
834c96a4fc
update comments and remove some notes
2020-04-01 17:43:40 -04:00
ansuz
ed5d97f899
WIP history-keeper fixes
2020-04-01 11:48:16 -04:00
ansuz
eddbe80eef
Merge branch 'soon' into staging
2020-03-30 18:30:34 -04:00
ansuz
3d8e78a268
fix overly broad config interpretation for daily check
2020-03-30 18:27:14 -04:00
ansuz
e6ec891d9a
improve admin rpc for diagnosing memory used by the cache
2020-03-30 18:26:04 -04:00
ansuz
77961e3954
trim lookup tables for channels without checkpoints
2020-03-30 18:03:37 -04:00
ansuz
db9eaa8d4f
Merge branch 'soon' into staging
2020-03-27 19:59:45 -04:00
ansuz
6d0dee979a
allow admins to inspect index/metadata caches
2020-03-27 19:59:26 -04:00
ansuz
cbd3547814
remove log statements
2020-03-27 17:20:57 -04:00
ansuz
9058a59555
reassign db tasks if the responsible worker fails
2020-03-27 17:17:42 -04:00
ansuz
172823c954
lint compliance
2020-03-27 16:59:41 -04:00
ansuz
b5649707d1
export 'tryParse' command
2020-03-27 15:36:34 -04:00
ansuz
64b0879984
improve logging for parse errors
2020-03-27 15:15:54 -04:00
ansuz
3f86b6141e
rename worker processes
2020-03-27 15:14:45 -04:00
ansuz
d8a88cb4ca
run expiration tasks in a worker instead of the main process
2020-03-27 14:38:58 -04:00
ansuz
b0179eaad9
drop XXX note
2020-03-27 14:25:07 -04:00
ansuz
9dbd32758a
improve worker logging and move blob deletion to worker processes as well
2020-03-27 13:38:27 -04:00
ansuz
5f69fc18d0
suppress some noisy errors
2020-03-26 17:11:43 -04:00
ansuz
5f2d7c8dcf
increase worker rpc wait time before timeout
2020-03-26 15:53:00 -04:00
ansuz
33e8e65507
handle errors in the server's workers
2020-03-26 15:13:20 -04:00
ansuz
a4c8039cc7
improve error handling with rpc response API
2020-03-26 14:45:24 -04:00
ansuz
cb53bd1c15
lint compliance
2020-03-26 14:44:37 -04:00
yflory
e15196bd53
Merge branch 'reconnect' into staging
2020-03-26 15:24:38 +01:00
ansuz
14feef1757
calculate pin list checksums in a worker
2020-03-25 18:37:42 -04:00
