Commit Graph

24 Commits

Author SHA1 Message Date
Erik Thuning
6c11d5578f Added optional support for user-specified notification endpoints in packages 2024-03-26 15:47:39 +01:00
Erik Thuning
19498e64f9 Added logging of contents of queue files from disk and preprocessed jobs 2024-02-16 11:58:05 +01:00
Erik Thuning
b81bd64ffd Made it possible to have more than one handler of the same type
by making the handler's queue an init parameter.
2023-11-23 15:41:42 +01:00
Erik Thuning
100aa9d4dc Started caching generated package ids so they stay consistent across daemon restarts 2023-09-22 23:01:51 +02:00
Erik Thuning
c2a1cf61a0 Changed a bunch of debug messages to info, to make logging slightly less verbose if needed. 2023-08-24 14:06:39 +02:00
Erik Thuning
98595461a0 Fixed existing packages not getting loaded correctly due to a bad assumption about package base paths 2023-05-24 14:46:54 +02:00
Erik Thuning
a0996a9bba The distributor thread will no longer crash if there is more than one pending job for a single package. 2023-05-16 11:25:02 +02:00
Erik Thuning
ee5c420f4b package_id wasn't being assigned if it was supplied in the incoming package 2023-05-16 10:28:57 +02:00
Erik Thuning
8582e32f1d Finished updating docstrings to conform to convention. Also made abstract methods throw an exception if they get called. 2023-03-28 16:43:45 +02:00
Erik Thuning
826f548e63 Create a temporary copy of the existing package state,
send that to _handle() methods and clean up after handling is done.
2023-03-15 11:04:24 +01:00
Erik Thuning
b1c74aa86b Added existing package data to handler input 2023-03-14 16:54:04 +01:00
Erik Thuning
8e7d92962f Added logging to Distributor and QueueReader 2022-12-07 16:24:21 +01:00
Erik Thuning
b11f567903 Added logging to Distributor class 2022-12-06 15:14:42 +01:00
Erik Thuning
0b06690a38 * Completed ThumbnailHandler
* Simplified writing Package to json
* Collector now accepts Handler objects instead of name strings
* Refactored Handler._handle() and its invocation from _process():
 - _handle() now returns apply_func
 - boilerplate moved into Handler._process()
 - Handlers can require other handlers to finish before them
2022-10-22 00:19:03 +02:00
Erik Thuning
eb9f0b7371 Renamed QueueThread._handle() to ._process()
Renamed Preprocessor._handle() to ._preprocess()
Consistency updates to all subclasses
2022-10-21 23:15:38 +02:00
Erik Thuning
3ce89b8056 Package IDs are now properly handled at the start of the pipeline 2022-10-19 17:01:29 +02:00
Erik Thuning
3ab654d485 Moved ID generation to the distributor
so incoming jobs for new packages get consistent IDs between handlers
2022-10-19 16:20:58 +02:00
Erik Thuning
ef6bd5831d Moving to dataclasses for complex queue items 2022-10-17 17:10:16 +02:00
Erik Thuning
7d403d15cc Minor fixes 2022-10-17 13:18:58 +02:00
Erik Thuning
5c3ee40e85 made error notification calls consistent 2022-10-07 19:21:40 +02:00
Erik Thuning
f8cde16001 Started work on preprocessors 2022-10-03 16:37:56 +02:00
Erik Thuning
e888ec4f65 Cleanup 2022-10-03 14:30:47 +02:00
Erik Thuning
949eb4f04f PRogress is being made! 2022-09-27 17:38:18 +02:00
Erik Thuning
b23597e75a Getting somewhere 2022-09-23 09:49:39 +02:00