Commit Graph

  • 51c67e9737 Fixed duration keyts still being around in places where they shouldn't Erik Thuning 2023-04-20 14:02:12 +02:00
  • 0e08ae3f12 Uploaded files in subdirectories are now handled properly Erik Thuning 2023-04-14 15:52:14 +02:00
  • 06eb7dc233 Error notifications no longer cause the entire job to be deleted. Preparing for improved mid-job error handling and fixed a bug involving the temporary package copy's basedir not existing Erik Thuning 2023-04-14 15:06:27 +02:00
  • 0f0c97125f Added an FFmpegException type Erik Thuning 2023-04-14 15:05:56 +02:00
  • 9a372df9f6 Updated ERADME to reflect new course format Erik Thuning 2023-04-14 15:05:23 +02:00
  • 953181cdcb Updated the tests to use the new course syntax Erik Thuning 2023-04-14 15:02:07 +02:00
  • 480846b617 Refactored the temporary copy function and moved creation of the base directory for a package Erik Thuning 2023-04-14 15:01:09 +02:00
  • ab1d3bd86a Removed on_modified handling since it triggers unexpectedly Erik Thuning 2023-04-14 14:23:29 +02:00
  • 9bceb4c000 Added pickup of existing jobs on startup, and added handling of modified files Erik Thuning 2023-04-14 11:20:53 +02:00
  • 8c25f811c6 Updated the course format in the validation objects Erik Thuning 2023-04-14 11:19:11 +02:00
  • 1d44234c3c Fixed a number of bugs in the cattura preprocessor Erik Thuning 2023-04-14 11:18:23 +02:00
  • 6c48c103b1 The format for a course has changed, updated the thumbnail generation logic to match Erik Thuning 2023-04-14 11:16:07 +02:00
  • b15bcfb652 Temporarily(?) removed the requirement of at least one video stream having to play audio Erik Thuning 2023-04-14 11:15:11 +02:00
  • 6bee8a7e1c parseSemester had a few bugs, fixed Erik Thuning 2023-04-14 11:14:38 +02:00
  • 9d10f63587 Temporary files are now cleaned out when the daemon starts up Erik Thuning 2023-04-14 11:13:49 +02:00
  • 8dd40f95a5 Changed the name of the run script to be more easily identifiable. Also updated the example systemd unit Erik Thuning 2023-04-04 11:41:22 +02:00
  • 320bacb3b8 Added missing import Erik Thuning 2023-04-04 11:34:43 +02:00
  • 23a09b651e Updated README with more details Erik Thuning 2023-03-30 15:23:17 +02:00
  • 8582e32f1d Finished updating docstrings to conform to convention. Also made abstract methods throw an exception if they get called. Erik Thuning 2023-03-28 16:43:45 +02:00
  • 132f657ddb Fixed docstrings to follow convention Erik Thuning 2023-03-27 17:20:47 +02:00
  • 35334a1af2 Added a comment Erik Thuning 2023-03-27 17:20:39 +02:00
  • 5dcc856177 Moved some functions from utils into more logical places, and opportunistically fixed docstrings to follow the convention Erik Thuning 2023-03-27 17:01:59 +02:00
  • 6b7fff6294 Fixed erorr notifications crashing the test Erik Thuning 2023-03-27 17:00:47 +02:00
  • 278fe30b02 Refactored subtitles handling to include generation via whisper. Erik Thuning 2023-03-27 16:36:27 +02:00
  • d25eeda71e Added missing import Erik Thuning 2023-03-17 10:14:50 +01:00
  • 870c832ac0 Documentation updates Erik Thuning 2023-03-16 07:40:32 +01:00
  • e310f9c529 Refactored the ldap class to use a new connection for each request. This eliminates dangling connections. Erik Thuning 2023-03-15 11:04:49 +01:00
  • 826f548e63 Create a temporary copy of the existing package state, send that to _handle() methods and clean up after handling is done. Erik Thuning 2023-03-15 09:53:24 +01:00
  • b1c74aa86b Added existing package data to handler input Erik Thuning 2023-03-14 16:54:04 +01:00
  • df0a0419b6 Fixed typo Erik Thuning 2023-03-14 16:39:32 +01:00
  • 6fd3c3b256 Removed obsolete comment Erik Thuning 2023-03-14 16:32:28 +01:00
  • b8834ce7d6 Renamed utils.ffmpegjob to utils.asyncjob in preparation for also running whisper jobs through the same function Erik Thuning 2023-03-10 15:45:00 +01:00
  • e2adf73aa6 Added tests for handling of invalid queue items Erik Thuning 2022-12-07 16:27:16 +01:00
  • 8e7d92962f Added logging to Distributor and QueueReader Erik Thuning 2022-12-07 16:24:21 +01:00
  • a12fc96d67 asdict() call was missing from http notification function Erik Thuning 2022-12-07 16:14:11 +01:00
  • cf92d2490c Logging in notifier Erik Thuning 2022-12-07 16:13:53 +01:00
  • a37323a796 Reformatted log line Erik Thuning 2022-12-07 16:12:02 +01:00
  • f006df7149 Abstract methods now raise NotImplementedError; properly log errors in subprocesses Erik Thuning 2022-12-07 14:04:44 +01:00
  • 286891ef77 Updated documentation to reflect new course format Erik Thuning 2022-12-07 11:35:28 +01:00
  • de94d89814 Logging each start of processing on a queue item Erik Thuning 2022-12-07 11:12:18 +01:00
  • 82eb9d110c Added a deduplicating log handler for the stderr logger Erik Thuning 2022-12-06 16:06:31 +01:00
  • b11f567903 Added logging to Distributor class Erik Thuning 2022-12-06 15:14:42 +01:00
  • 517a5a1e55 Logging handlers are now cleared on pipeline creation Erik Thuning 2022-12-06 15:12:48 +01:00
  • feb1e1701a Changed the course format returned by get_booking() to a dict including both course designation and semester Erik Thuning 2022-12-06 14:52:39 +01:00
  • 3c276ecde3 Added logging Erik Thuning 2022-11-28 16:28:47 +01:00
  • 288d2665bf Flip-flopping on string quotes Erik Thuning 2022-11-28 16:28:32 +01:00
  • a8ecc469dd The superclass already has self.logger Erik Thuning 2022-11-28 16:15:26 +01:00
  • c42e4cb72e Added logging to notifier Erik Thuning 2022-11-28 16:08:36 +01:00
  • ccead70ed3 Made string quotes consistent Erik Thuning 2022-11-28 15:58:09 +01:00
  • bee9b78a8f Added startup/shutdown logging to QueueThread Erik Thuning 2022-11-28 15:54:59 +01:00
  • c9349ae30b Added logging Erik Thuning 2022-11-28 11:40:43 +01:00
  • 46bff015aa Added ThumbnailHandler config section Erik Thuning 2022-11-28 11:39:43 +01:00
  • 905d7f2f01 Fixed various slop so tests pass Erik Thuning 2022-10-31 14:16:04 +01:00
  • be6a7877d7 Refactored poster handling to always be done in PosterHandler. Also improved docstrings and implemented removal of superseded video and poster files. Erik Thuning 2022-10-28 14:18:24 +02:00
  • dac19f6f7f Added the option of multiple subtitle tracks Erik Thuning 2022-10-28 11:20:47 +02:00
  • 1957b59e85 The poster handler now generates posters for existing streams if the job contains a falsy 'poster' value for a stream with no 'video' key. Erik Thuning 2022-10-24 16:52:32 +02:00
  • df64ccffb0 The exception shouldn't cause exceptions Erik Thuning 2022-10-24 16:48:14 +02:00
  • 6291b66c86 Capitalized all sections in config Implemented HTTP notification Erik Thuning 2022-10-24 16:47:24 +02:00
  • c8c2d04ed3 Wording change Erik Thuning 2022-10-24 16:38:32 +02:00
  • 0b06690a38 * Completed ThumbnailHandler * Simplified writing Package to json * Collector now accepts Handler objects instead of name strings * Refactored Handler._handle() and its invocation from _process(): - _handle() now returns apply_func - boilerplate moved into Handler._process() - Handlers can require other handlers to finish before them Erik Thuning 2022-10-21 23:45:27 +02:00
  • eb9f0b7371 Renamed QueueThread._handle() to ._process() Renamed Preprocessor._handle() to ._preprocess() Consistency updates to all subclasses Erik Thuning 2022-10-21 23:15:38 +02:00
  • c90ea5966f Allow None in package for duration and creation Erik Thuning 2022-10-21 23:12:31 +02:00
  • 3716d3dc0b Revert "Forgot to remove an import" Erik Thuning 2022-10-21 16:34:59 +02:00
  • 1a5cade01d Didn't read the docs properly, my solution was correct from the beginning This reverts commit a12374b35259cc5c3a9152de6b32c2ede093f2fa. Erik Thuning 2022-10-21 16:34:18 +02:00
  • 5734d954a6 Forgot to remove an import Erik Thuning 2022-10-21 16:24:26 +02:00
  • a494322a08 Don't need fallbacks for package keys anymore Erik Thuning 2022-10-21 15:31:28 +02:00
  • a12374b352 Found the proper way to provide a fallback on missing configparser section Erik Thuning 2022-10-21 15:29:50 +02:00
  • fc23dff9da Package now guarantees existence of all valid top-level keys Erik Thuning 2022-10-21 15:28:07 +02:00
  • 20a26de102 splitext reutnrs more than one thing Erik Thuning 2022-10-21 14:50:02 +02:00
  • a1af06fae8 Added thumbnail generation handler Erik Thuning 2022-10-21 14:43:21 +02:00
  • ac1a1d9fbf Tyop fixes Erik Thuning 2022-10-21 14:40:27 +02:00
  • f1368e3398 Moved creation of Daisy object closer to consumers Erik Thuning 2022-10-21 11:28:33 +02:00
  • d3090d7dc4 Added ldap utility class Erik Thuning 2022-10-21 11:13:54 +02:00
  • 0f3da0a717 Async jobs now have a centralized function in Handler. Erik Thuning 2022-10-21 10:59:58 +02:00
  • a9596f71cb Catching ffprobe errors Erik Thuning 2022-10-20 23:41:13 +02:00
  • 9e51321e6a Implemented poster handler Erik Thuning 2022-10-20 22:35:16 +02:00
  • 9cc0efd433 Forgot to add the poster to the metadata Erik Thuning 2022-10-20 22:34:50 +02:00
  • b15045eb13 Removed unnecessary import Erik Thuning 2022-10-20 21:08:07 +02:00
  • 24c32a2419 Updated help string Erik Thuning 2022-10-20 17:02:05 +02:00
  • 58a7362820 Activated slides handler Erik Thuning 2022-10-20 17:01:17 +02:00
  • f772aa5033 Missing import Erik Thuning 2022-10-20 17:01:04 +02:00
  • 782f994125 Typo Erik Thuning 2022-10-20 16:51:13 +02:00
  • 1ccd27d65a Implemented slide handler, moved ffmpeg invocations to utils.py, moved duration handling to Package class. Erik Thuning 2022-10-20 16:49:31 +02:00
  • d609173dca Revert "Hander.validate() is now a no-op" Erik Thuning 2022-10-20 14:13:07 +02:00
  • 48a825f245 Added pattern matching to incoming queue item filenames Erik Thuning 2022-10-20 14:04:46 +02:00
  • cdc3af2187 Worker pool is now shared between handlers Erik Thuning 2022-10-20 13:25:13 +02:00
  • bcc91cbcb3 Reordered imports Erik Thuning 2022-10-20 13:23:37 +02:00
  • eca8caedf1 Updated tests Erik Thuning 2022-10-20 09:37:27 +02:00
  • a6c714de33 TranscodeHandler now uses a multiprocessing pool for transcode jobs Erik Thuning 2022-10-19 17:04:30 +02:00
  • 3ce89b8056 Package IDs are now properly handled at the start of the pipeline Erik Thuning 2022-10-19 17:01:29 +02:00
  • e00bbdab60 Forgot to remove an import Erik Thuning 2022-10-19 16:23:04 +02:00
  • 83b3ca4900 Shorter dict accesses Erik Thuning 2022-10-19 16:22:11 +02:00
  • 3ab654d485 Moved ID generation to the distributor so incoming jobs for new packages get consistent IDs between handlers Erik Thuning 2022-10-19 16:20:58 +02:00
  • 9c5744d686 Error fixes Erik Thuning 2022-10-19 10:19:48 +02:00
  • 4e9b3f1aec Jobs without a pkg_id are now properly handled. Removed premature optimizations from PackageManager Erik Thuning 2022-10-18 16:37:29 +02:00
  • 1889bb61bb Updated example systemd unit to reflect the correct run script Erik Thuning 2022-10-18 15:54:21 +02:00
  • 5de59ffceb Added a run script Erik Thuning 2022-10-18 15:41:45 +02:00
  • f305b57811 Duration is now computed from the streams instead of passed by the user Erik Thuning 2022-10-18 14:25:36 +02:00
  • 917b8f133c Efficiency Erik Thuning 2022-10-18 14:25:18 +02:00
  • 89316f8024 Docstring shouldn't lie Erik Thuning 2022-10-18 14:24:08 +02:00