Commit Graph

  • 65beedd281 Upgrade to ubuntu noble, add cuda 12 bundle Ingo Oppermann 2024-09-26 14:13:59 +02:00
  • ca6dba7259 Add ubuntu build for vod branch Ingo Oppermann 2024-09-24 11:47:25 +02:00
  • d75c7d188f Make audio/video specific fields optional Ingo Oppermann 2024-09-19 15:05:11 +02:00
  • 0f6d7949c4 Fix deadlock in cluster shutdown Ingo Oppermann 2024-09-17 15:08:11 +02:00
  • 705c7fa946 Introduce budget for process relocation Ingo Oppermann 2024-09-17 11:55:31 +02:00
  • a1f41bd202 Fix using possibly unavailable value Ingo Oppermann 2024-09-09 18:02:16 +02:00
  • 385628382c Fix linter error Ingo Oppermann 2024-09-05 14:10:16 +02:00
  • 0327edcaf3 Update openapi specification Ingo Oppermann 2024-09-05 13:58:59 +02:00
  • b0e932d77a Add avstream codec parameter Ingo Oppermann 2024-09-05 13:56:22 +02:00
  • bc1b2cf76b Add profile and level to progress IO Ingo Oppermann 2024-09-05 13:44:19 +02:00
  • 1a51db01ea Add sample_fmt to API progress Ingo Oppermann 2024-09-05 13:40:04 +02:00
  • 7831992936 Add parsing for track specific avstream progress data Ingo Oppermann 2024-09-05 13:33:01 +02:00
  • 70ffb805b4 Fix returning original config Ingo Oppermann 2024-09-03 16:39:19 +02:00
  • af6228e9b1 Merge branch 'vod' into psutil_gpu Ingo Oppermann 2024-09-03 11:44:35 +02:00
  • bebef61e55 Add /v3/cluster/events endpoint to gather events from all nodes Ingo Oppermann 2024-08-22 13:40:38 +02:00
  • 9947ba822b Add missing JSON tags Ingo Oppermann 2024-08-21 20:31:22 +02:00
  • 1c56d53a6b Adjust comments Ingo Oppermann 2024-08-21 17:02:22 +02:00
  • 3756ce4977 Add AppendFileReader to filesystem, allows session logging with less I/O Ingo Oppermann 2024-08-20 17:34:50 +02:00
  • 1327fd6e21 Add memfs storage based on dolthub's swiss maps Ingo Oppermann 2024-08-20 14:14:47 +02:00
  • 68607ed932 Add basic resource information in about response Ingo Oppermann 2024-08-20 11:55:08 +02:00
  • 0b1601542d Wait for follower and leader loops to finish Ingo Oppermann 2024-08-19 15:22:24 +02:00
  • 1650b17e05 Simply return error as-is, check process list length Ingo Oppermann 2024-08-19 15:21:24 +02:00
  • 644185dd50 Merge branch 'vod' into psutil_gpu Ingo Oppermann 2024-08-19 12:43:47 +02:00
  • 72a3b8c17d Update detendencies Ingo Oppermann 2024-08-19 12:03:34 +02:00
  • fa199736e0 Merge branch 'vod' into vod-auto-remove-node Ingo Oppermann 2024-08-19 10:55:43 +02:00
  • d6d39f162a Adding a TODO Ingo Oppermann 2024-07-26 12:38:21 +02:00
  • b9baa17b0c Fix writing string to prelude tail Ingo Oppermann 2024-07-26 11:47:40 +02:00
  • 70a49f8bdb Process []byte instread of string in parser Ingo Oppermann 2024-07-26 11:31:47 +02:00
  • d391e274d7 Fix wrong memory limit, add total memory, add cpu and memory consumed by core itself to node resources Ingo Oppermann 2024-07-25 21:13:49 +02:00
  • e54bb4ee7c Remove debug dockerfile Ingo Oppermann 2024-07-25 21:12:06 +02:00
  • 6101585fd2 Extract linux specifc code from psutils for reading CPU times Ingo Oppermann 2024-07-25 09:30:11 +02:00
  • 46950372be WIP: Optimize copy from io.Reader, allow to suggest file size Ingo Oppermann 2024-07-24 15:40:28 +02:00
  • 79791d190b Optimize isDir function on memfs Ingo Oppermann 2024-07-24 12:55:28 +02:00
  • 0a74470d38 Don't mark processes as errNotEnoughResourcesForDeployment when budget has been used up Ingo Oppermann 2024-07-24 12:54:45 +02:00
  • 28e1325eb2 Prevent sending RESUME if process is already resumed Ingo Oppermann 2024-07-23 16:07:48 +02:00
  • 54b1fe8e86 Dump casbin, replace with own policy enforcer Ingo Oppermann 2024-07-23 15:54:09 +02:00
  • 879819f10f Retrieve current process from leader, clone metadata, introduce new state 'deploying' Ingo Oppermann 2024-07-22 16:58:57 +02:00
  • 9e52f19a66 Introduce synchronize budget, experimental Ingo Oppermann 2024-07-22 09:25:23 +02:00
  • 85011cb947 Don't upload existing binaries Ingo Oppermann 2024-07-19 16:03:37 +02:00
  • 61f9de0dd2 Don't trim paths in normal build Ingo Oppermann 2024-07-19 16:03:09 +02:00
  • 64ab09f4fc Fix warning Ingo Oppermann 2024-07-19 16:02:42 +02:00
  • a3948b597d Return uploaded process config Ingo Oppermann 2024-07-19 16:02:17 +02:00
  • b160e604d2 Don't import metadata, leads to race condition Ingo Oppermann 2024-07-19 16:01:50 +02:00
  • 308f008969 Only compare configs if the process will get replaced Ingo Oppermann 2024-07-19 16:00:45 +02:00
  • 688450f341 Add nil checks, add NewTask function Ingo Oppermann 2024-07-19 12:26:47 +02:00
  • 72883d18d4 Remove bottlenecks in process handling, still some rough edges Ingo Oppermann 2024-07-18 17:16:49 +02:00
  • 8a28e2cf96 Update dependencies Ingo Oppermann 2024-07-17 16:58:45 +02:00
  • 15e1cd7b6f Use puzpuzpuz/xsync.MapOf for tasks, abstract tasks Ingo Oppermann 2024-07-17 16:54:26 +02:00
  • 4d0eed092e Return error from ClusterProcessList, remove ProcessFindNodeID Ingo Oppermann 2024-07-17 16:50:39 +02:00
  • 6f524f5991 Use store.ProcessGetNode function Ingo Oppermann 2024-07-17 16:49:31 +02:00
  • db564de1f1 Use store.ProcessGetNode function Ingo Oppermann 2024-07-17 16:49:09 +02:00
  • e12fb0be52 Fix cluster shutdown, limit parallel opstack worker Ingo Oppermann 2024-07-17 16:48:33 +02:00
  • 3df1075548 Add ProcessGetNode function Ingo Oppermann 2024-07-17 16:47:00 +02:00
  • 88739e3f7f Cosmetics Ingo Oppermann 2024-07-17 16:45:33 +02:00
  • f56c0dde14 Use alpine3.20 as base image Ingo Oppermann 2024-07-17 16:44:29 +02:00
  • 3becd86f60 Return errors Ingo Oppermann 2024-07-17 16:43:41 +02:00
  • de1c42e969 Don't do a file listing if no patterns are defined Ingo Oppermann 2024-07-16 14:40:45 +02:00
  • 96f7d8030c Disable locally persisting DB in cluster mode Ingo Oppermann 2024-07-16 14:01:31 +02:00
  • 7fa47a962a Add basic nvidia-smi parser Ingo Oppermann 2024-07-16 08:14:19 +02:00
  • 3d78122053 Fix crash when updating unavailable node Ingo Oppermann 2024-07-16 08:13:15 +02:00
  • b9796a46f2 Add test for type conversion Ingo Oppermann 2024-07-12 09:00:47 +02:00
  • cb9ce6f1dc Fix nil pointer dereference Ingo Oppermann 2024-07-11 12:33:51 +02:00
  • ddba7bbf74 Upgrade base image to alpine3.20 Ingo Oppermann 2024-07-11 12:22:50 +02:00
  • 7e90bb87ce Allow to import report history for a process Ingo Oppermann 2024-07-10 16:46:49 +02:00
  • 787948080b Fix name and use of CORE_CLUSTER_RECOVER_TIMEOUT_SEC Ingo Oppermann 2024-07-09 14:44:34 +02:00
  • e306d20d55 Fix use of proxy Ingo Oppermann 2024-07-09 14:14:47 +02:00
  • 8dcda07fc1 Merge branch 'vod' into vod-auto-remove-node Ingo Oppermann 2024-07-09 14:08:57 +02:00
  • 480dbb7f53 Refactor cluster node code Ingo Oppermann 2024-07-09 12:26:02 +02:00
  • 1c13821688 fix: Dockerfile to reduce vulnerabilities snyk-fix-368cbee297c7654cb49417500e76cd1a snyk-bot 2024-07-01 03:45:11 +00:00
  • 28603aab98 Incorporate process throttling into deploy decision, fix bug in rebalance, parallelize opstack Ingo Oppermann 2024-06-26 17:03:42 +02:00
  • ca177becfa Fix tests Ingo Oppermann 2024-06-24 17:37:04 +02:00
  • c032cdf5c7 Add API for setting node status, respect it in leader tasks Ingo Oppermann 2024-06-24 16:50:15 +02:00
  • 166e313642 Fix tests Ingo Oppermann 2024-06-19 15:38:42 +02:00
  • a9d6b1ec49 Add API endpoints for relocating processes Ingo Oppermann 2024-06-19 15:28:30 +02:00
  • 8db7357802 fix: Dockerfile to reduce vulnerabilities snyk-fix-49ccd36c1b074b12946afd280f1d8fe5 snyk-bot 2024-06-18 18:06:42 +00:00
  • de6a267fd4 Add operations to relocate processes Ingo Oppermann 2024-06-18 16:50:59 +02:00
  • cc75be6372 Fix punctuation in log messages Ingo Oppermann 2024-06-13 16:57:25 +02:00
  • 8290d007b4 Fix minimal raft uptime requirement Ingo Oppermann 2024-06-13 16:05:15 +02:00
  • 0bf371807a Add autorecovery, add CORE_CLUSTER_NODE_RECOVER_TIMEOUT_SECONDS Ingo Oppermann 2024-06-13 15:55:18 +02:00
  • f5d9725a48 Return proper HTTP status on leave Ingo Oppermann 2024-06-12 15:08:07 +02:00
  • a1b1609e73 Return proper HTTP status on leave Ingo Oppermann 2024-06-12 15:05:05 +02:00
  • 2c17572027 Drop dead nodes after CORE_CLUSTER_NODE_RECOVER_TIMEOUT_SEC Ingo Oppermann 2024-06-12 14:42:27 +02:00
  • 6872ba0498 Merge branch 'main' into dev v16.16.0 Ingo Oppermann 2024-06-07 11:47:03 +02:00
  • 69d3155176 Remove alpine3.16 builds for vod branch Ingo Oppermann 2024-06-07 11:45:06 +02:00
  • 18fc8abe62 Update changelog, bump version to 16.16.0 Ingo Oppermann 2024-06-07 11:37:25 +02:00
  • 1a64fddbb1 Allow cluster leave endpoint to remove any node in the cluster Ingo Oppermann 2024-06-07 11:28:54 +02:00
  • 0f344f1998 Allow to send leave request to any node for any node Ingo Oppermann 2024-06-06 13:20:49 +02:00
  • 371c62fa8d Update dependencies Ingo Oppermann 2024-06-05 10:46:35 +02:00
  • 32b5a83fa9 Fix datarhei/restreamer#759 Ingo Oppermann 2024-06-04 17:51:49 +02:00
  • 8bc84adc2b Upgrade RTMP dependency Ingo Oppermann 2024-05-30 22:53:20 +02:00
  • 609bce569b Don't report EOF as error in RTMP server, update dependency Ingo Oppermann 2024-05-29 16:33:32 +02:00
  • d6a80c28e5 Add ConnectionIdleTimeout to RTMP server Ingo Oppermann 2024-05-29 16:16:10 +02:00
  • ad8d214805 Add WithLevel() to Logger interface Ingo Oppermann 2024-05-29 15:51:51 +02:00
  • b4aa76f5af Fix test Ingo Oppermann 2024-05-28 14:56:27 +02:00
  • 32ccfc24ee Upgrade dependencies Ingo Oppermann 2024-05-28 14:32:25 +02:00
  • 8ae7ba8dfe Upgrade dependencies Ingo Oppermann 2024-05-28 14:26:54 +02:00
  • e271a0257b Update dependencies Ingo Oppermann 2024-05-15 14:59:04 +02:00
  • 3ee4876290 Parallelize reading out process information Ingo Oppermann 2024-04-30 14:15:40 +02:00
  • 43ae0c149b Fix compatibility for benchmarks, add option to not to decode response Ingo Oppermann 2024-04-30 14:13:21 +02:00
  • 3a511ac393 Add cache for compiled glob patterns Ingo Oppermann 2024-04-30 14:12:01 +02:00