kalugin66/windmill
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,340 Commits 513 Branches 1,362 Tags
92a00a20eb6376d8028fa2cd2a4c9964a09cb1f8
Commit Graph

309 Commits

Author SHA1 Message Date
Ruben Fiszel
070b16222b feat: worker groups admin panel (#2277) 
* merge

* merge

* merge

* wg

* progress

* all

* all

* all

* all

* all

* all

* fix

* fix
 2023-09-13 21:24:54 +02:00
Ruben Fiszel
dff1cd9a64 feat: submit result in background thread (unify architecture for dedicated worker) (#2226) 
* merge

* all

* all
 2023-09-04 01:56:23 +02:00
Ruben Fiszel
069e2d18d5 perf: improve queue performance (#2222) 
* benchs

* progress

* prog

* progress

* progress

* progress

* update

* progress

* progress

* progress

* progress

* progress

* all

* all

* improve queries

* improve queries

* rm imv

* all

* all
 2023-09-03 09:44:16 +02:00
Ruben Fiszel
7c5ea569a8 feat: add global cache configuration 2023-08-30 13:35:41 +02:00
Ruben Fiszel
5e3daf02b4 fix serving metrics on ee 2023-08-20 19:40:50 +02:00
Ruben Fiszel
09a4e492ea fix tests 2023-08-20 19:27:42 +02:00
Ruben Fiszel
0503942170 refactor default non-cloud-hosted timeout 2023-08-20 16:30:31 +02:00
Ruben Fiszel
da036b2a19 refactor workers 2023-08-20 15:58:43 +02:00
Ruben Fiszel
2afea50497 feat: prometheus metrics are now ee only 2023-08-20 12:29:05 +02:00
Ruben Fiszel
4b8d38d077 fix tar initialization 2023-08-14 16:16:42 +02:00
Ruben Fiszel
933021ad8d feat: implement binary caching for go 2023-08-08 20:54:31 +02:00
Ruben Fiszel
c22d2b91a1 feat: use flock to avoid concurrency issues on pip and shared volume 2023-07-26 20:17:26 +02:00
Ruben Fiszel
6f47bf9806 feat: handle worker groups with redis 2023-07-26 17:33:46 +02:00
Ruben Fiszel
601da7f878 fix: respect FIFO order for concurrency limit 2023-07-24 18:11:23 +02:00
Jakub Kołodziejczak
72d0d8a7f5 chore(backend): upgrade sqlx to ^0.7 (#1865) 
* DRAFT chore(backend): upgrade sqlx to ^0.7

related to:
* https://github.com/windmill-labs/windmill/pull/1858
* https://github.com/launchbadge/sqlx/issues/1163#issuecomment-1627685514

* (vol. 2) in 0.7, `Transaction` can no longer implement `Executor` directly

ref: afb6b1066e/examples/postgres/transaction/src/main.rs (L14-L17)

notice that I'm temporarly using my custom patch
16e4c9a8f3
it's related to https://github.com/launchbadge/sqlx/issues/2611

* post git rebase chores

* use upstream fix from 0.7.1

* fix compile

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
 2023-07-15 14:06:20 +02:00
Ruben Fiszel
08e3502126 fix: make workers bind their http servers on any available port for OCI compliance 2023-07-12 11:19:01 +02:00
Guillaume Bouvignies
96df8900cb Specific NOOP jobs benchmark (#1810) 
* Refactor and fix NOOP benchmark

* Add endpoint to toggle workers on/off when compiled in benchmark mode

* Improve noop benchmark
 2023-07-10 14:16:34 +02:00
Ruben Fiszel
3d999007f5 improve docker-compose 2023-07-08 09:58:45 +02:00
Ruben Fiszel
2921649c3c feat: bun support (#1800) 
* feat: bun support

* feat: bun support

* add bun support

* add bun support

* add bun support

* add bun
 2023-07-06 21:19:07 +02:00
Ruben Fiszel
8c566a2e46 feat: add configurable global error handler 2023-06-30 12:46:02 +02:00
Ruben Fiszel
ff942f4d06 fix: add CREATE_WORKSPACE_REQUIRE_SUPERADMIN 2023-06-29 23:06:03 +02:00
Ruben Fiszel
f096145cee improve docker-compose and email sending 2023-06-29 11:52:46 +02:00
Ruben Fiszel
7851e932ec feat: smtp support to invite users (#1777) 
* email support

* everyhting

* smtp

* update

* update

* update

* setup backend test
 2023-06-29 10:34:44 +02:00
Ruben Fiszel
293ba774e8 minor worker_flow refactor 2023-06-23 16:53:05 +02:00
Ruben Fiszel
263e03c2bd feat: remove the need for BASE_INTERNAL_URL 2023-06-12 12:00:42 +02:00
Ruben Fiszel
1816252f03 fix(backend): fix initial worker ping issue 2023-05-29 13:53:53 +02:00
Ruben Fiszel
521bf7b495 use hostname as worker name 2023-05-28 21:44:57 +02:00
Ruben Fiszel
9461b15d43 use hostname as worker name 2023-05-28 19:28:06 +02:00
Ruben Fiszel
c8ff19befd add logs around connecting to database 2023-05-25 17:45:17 +02:00
Ruben Fiszel
7201045789 fix migration break 2023-05-25 11:07:54 +02:00
Ruben Fiszel
45a6ffcf32 add ee_license endpoint 2023-05-24 14:34:03 +02:00
Ruben Fiszel
9c90e331f7 implement license keys with expiry 2023-05-22 11:06:23 +02:00
Ruben Fiszel
cdc4f29ec1 feat: add GOPROXY + fix on saved inputs 2023-05-18 17:29:37 +02:00
Ruben Fiszel
1cbd704a25 feat(backend): add REQUEST_SIZE_LIMIT env variable 2023-05-17 23:07:17 +02:00
Ruben Fiszel
d814a25b0f add cairo to openbb build 2023-05-09 11:11:09 +02:00
Ruben Fiszel
de9abd129d feat(backend): add EXIT_AFTER_NO_JOB_FOR_SECS for ephemeral workers 2023-04-28 00:09:48 +02:00
Ruben Fiszel
4387db275f fix run_wait_result polling + make it configurable 2023-04-27 07:35:53 +02:00
Ruben Fiszel
0b7bad3816 feat(backend): add JOB_RETENTION_SECS to delete completed jobs completed after expiration period 2023-04-26 19:34:54 +02:00
Ruben Fiszel
4a34e83b56 minor worker tags nit 2023-04-26 01:54:09 +02:00
Ruben Fiszel
670ba51d9b feat(backend): workers are instantly ready and sync with global cache in background 2023-04-21 09:45:25 +02:00
Ruben Fiszel
369dd0dac6 feat(backend): global cache refactor for pip using tar for each dependency (#1443) 
* cache refactor

* exclude tar from being synced to bucket

* run

* update

* update
 2023-04-20 20:05:12 +02:00
Ruben Fiszel
62d196ecec add barrier when num workers > 1 2023-04-19 17:00:03 +02:00
Ruben Fiszel
29848ae466 add barrier when num workers > 1 2023-04-19 12:46:25 +02:00
Ruben Fiszel
0e77e37fbd feat(ee): sync cache in background 2023-04-19 00:55:51 +02:00
Ruben Fiszel
34f48aa1e3 split worker.rs into more files 2023-04-13 17:44:47 +02:00
Ruben Fiszel
3932e5dfb9 add GOPRIVATE and NETRC for private modules 2023-04-11 19:55:38 +02:00
Kai Jellinghaus
d45e6c94ab feat(backend): Redis based queue (#1324) 
* Merge?

* Fix V8 breaking change

* WIP

* WIP

* Cleanup

* Move to git reference

* Fix Merge conflict

* update

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
 2023-04-11 12:24:13 +02:00
Ruben Fiszel
f2d3c8208b feat(backend): add instance events webhook 2023-04-11 01:45:56 +02:00
Ruben Fiszel
3097510550 only register prometheus metrics if they are enabled 2023-04-09 15:39:25 +02:00
Ruben Fiszel
94eecea02b feat(backend): add /ready endpoint for workers 2023-04-05 10:34:25 +02:00