Commit Graph

300 Commits

Author SHA1 Message Date
Ruben Fiszel
c711180bdc fix tar initialization 2023-08-14 16:16:42 +02:00
Ruben Fiszel
8ab4336c0d feat: implement binary caching for go 2023-08-08 20:54:31 +02:00
Ruben Fiszel
be832f7f19 feat: use flock to avoid concurrency issues on pip and shared volume 2023-07-26 20:17:26 +02:00
Ruben Fiszel
ea8a456acc feat: handle worker groups with redis 2023-07-26 17:33:46 +02:00
Ruben Fiszel
0f48c19d5a fix: respect FIFO order for concurrency limit 2023-07-24 18:11:23 +02:00
Jakub Kołodziejczak
223b80768a chore(backend): upgrade sqlx to ^0.7 (#1865)
* DRAFT chore(backend): upgrade sqlx to ^0.7

related to:
* https://github.com/windmill-labs/windmill/pull/1858
* https://github.com/launchbadge/sqlx/issues/1163#issuecomment-1627685514

* (vol. 2) in 0.7, `Transaction` can no longer implement `Executor` directly

ref: afb6b1066e/examples/postgres/transaction/src/main.rs (L14-L17)

notice that I'm temporarly using my custom patch
16e4c9a8f3
it's related to https://github.com/launchbadge/sqlx/issues/2611

* post git rebase chores

* use upstream fix from 0.7.1

* fix compile

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2023-07-15 14:06:20 +02:00
Ruben Fiszel
d36a9d19aa fix: make workers bind their http servers on any available port for OCI compliance 2023-07-12 11:19:01 +02:00
Guillaume Bouvignies
7f3c7ea9d1 Specific NOOP jobs benchmark (#1810)
* Refactor and fix NOOP benchmark

* Add endpoint to toggle workers on/off when compiled in benchmark mode

* Improve noop benchmark
2023-07-10 14:16:34 +02:00
Ruben Fiszel
9709f21c2b improve docker-compose 2023-07-08 09:58:45 +02:00
Ruben Fiszel
4317f065f5 feat: bun support (#1800)
* feat: bun support

* feat: bun support

* add bun support

* add bun support

* add bun support

* add bun
2023-07-06 21:19:07 +02:00
Ruben Fiszel
218ad892d7 feat: add configurable global error handler 2023-06-30 12:46:02 +02:00
Ruben Fiszel
82c48dc5c9 fix: add CREATE_WORKSPACE_REQUIRE_SUPERADMIN 2023-06-29 23:06:03 +02:00
Ruben Fiszel
d6132ed8d2 improve docker-compose and email sending 2023-06-29 11:52:46 +02:00
Ruben Fiszel
663e2148ac feat: smtp support to invite users (#1777)
* email support

* everyhting

* smtp

* update

* update

* update

* setup backend test
2023-06-29 10:34:44 +02:00
Ruben Fiszel
50ee66d9fd minor worker_flow refactor 2023-06-23 16:53:05 +02:00
Ruben Fiszel
768d44b55b feat: remove the need for BASE_INTERNAL_URL 2023-06-12 12:00:42 +02:00
Ruben Fiszel
7e6ccacbf7 fix(backend): fix initial worker ping issue 2023-05-29 13:53:53 +02:00
Ruben Fiszel
b8cd70ea00 use hostname as worker name 2023-05-28 21:44:57 +02:00
Ruben Fiszel
2838d77128 use hostname as worker name 2023-05-28 19:28:06 +02:00
Ruben Fiszel
26b68fa2db add logs around connecting to database 2023-05-25 17:45:17 +02:00
Ruben Fiszel
470650e504 fix migration break 2023-05-25 11:07:54 +02:00
Ruben Fiszel
9a8f96a2f3 add ee_license endpoint 2023-05-24 14:34:03 +02:00
Ruben Fiszel
7367fea524 implement license keys with expiry 2023-05-22 11:06:23 +02:00
Ruben Fiszel
dc1bfbb5f5 feat: add GOPROXY + fix on saved inputs 2023-05-18 17:29:37 +02:00
Ruben Fiszel
675bbfa7b1 feat(backend): add REQUEST_SIZE_LIMIT env variable 2023-05-17 23:07:17 +02:00
Ruben Fiszel
796b346bfb add cairo to openbb build 2023-05-09 11:11:09 +02:00
Ruben Fiszel
e21208de31 feat(backend): add EXIT_AFTER_NO_JOB_FOR_SECS for ephemeral workers 2023-04-28 00:09:48 +02:00
Ruben Fiszel
27097921d3 fix run_wait_result polling + make it configurable 2023-04-27 07:35:53 +02:00
Ruben Fiszel
1d1c812e36 feat(backend): add JOB_RETENTION_SECS to delete completed jobs completed after expiration period 2023-04-26 19:34:54 +02:00
Ruben Fiszel
d93b85c724 minor worker tags nit 2023-04-26 01:54:09 +02:00
Ruben Fiszel
394c6fa92d feat(backend): workers are instantly ready and sync with global cache in background 2023-04-21 09:45:25 +02:00
Ruben Fiszel
242b2ae899 feat(backend): global cache refactor for pip using tar for each dependency (#1443)
* cache refactor

* exclude tar from being synced to bucket

* run

* update

* update
2023-04-20 20:05:12 +02:00
Ruben Fiszel
f0b939cd3a add barrier when num workers > 1 2023-04-19 17:00:03 +02:00
Ruben Fiszel
26c7e9e8c3 add barrier when num workers > 1 2023-04-19 12:46:25 +02:00
Ruben Fiszel
89d0bea9fa feat(ee): sync cache in background 2023-04-19 00:55:51 +02:00
Ruben Fiszel
be41e45130 split worker.rs into more files 2023-04-13 17:44:47 +02:00
Ruben Fiszel
e8611ba8c1 add GOPRIVATE and NETRC for private modules 2023-04-11 19:55:38 +02:00
Kai Jellinghaus
63102b036c feat(backend): Redis based queue (#1324)
* Merge?

* Fix V8 breaking change

* WIP

* WIP

* Cleanup

* Move to git reference

* Fix Merge conflict

* update

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2023-04-11 12:24:13 +02:00
Ruben Fiszel
db075f2ca1 feat(backend): add instance events webhook 2023-04-11 01:45:56 +02:00
Ruben Fiszel
bbb6a15da7 only register prometheus metrics if they are enabled 2023-04-09 15:39:25 +02:00
Ruben Fiszel
b64c9f6569 feat(backend): add /ready endpoint for workers 2023-04-05 10:34:25 +02:00
Ruben Fiszel
0bec54edfd feat: do cache bucket syncing in background + check tar before pushing it (#1360)
* all

* improve tar caching
2023-04-04 01:34:11 +02:00
Ruben Fiszel
8ad321da42 feat(backend): increase timeout for premium workspace 2023-03-26 18:56:40 +02:00
Ruben Fiszel
07d3bb6977 feat(backend): introduce RESTART_ZOMBIE_JOBS and ZOMBIE_JOB_TIMEOUT 2023-03-23 12:47:49 +01:00
Ryan Rich
a828d6670d feat(deno): add support for custom npm repo (#1291)
* feat(deno): add support for custom npm repo

* feat(deno): add support for custom npm repo

* feat(deno): fix comment being on wrong line

* feat(deno): review feedback
2023-03-14 22:23:44 +01:00
Ryan Rich
36e95b904e Add support for binding server listener to a specific IP address (#1253) 2023-03-02 08:01:50 +01:00
Ruben Fiszel
e791fbd377 display startup info in all cases 2023-02-28 17:52:47 +01:00
Ruben Fiszel
69d4a23b4f send a webhook on new user + lazy static refactor (#1203)
* supercharge

* supercharge

* progress

* progress

* display config

* display config

* display config

* display config

* fix extensions

* fix build

* disable nsjail = false for test
2023-02-15 10:59:50 +01:00
Ruben Fiszel
e0d02e8f40 add license key check 2023-01-15 12:06:37 +01:00
Ruben Fiszel
f0527f6810 re-enable picking groups 2022-12-20 07:18:10 +01:00