Commit Graph

726 Commits

Author SHA1 Message Date
HugoCasa
b076e093df feat: add unique id (#2483)
* feat: add unique id

* fix: sqlx prepare

* feat: add disable option

* fix: cron schedule
2023-10-23 17:05:54 +02:00
HugoCasa
1d1ffdf599 fix: cache embedding model in docker img (#2474) 2023-10-20 15:49:04 +02:00
Ruben Fiszel
17129fdf0f add MODE env variable 2023-10-16 15:20:50 +02:00
Ruben Fiszel
2ee57f3f84 feat: refactor entirely json processing in favor or rawjson to handle larger payloads (#2446)
* raw json

* raw json

* raw json

* raw json

* the big rawjson rewrite

* resolve merge conflicts

* all

* progress

* progress

* all compile

* remove mut

* remove mut

* remove mut

* arc queuedjob

* finish

* finish

* finish

* fixes

* progress

* fix result

* small fixes

* small fixes

* fix tests

* fix tests

* fix tests

* optimize eval timeout

* optimize eval timeout

* optimize eval timeout

* handle big args and result in get jobs

* improve args

* fix

* fix

* fix tests

* fix tests

* done

* add bigquery to native picker

* add bigquery

---------

Co-authored-by: gbouv <guillaume@windmill.dev>
2023-10-16 10:46:55 +02:00
Ruben Fiszel
156e60be19 handle default base_url in instance settings 2023-10-11 14:50:47 +02:00
Ruben Fiszel
e5731504d0 feat: add support for aggrid ee 2023-10-06 17:34:13 +02:00
Ruben Fiszel
1ff5bc2f7a feat: manage cache and init scripts from worker group UI (#2396)
* cache & inits

* cache & inits

* cache & inits

* all

* fix tests

* improve
2023-10-05 19:42:15 +02:00
Ruben Fiszel
c8543d7ed4 feat: add npm_config_registry support for bun, deno and being settable from UI (#2373)
* foo

* foo

* npm config
2023-10-02 14:45:29 +02:00
Ruben Fiszel
1dffd5dc7b improve license key check 2023-09-28 04:58:44 +02:00
Ruben Fiszel
93f536c26a fix: improve license key check 2023-09-28 04:28:52 +02:00
Ruben Fiszel
f9546de81d feat: support automatic reconnection to pg 2023-09-25 19:30:02 +02:00
Ruben Fiszel
7253eb4e46 fix setting base_url on workers 2023-09-23 08:57:59 -07:00
Ruben Fiszel
51255981fa feat: add license key as superadmin setting (#2321)
* license key

* all

* feat: add license key as a superadmin setting

* fix

* fix
2023-09-23 14:40:07 +02:00
HugoCasa
3ae5c6ce7c feat: improved dedicated benchmarks + buffer fix (#2313)
* feat: improved dedicated benchmarks + buffer fix

* fixes + limit task spawning to noop/dedicated

* fix: cargo test

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2023-09-21 17:12:00 +02:00
Ruben Fiszel
79c4ee5e6f feat: set instance settings from UI (#2314) 2023-09-20 23:15:19 +02:00
Ruben Fiszel
69a4fb9cdc improve queue metrics 2023-09-16 03:23:32 +02:00
Ruben Fiszel
e54a8013a0 fix: add queue_count to metrics 2023-09-16 02:31:58 +02:00
Ruben Fiszel
dfcdb2d8ff feat: worker groups admin panel (#2277)
* merge

* merge

* merge

* wg

* progress

* all

* all

* all

* all

* all

* all

* fix

* fix
2023-09-13 21:24:54 +02:00
Ruben Fiszel
7982b75613 feat: submit result in background thread (unify architecture for dedicated worker) (#2226)
* merge

* all

* all
2023-09-04 01:56:23 +02:00
Ruben Fiszel
21e8d7694c perf: improve queue performance (#2222)
* benchs

* progress

* prog

* progress

* progress

* progress

* update

* progress

* progress

* progress

* progress

* progress

* all

* all

* improve queries

* improve queries

* rm imv

* all

* all
2023-09-03 09:44:16 +02:00
Ruben Fiszel
9829105d08 feat: add global cache configuration 2023-08-30 13:35:41 +02:00
Ruben Fiszel
fe99bcad6b fix serving metrics on ee 2023-08-20 19:40:50 +02:00
Ruben Fiszel
b7b2af2c25 fix tests 2023-08-20 19:27:42 +02:00
Ruben Fiszel
1def1d3c66 refactor default non-cloud-hosted timeout 2023-08-20 16:30:31 +02:00
Ruben Fiszel
580c4cf6ae refactor workers 2023-08-20 15:58:43 +02:00
Ruben Fiszel
69cfe1ee13 feat: prometheus metrics are now ee only 2023-08-20 12:29:05 +02:00
Ruben Fiszel
c711180bdc fix tar initialization 2023-08-14 16:16:42 +02:00
Ruben Fiszel
8ab4336c0d feat: implement binary caching for go 2023-08-08 20:54:31 +02:00
Ruben Fiszel
be832f7f19 feat: use flock to avoid concurrency issues on pip and shared volume 2023-07-26 20:17:26 +02:00
Ruben Fiszel
ea8a456acc feat: handle worker groups with redis 2023-07-26 17:33:46 +02:00
Ruben Fiszel
0f48c19d5a fix: respect FIFO order for concurrency limit 2023-07-24 18:11:23 +02:00
Jakub Kołodziejczak
223b80768a chore(backend): upgrade sqlx to ^0.7 (#1865)
* DRAFT chore(backend): upgrade sqlx to ^0.7

related to:
* https://github.com/windmill-labs/windmill/pull/1858
* https://github.com/launchbadge/sqlx/issues/1163#issuecomment-1627685514

* (vol. 2) in 0.7, `Transaction` can no longer implement `Executor` directly

ref: afb6b1066e/examples/postgres/transaction/src/main.rs (L14-L17)

notice that I'm temporarly using my custom patch
16e4c9a8f3
it's related to https://github.com/launchbadge/sqlx/issues/2611

* post git rebase chores

* use upstream fix from 0.7.1

* fix compile

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2023-07-15 14:06:20 +02:00
Ruben Fiszel
d36a9d19aa fix: make workers bind their http servers on any available port for OCI compliance 2023-07-12 11:19:01 +02:00
Guillaume Bouvignies
7f3c7ea9d1 Specific NOOP jobs benchmark (#1810)
* Refactor and fix NOOP benchmark

* Add endpoint to toggle workers on/off when compiled in benchmark mode

* Improve noop benchmark
2023-07-10 14:16:34 +02:00
Ruben Fiszel
9709f21c2b improve docker-compose 2023-07-08 09:58:45 +02:00
Ruben Fiszel
4317f065f5 feat: bun support (#1800)
* feat: bun support

* feat: bun support

* add bun support

* add bun support

* add bun support

* add bun
2023-07-06 21:19:07 +02:00
Ruben Fiszel
218ad892d7 feat: add configurable global error handler 2023-06-30 12:46:02 +02:00
Ruben Fiszel
82c48dc5c9 fix: add CREATE_WORKSPACE_REQUIRE_SUPERADMIN 2023-06-29 23:06:03 +02:00
Ruben Fiszel
d6132ed8d2 improve docker-compose and email sending 2023-06-29 11:52:46 +02:00
Ruben Fiszel
663e2148ac feat: smtp support to invite users (#1777)
* email support

* everyhting

* smtp

* update

* update

* update

* setup backend test
2023-06-29 10:34:44 +02:00
Ruben Fiszel
50ee66d9fd minor worker_flow refactor 2023-06-23 16:53:05 +02:00
Ruben Fiszel
768d44b55b feat: remove the need for BASE_INTERNAL_URL 2023-06-12 12:00:42 +02:00
Ruben Fiszel
7e6ccacbf7 fix(backend): fix initial worker ping issue 2023-05-29 13:53:53 +02:00
Ruben Fiszel
b8cd70ea00 use hostname as worker name 2023-05-28 21:44:57 +02:00
Ruben Fiszel
2838d77128 use hostname as worker name 2023-05-28 19:28:06 +02:00
Ruben Fiszel
26b68fa2db add logs around connecting to database 2023-05-25 17:45:17 +02:00
Ruben Fiszel
470650e504 fix migration break 2023-05-25 11:07:54 +02:00
Ruben Fiszel
9a8f96a2f3 add ee_license endpoint 2023-05-24 14:34:03 +02:00
Ruben Fiszel
7367fea524 implement license keys with expiry 2023-05-22 11:06:23 +02:00
Ruben Fiszel
dc1bfbb5f5 feat: add GOPROXY + fix on saved inputs 2023-05-18 17:29:37 +02:00