Commit Graph

340 Commits

Author SHA1 Message Date
Guillaume Bouvignies
83f9ef34e6 feat: Add toggle to optionally mute error handler for cancelled jobs (#2567)
* fix: Fix canceled flag in completed_job table

* Add toggle to workspace settings
2023-11-06 18:24:51 +01:00
HugoCasa
1ed52ab4c9 feat: add new stats (#2568)
* feat: add new stats

* feat: use license key id + manually send usage
2023-11-06 18:23:25 +01:00
Ruben Fiszel
c8036317d2 fix: only load embeddings if in server mode 2023-11-01 00:44:24 +01:00
Ruben Fiszel
cd01734735 add more migration info at start 2023-10-30 15:17:32 +01:00
Ruben Fiszel
ed86a61cf0 improve slow pull metrics 2023-10-30 12:20:40 +01:00
Ruben Fiszel
82eaacb316 add support for pg-embed 2023-10-28 19:02:49 +02:00
Ruben Fiszel
2cec6a0971 add more metrics 2023-10-28 15:35:45 +02:00
Ruben Fiszel
b8883481f4 feat: refactor metrics and add performance debug metrics (#2520)
* all

* feat: add debug metrics
2023-10-27 21:00:28 +02:00
Ruben Fiszel
dc10aaa660 associate metrics with tags and not langs anymore 2023-10-26 23:44:25 +02:00
Ruben Fiszel
55ceca1913 fix: move keep job directories and expose debug metrics to instance settings UI 2023-10-26 13:08:39 +02:00
Ruben Fiszel
ea28163865 fix: prometheus metrics are an instance settings 2023-10-25 23:32:47 +02:00
Ruben Fiszel
402193cef9 fix: do not share http_client in js_eval runtime 2023-10-25 09:51:20 +02:00
Ruben Fiszel
176dd415b6 show psql version on start 2023-10-24 09:54:01 +02:00
Ruben Fiszel
1ec56c0e23 fix: improve flow performance at high-throughput 2023-10-24 00:11:30 +02:00
HugoCasa
7037d70ca2 feat: add unique id (#2483)
* feat: add unique id

* fix: sqlx prepare

* feat: add disable option

* fix: cron schedule
2023-10-23 17:05:54 +02:00
HugoCasa
8fe30ca4ca fix: cache embedding model in docker img (#2474) 2023-10-20 15:49:04 +02:00
Ruben Fiszel
b18ab1d154 add MODE env variable 2023-10-16 15:20:50 +02:00
Ruben Fiszel
9314d38bf1 feat: refactor entirely json processing in favor or rawjson to handle larger payloads (#2446)
* raw json

* raw json

* raw json

* raw json

* the big rawjson rewrite

* resolve merge conflicts

* all

* progress

* progress

* all compile

* remove mut

* remove mut

* remove mut

* arc queuedjob

* finish

* finish

* finish

* fixes

* progress

* fix result

* small fixes

* small fixes

* fix tests

* fix tests

* fix tests

* optimize eval timeout

* optimize eval timeout

* optimize eval timeout

* handle big args and result in get jobs

* improve args

* fix

* fix

* fix tests

* fix tests

* done

* add bigquery to native picker

* add bigquery

---------

Co-authored-by: gbouv <guillaume@windmill.dev>
2023-10-16 10:46:55 +02:00
Ruben Fiszel
4d26c01df8 handle default base_url in instance settings 2023-10-11 14:50:47 +02:00
Ruben Fiszel
c4a817aeb6 feat: add support for aggrid ee 2023-10-06 17:34:13 +02:00
Ruben Fiszel
2c9ae41706 feat: manage cache and init scripts from worker group UI (#2396)
* cache & inits

* cache & inits

* cache & inits

* all

* fix tests

* improve
2023-10-05 19:42:15 +02:00
Ruben Fiszel
c42b8750f1 feat: add npm_config_registry support for bun, deno and being settable from UI (#2373)
* foo

* foo

* npm config
2023-10-02 14:45:29 +02:00
Ruben Fiszel
a2594a7731 improve license key check 2023-09-28 04:58:44 +02:00
Ruben Fiszel
035bad5268 fix: improve license key check 2023-09-28 04:28:52 +02:00
Ruben Fiszel
ccaa05d4bf feat: support automatic reconnection to pg 2023-09-25 19:30:02 +02:00
Ruben Fiszel
4f10baa2af fix setting base_url on workers 2023-09-23 08:57:59 -07:00
Ruben Fiszel
304a2596fd feat: add license key as superadmin setting (#2321)
* license key

* all

* feat: add license key as a superadmin setting

* fix

* fix
2023-09-23 14:40:07 +02:00
HugoCasa
fc93c2a7ce feat: improved dedicated benchmarks + buffer fix (#2313)
* feat: improved dedicated benchmarks + buffer fix

* fixes + limit task spawning to noop/dedicated

* fix: cargo test

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2023-09-21 17:12:00 +02:00
Ruben Fiszel
2f0e43bfdb feat: set instance settings from UI (#2314) 2023-09-20 23:15:19 +02:00
Ruben Fiszel
5ce750cb9b improve queue metrics 2023-09-16 03:23:32 +02:00
Ruben Fiszel
9ced8834a4 fix: add queue_count to metrics 2023-09-16 02:31:58 +02:00
Ruben Fiszel
070b16222b feat: worker groups admin panel (#2277)
* merge

* merge

* merge

* wg

* progress

* all

* all

* all

* all

* all

* all

* fix

* fix
2023-09-13 21:24:54 +02:00
Ruben Fiszel
dff1cd9a64 feat: submit result in background thread (unify architecture for dedicated worker) (#2226)
* merge

* all

* all
2023-09-04 01:56:23 +02:00
Ruben Fiszel
069e2d18d5 perf: improve queue performance (#2222)
* benchs

* progress

* prog

* progress

* progress

* progress

* update

* progress

* progress

* progress

* progress

* progress

* all

* all

* improve queries

* improve queries

* rm imv

* all

* all
2023-09-03 09:44:16 +02:00
Ruben Fiszel
7c5ea569a8 feat: add global cache configuration 2023-08-30 13:35:41 +02:00
Ruben Fiszel
5e3daf02b4 fix serving metrics on ee 2023-08-20 19:40:50 +02:00
Ruben Fiszel
09a4e492ea fix tests 2023-08-20 19:27:42 +02:00
Ruben Fiszel
0503942170 refactor default non-cloud-hosted timeout 2023-08-20 16:30:31 +02:00
Ruben Fiszel
da036b2a19 refactor workers 2023-08-20 15:58:43 +02:00
Ruben Fiszel
2afea50497 feat: prometheus metrics are now ee only 2023-08-20 12:29:05 +02:00
Ruben Fiszel
4b8d38d077 fix tar initialization 2023-08-14 16:16:42 +02:00
Ruben Fiszel
933021ad8d feat: implement binary caching for go 2023-08-08 20:54:31 +02:00
Ruben Fiszel
c22d2b91a1 feat: use flock to avoid concurrency issues on pip and shared volume 2023-07-26 20:17:26 +02:00
Ruben Fiszel
6f47bf9806 feat: handle worker groups with redis 2023-07-26 17:33:46 +02:00
Ruben Fiszel
601da7f878 fix: respect FIFO order for concurrency limit 2023-07-24 18:11:23 +02:00
Jakub Kołodziejczak
72d0d8a7f5 chore(backend): upgrade sqlx to ^0.7 (#1865)
* DRAFT chore(backend): upgrade sqlx to ^0.7

related to:
* https://github.com/windmill-labs/windmill/pull/1858
* https://github.com/launchbadge/sqlx/issues/1163#issuecomment-1627685514

* (vol. 2) in 0.7, `Transaction` can no longer implement `Executor` directly

ref: afb6b1066e/examples/postgres/transaction/src/main.rs (L14-L17)

notice that I'm temporarly using my custom patch
16e4c9a8f3
it's related to https://github.com/launchbadge/sqlx/issues/2611

* post git rebase chores

* use upstream fix from 0.7.1

* fix compile

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2023-07-15 14:06:20 +02:00
Ruben Fiszel
08e3502126 fix: make workers bind their http servers on any available port for OCI compliance 2023-07-12 11:19:01 +02:00
Guillaume Bouvignies
96df8900cb Specific NOOP jobs benchmark (#1810)
* Refactor and fix NOOP benchmark

* Add endpoint to toggle workers on/off when compiled in benchmark mode

* Improve noop benchmark
2023-07-10 14:16:34 +02:00
Ruben Fiszel
3d999007f5 improve docker-compose 2023-07-08 09:58:45 +02:00
Ruben Fiszel
2921649c3c feat: bun support (#1800)
* feat: bun support

* feat: bun support

* add bun support

* add bun support

* add bun support

* add bun
2023-07-06 21:19:07 +02:00