Commit Graph

5945 Commits

Author SHA1 Message Date
Ruben Fiszel
fb95c97463 feat: invalidate result cache on flow or script change 2023-10-31 12:49:31 +01:00
Guillaume Bouvignies
9328ab24ac chore: Add restarted flow test in worker.rs (#2524)
* chore: Add restarted flow test in worker.rs

* small refactor to rust code

* Fix unused imports
2023-10-31 09:14:14 +01:00
Ruben Fiszel
d2fca5b1c6 chore(main): release 1.194.0 (#2523)
* chore(main): release 1.194.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-30 20:17:31 +01:00
HugoCasa
b3aaed8721 fix: workspaced embeddings for resource types (#2525)
* fix: workspaced embeddings for resource types

* fix: remove admins only rts
2023-10-30 15:28:20 +01:00
Ruben Fiszel
5408da3a74 add more migration info at start 2023-10-30 15:17:32 +01:00
Guillaume Bouvignies
29ea5f0f7e feat: Restartable flows (#2514)
* feat: Restartable flows for simple sequential flows

* check if status of previous module to initialize last_result

* compute result of forloop flows when needed

* Add possibility to restart a flow preview

* Re-compute leaf jobs when needed

* FE polishing

* Add tooltip on button and fix module not found error in preview

* Handle ListJob when computing leaf job from db

* Fix unused imports

* ./build_openapi.sh

* sqlx prepare
2023-10-30 12:51:56 +01:00
Ruben Fiszel
20a6e7414e improve slow pull metrics 2023-10-30 12:20:40 +01:00
Ruben Fiszel
8e49045306 add support for pg-embed 2023-10-28 19:02:49 +02:00
Ruben Fiszel
73d0eb24ed nit metrics 2023-10-28 16:21:30 +02:00
Ruben Fiszel
b525548de0 add more metrics 2023-10-28 15:35:45 +02:00
Ruben Fiszel
37293b533e chore(main): release 1.193.0 (#2513)
* chore(main): release 1.193.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-28 15:04:26 +02:00
Ruben Fiszel
638fa64062 add dedicated worker sender channel queue 2023-10-28 14:15:42 +02:00
Ruben Fiszel
8f9bc6d3d3 feat: refactor metrics and add performance debug metrics (#2520)
* all

* feat: add debug metrics
2023-10-27 21:00:28 +02:00
Ruben Fiszel
fb2da8ebb7 fix resource types embedding 2023-10-27 16:48:20 +02:00
Ruben Fiszel
353f4fcfdb add loki as optional feature flag 2023-10-27 11:51:26 +02:00
Ruben Fiszel
acfdca7e72 associate metrics with tags and not langs anymore 2023-10-26 23:52:37 +02:00
Ruben Fiszel
bb5aad4eb8 associate metrics with tags and not langs anymore 2023-10-26 23:44:25 +02:00
Ruben Fiszel
35665cf102 fix: move keep job directories and expose debug metrics to instance settings UI 2023-10-26 13:08:39 +02:00
Ruben Fiszel
57dc62b298 fix: prometheus metrics are an instance settings 2023-10-25 23:32:47 +02:00
Ruben Fiszel
1a95c7f923 chore(main): release 1.192.0 (#2509)
* chore(main): release 1.192.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-25 10:13:51 +02:00
Ruben Fiszel
6ee1addea3 improve key not found error 2023-10-25 09:59:49 +02:00
Ruben Fiszel
4a4b3bea0c fix: do not share http_client in js_eval runtime 2023-10-25 09:51:20 +02:00
Ruben Fiszel
e555b30517 chore(main): release 1.191.0 (#2506)
* chore(main): release 1.191.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-25 01:27:28 +02:00
Ruben Fiszel
d4da2de5c0 fix: improve concurrency limit lock 2023-10-25 00:17:38 +02:00
Guillaume Bouvignies
9f6f7150cd feat: Priority worker tags (#2504)
* feat: Priority worker tags

* Fix deprecation warning

* fix tests by initializing the WorkerConfig properly
2023-10-24 17:59:31 +02:00
Guillaume Bouvignies
7441e407d4 fix: concurrency limit EE feature warning (#2505)
* fix: concurrency limit EE feature warning

* fix deprecated usage

* skip serializing empty optional
2023-10-24 17:59:16 +02:00
Ruben Fiszel
7a0346e167 improve batch job api for scripts 2023-10-24 12:20:57 +02:00
Ruben Fiszel
6a20bc8d89 chore(main): release 1.190.3 (#2502)
* chore(main): release 1.190.3

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-24 10:21:50 +02:00
Ruben Fiszel
43ba33297b fix sqlx 2023-10-24 10:21:30 +02:00
Ruben Fiszel
efe21eea75 chore(main): release 1.190.2 (#2501)
* chore(main): release 1.190.2

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-24 09:54:41 +02:00
Ruben Fiszel
02266ac311 show psql version on start 2023-10-24 09:54:01 +02:00
Guillaume Bouvignies
a6c8725227 fix: ListableQueuedJob were missing the priority field (#2500) 2023-10-24 09:49:14 +02:00
Ruben Fiszel
67e4b314bb chore(main): release 1.190.1 (#2497)
* chore(main): release 1.190.1

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-24 09:31:20 +02:00
Guillaume Bouvignies
eacef8cd5b fix: Track job UUIDs in concurrency table instead of a simple counter (#2498)
* fix: Track job UUIDs in concurrency table instead of a simple counter

* sqlx prepare
2023-10-24 09:28:46 +02:00
Ruben Fiszel
affaf57250 update rust-python to 3.0 (#2499) 2023-10-24 09:26:36 +02:00
Ruben Fiszel
f3b709857f fix: improve flow performance at high-throughput 2023-10-24 00:11:30 +02:00
Ruben Fiszel
83877a3591 fix: add shapefile to python remapping 2023-10-23 23:06:08 +02:00
Ruben Fiszel
d8eefe59b7 improve dedicated worker on default worker grou[ 2023-10-23 22:59:25 +02:00
Bonnie White
edd93b5d44 Update lib.rs (#2495) 2023-10-23 22:50:26 +02:00
Ruben Fiszel
723059b0d5 add support for batch flow jobs 2023-10-23 21:53:22 +02:00
Ruben Fiszel
402d0e3cef chore(main): release 1.190.0 (#2491)
* chore(main): release 1.190.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-23 21:49:32 +02:00
Ruben Fiszel
65b36baf41 feat: dedicated worker for python (#2492)
* update

* all
2023-10-23 20:21:16 +02:00
Ruben Fiszel
ca4502f40b remove spurious tracing::error 2023-10-23 19:46:37 +02:00
Ruben Fiszel
f586e2eec0 fix: stats nits (#2490)
Co-authored-by: HugoCasa <hugo@casademont.ch>
2023-10-23 18:07:24 +02:00
Ruben Fiszel
e86c7f1f3f chore(main): release 1.189.0 (#2481)
* chore(main): release 1.189.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2023-10-23 17:21:30 +02:00
HugoCasa
b076e093df feat: add unique id (#2483)
* feat: add unique id

* fix: sqlx prepare

* feat: add disable option

* fix: cron schedule
2023-10-23 17:05:54 +02:00
Ruben Fiszel
be13471771 fix: fix include_header 2023-10-23 17:04:16 +02:00
Guillaume Bouvignies
bd69bafe59 feat: Priority queue (#2476)
* BE v1 for priority queue

* Add FE prototype

* sqlx prepare

* Disply priority badge in job detail view

* sqlx prepare post merge

* Add priority number input field next to toggle

* increase dnd timeout for app events

* Update db migration

* Fix FE import

* Add badge to script/flow details page and fix EE-only mention in tooltip

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2023-10-23 14:22:59 +02:00
Guillaume Bouvignies
885e44e1c1 fix: Update openapi definition to be compatible with oapi-codegen (#2487) 2023-10-23 14:18:24 +02:00
Ruben Fiszel
9dd210478e feat: dragndrop component on creation 2023-10-21 22:50:19 +02:00