Commit Graph

270 Commits

Author SHA1 Message Date
Ruben Fiszel
c73e7dbd8c feat: add distributed global cache for go 2024-04-26 11:31:21 +02:00
Ruben Fiszel
4188383d3e feat: add distributed global cache for go 2024-04-26 11:31:21 +02:00
Ruben Fiszel
0be55ae98c feat: support multiple labels for jobs (wm_label -> wm_labels) 2024-04-24 11:32:25 +02:00
Ruben Fiszel
fcff457462 feat: add label and schedule filters to runs page 2024-04-23 22:48:21 +02:00
HugoCasa
8ae16d90ed feat: hide scripts with on function main from operators + badge/filter for devs (#3584)
* feat: save in DB whether script has not main function

* fix: if cannot parse script args, clear schema

* feat: no main function badge and filter

* fix: sqlx

* fix: no main
2024-04-22 15:59:13 +02:00
wendrul
ac841400ba Instrument logs (#3566)
* Add spans to show worker_name and job_id

Always show worker_name and job_id when relevant, by creating spans that
live as long as the worker and the job.

* Remove redundant worker names from fn run_worker

Remove the now redundant worker_name tracing, as the information now
lives at the span level

* Use span when spawning new thread

* Instrument more pertinent functions

Move spans to more pertinent functions. Remove more redundant info, and
change worker_name to just worker

* Change tracing subscriber to log path:line_no

Change from logging target (module name usually) to file path and line
number
2024-04-18 01:11:14 +02:00
Ruben Fiszel
ca3e2888a6 fix ee links 2024-04-17 22:38:03 +02:00
Ruben Fiszel
071a0ae927 feat: show more for logs on s3 directly possible from browser log viewer 2024-04-17 21:42:46 +02:00
Ruben Fiszel
a55aad3003 feat: flow concurrency limits support custom concurrency key 2024-04-09 22:03:39 +02:00
HugoCasa
08231c02d2 feat: git sync group changes by folder (#3517)
* feat: git sync group changes by folder

* chore: update ee ref
2024-04-05 23:07:27 +02:00
HugoCasa
1d7bab075b feat: private hub (#3491)
* feat: private hub v0

* feat: add UI setting

* Update ee.rs

* Update ee.rs

* fix: remove ee symlink

* fix: add back CE ee.rs

* feat: disable s3 embedding loading when private hub

* feat: reload embeddings on hub url change

* fix: only reload embeddings db on server mode

* patch: set default hub url const

* fix: nit
2024-04-04 04:16:53 +02:00
Ruben Fiszel
501c4d8ac4 allow_http by default for s3 2024-04-03 13:58:52 +02:00
Ruben Fiszel
ff26c8e42d feat: while loop as new flow primitive 2024-04-02 17:38:11 +02:00
Ruben Fiszel
cc5d1b405e continue on error option for steps 2024-04-02 10:32:47 +02:00
Ruben Fiszel
810136a4a4 feat: approval steps description 2024-03-27 14:04:14 +01:00
HugoCasa
14a86bf59c feat: add visible to runner only default value (#3472) 2024-03-26 19:07:21 +01:00
Ruben Fiszel
ef1ce83279 feat: add set_flow_user_states and get_flow_user_states api and sdk support 2024-03-26 17:31:17 +01:00
HugoCasa
283d55008c feat: add workspace environment vars (custom contextual vars) (#3455)
* feat: custom contextual variables

* chore: sqlx prepare

* fix: main merge
2024-03-23 11:40:55 +01:00
Ruben Fiszel
75e9e67d7a feat: large log disk and distributed storage compaction 2024-03-23 10:55:29 +01:00
Ruben Fiszel
c2d4512978 improve cred store error 2024-03-22 18:00:06 +01:00
HugoCasa
522f32c6c0 feat keep sql columns ordering (#3444)
* feat: keep pg columns ordering

* feat: pass column order through flow status

* feat: sql ordering for all sql langs

* fix: sqlx build on mac + rename to _metadata

* Update JobPreview.svelte

* Update +page.svelte

* Update +page.svelte

* Update LogPanel.svelte

* Update +page.svelte

* Update LogPanel.svelte

* Update JobPreview.svelte

* fix: build

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-03-22 10:34:32 +01:00
Ruben Fiszel
4c388533fb chore: update deps 2024-03-21 13:37:17 +01:00
Ruben Fiszel
030f6c553e generalize cache object store 2024-03-21 08:50:10 +01:00
Ruben Fiszel
745bd4d170 fix compile on non ee 2024-03-20 15:09:28 +01:00
Ruben Fiszel
174ead0473 feat: s3 cache config added to instance settings + parallelized tar pulling 2024-03-20 14:19:34 +01:00
Ruben Fiszel
b3e53de947 removing pulling all piptars at start 2024-03-17 11:21:43 +01:00
Ruben Fiszel
e5366b84bb feat: refactor logging to improve performance by order of magnitude for longer jobs 2024-03-16 17:55:34 +01:00
Ruben Fiszel
ae661365e4 fix: s3 cache is an instance settings (#3421)
* s3

* s3
2024-03-15 15:09:05 +01:00
Ruben Fiszel
cd0a6809ee fix readme 2024-03-15 10:09:08 +01:00
Ruben Fiszel
df910d7441 fix: be less agressive with log streaming for long jobs 2024-03-14 19:42:41 +01:00
HugoCasa
104aa75634 feat: git sync users groups (#3391)
* feat: git sync users groups

* fix: sqlx build

* chore: set ee ref + hub sync script
2024-03-12 23:42:59 +01:00
HugoCasa
4f65b23cdd feat: instance usernames (#3382)
* feat: instance usernames

* fix: sqlx + ee ref

* feat: make one-off button for enabling

* chore: set ee ref

* fix: permissions and nits

* fix: admin instance username + sqlx build

* fix: revert stupid change

* fix: only create instance username when setting enabled

* chore: update to ee latest
2024-03-12 11:55:18 +01:00
Ruben Fiszel
bddbd0940e fix compile 2024-03-08 23:55:10 +01:00
Ruben Fiszel
4578ed32da feat: implement s3 oidc support + azure workload identity support 2024-03-08 22:51:16 +01:00
Ruben Fiszel
619e2784f0 feat: workflow as code v0 2024-03-04 20:19:34 +01:00
Ruben Fiszel
49be282d21 fix: fix scheduling of overlapping flows 2024-02-27 00:50:03 +01:00
Ruben Fiszel
36771fbbde improve runs filter 2024-02-27 00:08:37 +01:00
HugoCasa
31c17be8b7 chore: stats in EE (#3296)
* feat: switch stats to closed source

* fix: remove symlink

* fix: add emptied stats

* fix: remove unneeded imports

* fix: embedding feature flag

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-02-26 20:08:22 +01:00
Ruben Fiszel
acd6c07444 revert ee 2024-02-24 17:26:35 +01:00
Ruben Fiszel
665d0d5ef1 chore: fasten compilation time 2024-02-24 17:10:55 +01:00
Ruben Fiszel
494ce162c0 chore: fasten compilation time 2024-02-24 16:29:35 +01:00
Ruben Fiszel
37987bf9ad fix: make setting owner for folders a transaction 2024-02-23 23:12:50 +01:00
Ruben Fiszel
0df43221ec fix: improve support for singlescriptflow 2024-02-23 21:06:55 +01:00
Ruben Fiszel
4db0eb9222 revert ee links 2024-02-22 15:28:18 +01:00
Ruben Fiszel
08264e9c1a fix: fix sqlx build 2024-02-22 15:11:36 +01:00
Ruben Fiszel
34ffde0652 revert ee symlink change 2024-02-22 14:41:39 +01:00
Ruben Fiszel
bc8e481fbb fix: improve scim handling of renames on azure 2024-02-22 14:35:40 +01:00
Ruben Fiszel
1a4e56d18a lighten schedule export 2024-02-21 22:39:01 +01:00
Ruben Fiszel
18a7c48f91 fix: fix app policy quote escaping 2024-02-21 21:44:44 +01:00
HugoCasa
458550f314 fix: backend build on macos (#3243) 2024-02-19 09:58:12 +01:00