Commit Graph

796 Commits

Author SHA1 Message Date
Ruben Fiszel
ece86d9d14 fix: improve perf of forloop with parallelism massively 2024-06-22 14:14:15 +02:00
HugoCasa
6933f06f1c feat: add extra metadata to folders/resources/types + path prefix filtering for all + improve groups UI (#3936)
* feat: add extra metadata to folders/schedules/resources/types

* feat: add path prefix filter to api

* chore: updatee ref

* feat: improve groups UI

* fix: nit

* fix: nit
2024-06-22 01:29:23 +02:00
Ruben Fiszel
0ad858ee5c fix: improve support of relative paths in subflows and apps 2024-06-21 18:07:58 +02:00
Ruben Fiszel
4d0c1b1371 fix(cli): support windows more thoroughly + fix generate flow locks (#3944)
* all

* all

* all

* fix lock

* fix lock

* fix lock

* fix lock
2024-06-21 14:23:33 +02:00
Ruben Fiszel
72ab75a149 add more debug lines 2024-06-19 19:43:13 +02:00
Ruben Fiszel
88416020b8 nit remove error logs + add setTimeout to REST runtime 2024-06-19 17:58:24 +02:00
Ruben Fiszel
6bb93d91d8 fix: handle better single step parallel flows 2024-06-19 08:28:15 +02:00
Ruben Fiszel
710a0933bd update datafusion 2024-06-18 20:51:59 +02:00
HugoCasa
6da5e15903 feat: add support for bytea in pg (#3926)
* feat: add support for bytea in pg

* fix: editor nits
2024-06-18 17:38:46 +02:00
Ruben Fiszel
1e26af3b44 fix: add more debug logs around http client errors 2024-06-18 09:01:55 +02:00
Ruben Fiszel
f2f3333e2d fix: add more debug logs around http client errors 2024-06-18 08:54:55 +02:00
HugoCasa
93f58056a0 feat: replace ephemeral tokens by jwt (#3908)
* feat: replace ephemeral tokens by jwt

* fix: migration + sqlx

* fix: tests, agent, ee ref

* fix: sqlx

* fix: tests

* fix: jwt prefix change + fix tests

* fix: nit

* fix: handle agent mode
2024-06-14 13:07:35 +02:00
Ruben Fiszel
fa365027a3 fix bun cache 2024-06-13 22:08:33 +02:00
Ruben Fiszel
f740614c0b feat: accelerate bun through caches (#3909)
* all

* all

* all

* all

* all

* simplify extract
2024-06-13 19:09:16 +02:00
Richard Klees
c6a74739aa fix: correct exception handling in PHP wrapper (#3901)
The `catch` is hinting on `\Exception` [1] which has not `getName`-method.
To identify the type of exception, `get_class` can be used.

[1] https://www.php.net/manual/de/class.exception.php

Co-authored-by: HugoCasa <hugo@casademont.ch>
2024-06-13 08:13:32 +02:00
Ruben Fiszel
2a2755166d fix: fix dependency tracking for single scripts 2024-06-11 21:04:03 +02:00
Ruben Fiszel
f642716e5d fix: fix dependency tracking for single scripts 2024-06-11 20:51:57 +02:00
Ruben Fiszel
5e73ed5569 fix(backend): wrong previous result used in flow for-loop 2024-06-11 17:35:38 +02:00
Ruben Fiszel
db938f5227 fix: flow args should always render in test flow 2024-06-11 13:57:53 +02:00
Ruben Fiszel
f3f8d6ac8d fix: fix nativets scripts 2024-06-10 19:09:38 +02:00
Ruben Fiszel
af52c61385 fix: update deno_core to latest to work better with rust 1.78 (#3890) 2024-06-10 18:31:16 +02:00
Ruben Fiszel
5cb2c9d1f7 feat(cli): add wmill flow generate-locks 2024-06-10 11:44:53 +02:00
Ruben Fiszel
4c20d88fee remove all warnings 2024-06-08 18:06:04 +02:00
Ruben Fiszel
600fcaf32f return flow value in flow dependency job 2024-06-08 17:38:06 +02:00
Ruben Fiszel
c8915063c4 feat: track dependency map for bun + inline script of flows 2024-06-08 16:43:48 +02:00
Ruben Fiszel
d392de3a70 fix: retrigger bun dependencies jobs for importers when using common deps 2024-06-07 13:34:07 +02:00
Ruben Fiszel
de2d524362 increase token length to 32 chars 2024-06-05 15:49:21 +02:00
Ruben Fiszel
8671126d84 fix: use full hostname as worker ping hostname and add it in other contexts 2024-06-05 11:28:51 +02:00
Ruben Fiszel
fa0e7d0fde fix: fix writing binary file from global cache in go 2024-06-04 21:17:05 +02:00
Ruben Fiszel
1882c60eb3 fix: lock steps inside whileloops for flows 2024-06-03 19:37:42 +02:00
wendrul
62f889c9da feat: warn when jobs spent a long time waiting in queue (#3856)
* Store jobs that waited for too long

* Add warnings as badges for long waited jobs

* Separate into self_wait_time and aggregate

Change the UI accordingly

* Prepare sqlx

* Update backend/windmill-queue/src/jobs.rs

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* Fix incorrect query

* Prepare sqlx

* Move insert to pull + UI fixes

Insert as soon as the job is pulled and therefore started.
Add a badge on the lfow timeline to show the self wait time

* Move to after the pull in the worker

Move the logic to after the pull in the worker in the case its not a
noop

* Remove weird line

* Remove unnecessary async

---------

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2024-06-03 16:05:15 +02:00
Ruben Fiszel
e666f837cd fix: further restrict job api to logged in workspace users or anonymous jobs only" (#3860) 2024-06-03 15:13:15 +02:00
Ruben Fiszel
a4d4213f2f fix compile issue 2024-05-31 12:30:58 +02:00
Ruben Fiszel
0e7a25c0bd feat: support multiple object storage + parquet_csv + polars -> datafusion" (#3853)
* multiple storage

* all

* rm symlinks

* all

* all
2024-05-31 11:59:51 +02:00
Ruben Fiszel
9c7bb778a1 jemalloc for all 2024-05-29 01:44:37 +02:00
HugoCasa
bba0091bff fix: worker metrics (#3837)
* fix: worker metrics

* chore: sqlx

* chore: update ee ref

* fix: remove jemalloc stats unwrap
2024-05-29 01:12:00 +02:00
Ruben Fiszel
f254870e91 fix: fix retry not working on single step flow due to opt 2024-05-28 10:48:41 +02:00
HugoCasa
5de79aace3 feat: worker vcpus/memory limits + mem usage (#3828) 2024-05-27 18:43:02 +02:00
Ruben Fiszel
3db4e3bab1 feat: allow user resources in apps with a toggle (#3821)
* all

* all

* all

* all

* all

* all

* all

* all

* all

* all

* nits

* nits
2024-05-27 07:51:49 +02:00
Ruben Fiszel
6a332bc30f fix: make all error strings more verbose 2024-05-25 22:15:15 +02:00
Ruben Fiszel
4f30b1fb82 feat: store failed_retries per module state and display failed retries in flow status viewer 2024-05-23 19:16:26 +02:00
HugoCasa
126459f972 feat: improve permissioned audit logs (#3799)
* fix: increase token label size in db

* Revert "Revert "feat:  improve premissioned audit logs (#3793)" (#3798)"

This reverts commit afae33f5f8.

* feat: add username to email function

* fix: nit

* fix: add docstring to global func
2024-05-23 17:23:50 +02:00
Ruben Fiszel
afae33f5f8 Revert "feat: improve premissioned audit logs (#3793)" (#3798)
This reverts commit 35f8eecf2d.
2024-05-23 11:12:51 +02:00
HugoCasa
35f8eecf2d feat: improve premissioned audit logs (#3793)
* feat:  improve premissioned audit logs

* chore: update ee ref

* fix: build

* fix: sqlx
2024-05-23 08:55:48 +02:00
Ruben Fiszel
9a1611db6f make drop cache not an error 2024-05-22 13:16:53 +02:00
Ruben Fiszel
e39b02d2a3 fix: drop the linux file cache regularly to avoid triggering OOM killer 2024-05-21 10:21:14 +02:00
Ruben Fiszel
b6ff540f6e remove extra tracing 2024-05-20 12:34:15 +02:00
Ruben Fiszel
44986bbf16 sleep handle f64 2024-05-19 22:21:18 +02:00
Ruben Fiszel
fc2691d598 handle early stop for simple flows 2024-05-19 22:07:06 +02:00
Ruben Fiszel
c43d04b95d feat: reduce memory usage (#3768)
* all

* all

* optimize deserialize

* all

* all

* fix issue

* fix compile

* fix compile

* fix compile

* fix compile

* fix compile

* fix compile

* fix compile

* fix compile

* fix compile

* fix compile
2024-05-19 21:58:38 +02:00