Commit Graph

726 Commits

Author SHA1 Message Date
Ruben Fiszel
7ff94381b1 feat: support union type will null | undefined (#400) 2022-08-13 19:35:52 +02:00
Ruben Fiszel
2d60bf2396 feat: support union types (#398) 2022-08-13 17:25:16 +02:00
Ruben Fiszel
152287ab9f full backend ci tests
* attempt ci in container

* attempt ci in container

* psql

* psql

* psql

* psql

* privileged

* cache
2022-08-12 11:21:19 +02:00
sqwishy
876709fbe9 make initialize_tracing sync and infallable (#395)
also remove tiny bit of raceyness from worker tests, there's a bit of
sync around Once but it's short so it should be fine
2022-08-12 10:44:41 +02:00
sqwishy
b17c1b1d02 pass broadcast::Receiver instead of Sender (#396)
I think this was just added a couple months ago.  If all Senders drop
the Receivers close.  This change helps avoid creating Senders that you
never send on that are just held in scope and prevent the channel from
closing.
2022-08-12 10:43:06 +02:00
sqwishy
289cd2ebaa remove unused mutex parameter for run_worker (#394) 2022-08-12 10:42:46 +02:00
Ruben Fiszel
b79ac67987 fix schedule bug 2022-08-12 04:03:39 +02:00
Ruben Fiszel
eba7054a2a disable nsjail for test 2022-08-12 03:31:50 +02:00
Ruben Fiszel
4ec74f81b2 fix test_eval_timeout 2022-08-12 02:05:59 +02:00
sqwishy
655a55777d backend tests for python job and deno flow (#389) 2022-08-12 01:50:31 +02:00
Ruben Fiszel
5a7168b372 update backend + 404 on non found assets 2022-08-11 21:00:53 +02:00
sqwishy
1b48c2c1cf ping hub.windmill.dev/getip for external ip without using only reqwest (#384) 2022-08-11 01:01:24 +02:00
sqwishy
bc3c69c554 correct query param number in delete_token (#380) 2022-08-09 17:57:03 +02:00
Ruben Fiszel
887ba750f9 fix replacement 2022-08-09 15:57:56 +02:00
Ruben Fiszel
0d9d24bb1b fix replacement 2022-08-09 15:48:28 +02:00
Ruben Fiszel
fc0a83ee6d psycopg2 => binary 2022-08-09 15:17:01 +02:00
sqwishy
2926fc54f4 DATABASE_CONNECTIONS sets Pool max_connections (#376)
If unspecified, defaults to the current value of 100
2022-08-09 09:47:48 +02:00
Ruben Fiszel
0a9332187f raise limit to 200000 chars 2022-08-08 13:57:39 +02:00
Ruben Fiszel
85c1559c9f surface better the transform_json_value step errors 2022-08-08 11:54:01 +02:00
Ruben Fiszel
53b19b871c increase limit to 900s over the last 1200s 2022-08-07 14:39:57 +02:00
Ruben Fiszel
373d8085a7 do rate limit based on as_permissioned_as 2022-08-07 14:04:17 +02:00
Ruben Fiszel
69dcdbd00b fix: update logs even if last new log was < 500ms 2022-08-07 13:48:37 +02:00
Ruben Fiszel
a831cb1472 rewrite kill wait 2022-08-07 12:55:21 +02:00
Ruben Fiszel
084cc8a2dd prevent log spam abuse 2022-08-07 12:50:28 +02:00
Ruben Fiszel
503b56b3db more logging around command executions 2022-08-07 12:25:45 +02:00
Ruben Fiszel
23a2b3389b more logging around command executions 2022-08-07 12:00:41 +02:00
Ruben Fiszel
20a2b5808c audit logs for all execute case 2022-08-07 11:14:00 +02:00
Ruben Fiszel
feeaf5d963 add summary field for modules 2022-08-06 23:37:17 +02:00
Ruben Fiszel
dcb5d8deb9 rework input transform for the forloop module 2022-08-06 14:02:39 +02:00
Ruben Fiszel
9f3a191b3b fix(python): not filled field with default <function_call> now call the default function 2022-08-06 12:51:14 +02:00
Ruben Fiszel
837a500a1a display inputs in flow viewer too 2022-08-06 09:30:10 +02:00
Ruben Fiszel
6026e32c98 improve error message for parsing 2022-08-06 08:45:37 +02:00
Ruben Fiszel
323fd30a00 rework default python script 2022-08-05 20:21:13 +02:00
Ruben Fiszel
02fd242bb7 feat: _value, _index => iter.value, iter.index 2022-08-05 20:11:25 +02:00
Ruben Fiszel
5d3cd541c7 fix: do not skip undefined values 2022-08-05 19:53:28 +02:00
Ruben Fiszel
449fb27a53 feat: remove res1 wrapping 2022-08-05 19:47:00 +02:00
Ruben Fiszel
cd8db7a015 do not cache html, cache everything else for a long time 2022-08-05 11:00:41 +02:00
Ruben Fiszel
5cc1ae2c05 fix flowstatusviewer and updating to in_progress much sooner 2022-08-05 00:46:10 +02:00
Ruben Fiszel
fe81c17d2f fix(backend): generalize oauth clients to take in extra params 2022-08-04 14:32:04 +02:00
Ruben Fiszel
644f8cfe37 fix(backend): handle better some flow edge-cases 2022-08-04 01:50:47 +02:00
Ruben Fiszel
cd9bd29931 fix(backend): handle better some flow edge-cases 2022-08-04 01:48:53 +02:00
Ruben Fiszel
089f4a7811 fix(backend): handle better some flow edge-cases 2022-08-04 01:13:12 +02:00
sqwishy
6c71fac136 fix(backend): prometheus histogram for worker job timer (#312)
* prometheus histogram for worker job timer

hosts on :8001

* some new metrics in worker + field

adds start_time_seconds, job_duration_seconds & jobs_failed

* use tokio task_local to count job failures

* METRICS_ADDR environment variable off by default

true defaults to 0.0.0.0:8001 otherwise expects a socket address

* pass metrics as args instead of task local
2022-08-02 22:56:25 +02:00
Ruben Fiszel
5e14b6dfb3 feat: add primitive sql format (#320) 2022-08-02 16:55:20 +02:00
Ruben Fiszel
31904be890 update current job to in progress 2022-07-31 22:47:07 +02:00
Ruben Fiszel
d397e6d618 update current job to in progress 2022-07-31 22:41:41 +02:00
Ruben Fiszel
c37b9f7106 do not serialize the whole object for job in progress update 2022-07-31 22:31:44 +02:00
Ruben Fiszel
a368d2c6d4 order result from forloop bby args _index 2022-07-31 20:41:35 +02:00
Ruben Fiszel
03ed38e9b2 only check for schedule if not a flow step 2022-07-31 20:30:30 +02:00
Ruben Fiszel
7f55e7a498 report flow for whom the fetching error is happening 2022-07-31 20:23:03 +02:00