Commit Graph

147 Commits

Author SHA1 Message Date
Ruben Fiszel
f679e67de8 feat: rely on PG time rather than worker time 2022-08-20 15:16:08 +02:00
sqwishy
84fd2e2532 feat(backend): failure_module (#452)
* run failure_module

- renames FlowModule.input_transform to input_transforms
- parse_deno_signature prints source on failure instead of debug
  representation of AST

* s/should_continue_job/should_continue_flow
2022-08-19 20:18:07 +02:00
sqwishy
e42355b27c fix(backend): fixes forloop with 257 items only iterates once (#446)
usize as u8 will mask out the higher bits, so 0x100 as u8 is 0x00, 0x101
is 0x01 and only iterates once, etc....

refactors push_next_flow_job a bit
2022-08-19 17:14:46 +02:00
Ruben Fiszel
131483751f pass BASE_INTERNAL_URL to the python process 2022-08-19 07:09:50 +02:00
Ruben Fiszel
8329e1ab95 pass BASE_INTERNAL_URL to the deno process 2022-08-19 07:02:10 +02:00
Ruben Fiszel
f26ace0cf1 fix export to tarball 2022-08-19 00:55:38 +02:00
Ruben Fiszel
7564901a84 use ts extension for private imports 2022-08-18 22:18:57 +02:00
Ruben Fiszel
d2f5505589 feat: private imports 2022-08-18 21:49:24 +02:00
Ruben Fiszel
d3e0982bac fix behavior of disable nsjail and disable nuser 2022-08-18 17:22:16 +02:00
Ruben Fiszel
79ec90acfc fix forloop empty no step afterward 2022-08-18 00:01:04 +02:00
Ruben Fiszel
47169f9c0b fix: handle 0 length for-loops in the backend (#440)
* wip

* TODO

* my fix works I think
2022-08-17 15:56:49 +02:00
Ruben Fiszel
ad4c06df94 remove zendesk 2022-08-16 23:45:58 +02:00
Ruben Fiszel
d31804802e fix(backend): collecting result when for loop is not the last step #422
* wip: step after forloop results

Adding a failing test so I don't forget out about it.

In the last step, `items` is `4`, the last item in iteration, rather
than the collected list.  My guess is this is because the results aren't
collected unless the flow quits early or the forloop module is the last
module so that `last_step` is true.

* test

Co-authored-by: sqwishy <somebody@froghat.ca>
2022-08-16 23:03:55 +02:00
Ruben Fiszel
f1b9964fe0 pass path as env variable 2022-08-15 13:51:16 +02:00
Ruben Fiszel
7b81de9665 make executable paths configurable 2022-08-15 13:32:51 +02:00
Ruben Fiszel
95274ea651 fix: set secure only for https 2022-08-15 10:40:01 +02:00
Ruben Fiszel
8a643b2209 remove hardcoded paths when nsjail is disabled 2022-08-15 10:08:40 +02:00
Ruben Fiszel
698c510f81 set local authorization -> set role 2022-08-14 23:33:09 +02:00
Ruben Fiszel
08374e7984 feat: db users: admin -> windmill_admin, app -> windmill_user (#404)
* feat: db users: admin -> windmill_admin, app -> windmill_user

* clean up

* backend tests

* backend tests

* backend tests

* lock roles in first migration

* check if user is superuser too

* add init-db

* add init-db
2022-08-14 18:20:27 +02:00
Ruben Fiszel
3d6167399a remove println 2022-08-13 21:20:50 +02:00
Ruben Fiszel
6e8e0e59d0 feat: add literal object type support (#401) 2022-08-13 21:18:54 +02:00
Ruben Fiszel
7ff94381b1 feat: support union type will null | undefined (#400) 2022-08-13 19:35:52 +02:00
Ruben Fiszel
2d60bf2396 feat: support union types (#398) 2022-08-13 17:25:16 +02:00
Ruben Fiszel
152287ab9f full backend ci tests
* attempt ci in container

* attempt ci in container

* psql

* psql

* psql

* psql

* privileged

* cache
2022-08-12 11:21:19 +02:00
sqwishy
876709fbe9 make initialize_tracing sync and infallable (#395)
also remove tiny bit of raceyness from worker tests, there's a bit of
sync around Once but it's short so it should be fine
2022-08-12 10:44:41 +02:00
sqwishy
b17c1b1d02 pass broadcast::Receiver instead of Sender (#396)
I think this was just added a couple months ago.  If all Senders drop
the Receivers close.  This change helps avoid creating Senders that you
never send on that are just held in scope and prevent the channel from
closing.
2022-08-12 10:43:06 +02:00
sqwishy
289cd2ebaa remove unused mutex parameter for run_worker (#394) 2022-08-12 10:42:46 +02:00
Ruben Fiszel
b79ac67987 fix schedule bug 2022-08-12 04:03:39 +02:00
Ruben Fiszel
eba7054a2a disable nsjail for test 2022-08-12 03:31:50 +02:00
Ruben Fiszel
4ec74f81b2 fix test_eval_timeout 2022-08-12 02:05:59 +02:00
sqwishy
655a55777d backend tests for python job and deno flow (#389) 2022-08-12 01:50:31 +02:00
Ruben Fiszel
5a7168b372 update backend + 404 on non found assets 2022-08-11 21:00:53 +02:00
sqwishy
1b48c2c1cf ping hub.windmill.dev/getip for external ip without using only reqwest (#384) 2022-08-11 01:01:24 +02:00
sqwishy
bc3c69c554 correct query param number in delete_token (#380) 2022-08-09 17:57:03 +02:00
Ruben Fiszel
887ba750f9 fix replacement 2022-08-09 15:57:56 +02:00
Ruben Fiszel
0d9d24bb1b fix replacement 2022-08-09 15:48:28 +02:00
Ruben Fiszel
fc0a83ee6d psycopg2 => binary 2022-08-09 15:17:01 +02:00
sqwishy
2926fc54f4 DATABASE_CONNECTIONS sets Pool max_connections (#376)
If unspecified, defaults to the current value of 100
2022-08-09 09:47:48 +02:00
Ruben Fiszel
0a9332187f raise limit to 200000 chars 2022-08-08 13:57:39 +02:00
Ruben Fiszel
85c1559c9f surface better the transform_json_value step errors 2022-08-08 11:54:01 +02:00
Ruben Fiszel
53b19b871c increase limit to 900s over the last 1200s 2022-08-07 14:39:57 +02:00
Ruben Fiszel
373d8085a7 do rate limit based on as_permissioned_as 2022-08-07 14:04:17 +02:00
Ruben Fiszel
69dcdbd00b fix: update logs even if last new log was < 500ms 2022-08-07 13:48:37 +02:00
Ruben Fiszel
a831cb1472 rewrite kill wait 2022-08-07 12:55:21 +02:00
Ruben Fiszel
084cc8a2dd prevent log spam abuse 2022-08-07 12:50:28 +02:00
Ruben Fiszel
503b56b3db more logging around command executions 2022-08-07 12:25:45 +02:00
Ruben Fiszel
23a2b3389b more logging around command executions 2022-08-07 12:00:41 +02:00
Ruben Fiszel
20a2b5808c audit logs for all execute case 2022-08-07 11:14:00 +02:00
Ruben Fiszel
feeaf5d963 add summary field for modules 2022-08-06 23:37:17 +02:00
Ruben Fiszel
dcb5d8deb9 rework input transform for the forloop module 2022-08-06 14:02:39 +02:00