Commit Graph

169 Commits

Author SHA1 Message Date
ex0ns
6f09405c2d feat(job): run job by hash (#551)
It was possible to run them using a webhook, but not through an endpoint.
This PR aims to fix that so the user can target a specific version of
the script to run.
2022-09-11 16:39:48 +02:00
Ruben Fiszel
e9abcffdd1 feat: is_trigger is just a type tag, soon to include failure and command (#523)
* script kind

* all

* init code flow

* kind: trigger

* kind: trigger
2022-09-05 09:55:04 +02:00
Ruben Fiszel
482dc808ae logs around fetching job 2022-09-04 13:30:48 +02:00
Ruben Fiszel
12e2a31776 logs around job execution contain job id 2022-09-04 13:11:43 +02:00
Ruben Fiszel
b6725dceca use local time for timeout 2022-09-04 13:05:39 +02:00
Ruben Fiszel
1bc12179c7 fix: last ping is set when the job is started avoiding erronous restart 2022-09-04 12:51:55 +02:00
sqwishy
d69d002b82 flow step retry feature (#493)
* flow step retry feature

* comparison constant on right side for clarity

* raise high retry values when starting a flow

also renamed duration to interval to be more specific about the retry
interval/period between tries or attempts

* add flow retry to openflow openapi

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2022-09-03 20:38:31 +02:00
Ruben Fiszel
cf7209bdb9 feat: clean openflow spec v1 (#491)
* clean api 2

* the rest

* clean tests

* stop_after_if test

* unbox `modules: Vec<FlowModule>` in `ForloopFlow`

* migrate

* initFlow stop_after_if_expr and skip_if_stopped

* s/migrateInitTransform/migrateFlowModule

I didn't read the name before... oops

* sql migration for openflow changes

* fix frontend migration code

Co-authored-by: sqwishy <somebody@froghat.ca>
2022-09-02 01:26:39 +02:00
Ruben Fiszel
76f8165b82 pass language to completed job 2022-08-25 14:55:38 +02:00
Ruben Fiszel
b8b1cc83ae list flow steps only on the tab 'all' 2022-08-23 15:18:44 +02:00
Ruben Fiszel
9498975fee add base_url to DENO_AUTH_TOKENS 2022-08-22 02:47:44 +02:00
Ruben Fiszel
35277160a6 feat: pass bearerToken as queryArg 2022-08-21 22:39:19 +02:00
Ruben Fiszel
b9dfbfa2d8 feat: implicit types infered from default parameters 2022-08-21 22:01:24 +02:00
Ruben Fiszel
da77d04094 fix: restart zombie jobs was restarting all jobs 2022-08-21 12:19:31 +02:00
Ruben Fiszel
1849cd8398 remove unecessary comment in worker 2022-08-21 12:10:03 +02:00
Ruben Fiszel
34e69bfe5d remove unecessary transaction in worker 2022-08-21 12:08:15 +02:00
Ruben Fiszel
1a552d1517 optimize python parsing + adding tests 2022-08-21 10:53:41 +02:00
Ruben Fiszel
c0e9cd0564 fix: cancel a flow now does the expected behavior 2022-08-20 19:23:43 +02:00
Ruben Fiszel
0cd814cfec fix(backend): clear_schedule only clear non running jobs 2022-08-20 19:14:16 +02:00
Ruben Fiszel
77a685144d fix(backend): started_at info for completed_job is no more completed_at 2022-08-20 17:06:13 +02:00
Ruben Fiszel
d99d4aaa92 optimize for python code having no imports 2022-08-20 16:21:04 +02:00
Ruben Fiszel
e38cec3b17 fix collection on forloops + increase number of tests 2022-08-20 16:08:11 +02:00
Ruben Fiszel
00572668f1 feat: rely on PG time rather than worker time 2022-08-20 15:16:08 +02:00
sqwishy
32d067f8c0 feat(backend): failure_module (#452)
* run failure_module

- renames FlowModule.input_transform to input_transforms
- parse_deno_signature prints source on failure instead of debug
  representation of AST

* s/should_continue_job/should_continue_flow
2022-08-19 20:18:07 +02:00
sqwishy
bae85732ff fix(backend): fixes forloop with 257 items only iterates once (#446)
usize as u8 will mask out the higher bits, so 0x100 as u8 is 0x00, 0x101
is 0x01 and only iterates once, etc....

refactors push_next_flow_job a bit
2022-08-19 17:14:46 +02:00
Ruben Fiszel
8c04558c4e pass BASE_INTERNAL_URL to the python process 2022-08-19 07:09:50 +02:00
Ruben Fiszel
ea6f3c037c pass BASE_INTERNAL_URL to the deno process 2022-08-19 07:02:10 +02:00
Ruben Fiszel
9f02ca8dec fix export to tarball 2022-08-19 00:55:38 +02:00
Ruben Fiszel
c2f616da0d use ts extension for private imports 2022-08-18 22:18:57 +02:00
Ruben Fiszel
a5343fa959 feat: private imports 2022-08-18 21:49:24 +02:00
Ruben Fiszel
451bddf015 fix behavior of disable nsjail and disable nuser 2022-08-18 17:22:16 +02:00
Ruben Fiszel
ae90c1cfed fix forloop empty no step afterward 2022-08-18 00:01:04 +02:00
Ruben Fiszel
561e13e51e fix: handle 0 length for-loops in the backend (#440)
* wip

* TODO

* my fix works I think
2022-08-17 15:56:49 +02:00
Ruben Fiszel
99594ff968 remove zendesk 2022-08-16 23:45:58 +02:00
Ruben Fiszel
e606118943 fix(backend): collecting result when for loop is not the last step #422
* wip: step after forloop results

Adding a failing test so I don't forget out about it.

In the last step, `items` is `4`, the last item in iteration, rather
than the collected list.  My guess is this is because the results aren't
collected unless the flow quits early or the forloop module is the last
module so that `last_step` is true.

* test

Co-authored-by: sqwishy <somebody@froghat.ca>
2022-08-16 23:03:55 +02:00
Ruben Fiszel
824e91bbc7 pass path as env variable 2022-08-15 13:51:16 +02:00
Ruben Fiszel
064ae59338 make executable paths configurable 2022-08-15 13:32:51 +02:00
Ruben Fiszel
1275f5f7fb fix: set secure only for https 2022-08-15 10:40:01 +02:00
Ruben Fiszel
92d1a3a441 remove hardcoded paths when nsjail is disabled 2022-08-15 10:08:40 +02:00
Ruben Fiszel
1b377f8f02 set local authorization -> set role 2022-08-14 23:33:09 +02:00
Ruben Fiszel
1c40f01e5d feat: db users: admin -> windmill_admin, app -> windmill_user (#404)
* feat: db users: admin -> windmill_admin, app -> windmill_user

* clean up

* backend tests

* backend tests

* backend tests

* lock roles in first migration

* check if user is superuser too

* add init-db

* add init-db
2022-08-14 18:20:27 +02:00
Ruben Fiszel
c8dca072dd remove println 2022-08-13 21:20:50 +02:00
Ruben Fiszel
845de82062 feat: add literal object type support (#401) 2022-08-13 21:18:54 +02:00
Ruben Fiszel
0384727a56 feat: support union type will null | undefined (#400) 2022-08-13 19:35:52 +02:00
Ruben Fiszel
e68ea1b8fc feat: support union types (#398) 2022-08-13 17:25:16 +02:00
Ruben Fiszel
cb43802c69 full backend ci tests
* attempt ci in container

* attempt ci in container

* psql

* psql

* psql

* psql

* privileged

* cache
2022-08-12 11:21:19 +02:00
sqwishy
91bc88b574 make initialize_tracing sync and infallable (#395)
also remove tiny bit of raceyness from worker tests, there's a bit of
sync around Once but it's short so it should be fine
2022-08-12 10:44:41 +02:00
sqwishy
08d1a35009 pass broadcast::Receiver instead of Sender (#396)
I think this was just added a couple months ago.  If all Senders drop
the Receivers close.  This change helps avoid creating Senders that you
never send on that are just held in scope and prevent the channel from
closing.
2022-08-12 10:43:06 +02:00
sqwishy
65e275556d remove unused mutex parameter for run_worker (#394) 2022-08-12 10:42:46 +02:00
Ruben Fiszel
359d3899a2 fix schedule bug 2022-08-12 04:03:39 +02:00