Commit Graph

438 Commits

Author SHA1 Message Date
Ruben Fiszel
6332910dd2 fix(backend): generalize oauth clients to take in extra params 2022-08-04 14:32:04 +02:00
Ruben Fiszel
3bcd542130 fix(backend): handle better some flow edge-cases 2022-08-04 01:50:47 +02:00
Ruben Fiszel
988536128b fix(backend): handle better some flow edge-cases 2022-08-04 01:48:53 +02:00
Ruben Fiszel
70de6e3972 fix(backend): handle better some flow edge-cases 2022-08-04 01:13:12 +02:00
sqwishy
40555868e6 fix(backend): prometheus histogram for worker job timer (#312)
* prometheus histogram for worker job timer

hosts on :8001

* some new metrics in worker + field

adds start_time_seconds, job_duration_seconds & jobs_failed

* use tokio task_local to count job failures

* METRICS_ADDR environment variable off by default

true defaults to 0.0.0.0:8001 otherwise expects a socket address

* pass metrics as args instead of task local
2022-08-02 22:56:25 +02:00
Ruben Fiszel
9daff2a228 feat: add primitive sql format (#320) 2022-08-02 16:55:20 +02:00
Ruben Fiszel
803fb510c4 update current job to in progress 2022-07-31 22:47:07 +02:00
Ruben Fiszel
3ebc9b7b09 update current job to in progress 2022-07-31 22:41:41 +02:00
Ruben Fiszel
cf6d513228 do not serialize the whole object for job in progress update 2022-07-31 22:31:44 +02:00
Ruben Fiszel
0c5a7f12ba order result from forloop bby args _index 2022-07-31 20:41:35 +02:00
Ruben Fiszel
658ac65019 only check for schedule if not a flow step 2022-07-31 20:30:30 +02:00
Ruben Fiszel
124bd452ab report flow for whom the fetching error is happening 2022-07-31 20:23:03 +02:00
Ruben Fiszel
a6cddc4fb4 report flow for whom the fetching error is happening 2022-07-31 19:53:19 +02:00
Ruben Fiszel
cb61adc795 error for flow of length 0 2022-07-31 19:15:05 +02:00
Ruben Fiszel
168d66c7f9 improve error messages 2022-07-31 19:01:46 +02:00
Ruben Fiszel
dd708ffa61 transferring copyright from ruben to windmill labs 2022-07-30 14:09:41 +02:00
Ruben Fiszel
ee08b2b352 more errors 2022-07-30 01:10:01 +02:00
sqwishy
e1d16860e4 job duration to ms & added to /api/w/*/users/list (#261)
* add jobs_duration to /api/w/*/users/list

A few improvements on this might be considered.

- Adding the duration to /whoami and /whois
- Optionally fetching duration conditional on a query parameter.
- Using the query parameter value to select how far back to look,
  `created_at > now() - $2 * '1 day'::interval`.

Subquery might not be optimal, but performance is a bit weird to test
right now as I haven't done much with my development database to get it
to resemble a typical (production) database.  And there aren't many
indexes currently either.

And I think my rust rustfmt doesn't run because unstable options in the
rustfmt.toml or something so the formatting might be a bit wonky.

* duration -> duration_ms for completed_job

sqlx reordered keys in sqlx-data.json so the diff is quite noisy. I'm
not sure if I did it wrong or if this tool is obnoxious that way.

* don't double count job duration in flows

* job_duration_ms to Usage duration_ms jobs flows

rustfmt got carried away sorry
2022-07-30 00:02:51 +02:00
Ruben Fiszel
2ecec4b34c cargo fmt II 2022-07-29 21:35:50 +02:00
Ruben Fiszel
6cf4072f1d cargo fmt 2022-07-29 21:29:59 +02:00
Ruben Fiszel
8dca5e0341 protect against ill-defined state for flows restart 2022-07-29 21:14:56 +02:00
Ruben Fiszel
b9ff6e78c3 also handle the case where it's the input transform of the first flow job that fails 2022-07-29 20:48:39 +02:00
Ruben Fiszel
1b5ce3243b fix: forloop flows unsoundness fix part I 2022-07-29 20:36:57 +02:00
Ruben Fiszel
0faabdbc40 fix: update variable and resources now return error if nothing was updated 2022-07-29 11:07:59 +02:00
Ruben Fiszel
80f7d6c77d typescript parser now support ? syntax for args 2022-07-28 21:40:47 +02:00
Ruben Fiszel
6dec447953 fix: if :path is not a valid path, do not even attempt to fetch it 2022-07-28 12:59:14 +02:00
Ruben Fiszel
eafde7317e bring back username, workspace_id in audit log 2022-07-28 09:50:00 +02:00
Ruben Fiszel
099caf540d improve logging 2022-07-28 02:31:52 +02:00
Ruben Fiszel
c2c83608c8 nit: make handle flow log a debug 2022-07-28 00:57:47 +02:00
Ruben Fiszel
390e9b37fb fix: get_variable refresh_token bug 2022-07-27 16:24:10 +02:00
Ruben Fiszel
a051c2121a fix: encrypt the refresh token 2022-07-27 15:39:39 +02:00
Ruben Fiszel
3feef738dc fix: keep previous refresh token if no new ones were provided 2022-07-27 15:21:10 +02:00
Ruben Fiszel
de3fe69908 feat: skip failures loop (#258)
* wip: forloop skip failures -- very first pass

* last iteration fix + barebone UI integration

Co-authored-by: sqwishy <somebody@froghat.ca>
2022-07-27 12:40:08 +02:00
Ruben Fiszel
caecbfd0d9 feat: add schedule settable from pull flows 2022-07-27 12:18:02 +02:00
Ruben Fiszel
ca4bed34a6 fix: audit logs 2022-07-26 18:49:27 +02:00
Ruben Fiszel
2f0d8d5384 fix(frontend): get refresh token for google services 2022-07-26 01:52:36 +02:00
Ruben Fiszel
8dfe688a6a fix(frontend): get refresh token for google services 2022-07-26 01:22:54 +02:00
Ruben Fiszel
a2c5dc18a3 fix(frontend): get refresh token for google services 2022-07-26 01:05:34 +02:00
Ruben Fiszel
2c02442b39 monaco-lsp downgrade + google-refresh fix + backend update 2022-07-25 22:53:08 +02:00
Ruben Fiszel
fc918a24cc feat: add google login v1 2022-07-25 21:15:46 +02:00
Ruben Fiszel
62777b7a78 feat: hub flows integration 2022-07-25 10:03:52 +02:00
Ruben Fiszel
84ab9dae5d also allow editable flow 2022-07-24 11:27:36 +02:00
Ruben Fiszel
b05422963b feat(backend): do not require visibility on job to see job if in possesion of uuid 2022-07-23 21:16:48 +02:00
Ruben Fiszel
f6d6934584 feat: add delete schedule 2022-07-20 17:37:04 +02:00
Ruben Fiszel
c34633989e feat(backend): check of no path conflict between flow and flow's primary schedules 2022-07-20 14:43:08 +02:00
Ruben Fiszel
97292d18fb fix(frontend): filter script by is_trigger and jobs by is_skipped + path fix 2022-07-19 20:23:58 +02:00
Ruben Fiszel
6939f9d76b fix: list with is_skipped + deno-client fix 2022-07-19 05:59:12 +02:00
Ruben Fiszel
98a5959fcc fix(backend): clear env variables before running script 2022-07-19 05:51:19 +02:00
Ruben Fiszel
ca66d33a42 fix: consistent exists/{resource} addition + usage in frontend 2022-07-18 17:21:34 +02:00
Ruben Fiszel
6ef3754759 feat: add run_wait_result to mimic lambda ability 2022-07-18 00:45:05 +02:00