Commit Graph

105 Commits

Author SHA1 Message Date
Ruben Fiszel
69dcdbd00b fix: update logs even if last new log was < 500ms 2022-08-07 13:48:37 +02:00
Ruben Fiszel
a831cb1472 rewrite kill wait 2022-08-07 12:55:21 +02:00
Ruben Fiszel
084cc8a2dd prevent log spam abuse 2022-08-07 12:50:28 +02:00
Ruben Fiszel
503b56b3db more logging around command executions 2022-08-07 12:25:45 +02:00
Ruben Fiszel
23a2b3389b more logging around command executions 2022-08-07 12:00:41 +02:00
Ruben Fiszel
20a2b5808c audit logs for all execute case 2022-08-07 11:14:00 +02:00
Ruben Fiszel
feeaf5d963 add summary field for modules 2022-08-06 23:37:17 +02:00
Ruben Fiszel
dcb5d8deb9 rework input transform for the forloop module 2022-08-06 14:02:39 +02:00
Ruben Fiszel
9f3a191b3b fix(python): not filled field with default <function_call> now call the default function 2022-08-06 12:51:14 +02:00
Ruben Fiszel
837a500a1a display inputs in flow viewer too 2022-08-06 09:30:10 +02:00
Ruben Fiszel
6026e32c98 improve error message for parsing 2022-08-06 08:45:37 +02:00
Ruben Fiszel
323fd30a00 rework default python script 2022-08-05 20:21:13 +02:00
Ruben Fiszel
02fd242bb7 feat: _value, _index => iter.value, iter.index 2022-08-05 20:11:25 +02:00
Ruben Fiszel
5d3cd541c7 fix: do not skip undefined values 2022-08-05 19:53:28 +02:00
Ruben Fiszel
449fb27a53 feat: remove res1 wrapping 2022-08-05 19:47:00 +02:00
Ruben Fiszel
cd8db7a015 do not cache html, cache everything else for a long time 2022-08-05 11:00:41 +02:00
Ruben Fiszel
5cc1ae2c05 fix flowstatusviewer and updating to in_progress much sooner 2022-08-05 00:46:10 +02:00
Ruben Fiszel
fe81c17d2f fix(backend): generalize oauth clients to take in extra params 2022-08-04 14:32:04 +02:00
Ruben Fiszel
644f8cfe37 fix(backend): handle better some flow edge-cases 2022-08-04 01:50:47 +02:00
Ruben Fiszel
cd9bd29931 fix(backend): handle better some flow edge-cases 2022-08-04 01:48:53 +02:00
Ruben Fiszel
089f4a7811 fix(backend): handle better some flow edge-cases 2022-08-04 01:13:12 +02:00
sqwishy
6c71fac136 fix(backend): prometheus histogram for worker job timer (#312)
* prometheus histogram for worker job timer

hosts on :8001

* some new metrics in worker + field

adds start_time_seconds, job_duration_seconds & jobs_failed

* use tokio task_local to count job failures

* METRICS_ADDR environment variable off by default

true defaults to 0.0.0.0:8001 otherwise expects a socket address

* pass metrics as args instead of task local
2022-08-02 22:56:25 +02:00
Ruben Fiszel
5e14b6dfb3 feat: add primitive sql format (#320) 2022-08-02 16:55:20 +02:00
Ruben Fiszel
31904be890 update current job to in progress 2022-07-31 22:47:07 +02:00
Ruben Fiszel
d397e6d618 update current job to in progress 2022-07-31 22:41:41 +02:00
Ruben Fiszel
c37b9f7106 do not serialize the whole object for job in progress update 2022-07-31 22:31:44 +02:00
Ruben Fiszel
a368d2c6d4 order result from forloop bby args _index 2022-07-31 20:41:35 +02:00
Ruben Fiszel
03ed38e9b2 only check for schedule if not a flow step 2022-07-31 20:30:30 +02:00
Ruben Fiszel
7f55e7a498 report flow for whom the fetching error is happening 2022-07-31 20:23:03 +02:00
Ruben Fiszel
4df819554e report flow for whom the fetching error is happening 2022-07-31 19:53:19 +02:00
Ruben Fiszel
abcd25dbff error for flow of length 0 2022-07-31 19:15:05 +02:00
Ruben Fiszel
2483072d81 improve error messages 2022-07-31 19:01:46 +02:00
Ruben Fiszel
e82e5fff56 transferring copyright from ruben to windmill labs 2022-07-30 14:09:41 +02:00
Ruben Fiszel
ae2aa7b8f8 more errors 2022-07-30 01:10:01 +02:00
sqwishy
9a632befdd job duration to ms & added to /api/w/*/users/list (#261)
* add jobs_duration to /api/w/*/users/list

A few improvements on this might be considered.

- Adding the duration to /whoami and /whois
- Optionally fetching duration conditional on a query parameter.
- Using the query parameter value to select how far back to look,
  `created_at > now() - $2 * '1 day'::interval`.

Subquery might not be optimal, but performance is a bit weird to test
right now as I haven't done much with my development database to get it
to resemble a typical (production) database.  And there aren't many
indexes currently either.

And I think my rust rustfmt doesn't run because unstable options in the
rustfmt.toml or something so the formatting might be a bit wonky.

* duration -> duration_ms for completed_job

sqlx reordered keys in sqlx-data.json so the diff is quite noisy. I'm
not sure if I did it wrong or if this tool is obnoxious that way.

* don't double count job duration in flows

* job_duration_ms to Usage duration_ms jobs flows

rustfmt got carried away sorry
2022-07-30 00:02:51 +02:00
Ruben Fiszel
8037e390db cargo fmt II 2022-07-29 21:35:50 +02:00
Ruben Fiszel
d4b5a0ea3d cargo fmt 2022-07-29 21:29:59 +02:00
Ruben Fiszel
fed1849256 protect against ill-defined state for flows restart 2022-07-29 21:14:56 +02:00
Ruben Fiszel
b3e821e1b2 also handle the case where it's the input transform of the first flow job that fails 2022-07-29 20:48:39 +02:00
Ruben Fiszel
3e07ae2b55 fix: forloop flows unsoundness fix part I 2022-07-29 20:36:57 +02:00
Ruben Fiszel
771de0990a fix: update variable and resources now return error if nothing was updated 2022-07-29 11:07:59 +02:00
Ruben Fiszel
a8d4b7d535 typescript parser now support ? syntax for args 2022-07-28 21:40:47 +02:00
Ruben Fiszel
c3259ec262 fix: if :path is not a valid path, do not even attempt to fetch it 2022-07-28 12:59:14 +02:00
Ruben Fiszel
127bba6c9b bring back username, workspace_id in audit log 2022-07-28 09:50:00 +02:00
Ruben Fiszel
98c57e974b improve logging 2022-07-28 02:31:52 +02:00
Ruben Fiszel
c5873ddc34 nit: make handle flow log a debug 2022-07-28 00:57:47 +02:00
Ruben Fiszel
4243a46d52 fix: get_variable refresh_token bug 2022-07-27 16:24:10 +02:00
Ruben Fiszel
e92f5c0b63 fix: encrypt the refresh token 2022-07-27 15:39:39 +02:00
Ruben Fiszel
5636ecd276 fix: keep previous refresh token if no new ones were provided 2022-07-27 15:21:10 +02:00
Ruben Fiszel
c95da3a29d feat: skip failures loop (#258)
* wip: forloop skip failures -- very first pass

* last iteration fix + barebone UI integration

Co-authored-by: sqwishy <somebody@froghat.ca>
2022-07-27 12:40:08 +02:00