Ruben Fiszel
785d3ea4e7
raise limit to 200000 chars
2022-08-08 13:57:39 +02:00
Ruben Fiszel
a613b45f8b
surface better the transform_json_value step errors
2022-08-08 11:54:01 +02:00
Ruben Fiszel
cdf2d2f7df
increase limit to 900s over the last 1200s
2022-08-07 14:39:57 +02:00
Ruben Fiszel
8153718166
do rate limit based on as_permissioned_as
2022-08-07 14:04:17 +02:00
Ruben Fiszel
c69621fa7a
fix: update logs even if last new log was < 500ms
2022-08-07 13:48:37 +02:00
Ruben Fiszel
b647f59c82
rewrite kill wait
2022-08-07 12:55:21 +02:00
Ruben Fiszel
79af9abb92
prevent log spam abuse
2022-08-07 12:50:28 +02:00
Ruben Fiszel
56a3a9c4f5
more logging around command executions
2022-08-07 12:25:45 +02:00
Ruben Fiszel
2c6f1c3b82
more logging around command executions
2022-08-07 12:00:41 +02:00
Ruben Fiszel
dfb4339c5e
audit logs for all execute case
2022-08-07 11:14:00 +02:00
Ruben Fiszel
fbe878407c
add summary field for modules
2022-08-06 23:37:17 +02:00
Ruben Fiszel
bd8bcb36a1
rework input transform for the forloop module
2022-08-06 14:02:39 +02:00
Ruben Fiszel
33962c4466
fix(python): not filled field with default <function_call> now call the default function
2022-08-06 12:51:14 +02:00
Ruben Fiszel
da630b5add
display inputs in flow viewer too
2022-08-06 09:30:10 +02:00
Ruben Fiszel
bc35a81bec
improve error message for parsing
2022-08-06 08:45:37 +02:00
Ruben Fiszel
0346d955f9
rework default python script
2022-08-05 20:21:13 +02:00
Ruben Fiszel
07f4a217d0
feat: _value, _index => iter.value, iter.index
2022-08-05 20:11:25 +02:00
Ruben Fiszel
8b68a87c52
fix: do not skip undefined values
2022-08-05 19:53:28 +02:00
Ruben Fiszel
e76a9816ee
feat: remove res1 wrapping
2022-08-05 19:47:00 +02:00
Ruben Fiszel
4c98cf4b66
do not cache html, cache everything else for a long time
2022-08-05 11:00:41 +02:00
Ruben Fiszel
6b129b213b
fix flowstatusviewer and updating to in_progress much sooner
2022-08-05 00:46:10 +02:00
Ruben Fiszel
6332910dd2
fix(backend): generalize oauth clients to take in extra params
2022-08-04 14:32:04 +02:00
Ruben Fiszel
3bcd542130
fix(backend): handle better some flow edge-cases
2022-08-04 01:50:47 +02:00
Ruben Fiszel
988536128b
fix(backend): handle better some flow edge-cases
2022-08-04 01:48:53 +02:00
Ruben Fiszel
70de6e3972
fix(backend): handle better some flow edge-cases
2022-08-04 01:13:12 +02:00
sqwishy
40555868e6
fix(backend): prometheus histogram for worker job timer ( #312 )
...
* prometheus histogram for worker job timer
hosts on :8001
* some new metrics in worker + field
adds start_time_seconds, job_duration_seconds & jobs_failed
* use tokio task_local to count job failures
* METRICS_ADDR environment variable off by default
true defaults to 0.0.0.0:8001 otherwise expects a socket address
* pass metrics as args instead of task local
2022-08-02 22:56:25 +02:00
Ruben Fiszel
9daff2a228
feat: add primitive sql format ( #320 )
2022-08-02 16:55:20 +02:00
Ruben Fiszel
803fb510c4
update current job to in progress
2022-07-31 22:47:07 +02:00
Ruben Fiszel
3ebc9b7b09
update current job to in progress
2022-07-31 22:41:41 +02:00
Ruben Fiszel
cf6d513228
do not serialize the whole object for job in progress update
2022-07-31 22:31:44 +02:00
Ruben Fiszel
0c5a7f12ba
order result from forloop bby args _index
2022-07-31 20:41:35 +02:00
Ruben Fiszel
658ac65019
only check for schedule if not a flow step
2022-07-31 20:30:30 +02:00
Ruben Fiszel
124bd452ab
report flow for whom the fetching error is happening
2022-07-31 20:23:03 +02:00
Ruben Fiszel
a6cddc4fb4
report flow for whom the fetching error is happening
2022-07-31 19:53:19 +02:00
Ruben Fiszel
cb61adc795
error for flow of length 0
2022-07-31 19:15:05 +02:00
Ruben Fiszel
168d66c7f9
improve error messages
2022-07-31 19:01:46 +02:00
Ruben Fiszel
dd708ffa61
transferring copyright from ruben to windmill labs
2022-07-30 14:09:41 +02:00
Ruben Fiszel
ee08b2b352
more errors
2022-07-30 01:10:01 +02:00
sqwishy
e1d16860e4
job duration to ms & added to /api/w/*/users/list ( #261 )
...
* add jobs_duration to /api/w/*/users/list
A few improvements on this might be considered.
- Adding the duration to /whoami and /whois
- Optionally fetching duration conditional on a query parameter.
- Using the query parameter value to select how far back to look,
`created_at > now() - $2 * '1 day'::interval`.
Subquery might not be optimal, but performance is a bit weird to test
right now as I haven't done much with my development database to get it
to resemble a typical (production) database. And there aren't many
indexes currently either.
And I think my rust rustfmt doesn't run because unstable options in the
rustfmt.toml or something so the formatting might be a bit wonky.
* duration -> duration_ms for completed_job
sqlx reordered keys in sqlx-data.json so the diff is quite noisy. I'm
not sure if I did it wrong or if this tool is obnoxious that way.
* don't double count job duration in flows
* job_duration_ms to Usage duration_ms jobs flows
rustfmt got carried away sorry
2022-07-30 00:02:51 +02:00
Ruben Fiszel
2ecec4b34c
cargo fmt II
2022-07-29 21:35:50 +02:00
Ruben Fiszel
6cf4072f1d
cargo fmt
2022-07-29 21:29:59 +02:00
Ruben Fiszel
8dca5e0341
protect against ill-defined state for flows restart
2022-07-29 21:14:56 +02:00
Ruben Fiszel
b9ff6e78c3
also handle the case where it's the input transform of the first flow job that fails
2022-07-29 20:48:39 +02:00
Ruben Fiszel
1b5ce3243b
fix: forloop flows unsoundness fix part I
2022-07-29 20:36:57 +02:00
Ruben Fiszel
0faabdbc40
fix: update variable and resources now return error if nothing was updated
2022-07-29 11:07:59 +02:00
Ruben Fiszel
80f7d6c77d
typescript parser now support ? syntax for args
2022-07-28 21:40:47 +02:00
Ruben Fiszel
6dec447953
fix: if :path is not a valid path, do not even attempt to fetch it
2022-07-28 12:59:14 +02:00
Ruben Fiszel
eafde7317e
bring back username, workspace_id in audit log
2022-07-28 09:50:00 +02:00
Ruben Fiszel
099caf540d
improve logging
2022-07-28 02:31:52 +02:00
Ruben Fiszel
c2c83608c8
nit: make handle flow log a debug
2022-07-28 00:57:47 +02:00
