Commit Graph

726 Commits

Author SHA1 Message Date
Ruben Fiszel
dd33179d70 make get job more reliable 2022-10-19 03:54:41 +02:00
Ruben Fiszel
b728041770 nits 2022-10-19 03:41:56 +02:00
Ruben Fiszel
d1657383c7 feat(backend): atomic moving queue -> complete and delete (#771)
* feat(backend): atomic move to queue + delete

* fix

* fix

* fix

* fix
2022-10-19 03:16:15 +02:00
Ruben Fiszel
8aa4c7691b fix(backend): reschedule flow at first step end (#746)
* fix(backend): reschedule flow at first step end

* fix

* fix

* fix

* fix

* sqlx prepare
2022-10-18 17:06:39 +02:00
Ruben Fiszel
d1780c8c6b feat: add result by id to fetch result from any node (#769)
* feat: add result by id to fetch result from any node

* sqlx prepare

* fix

* fix

* review
2022-10-18 17:04:13 +02:00
Ruben Fiszel
584f168f8f feat: add ids to modules + input_transform lowered to flowmodulevalue (#768)
* feat: add ids to modules + inputTransforms from module to module value

* all

* delete obsolete input transforms
2022-10-17 22:34:12 +02:00
Ruben Fiszel
5f3646fb37 feat(backend): add branch all (#751)
* feat(backend): add branch all

* progress

* all
2022-10-17 17:31:31 +02:00
Ruben Fiszel
ffad0c30f0 feat: InProgress forloop_jobs -> flow_jobs to unify with branchAll 2022-10-16 16:04:24 +02:00
Ruben Fiszel
4929a50286 feat(backend): rework forloop flow job arg passing + reimplement branchone using flows 2022-10-16 15:56:41 +02:00
Jakub Kołodziejczak
89e6b1a63a chore(backend): allow disabling nsjail for unit tests (#742)
UC: as a developer I want to be able to test code w/o nsjail

bug: flaky test `test_go_job`
```
running 1 test
test worker::tests::test_go_job ... FAILED

failures:

---- worker::tests::test_go_job stdout ----
received killpill for worker 0
thread 'worker::tests::test_go_job' panicked at 'assertion failed: `(left == right)`
  left: `Object {"error": String("Error during execution of the script:\n\ngo: error obtaining buildID for go tool compile: pipe2: too many open files\ngo: error obtaining buildID for go tool compile: pipe2: too many open files\ngo: error obtaining buildID for go tool compile: pipe2: too many open files")}`,
 right: `String("hello world")`', src/worker.rs:2434:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
```

workaround: disable nsjail
2022-10-15 16:08:05 +02:00
Ruben Fiszel
b7b5445874 add go-client mvp + stabilize openapi (#732) 2022-10-14 16:26:51 +02:00
Ruben Fiszel
7efd229b05 improve supercache 2022-10-13 03:04:55 +02:00
Ruben Fiszel
d1d3403658 improve supercache 2022-10-13 01:23:08 +02:00
Ruben Fiszel
4dce71c877 improve supercache 2022-10-13 00:47:00 +02:00
Ruben Fiszel
2b134158f4 improve supercache 2022-10-13 00:15:21 +02:00
Ruben Fiszel
7488c419f7 fix supercache in presence of other deps 2022-10-12 23:28:50 +02:00
Jakub Kołodziejczak
a5f545411f feat(backend): supercache for python heavy dependencies in alpha 2022-10-12 23:02:27 +02:00
Ruben Fiszel
953712d94e fix handle shared path not existing because job was resumed on another worker 2022-10-12 20:09:07 +02:00
Ruben Fiszel
eb6d0084ab fix suspend + sleep with same worker 2022-10-12 15:56:15 +02:00
Ruben Fiszel
c82004de00 feat: secure suspended resume event + configurable timeout (#721)
* fix suspend count for early message + delete resume_job

* all

* done everything

* done everything
2022-10-11 22:55:14 +02:00
Ruben Fiszel
6ea76b5a61 fix suspend count for early message + delete resume_job 2022-10-10 20:17:49 +02:00
Ruben Fiszel
0356384d4a add failed_jobs to retrystatus 2022-10-10 13:41:07 +02:00
Ruben Fiszel
45a563566e specify branch_chosen in openflow 2022-10-10 12:59:16 +02:00
Ruben Fiszel
b87b03a673 feat(backend): implement new OpenFlow module Branches (#692)
* branches

* iterate

* branches

* progress

* progress

* progress

* done

* adapt frontend

* adapt frontend

* sqlx
2022-10-09 23:12:05 +02:00
Ruben Fiszel
430e22a4b4 feat: support struct in Go as script parameters #705 2022-10-08 20:03:08 +02:00
Ruben Fiszel
a9f23d1ebf improve error messages 2022-10-08 14:36:21 +02:00
Ruben Fiszel
adc64746b1 improve error messages 2022-10-08 14:22:34 +02:00
Ruben Fiszel
6cbc6b421b feat: add go LSP (#699)
* lsp

* progress

* 1.36.0
2022-10-08 13:28:46 +02:00
Ruben Fiszel
7f21147c8d feat(backend): separate properly logs from result 2022-10-07 19:54:44 +02:00
Ruben Fiszel
5bf169577c fix(backend): go lock dependency with no requirements 2022-10-07 16:11:45 +02:00
Ruben Fiszel
a229e6f488 feat: sleep for arbitrary number of seconds statically or with a javascript expression (#691)
* progress

* progress

* fix serde

* fix frontend

* fix frontend
2022-10-07 04:09:32 +02:00
Ruben Fiszel
9a7cce1ab5 only stop wait on child on ok changes values 2022-10-06 23:37:10 +02:00
Ruben Fiszel
2198a64c0a fix: get info about kill reason 2022-10-06 23:25:49 +02:00
Ruben Fiszel
8ffc9dfe4c fix: get info about kill reason 2022-10-06 23:15:27 +02:00
Ruben Fiszel
8d8c9698a5 fix(backend): same_worker uses the same folder even within loops 2022-10-06 21:39:07 +02:00
Ruben Fiszel
8b60e9154c add GOMEMLIMIT to 2Gb 2022-10-06 05:13:06 +02:00
Ruben Fiszel
849842e9c6 feat: implement same_worker openflow attribute for running flow all in one go + sharing folder /shared (#689)
* init

* progress

* all

* sqlx

* remove unecessary test

* done

* frontend

* frontend
2022-10-06 04:59:09 +02:00
Ruben Fiszel
5b67da5cf5 spurrious printlns 2022-10-04 14:44:56 +02:00
Ruben Fiszel
4729cc8cc3 progress 2022-10-04 08:40:01 +02:00
Ruben Fiszel
3417325460 progress 2022-10-04 08:40:01 +02:00
Ruben Fiszel
84979527eb minor UI fixes 2022-10-02 21:35:07 +02:00
Ruben Fiszel
6bf1abf16e feat(backend): add WM_BASE_URL 2022-10-02 18:53:05 +02:00
Ruben Fiszel
75cf96b99f fix(backend): allow for now payload on resume GET 2022-10-02 05:14:36 +02:00
Ruben Fiszel
60e75e3b41 fix(go): make lines align with appended code 2022-10-02 01:28:14 +02:00
Ruben Fiszel
1d6dc484cd fix(go): inner_main is in a separate file rather than wrapped 2022-10-02 01:22:33 +02:00
Ruben Fiszel
c3c965c478 feat(backend): add WM_FLOW_JOB_ID 2022-10-01 09:02:00 +02:00
Ruben Fiszel
fd5921dc30 hotfix trusted host for pip-compile 2022-09-28 09:17:08 +02:00
Ruben Fiszel
7fd76265f7 feat: add private registries pip (#636)
* add private registries pip

* add private registries pip

* fix

* fix

* fix

* echo parameters
2022-09-28 08:47:43 +02:00
Ruben Fiszel
a4f31bbdd6 do not restart flow as zombie job 2022-09-26 00:45:26 +02:00
Ruben Fiszel
04ab59f928 refactor logs panel everywhere applicable (#625)
* init

* init

* progress

* progress

* refactor logs entirely

* fix sqlx
2022-09-25 18:03:51 +02:00