Commit Graph

12506 Commits

Author SHA1 Message Date
Ruben Fiszel
545c07b0f2 fix: only create a schedule after flow change if schedule is enabled 2022-10-21 13:33:44 +02:00
Kai Jellinghaus
93b1432625 fix(backend): avoid mem leak on interval #786 2022-10-21 12:15:03 +02:00
Ruben Fiszel
3b0a86676c fix z-index of menu 2022-10-21 08:48:24 +02:00
Ruben Fiszel
6d4d8e2d64 feat: support running and publishing go, python scripts to the hub (#779) 2022-10-20 20:16:08 +02:00
Ruben Fiszel
71a75a57b6 chore(main): release 1.39.0 (#747)
* chore(main): release 1.39.0

* Apply automatic changes

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2022-10-20 16:38:34 +02:00
Ruben Fiszel
655ad7be4f fix(deno-client): error handling for getInternalState 2022-10-20 16:36:09 +02:00
Kai Jellinghaus
9ab54b440a Bench improvements (#774)
* Fix trailing / in host URL

* Allow continous run with throughput

* Fix whitespace
2022-10-20 07:41:33 +02:00
Kai Jellinghaus
438563d5ea Add more tracing (#773) 2022-10-20 07:40:58 +02:00
Kai Jellinghaus
1537a1b756 Cargo config improvements (#775)
* Move cargo config to correct location

* Add --no-rosegment to build params.
This helps with stack traces, and is necessary for some profilers.
2022-10-20 07:38:49 +02:00
Ruben Fiszel
491e808fe2 feat(frontend): publish script of any lang to hub 2022-10-19 23:50:02 +02:00
Kai Jellinghaus
bce59a197e More Metrics (#735)
* Expose Worker Tokio Metrics

* Add metrics tracking the job queue

This can be used to (approximate) the queue length
This can be used to (approximate) the running jobs

* Remove testing code

* Rename metrics to exclude TOTAL_

* Sleep in worker metrics loop

* Add jobs_executed

* Add zombie job metrics

* Add uptime metric

* Fix metric naming

* Remove poll stats

* unify worker execution metrics

* Rename jobs_* metrics

* Rename metrics to match exposed name

* Remove leftover import

* Rename variables to match further

* Fix Merge error

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2022-10-19 10:15:42 +02:00
Ruben Fiszel
d2fd81e542 remove erronous pull created_by 2022-10-19 04:10:41 +02:00
Ruben Fiszel
dd33179d70 make get job more reliable 2022-10-19 03:54:41 +02:00
Ruben Fiszel
e67a49d9fb nits 2022-10-19 03:41:56 +02:00
Ruben Fiszel
b728041770 nits 2022-10-19 03:41:56 +02:00
Ruben Fiszel
d1657383c7 feat(backend): atomic moving queue -> complete and delete (#771)
* feat(backend): atomic move to queue + delete

* fix

* fix

* fix

* fix
2022-10-19 03:16:15 +02:00
Ruben Fiszel
5c5c9fbd78 migrating benchmark to deno client 1.38.5 2022-10-18 23:16:58 +02:00
Ruben Fiszel
126b33e1a8 show options 2022-10-18 22:08:37 +02:00
Ruben Fiszel
b9ce158357 fix benchmarks 2022-10-18 21:19:37 +02:00
Ruben Fiszel
c5e6607e5f little benchmark console feedback 2022-10-18 20:42:16 +02:00
Ruben Fiszel
8aa4c7691b fix(backend): reschedule flow at first step end (#746)
* fix(backend): reschedule flow at first step end

* fix

* fix

* fix

* fix

* sqlx prepare
2022-10-18 17:06:39 +02:00
Ruben Fiszel
d1780c8c6b feat: add result by id to fetch result from any node (#769)
* feat: add result by id to fetch result from any node

* sqlx prepare

* fix

* fix

* review
2022-10-18 17:04:13 +02:00
Kai Jellinghaus
43e6f5c525 feat(benchmark): Initial Benchmarking Tool (#731)
* Deno setup

* Very basic benchmarking

* Collect metrics into CSV

* Rip out CSV functionality

* export to influxdb

* remove old files

* Move into subfolder in preparation for merge

* Move settings to correct folder

* Cleanup & Fix typing

* Remove unused code

* Add JSON export of specific metrics

* Wait for all jobs to complete & check resutls

* Delete output.json

* Apply some review comments

* Simplify some truthy expressions

* Remove InfluxDB

* Rewrite Stats calculation

* Add CSV output

* Fix stdev calculations

* Add README

* Add maximum-throughput option

* Add flow option

* Remove testing changes

* Revert auto-format

* Track zombie workers
2022-10-18 14:10:04 +02:00
Ruben Fiszel
584f168f8f feat: add ids to modules + input_transform lowered to flowmodulevalue (#768)
* feat: add ids to modules + inputTransforms from module to module value

* all

* delete obsolete input transforms
2022-10-17 22:34:12 +02:00
dependabot[bot]
f7ee9c17ec chore(deps-dev): bump svelte from 3.51.0 to 3.52.0 in /frontend (#766)
Bumps [svelte](https://github.com/sveltejs/svelte) from 3.51.0 to 3.52.0.
- [Release notes](https://github.com/sveltejs/svelte/releases)
- [Changelog](https://github.com/sveltejs/svelte/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sveltejs/svelte/compare/v3.51.0...v3.52.0)

---
updated-dependencies:
- dependency-name: svelte
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 20:06:18 +00:00
dependabot[bot]
0573eb9e79 chore(deps-dev): bump flowbite-svelte from 0.27.6 to 0.27.8 in /frontend (#767)
Bumps [flowbite-svelte](https://github.com/themesberg/flowbite-svelte) from 0.27.6 to 0.27.8.
- [Release notes](https://github.com/themesberg/flowbite-svelte/releases)
- [Changelog](https://github.com/themesberg/flowbite-svelte/blob/main/CHANGELOG.md)
- [Commits](https://github.com/themesberg/flowbite-svelte/compare/v0.27.6...v0.27.8)

---
updated-dependencies:
- dependency-name: flowbite-svelte
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 19:52:00 +00:00
dependabot[bot]
c3f5c52257 chore(deps-dev): bump @typescript-eslint/eslint-plugin in /frontend (#764)
Bumps [@typescript-eslint/eslint-plugin](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/eslint-plugin) from 5.37.0 to 5.40.1.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/eslint-plugin/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v5.40.1/packages/eslint-plugin)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/eslint-plugin"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 19:40:45 +00:00
dependabot[bot]
170d48fe56 chore(deps-dev): bump @zerodevx/svelte-toast in /frontend (#761)
Bumps [@zerodevx/svelte-toast](https://github.com/zerodevx/svelte-toast) from 0.7.2 to 0.8.0.
- [Release notes](https://github.com/zerodevx/svelte-toast/releases)
- [Commits](https://github.com/zerodevx/svelte-toast/compare/v0.7.2...v0.8.0)

---
updated-dependencies:
- dependency-name: "@zerodevx/svelte-toast"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 19:39:34 +00:00
dependabot[bot]
7b932f2543 chore(deps-dev): bump postcss from 8.4.17 to 8.4.18 in /frontend (#765)
Bumps [postcss](https://github.com/postcss/postcss) from 8.4.17 to 8.4.18.
- [Release notes](https://github.com/postcss/postcss/releases)
- [Changelog](https://github.com/postcss/postcss/blob/main/CHANGELOG.md)
- [Commits](https://github.com/postcss/postcss/compare/8.4.17...8.4.18)

---
updated-dependencies:
- dependency-name: postcss
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 19:28:47 +00:00
dependabot[bot]
2d69b42441 chore(deps): bump magic-crypt from 3.1.10 to 3.1.12 in /backend (#762)
Bumps [magic-crypt](https://github.com/magiclen/rust-magiccrypt) from 3.1.10 to 3.1.12.
- [Release notes](https://github.com/magiclen/rust-magiccrypt/releases)
- [Commits](https://github.com/magiclen/rust-magiccrypt/compare/v3.1.10...v3.1.12)

---
updated-dependencies:
- dependency-name: magic-crypt
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 19:12:52 +00:00
dependabot[bot]
54111a10d7 chore(deps-dev): bump @typescript-eslint/parser in /frontend (#759)
Bumps [@typescript-eslint/parser](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/parser) from 5.40.0 to 5.40.1.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/parser/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v5.40.1/packages/parser)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/parser"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 18:55:16 +00:00
dependabot[bot]
261d7147c3 chore(deps): bump swc_ecma_parser from 0.122.7 to 0.122.13 in /backend (#758)
Bumps [swc_ecma_parser](https://github.com/swc-project/swc) from 0.122.7 to 0.122.13.
- [Release notes](https://github.com/swc-project/swc/releases)
- [Changelog](https://github.com/swc-project/swc/blob/main/CHANGELOG.md)
- [Commits](https://github.com/swc-project/swc/commits)

---
updated-dependencies:
- dependency-name: swc_ecma_parser
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 18:46:00 +00:00
dependabot[bot]
a29c9282f2 chore(deps): bump monaco-editor from 0.34.0 to 0.34.1 in /frontend (#757)
Bumps [monaco-editor](https://github.com/microsoft/monaco-editor) from 0.34.0 to 0.34.1.
- [Release notes](https://github.com/microsoft/monaco-editor/releases)
- [Changelog](https://github.com/microsoft/monaco-editor/blob/main/CHANGELOG.md)
- [Commits](https://github.com/microsoft/monaco-editor/commits)

---
updated-dependencies:
- dependency-name: monaco-editor
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 18:37:02 +00:00
dependabot[bot]
fa9d80c888 chore(deps-dev): bump @playwright/test in /frontend (#756)
Bumps [@playwright/test](https://github.com/Microsoft/playwright) from 1.27.0 to 1.27.1.
- [Release notes](https://github.com/Microsoft/playwright/releases)
- [Commits](https://github.com/Microsoft/playwright/compare/v1.27.0...v1.27.1)

---
updated-dependencies:
- dependency-name: "@playwright/test"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-17 18:36:44 +00:00
Ruben Fiszel
5f3646fb37 feat(backend): add branch all (#751)
* feat(backend): add branch all

* progress

* all
2022-10-17 17:31:31 +02:00
Ádám Kovács
0b196c485e fix(frontend): Style fix (#755) 2022-10-17 17:22:09 +02:00
Ádám Kovács
25671d6fbd feat(frontend): Update workspace selector (#754) 2022-10-17 17:17:31 +02:00
Ádám Kovács
30ef290372 fix(frontend): Fix text styling (#753) 2022-10-17 16:25:32 +02:00
Ádám Kovács
6bad6cf903 feat(frontend): Update split panes (#741) 2022-10-17 15:43:31 +02:00
Ruben Fiszel
ffad0c30f0 feat: InProgress forloop_jobs -> flow_jobs to unify with branchAll 2022-10-16 16:04:24 +02:00
Ruben Fiszel
4929a50286 feat(backend): rework forloop flow job arg passing + reimplement branchone using flows 2022-10-16 15:56:41 +02:00
Ruben Fiszel
9fe4229b63 chore(main): release 1.38.5 (#745)
* chore(main): release 1.38.5

* Apply automatic changes

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2022-10-15 18:37:41 +02:00
Ruben Fiszel
b25733d6ae fix(deno-client): use proper base url 2022-10-15 18:34:07 +02:00
Ruben Fiszel
85c41372be chore(main): release 1.38.4 (#744)
* chore(main): release 1.38.4

* Apply automatic changes

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2022-10-15 18:27:04 +02:00
Ruben Fiszel
9fb4e20e21 fix: refactor deno client to use another openapi generator #743 2022-10-15 18:25:26 +02:00
Ruben Fiszel
e7e8a4cf38 add rawscript as unique enum type on openflow 2022-10-15 16:37:18 +02:00
Jakub Kołodziejczak
89e6b1a63a chore(backend): allow disabling nsjail for unit tests (#742)
UC: as a developer I want to be able to test code w/o nsjail

bug: flaky test `test_go_job`
```
running 1 test
test worker::tests::test_go_job ... FAILED

failures:

---- worker::tests::test_go_job stdout ----
received killpill for worker 0
thread 'worker::tests::test_go_job' panicked at 'assertion failed: `(left == right)`
  left: `Object {"error": String("Error during execution of the script:\n\ngo: error obtaining buildID for go tool compile: pipe2: too many open files\ngo: error obtaining buildID for go tool compile: pipe2: too many open files\ngo: error obtaining buildID for go tool compile: pipe2: too many open files")}`,
 right: `String("hello world")`', src/worker.rs:2434:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
```

workaround: disable nsjail
2022-10-15 16:08:05 +02:00
Ruben Fiszel
9aabb163ad chore(main): release 1.38.3 (#740)
* chore(main): release 1.38.3

* Apply automatic changes

Co-authored-by: rubenfiszel <rubenfiszel@users.noreply.github.com>
2022-10-15 11:35:49 +02:00
Ruben Fiszel
7e673e3740 fix(go-client): go-client README 2022-10-15 11:23:10 +02:00
Ruben Fiszel
dcee703d66 chore(main): release 1.38.2 (#737) 2022-10-15 11:19:42 +02:00