Commit Graph

974 Commits

Author SHA1 Message Date
Ruben Fiszel
cf879fcecf fix cancel job 2022-09-25 17:13:03 +02:00
Ruben Fiszel
3a530c8566 fix cancel job 2022-09-25 16:36:32 +02:00
sqwishy
e7a6c1b99f reorganize handle_child (#606)
* reorganize handle_child

There were a couple issues with the current implementation:

1. When reading stdout and stderr from the child, as soon as we hit EOF
   on one we would stop reading from both (line 1420). This could lead
   to the return value not being read from the job program.

2. Lines read from stdout and stderr are put into a channel and read
   elsewhere with `rx.recv()` (line 1497) but that channel isn't read
   until empty.  It is only read in the `while !done.load(...)` (line
   1449) loop and that loop can stop after any `.store(true, ...)`.
   Which happens when the child exits, when the job is cancelled, when
   either stdout or stderr reach EOF...

   This can be verified by putting `dbg!(rx.recv().await)` or a similar
   assertion after the while loop before returning from that function.
   It shows the channel still containing log lines on rare occasions.

I was pretty careful in this to maintain the current behaviour; adding
comments to express intention.

One difference in this is that some regular intervals (cancel check and
ping update) should be more regular?

Before...

> at 00ms wait for 10ms
> at 10ms do things for 3ms
> at 13ms wait again for *10ms*
> at 23ms do things again ...

With change...

> at 00ms wait for 10ms
> at 10ms do things for 3ms
> at 13ms wait again but for *7ms*
> at 20ms do things again ...

Which I'm guessing is preferable but I could be wrong.

* renames; interpolate values in log messages

* do `append_logs()` in tokio::task

* tokio::time::interval & close pipe after limit

* clean up comments
2022-09-24 22:55:52 +02:00
sqwishy
e23e537328 update cron v0.12.0 (#623) 2022-09-24 21:18:36 +02:00
Ruben Fiszel
bcb113682f feat(frontend): merge logs and result tab in script editor (#622) 2022-09-23 16:20:47 +02:00
Ruben Fiszel
40160c03f1 fix(frontend): loading flows with for loops + flowStatusViewer treat single jobs properly 2022-09-23 13:28:02 +02:00
Faton Ramadani
2d0255824c feat(frontend): Extract publish to hub button (#620)
* feature(frontend): Extract publish to hub button

* feat(frontend): Extract Publish to hub button
2022-09-23 12:23:37 +02:00
Faton Ramadani
5146c37baf feat(frontend): Add a split panel in the test tab (#619) 2022-09-23 12:11:05 +02:00
Ádám Kovács
f4c8636209 feat(frontend): Badge component and script page (#617)
* fix(frontend): Consistent tooltip font size

* feature(frontend): Add new badge component

* feature(frontend): Add color type to badge

* feature(frontend): Add copy to clipboard utility

* feature(frontend): Update common badge component

* feature(frontend): Update badge to handle icons

* feature(frontend): Update script page design

* feat(frontend): Add capitalize option to badges

* fix(frontend): Fix shared badge text display
2022-09-23 12:10:15 +02:00
Faton Ramadani
e8e4199c5c feature(frontend): Button component (#616)
* feature(frontend): Button component

* feature(frontend): Ajust style
2022-09-22 13:25:17 +02:00
sqwishy
47fba21256 remove delay between spawning each worker (#614) 2022-09-21 21:05:19 -07:00
Ruben Fiszel
d71bca7443 fix flow UX and flowStateStore (#610)
* fix everything

* fix(frontend): Restore module deletion + restore for loop settings

* fix(frontend): Add missing focus on number inputs

* fix(frontend): Add key wrapper to make sure the editor content is reloaded

* fix(frontend): Fix mini-map spacing + add icon to schedule and retry buttons

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
2022-09-21 11:37:33 +02:00
Ruben Fiszel
3fe1afce29 improve preview results v1 2022-09-21 02:48:30 +02:00
Ruben Fiszel
4224bc42fe fix connect button 2022-09-21 02:00:30 +02:00
Ruben Fiszel
5642e5c734 fix Advanced flow module buttons 2022-09-21 01:38:16 +02:00
Ruben Fiszel
10db37a029 fix focusProp 2022-09-21 00:55:50 +02:00
dependabot[bot]
2947bb3c95 chore(deps): bump anyhow from 1.0.64 to 1.0.65 in /backend (#600)
Bumps [anyhow](https://github.com/dtolnay/anyhow) from 1.0.64 to 1.0.65.
- [Release notes](https://github.com/dtolnay/anyhow/releases)
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.64...1.0.65)

---
updated-dependencies:
- dependency-name: anyhow
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-20 22:06:10 +00:00
dependabot[bot]
b1513824df chore(deps): bump thiserror from 1.0.34 to 1.0.35 in /backend (#604)
Bumps [thiserror](https://github.com/dtolnay/thiserror) from 1.0.34 to 1.0.35.
- [Release notes](https://github.com/dtolnay/thiserror/releases)
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.34...1.0.35)

---
updated-dependencies:
- dependency-name: thiserror
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-20 22:03:02 +00:00
Faton Ramadani
0f33c26d54 feature(frontend): Add support for retries for flows (#607)
* feature(frontend): Add support for retries for flows

* feature(frontend): Fix design issues
2022-09-21 00:00:39 +02:00
dependabot[bot]
9045bd647e chore(deps): bump swc_ecma_parser from 0.119.7 to 0.119.12 in /backend (#597)
Bumps [swc_ecma_parser](https://github.com/swc-project/swc) from 0.119.7 to 0.119.12.
- [Release notes](https://github.com/swc-project/swc/releases)
- [Changelog](https://github.com/swc-project/swc/blob/main/CHANGELOG.md)
- [Commits](https://github.com/swc-project/swc/commits)

---
updated-dependencies:
- dependency-name: swc_ecma_parser
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-20 22:00:28 +00:00
Faton Ramadani
9ef6663dc5 feature(frontend): Prop picker panel (#605)
* feature(frontend): WIP Prop picker v2

* feature(frontend): add PropPicker context

* feature(frontend): prop picker working

* feature(frontend): restore connect button

* feature(frontend): Fix wording + fix height to avoid content shift

* feature(frontend): Fix upTo preview + adapt style

* feature(frontend): Preview results cleanup

* feature(frontend): Remove test logs

* feature(frontend): Revert wrong changes

* feature(frontend): Restore shared preview args

* feature(frontend): Reduce ObjectViewer font size + remove useless space

* feature(frontend): Wording

* feature(frontend): Fix Split panel scrolling issues
2022-09-20 23:59:48 +02:00
dependabot[bot]
17e480f3be chore(deps): bump swc_common from 0.28.7 to 0.28.8 in /backend (#601)
Bumps [swc_common](https://github.com/swc-project/swc) from 0.28.7 to 0.28.8.
- [Release notes](https://github.com/swc-project/swc/releases)
- [Changelog](https://github.com/swc-project/swc/blob/main/CHANGELOG.md)
- [Commits](https://github.com/swc-project/swc/commits)

---
updated-dependencies:
- dependency-name: swc_common
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 21:05:54 +00:00
dependabot[bot]
afa24ab100 chore(deps): bump itertools from 0.10.3 to 0.10.4 in /backend (#592)
Bumps [itertools](https://github.com/rust-itertools/itertools) from 0.10.3 to 0.10.4.
- [Release notes](https://github.com/rust-itertools/itertools/releases)
- [Changelog](https://github.com/rust-itertools/itertools/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-itertools/itertools/compare/v0.10.3...v0.10.4)

---
updated-dependencies:
- dependency-name: itertools
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 20:39:40 +00:00
dependabot[bot]
ad29df6ffa chore(deps): bump swc_ecma_ast from 0.91.3 to 0.91.7 in /backend (#599)
Bumps [swc_ecma_ast](https://github.com/swc-project/swc) from 0.91.3 to 0.91.7.
- [Release notes](https://github.com/swc-project/swc/releases)
- [Changelog](https://github.com/swc-project/swc/blob/main/CHANGELOG.md)
- [Commits](https://github.com/swc-project/swc/commits)

---
updated-dependencies:
- dependency-name: swc_ecma_ast
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 20:27:42 +00:00
dependabot[bot]
44f3b1abab chore(deps-dev): bump @sveltejs/adapter-static in /frontend (#598)
Bumps [@sveltejs/adapter-static](https://github.com/sveltejs/kit/tree/HEAD/packages/adapter-static) from 1.0.0-next.42 to 1.0.0-next.43.
- [Release notes](https://github.com/sveltejs/kit/releases)
- [Changelog](https://github.com/sveltejs/kit/blob/master/packages/adapter-static/CHANGELOG.md)
- [Commits](https://github.com/sveltejs/kit/commits/@sveltejs/adapter-static@1.0.0-next.43/packages/adapter-static)

---
updated-dependencies:
- dependency-name: "@sveltejs/adapter-static"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 20:10:59 +00:00
dependabot[bot]
807d2f70e7 chore(deps-dev): bump autoprefixer from 10.4.9 to 10.4.11 in /frontend (#594)
Bumps [autoprefixer](https://github.com/postcss/autoprefixer) from 10.4.9 to 10.4.11.
- [Release notes](https://github.com/postcss/autoprefixer/releases)
- [Changelog](https://github.com/postcss/autoprefixer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/postcss/autoprefixer/compare/10.4.9...10.4.11)

---
updated-dependencies:
- dependency-name: autoprefixer
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:53:38 +00:00
dependabot[bot]
b90ff8928e chore(deps): bump swc_common from 0.28.3 to 0.28.7 in /backend (#593)
Bumps [swc_common](https://github.com/swc-project/swc) from 0.28.3 to 0.28.7.
- [Release notes](https://github.com/swc-project/swc/releases)
- [Changelog](https://github.com/swc-project/swc/blob/main/CHANGELOG.md)
- [Commits](https://github.com/swc-project/swc/commits)

---
updated-dependencies:
- dependency-name: swc_common
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:43:11 +00:00
dependabot[bot]
53e81b3cf7 chore(deps-dev): bump flowbite-svelte in /frontend (#591)
Bumps [flowbite-svelte](https://github.com/themesberg/flowbite-svelte) from 0.26.18 to 0.26.25.
- [Release notes](https://github.com/themesberg/flowbite-svelte/releases)
- [Changelog](https://github.com/themesberg/flowbite-svelte/blob/main/CHANGELOG.md)
- [Commits](https://github.com/themesberg/flowbite-svelte/compare/v0.26.18...v0.26.25)

---
updated-dependencies:
- dependency-name: flowbite-svelte
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:27:17 +00:00
dependabot[bot]
7f917fbcde chore(deps): bump deno_core from 0.150.0 to 0.151.0 in /backend (#590)
Bumps [deno_core](https://github.com/denoland/deno) from 0.150.0 to 0.151.0.
- [Release notes](https://github.com/denoland/deno/releases)
- [Changelog](https://github.com/denoland/deno/blob/main/Releases.md)
- [Commits](https://github.com/denoland/deno/commits)

---
updated-dependencies:
- dependency-name: deno_core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:18:05 +00:00
dependabot[bot]
af2e05b5af chore(deps): bump sqlx from 0.6.1 to 0.6.2 in /backend (#589)
Bumps [sqlx](https://github.com/launchbadge/sqlx) from 0.6.1 to 0.6.2.
- [Release notes](https://github.com/launchbadge/sqlx/releases)
- [Changelog](https://github.com/launchbadge/sqlx/blob/main/CHANGELOG.md)
- [Commits](https://github.com/launchbadge/sqlx/compare/v0.6.1...v0.6.2)

---
updated-dependencies:
- dependency-name: sqlx
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:06:04 +00:00
dependabot[bot]
b52e032d22 chore(deps-dev): bump svelte2tsx from 0.5.16 to 0.5.18 in /frontend (#588)
Bumps [svelte2tsx](https://github.com/sveltejs/language-tools) from 0.5.16 to 0.5.18.
- [Release notes](https://github.com/sveltejs/language-tools/releases)
- [Commits](https://github.com/sveltejs/language-tools/compare/svelte2tsx-0.5.16...svelte2tsx-0.5.18)

---
updated-dependencies:
- dependency-name: svelte2tsx
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 18:53:29 +00:00
dependabot[bot]
cfa4d25716 chore(deps): bump tokio from 1.21.0 to 1.21.1 in /backend (#587)
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.21.0 to 1.21.1.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.21.0...tokio-1.21.1)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 18:44:19 +00:00
dependabot[bot]
c46024f64e chore(deps-dev): bump @typescript-eslint/parser in /frontend (#586)
Bumps [@typescript-eslint/parser](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/parser) from 5.37.0 to 5.38.0.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/parser/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v5.38.0/packages/parser)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/parser"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 18:31:22 +00:00
ex0ns
b78f2d1a91 feat(dev): setup devcontainer (#549)
Co-authored-by: ex0ns <ex0ns@protonmail.ch>
2022-09-19 16:58:22 +02:00
Ruben Fiszel
dfe473d2a0 fix logpanel ml 2022-09-19 08:59:14 +02:00
Ruben Fiszel
e1f54832fa more details on error handling job 2022-09-18 10:11:21 +02:00
Ruben Fiszel
56608f88d6 fix schema required added multiple times 2022-09-18 10:01:50 +02:00
Christian Paul
c8c806d776 Improve issue template: Bug Report (#582) 2022-09-18 09:52:50 +02:00
Faton Ramadani
a85302c1c3 fix(frontend): Support of suspend & stop expression + restore import/export menu (#580)
* feature(frontend): Various UI fix + restore removed features

* feature(frontend): WIP Prop picker panel

* feature(frontend): Advanced flow module tab

* feature(frontend): Add import/export flow menu

* feature(frontend): Remove summary edition + add a enable/disable button for suspend
2022-09-16 14:00:02 +02:00
Faton Ramadani
e2924d581e fix(frontend): Fix flow preview inputs display to avoid hiding results (#581) 2022-09-16 12:49:30 +02:00
Ruben Fiszel
a82f70a1bb fix flow status viewer 2022-09-15 22:24:44 +02:00
Ruben Fiszel
622ffe050c remove tooltip 2022-09-15 22:15:26 +02:00
sqwishy
126dd24c71 feat(backend): flow suspend resume (#522)
Flow observes `suspend` setting and will wait for resume messages sent for the job before continuing to the next step in a flow.

Adds endpoints under workspaces at `/jobs/<cancel|resume>/<job-uuid>` to either cancel or resume the job with a payload. For POST requests to the endpoint, payload is a JSON document. For GET requests to the endpoints, the payload is a base64url encoded JSON document as the value of the payload query parameter.
2022-09-14 11:46:57 -07:00
Ruben Fiszel
0b781f5411 add javascript worker 2022-09-14 12:51:16 +02:00
Faton Ramadani
9fa4d01e3b feat(frontend): Flow UX entire rework (#552)
* feature(frontend): Flow rework WIP

* feature(frontend): Right panel behavior done

* feature(frontend): Split panel working

* feature(frontend): Flows working

* feature(frontend): Add inputs + adapt style + remove duplicate library

* feature(frontend): remove old implementation

* feature(frontend): revert package-lock

* feature(frontend): revert old FlowBuilder component

* feature(frontend): Fix margins + add remove button on the minimap

* feature(frontend): Fix wording

* feature(frontend): add PR UI comments

* feature(frontend): Display the module title

* feature(frontend): Previews working

* feature(frontend): Fix schedule load + update

* feature(frontend): fix build

* feature(frontend): UI fix

* fix just this step

* feature(frontend): for loop iterator and skip failures

* just this step

* script helpers

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2022-09-14 12:34:51 +02:00
Ruben Fiszel
896a0ec2c5 update README 2022-09-14 01:39:06 +02:00
Ruben Fiszel
a8020b79d3 add golang-go 1.19 2022-09-14 01:07:05 +02:00
Ruben Fiszel
0765ed1767 add golang-go 1.19 2022-09-14 01:01:49 +02:00
Ruben Fiszel
d87c821588 add golang-go 1.19 2022-09-14 00:16:43 +02:00
Ruben Fiszel
39918a9bb1 feat: implement go support (#571)
* progress

* progress

* all in one

* frontend

* small nits

* go job test

* go.sum is optional

* add golang-go to backend test image

Co-authored-by: sqwishy <somebody@froghat.ca>
2022-09-13 21:14:21 +02:00