Commit Graph

973 Commits

Author SHA1 Message Date
Ruben Fiszel
f1fdb4e0b9 fix cancel job 2022-09-25 16:36:32 +02:00
sqwishy
c3ce89ec5f reorganize handle_child (#606)
* reorganize handle_child

There were a couple issues with the current implementation:

1. When reading stdout and stderr from the child, as soon as we hit EOF
   on one we would stop reading from both (line 1420). This could lead
   to the return value not being read from the job program.

2. Lines read from stdout and stderr are put into a channel and read
   elsewhere with `rx.recv()` (line 1497) but that channel isn't read
   until empty.  It is only read in the `while !done.load(...)` (line
   1449) loop and that loop can stop after any `.store(true, ...)`.
   Which happens when the child exits, when the job is cancelled, when
   either stdout or stderr reach EOF...

   This can be verified by putting `dbg!(rx.recv().await)` or a similar
   assertion after the while loop before returning from that function.
   It shows the channel still containing log lines on rare occasions.

I was pretty careful in this to maintain the current behaviour; adding
comments to express intention.

One difference in this is that some regular intervals (cancel check and
ping update) should be more regular?

Before...

> at 00ms wait for 10ms
> at 10ms do things for 3ms
> at 13ms wait again for *10ms*
> at 23ms do things again ...

With change...

> at 00ms wait for 10ms
> at 10ms do things for 3ms
> at 13ms wait again but for *7ms*
> at 20ms do things again ...

Which I'm guessing is preferable but I could be wrong.

* renames; interpolate values in log messages

* do `append_logs()` in tokio::task

* tokio::time::interval & close pipe after limit

* clean up comments
2022-09-24 22:55:52 +02:00
sqwishy
e81b53b3ef update cron v0.12.0 (#623) 2022-09-24 21:18:36 +02:00
Ruben Fiszel
5c430dee8c feat(frontend): merge logs and result tab in script editor (#622) 2022-09-23 16:20:47 +02:00
Ruben Fiszel
9430f3a5df fix(frontend): loading flows with for loops + flowStatusViewer treat single jobs properly 2022-09-23 13:28:02 +02:00
Faton Ramadani
78bab01226 feat(frontend): Extract publish to hub button (#620)
* feature(frontend): Extract publish to hub button

* feat(frontend): Extract Publish to hub button
2022-09-23 12:23:37 +02:00
Faton Ramadani
a7fcf18f20 feat(frontend): Add a split panel in the test tab (#619) 2022-09-23 12:11:05 +02:00
Ádám Kovács
f8b62f6e9f feat(frontend): Badge component and script page (#617)
* fix(frontend): Consistent tooltip font size

* feature(frontend): Add new badge component

* feature(frontend): Add color type to badge

* feature(frontend): Add copy to clipboard utility

* feature(frontend): Update common badge component

* feature(frontend): Update badge to handle icons

* feature(frontend): Update script page design

* feat(frontend): Add capitalize option to badges

* fix(frontend): Fix shared badge text display
2022-09-23 12:10:15 +02:00
Faton Ramadani
7d070b5a10 feature(frontend): Button component (#616)
* feature(frontend): Button component

* feature(frontend): Ajust style
2022-09-22 13:25:17 +02:00
sqwishy
45d0760ab9 remove delay between spawning each worker (#614) 2022-09-21 21:05:19 -07:00
Ruben Fiszel
a0a4de062c fix flow UX and flowStateStore (#610)
* fix everything

* fix(frontend): Restore module deletion + restore for loop settings

* fix(frontend): Add missing focus on number inputs

* fix(frontend): Add key wrapper to make sure the editor content is reloaded

* fix(frontend): Fix mini-map spacing + add icon to schedule and retry buttons

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
2022-09-21 11:37:33 +02:00
Ruben Fiszel
28b6eaf33f improve preview results v1 2022-09-21 02:48:30 +02:00
Ruben Fiszel
956bf10be1 fix connect button 2022-09-21 02:00:30 +02:00
Ruben Fiszel
f0d32fbb5a fix Advanced flow module buttons 2022-09-21 01:38:16 +02:00
Ruben Fiszel
29bad8ee49 fix focusProp 2022-09-21 00:55:50 +02:00
dependabot[bot]
84267eee0b chore(deps): bump anyhow from 1.0.64 to 1.0.65 in /backend (#600)
Bumps [anyhow](https://github.com/dtolnay/anyhow) from 1.0.64 to 1.0.65.
- [Release notes](https://github.com/dtolnay/anyhow/releases)
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.64...1.0.65)

---
updated-dependencies:
- dependency-name: anyhow
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-20 22:06:10 +00:00
dependabot[bot]
8e09502031 chore(deps): bump thiserror from 1.0.34 to 1.0.35 in /backend (#604)
Bumps [thiserror](https://github.com/dtolnay/thiserror) from 1.0.34 to 1.0.35.
- [Release notes](https://github.com/dtolnay/thiserror/releases)
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.34...1.0.35)

---
updated-dependencies:
- dependency-name: thiserror
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-20 22:03:02 +00:00
Faton Ramadani
56147ac946 feature(frontend): Add support for retries for flows (#607)
* feature(frontend): Add support for retries for flows

* feature(frontend): Fix design issues
2022-09-21 00:00:39 +02:00
dependabot[bot]
0aeec2e735 chore(deps): bump swc_ecma_parser from 0.119.7 to 0.119.12 in /backend (#597)
Bumps [swc_ecma_parser](https://github.com/swc-project/swc) from 0.119.7 to 0.119.12.
- [Release notes](https://github.com/swc-project/swc/releases)
- [Changelog](https://github.com/swc-project/swc/blob/main/CHANGELOG.md)
- [Commits](https://github.com/swc-project/swc/commits)

---
updated-dependencies:
- dependency-name: swc_ecma_parser
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-20 22:00:28 +00:00
Faton Ramadani
21ac344c1e feature(frontend): Prop picker panel (#605)
* feature(frontend): WIP Prop picker v2

* feature(frontend): add PropPicker context

* feature(frontend): prop picker working

* feature(frontend): restore connect button

* feature(frontend): Fix wording + fix height to avoid content shift

* feature(frontend): Fix upTo preview + adapt style

* feature(frontend): Preview results cleanup

* feature(frontend): Remove test logs

* feature(frontend): Revert wrong changes

* feature(frontend): Restore shared preview args

* feature(frontend): Reduce ObjectViewer font size + remove useless space

* feature(frontend): Wording

* feature(frontend): Fix Split panel scrolling issues
2022-09-20 23:59:48 +02:00
dependabot[bot]
81139c0ba7 chore(deps): bump swc_common from 0.28.7 to 0.28.8 in /backend (#601)
Bumps [swc_common](https://github.com/swc-project/swc) from 0.28.7 to 0.28.8.
- [Release notes](https://github.com/swc-project/swc/releases)
- [Changelog](https://github.com/swc-project/swc/blob/main/CHANGELOG.md)
- [Commits](https://github.com/swc-project/swc/commits)

---
updated-dependencies:
- dependency-name: swc_common
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 21:05:54 +00:00
dependabot[bot]
56cec8d731 chore(deps): bump itertools from 0.10.3 to 0.10.4 in /backend (#592)
Bumps [itertools](https://github.com/rust-itertools/itertools) from 0.10.3 to 0.10.4.
- [Release notes](https://github.com/rust-itertools/itertools/releases)
- [Changelog](https://github.com/rust-itertools/itertools/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-itertools/itertools/compare/v0.10.3...v0.10.4)

---
updated-dependencies:
- dependency-name: itertools
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 20:39:40 +00:00
dependabot[bot]
1cfe6d299f chore(deps): bump swc_ecma_ast from 0.91.3 to 0.91.7 in /backend (#599)
Bumps [swc_ecma_ast](https://github.com/swc-project/swc) from 0.91.3 to 0.91.7.
- [Release notes](https://github.com/swc-project/swc/releases)
- [Changelog](https://github.com/swc-project/swc/blob/main/CHANGELOG.md)
- [Commits](https://github.com/swc-project/swc/commits)

---
updated-dependencies:
- dependency-name: swc_ecma_ast
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 20:27:42 +00:00
dependabot[bot]
8f469e156d chore(deps-dev): bump @sveltejs/adapter-static in /frontend (#598)
Bumps [@sveltejs/adapter-static](https://github.com/sveltejs/kit/tree/HEAD/packages/adapter-static) from 1.0.0-next.42 to 1.0.0-next.43.
- [Release notes](https://github.com/sveltejs/kit/releases)
- [Changelog](https://github.com/sveltejs/kit/blob/master/packages/adapter-static/CHANGELOG.md)
- [Commits](https://github.com/sveltejs/kit/commits/@sveltejs/adapter-static@1.0.0-next.43/packages/adapter-static)

---
updated-dependencies:
- dependency-name: "@sveltejs/adapter-static"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 20:10:59 +00:00
dependabot[bot]
e254161e92 chore(deps-dev): bump autoprefixer from 10.4.9 to 10.4.11 in /frontend (#594)
Bumps [autoprefixer](https://github.com/postcss/autoprefixer) from 10.4.9 to 10.4.11.
- [Release notes](https://github.com/postcss/autoprefixer/releases)
- [Changelog](https://github.com/postcss/autoprefixer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/postcss/autoprefixer/compare/10.4.9...10.4.11)

---
updated-dependencies:
- dependency-name: autoprefixer
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:53:38 +00:00
dependabot[bot]
799a877579 chore(deps): bump swc_common from 0.28.3 to 0.28.7 in /backend (#593)
Bumps [swc_common](https://github.com/swc-project/swc) from 0.28.3 to 0.28.7.
- [Release notes](https://github.com/swc-project/swc/releases)
- [Changelog](https://github.com/swc-project/swc/blob/main/CHANGELOG.md)
- [Commits](https://github.com/swc-project/swc/commits)

---
updated-dependencies:
- dependency-name: swc_common
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:43:11 +00:00
dependabot[bot]
4423941c46 chore(deps-dev): bump flowbite-svelte in /frontend (#591)
Bumps [flowbite-svelte](https://github.com/themesberg/flowbite-svelte) from 0.26.18 to 0.26.25.
- [Release notes](https://github.com/themesberg/flowbite-svelte/releases)
- [Changelog](https://github.com/themesberg/flowbite-svelte/blob/main/CHANGELOG.md)
- [Commits](https://github.com/themesberg/flowbite-svelte/compare/v0.26.18...v0.26.25)

---
updated-dependencies:
- dependency-name: flowbite-svelte
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:27:17 +00:00
dependabot[bot]
6d64827ea7 chore(deps): bump deno_core from 0.150.0 to 0.151.0 in /backend (#590)
Bumps [deno_core](https://github.com/denoland/deno) from 0.150.0 to 0.151.0.
- [Release notes](https://github.com/denoland/deno/releases)
- [Changelog](https://github.com/denoland/deno/blob/main/Releases.md)
- [Commits](https://github.com/denoland/deno/commits)

---
updated-dependencies:
- dependency-name: deno_core
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:18:05 +00:00
dependabot[bot]
9c542225bf chore(deps): bump sqlx from 0.6.1 to 0.6.2 in /backend (#589)
Bumps [sqlx](https://github.com/launchbadge/sqlx) from 0.6.1 to 0.6.2.
- [Release notes](https://github.com/launchbadge/sqlx/releases)
- [Changelog](https://github.com/launchbadge/sqlx/blob/main/CHANGELOG.md)
- [Commits](https://github.com/launchbadge/sqlx/compare/v0.6.1...v0.6.2)

---
updated-dependencies:
- dependency-name: sqlx
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:06:04 +00:00
dependabot[bot]
f438dc6579 chore(deps-dev): bump svelte2tsx from 0.5.16 to 0.5.18 in /frontend (#588)
Bumps [svelte2tsx](https://github.com/sveltejs/language-tools) from 0.5.16 to 0.5.18.
- [Release notes](https://github.com/sveltejs/language-tools/releases)
- [Commits](https://github.com/sveltejs/language-tools/compare/svelte2tsx-0.5.16...svelte2tsx-0.5.18)

---
updated-dependencies:
- dependency-name: svelte2tsx
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 18:53:29 +00:00
dependabot[bot]
7e9aee7443 chore(deps): bump tokio from 1.21.0 to 1.21.1 in /backend (#587)
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.21.0 to 1.21.1.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.21.0...tokio-1.21.1)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 18:44:19 +00:00
dependabot[bot]
98545fb2f1 chore(deps-dev): bump @typescript-eslint/parser in /frontend (#586)
Bumps [@typescript-eslint/parser](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/parser) from 5.37.0 to 5.38.0.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/parser/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v5.38.0/packages/parser)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/parser"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 18:31:22 +00:00
ex0ns
f5cd65093c feat(dev): setup devcontainer (#549)
Co-authored-by: ex0ns <ex0ns@protonmail.ch>
2022-09-19 16:58:22 +02:00
Ruben Fiszel
a37ddd398e fix logpanel ml 2022-09-19 08:59:14 +02:00
Ruben Fiszel
cdab7befcd more details on error handling job 2022-09-18 10:11:21 +02:00
Ruben Fiszel
32b2d18ecc fix schema required added multiple times 2022-09-18 10:01:50 +02:00
Christian Paul
68df9eb456 Improve issue template: Bug Report (#582) 2022-09-18 09:52:50 +02:00
Faton Ramadani
381191442f fix(frontend): Support of suspend & stop expression + restore import/export menu (#580)
* feature(frontend): Various UI fix + restore removed features

* feature(frontend): WIP Prop picker panel

* feature(frontend): Advanced flow module tab

* feature(frontend): Add import/export flow menu

* feature(frontend): Remove summary edition + add a enable/disable button for suspend
2022-09-16 14:00:02 +02:00
Faton Ramadani
50d819fd83 fix(frontend): Fix flow preview inputs display to avoid hiding results (#581) 2022-09-16 12:49:30 +02:00
Ruben Fiszel
bada20cfdd fix flow status viewer 2022-09-15 22:24:44 +02:00
Ruben Fiszel
f6f829b9f0 remove tooltip 2022-09-15 22:15:26 +02:00
sqwishy
a4a583f4e3 feat(backend): flow suspend resume (#522)
Flow observes `suspend` setting and will wait for resume messages sent for the job before continuing to the next step in a flow.

Adds endpoints under workspaces at `/jobs/<cancel|resume>/<job-uuid>` to either cancel or resume the job with a payload. For POST requests to the endpoint, payload is a JSON document. For GET requests to the endpoints, the payload is a base64url encoded JSON document as the value of the payload query parameter.
2022-09-14 11:46:57 -07:00
Ruben Fiszel
7dd16de479 add javascript worker 2022-09-14 12:51:16 +02:00
Faton Ramadani
c9ae5905a8 feat(frontend): Flow UX entire rework (#552)
* feature(frontend): Flow rework WIP

* feature(frontend): Right panel behavior done

* feature(frontend): Split panel working

* feature(frontend): Flows working

* feature(frontend): Add inputs + adapt style + remove duplicate library

* feature(frontend): remove old implementation

* feature(frontend): revert package-lock

* feature(frontend): revert old FlowBuilder component

* feature(frontend): Fix margins + add remove button on the minimap

* feature(frontend): Fix wording

* feature(frontend): add PR UI comments

* feature(frontend): Display the module title

* feature(frontend): Previews working

* feature(frontend): Fix schedule load + update

* feature(frontend): fix build

* feature(frontend): UI fix

* fix just this step

* feature(frontend): for loop iterator and skip failures

* just this step

* script helpers

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2022-09-14 12:34:51 +02:00
Ruben Fiszel
5a2c45e6b2 update README 2022-09-14 01:39:06 +02:00
Ruben Fiszel
ad498fb635 add golang-go 1.19 2022-09-14 01:07:05 +02:00
Ruben Fiszel
d2f45c19f1 add golang-go 1.19 2022-09-14 01:01:49 +02:00
Ruben Fiszel
16cad5c8af add golang-go 1.19 2022-09-14 00:16:43 +02:00
Ruben Fiszel
9d991f968c feat: implement go support (#571)
* progress

* progress

* all in one

* frontend

* small nits

* go job test

* go.sum is optional

* add golang-go to backend test image

Co-authored-by: sqwishy <somebody@froghat.ca>
2022-09-13 21:14:21 +02:00
Ruben Fiszel
52ec744992 fix: iterator input transform is made more generic (#524)
* fix: iterator expr is standardized with regular input transforms

* fix: iterator expr is standardized with regular input transforms

* v2
2022-09-13 20:11:00 +02:00