Commit Graph

1640 Commits

Author SHA1 Message Date
Ruben Fiszel
4bacd8f28b fix(caching): preserve permissions 2022-11-20 21:39:57 +01:00
Ruben Fiszel
5c3b07addf fix(caching): add a second caching mechanism by tarring the entire cache for fast startup 2022-11-20 19:46:01 +01:00
Ruben Fiszel
01400c571e better logging for worker 2022-11-20 18:06:53 +01:00
Ruben Fiszel
f5269bfe61 improve distributed caching 2022-11-20 17:48:46 +01:00
Ruben Fiszel
c2e9dff784 feat(go): improve cold start of 200ms by building outside of nsjail 2022-11-20 14:40:29 +01:00
Ruben Fiszel
66f5698c3f fix enterprise sync 2022-11-20 11:12:53 +01:00
Ruben Fiszel
001ee86425 resync even for later steps 2022-11-20 04:34:38 +01:00
Ruben Fiszel
c45d39d717 add resolver backtracking to silence error 2022-11-19 10:17:36 +01:00
Ruben Fiszel
1d6a62fe00 force creating initial cache dirs after resync 2022-11-18 21:17:38 +01:00
Ruben Fiszel
e406da9452 cleanup logs 2022-11-18 21:08:29 +01:00
Ruben Fiszel
0a8fd771b0 feat: supercache extended to all version 2022-11-18 20:17:23 +01:00
Kai Jellinghaus
7efdb3af6b feat(backend): sync cache features on all workers [enterprise] (#907)
* Periodic Job

* Add write lock & bash execution

* Use env for bash script

* Enterprise Feature

* Only time based

* Cleanup

* Move code

* Use rclone sync

* WIP

* Use buildarg

* Remove unecessary deps

* 10 Minute Intervals

* Revert testing change

* Manually pull rclone

* fix rclone

* Initial sync

* Update worker.rs

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2022-11-18 17:20:39 +01:00
Ruben Fiszel
255c7a14bd improve same_worker UX clarity 2022-11-17 18:03:07 +01:00
Ruben Fiszel
9f7ed2bb88 add build-essential to base image + pip install has path as env variable 2022-11-16 18:47:11 +01:00
Faton Ramadani
31f6e47390 fix(frontend): App Editor v0 (#886) 2022-11-14 17:30:49 +01:00
Ruben Fiszel
5211eb6738 add cache dir for deno even when nsjail disabled 2022-11-14 11:43:56 +01:00
Ruben Fiszel
e03b61f31a fix(backend): go use windmill cache dir even if nsjail disabled 2022-11-14 09:20:09 +01:00
Kai Jellinghaus
937e16c2af feat(backend): Flow lock (#868)
* Add lockfile information

* Allow Lockfiles to be pushed to queue

* Handle raw_lock on worker

* Flow Lock Job

* Allow RawScript path

* Simplify handle_code_execution_job

* Regenerate SQLX

* Fix tests

* fix test

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2022-11-13 18:31:08 +01:00
Ruben Fiszel
541ac1e74d feat(backend): remove go.sum from go lockfile (#891) 2022-11-13 17:36:35 +01:00
Ruben Fiszel
791c0635d5 tweak identity to extract previous_result 2022-11-10 08:48:06 +01:00
Ruben Fiszel
cd8d0e5ea6 feat: deprecate previous_result in favor of results per id 2022-11-10 01:58:52 +01:00
Kai Jellinghaus
15561541f1 Disable Deno Lock Files unless feature flag require it(#881) 2022-11-08 16:52:45 +01:00
Ruben Fiszel
d969eb4f2c fix python on nsjail 2022-11-08 00:42:14 +01:00
Ruben Fiszel
61c915488c ci: trim down docker main docker image 2022-11-07 13:37:37 +01:00
Ruben Fiszel
7c97fac746 feat: support bash as 4th language (#865)
* bash support

* bash backend working

* frontend part

* bash backend working
2022-11-06 23:48:18 +01:00
Ruben Fiszel
a522cea109 feat(backend): flow duration is now computed as the sum of every child 2022-11-05 22:31:54 +01:00
Ruben Fiszel
d248ac4134 feat(backend): use result_by_id in branchone (#857)
* progress

* fix result by id
2022-11-04 12:06:08 +01:00
Kai Jellinghaus
357d313dd5 Ignore deno lockfile if invalid (#854)
* Ignore deno lockfile if invalid

* Always write file
2022-11-03 00:47:09 +01:00
Kai Jellinghaus
621ed290cf feat(backend): Deno lock files (#851)
* Enable generating locks for deno

* Handle deno lockfile

* Fix bug with empty lockfiles

* Handle deno lockfiles

* Allow unstable features when resolving deno deps

* Ignore bad lockfiles

* Handle Deno Path

* No Color output

* Fix OsStr
2022-11-02 23:52:45 +01:00
Ruben Fiszel
c097a3d039 fix(backend): capture up all lockfile issues 2022-11-02 14:04:44 +01:00
Ruben Fiszel
f7572ba2f3 approvers are available to the step right after approval 2022-11-02 10:43:19 +01:00
Ruben Fiszel
a1859ca34a add a bit of docs 2022-11-01 07:50:59 +01:00
Ruben Fiszel
463d73399d feat(backend): add parallel option for forloop and branchall (#840)
* parallel

* parallel

* fix 1

* fix 2

* fix 3

* fix 3

* fix 4

* sqlx

* add parallel toggle on frontend

* parallel in frontend

* serde

* fix everything

* fix everything
2022-11-01 06:09:00 +01:00
Ruben Fiszel
afd8ce8797 handle errors prior to first step better 2022-10-30 19:03:22 +01:00
Ruben Fiszel
fc61e9674e add flow_input to context of branch predicates and stop early 2022-10-30 18:24:23 +01:00
Ruben Fiszel
e8bbda8a5b fix input transforms for resource and variable 2022-10-30 17:28:59 +01:00
Ruben Fiszel
b02521d7ff fix(backend): fix error handler progress update 2022-10-30 13:47:28 +01:00
Ruben Fiszel
e96c5ca670 early stop now bubble up to the top 2022-10-30 02:32:35 +02:00
Ruben Fiszel
12de3e700f handle more error edge cases 2022-10-29 13:59:50 +02:00
Kai Jellinghaus
6263e90735 restructure the entire backend layout using workspaces (#815) 2022-10-29 11:58:06 +02:00