Commit Graph

74 Commits

Author SHA1 Message Date
Ruben Fiszel
bf3e417acc fix(python): handle recursive python imports with loop 2024-02-20 19:42:11 +01:00
Ruben Fiszel
77aaf2724c chore: remove warnings 2024-02-18 14:03:00 +01:00
Ruben Fiszel
1de8479259 add support for pip index url 2024-02-17 15:58:20 +01:00
Ruben Fiszel
0a5bf33beb fix compile 2024-02-10 00:40:53 +01:00
Ryan Doyle
b230378320 fix: Properly handle pip index urls in pip-compile (#3192)
- URLs that contain simple auth seem to have that stripped before being
  passed to underlying pip if it needs to be called by pip-compile.
- This forces explicit passing of the complete, authenticated url
  string to pip, through pip-compile, via pip-compile's "--pip-args"
  argument.
2024-02-10 00:29:08 +01:00
Ruben Fiszel
7845ad0d18 add tracing debug to pip compile 2024-02-09 22:38:52 +01:00
Ruben Fiszel
e5a447d699 add tracing debug to pip install command args 2024-02-09 22:35:59 +01:00
Ruben Fiszel
e4dc972d40 fix: handle better \u0000 in python result 2024-02-08 16:02:38 +01:00
Ruben Fiszel
95952da387 fix: add support for ephemeral tokens 2024-02-03 12:09:39 +01:00
Audrius Butkevicius
ec911f6a5a feat: Passing HOME env var through to python workers (#3092)
* feat: Allow passing through certain environment variables

* Lookup the env vars on startup

* Faceplam

* Update python_executor.rs
2024-01-27 15:49:29 +01:00
Ruben Fiszel
a66208f326 fix(scim): improve get_user for scim 2024-01-24 20:23:42 +01:00
Ruben Fiszel
450267a84e fix: no-emit-index-url on lockfiles 2024-01-24 12:47:19 +01:00
Ruben Fiszel
00d3305592 fix build 2024-01-23 20:15:32 +01:00
Ruben Fiszel
9121eb0a74 remove denogobuncache 2024-01-23 19:54:07 +01:00
Ruben Fiszel
640ebcb146 feat: OIDC support (#3017)
* oidc

* update

* feat: add support for multiselect in python

* d

* d

* progress

* all

* all

* all
2024-01-16 23:32:26 +01:00
Ruben Fiszel
dff1948a64 add step_id to errors in flows 2024-01-13 13:46:42 +01:00
Ruben Fiszel
605a61c378 replace tracing log 2024-01-10 13:54:58 +01:00
Ruben Fiszel
3517c7f283 feat: add ability to use secrets in pip requirements 2024-01-10 13:12:20 +01:00
Ruben Fiszel
e0140f175d feat: PIP_LOCAL_DEPENDENCIES now accepts regex and is configurable from the UI (#2940)
* fix(frontend): Fix decision tree (#2928)

* fix(frontend): wip

* fix(frontend): wip

* fix(frontend): decision tree history

* fix(frontend): fix wording

* feat: PIP_LOCAL_DEPENDENCIES now accepts regex

* Add worker config FE

---------

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
Co-authored-by: gbouv <guillaume@windmill.dev>
2023-12-30 03:35:04 +01:00
Guillaume Bouvignies
5f85b67dfc fix: Failing jobs in dedicated worker mode are now marked as failing (#2894)
* fix: Failing jobs in dedicated worker mode are now marked as failing

* remove log line

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2023-12-21 10:29:26 +01:00
Guillaume Bouvignies
4c3c988f7b fix: Python wrapper catches BaseException instead of Exception (#2902) 2023-12-21 10:26:13 +01:00
Guillaume Bouvignies
292b2309a7 fix: Python imports from git repository (#2886) 2023-12-20 13:00:51 +09:00
Guillaume Bouvignies
350c8e843f feat: EnvVar allow list is configurable from the UI (#2829)
* feat: EnvVar allow list is configurable from the UI

* variable renaming
2023-12-12 07:04:55 +01:00
HugoCasa
c58190ef78 feat: limit pro plans (#2794) 2023-12-06 17:47:32 +01:00
Guillaume Bouvignies
3d6fb15a90 fix: minor fixes to private NPM and python registries to get everything working (#2728) 2023-11-29 16:30:45 +01:00
Guillaume Bouvignies
15ebf46abc chore: Add examples on how to deploy private registries (#2719)
* chore: Add examples on how to deploy private registries

* chore: example for private pypiserver with https

* Allow DENO_CERT certificate with native workers

* Add BUN_TLS_REJECT_UNAUTHORIZED
2023-11-29 11:38:23 +01:00
Ruben Fiszel
aa6bf4027f fix base_internal_url 2023-11-20 02:03:41 +01:00
Ruben Fiszel
fa3efd3f60 fix: handle console logs in dedicated workers 2023-11-11 13:39:06 +01:00
Ruben Fiszel
b9e41d066d fix: support digit prefixed script in python 2023-11-10 20:51:28 +01:00
Ruben Fiszel
4661dd2cea feat: exit dedicated worker upon new deployment 2023-11-10 20:41:43 +01:00
Guillaume Bouvignies
0d846b310d fix: Pythong script in dedicated worker fails with more than 1 arg (#2588) 2023-11-08 10:08:42 +01:00
Guillaume Bouvignies
83f9ef34e6 feat: Add toggle to optionally mute error handler for cancelled jobs (#2567)
* fix: Fix canceled flag in completed_job table

* Add toggle to workspace settings
2023-11-06 18:24:51 +01:00
Ruben Fiszel
b8883481f4 feat: refactor metrics and add performance debug metrics (#2520)
* all

* feat: add debug metrics
2023-10-27 21:00:28 +02:00
Ruben Fiszel
39f30785a0 feat: dedicated worker for python (#2492)
* update

* all
2023-10-23 20:21:16 +02:00
Ruben Fiszel
cef2949497 fix: allow superadmin to run inline scripts in repo they are not part of 2023-10-21 14:48:51 +02:00
Ruben Fiszel
656cb83d6b fix: fix app reactivity 2023-10-21 14:33:07 +02:00
Ruben Fiszel
9314d38bf1 feat: refactor entirely json processing in favor or rawjson to handle larger payloads (#2446)
* raw json

* raw json

* raw json

* raw json

* the big rawjson rewrite

* resolve merge conflicts

* all

* progress

* progress

* all compile

* remove mut

* remove mut

* remove mut

* arc queuedjob

* finish

* finish

* finish

* fixes

* progress

* fix result

* small fixes

* small fixes

* fix tests

* fix tests

* fix tests

* optimize eval timeout

* optimize eval timeout

* optimize eval timeout

* handle big args and result in get jobs

* improve args

* fix

* fix

* fix tests

* fix tests

* done

* add bigquery to native picker

* add bigquery

---------

Co-authored-by: gbouv <guillaume@windmill.dev>
2023-10-16 10:46:55 +02:00
Guillaume Bouvignies
e960efb499 Better error when executable not found (#2407)
Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2023-10-09 18:06:05 +02:00
Ruben Fiszel
2c9ae41706 feat: manage cache and init scripts from worker group UI (#2396)
* cache & inits

* cache & inits

* cache & inits

* all

* fix tests

* improve
2023-10-05 19:42:15 +02:00
HugoCasa
e7165f3357 fix: add reserved variables in args (#2371)
* fix: add reserved variables in args

* fix: only get job when necessary
2023-10-03 18:14:37 +02:00
Ruben Fiszel
c42b8750f1 feat: add npm_config_registry support for bun, deno and being settable from UI (#2373)
* foo

* foo

* npm config
2023-10-02 14:45:29 +02:00
Ruben Fiszel
f40bbba519 feat: attempt to SIGTERM before SIGKILL for bash 2023-09-11 18:55:19 +02:00
Ruben Fiszel
75a149009a fix: pass TZ from env to runtimes 2023-09-07 12:20:29 +02:00
Ruben Fiszel
b35ffd435d fix: fix datetime handling for python 2023-09-03 11:19:22 +02:00
Ruben Fiszel
9efca50541 refactor worker-common 2023-08-20 16:44:22 +02:00
Ruben Fiszel
da036b2a19 refactor workers 2023-08-20 15:58:43 +02:00
Ruben Fiszel
4c870272d4 feat: add step's custom timeout 2023-07-30 20:42:24 +02:00
Ruben Fiszel
c22d2b91a1 feat: use flock to avoid concurrency issues on pip and shared volume 2023-07-26 20:17:26 +02:00
Ruben Fiszel
d91ac5c77b initial python imports relative dependency resolver 2023-07-26 17:33:46 +02:00
Ruben Fiszel
a48edf435f fix: handle pip requirements to git commits 2023-07-20 08:32:44 +02:00