Commit Graph

4250 Commits

Author SHA1 Message Date
HugoCasa
23cce4ddb0 fix: workspace preprocessor improvements (#5784)
* add tracing to get of authed client

* internal: Trigger claude when commenting with /aider (#5783)

* add claude instructions files

* call claude too when using aider

* fix

* add draft for linear claude integration

* fix: workspace preprocessor fixes

* tmp ee ref

* fix build

* update ee ref

* fix: hub script preprocessor handling

* fix build

* good ref

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
Co-authored-by: centdix <40307056+centdix@users.noreply.github.com>
2025-05-21 17:49:21 +02:00
centdix
9e66e620c6 add claude instructions files (#5779) 2025-05-20 13:53:34 +02:00
Ruben Fiszel
3b8468757e nit 2025-05-20 13:23:02 +02:00
Ruben Fiszel
892379fd47 nit 2025-05-20 12:55:13 +02:00
Ruben Fiszel
5bd2e1772a add log on s3 loading 2025-05-20 10:24:55 +02:00
pyranota
f0ff62479f build: make flake.nix build with all features (#5773) 2025-05-20 09:43:44 +02:00
pyranota
14fd6458a8 feat(python): add annotation to skip result post-processing (#5769)
* feat(python): add annotation to skip result post-processing

Typically windmill will replace all NaN, Infinity and -Infinity from resulting string.
We do it because JSON specification does not support these types as well as DB.

However it will substitute also the cases when any of those words are used within the string.
E.g. script returning "To Infinity and Beyond" will be postprocessed to "To null and Beyond".
Current behaviour is done for the performance sake and now can be disabled with `#skip_result_postprocessing` annotation.

* add comments

* remove extra comments
2025-05-19 22:31:46 +02:00
HugoCasa
a13b27a099 feat: triggers git sync (#5766)
* feat: triggers git sync

* nits

* update hub paths + ee ref
2025-05-19 18:16:04 +02:00
Ruben Fiszel
ff7a90a2f0 chore(main): release 1.491.5 (#5765)
* chore(main): release 1.491.5

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-05-17 11:00:36 +02:00
Ruben Fiszel
985ef9cd9a nit error 2025-05-17 10:56:16 +02:00
Ruben Fiszel
a499f9dffe fix: improve handling of custom concurrency key/tag with preprocessors (#5762)
* fix

* rm spurrious diff

* handle failing preprocessors

* nits

* update

* update
2025-05-17 10:52:28 +02:00
Diego Imbert
e88954a217 fix: S3 sql mode returns S3Object (#5764)
* fix upload_s3_file not checking response

* Return S3Object instead of path string
2025-05-16 19:28:57 +02:00
dieriba
294dc62ffd add null typing to openapi spec for easier gen (#5759) 2025-05-16 09:59:45 +02:00
Ruben Fiszel
5f86e60350 chore(main): release 1.491.4 (#5758)
* chore(main): release 1.491.4

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-05-16 01:19:58 +02:00
HugoCasa
508b1039ac fix: add v1 preprocessor support to workspace preprocessor script (#5757)
* fix: add v1 preprocessor support to workspace preprocessor script

* nit

* build
2025-05-16 01:10:51 +02:00
Ruben Fiszel
17e9b38f65 chore(main): release 1.491.3 (#5754)
* chore(main): release 1.491.3

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-05-15 22:07:45 +02:00
HugoCasa
44c4af5339 fix: http trigger routers cache version sequence (#5755)
* fix: http trigger routers cache version sequence

* nit
2025-05-15 21:59:30 +02:00
Ruben Fiszel
b68cbb31df chore(main): release 1.491.2 (#5747)
* chore(main): release 1.491.2

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-05-15 20:27:36 +02:00
Ruben Fiszel
185725e677 fix 2025-05-15 20:11:00 +02:00
Ruben Fiszel
3fa5da1690 fix 2025-05-15 20:10:03 +02:00
dieriba
bef22287f8 fix: http trigger signature validation (#5753)
* fix

* fix import

* nits: force raw string on signature authentication

* fix
2025-05-15 20:07:05 +02:00
Ruben Fiszel
ad0f4e790e add alerts by workspace index 2025-05-15 19:19:53 +02:00
Ruben Fiszel
f4462bf0e3 nit sqlx 2025-05-15 18:24:11 +02:00
Ruben Fiszel
265ab6d679 add dependency_map grants 2025-05-15 17:54:49 +02:00
Ruben Fiszel
0a68067433 nit delete performance 2025-05-15 17:52:25 +02:00
wendrul
940432b231 fix: Improve indexer performance by factoring required queries to the DB # (#5749)
* search modal UI improvements

* Add ee repo ref

* Prepare sqlx

* Remove unused variable
2025-05-15 17:38:57 +02:00
HugoCasa
ac3d470202 perf: cache http trigger routers and auth (#5748)
* perf: cache http trigger routers and auth

* fix build

* fix

* fix build

* fix build

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2025-05-15 17:38:45 +02:00
Ruben Fiszel
2bf89ba684 update sqlx 2025-05-15 16:07:21 +02:00
Ruben Fiszel
8e177cabb9 fix: improve perf of job deletion 2025-05-15 15:44:55 +02:00
dieriba
8c6647e0b0 nit queue metrics drawer (#5745) 2025-05-15 11:03:16 +02:00
Ruben Fiszel
6343a744c3 chore(main): release 1.491.1 (#5744)
* chore(main): release 1.491.1

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-05-15 09:43:14 +02:00
Ruben Fiszel
123657fa63 fix: avoid deadlocks in sending completed job to result processors (#5742)
* buffer

* unbounded and bounded

* fix

* buffer

* impl clone

* flume it all

* update

* update

* update
2025-05-15 09:13:09 +02:00
Diego Imbert
d9916318b1 oracle support for s3 streaming + misc (#5738)
* changed SQL templates to include S3

* oracle support for s3 streaming
2025-05-14 15:45:00 +02:00
Ruben Fiszel
1fb741fac4 chore(main): release 1.491.0 (#5729)
* chore(main): release 1.491.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-05-14 10:37:34 +02:00
Ruben Fiszel
a325bf587f add more duration warnings to logs 2025-05-14 10:27:55 +02:00
Ruben Fiszel
ef068ab5ef add more duration warnings to logs 2025-05-14 10:13:14 +02:00
Ruben Fiszel
d5fbeaf91b nit logs 2025-05-14 09:37:47 +02:00
Ruben Fiszel
8659a7985e small fix 2025-05-14 08:48:48 +02:00
Alexander Petric
d98731b05c feat: Microsoft Teams approvals (#5734)
* move branch

* openapi version

* full interactive approvals

* move to ee

* move to ee

* move ee

* merge common logic slack/teams

* merge common logic slack/teams

* sqlx prepare

* formatting

* linter ee

* update ee-repo ref

* ee repo ref

---------

Co-authored-by: Ruben Fiszel <ruben@windmill.dev>
2025-05-13 23:06:49 +02:00
Ruben Fiszel
2b23348fec nit workspace 2025-05-13 22:23:25 +02:00
dieriba
20bb0d6ea3 fix gcp on ee private ref (#5735)
* fix

* update repo ref
2025-05-13 22:06:10 +02:00
Ruben Fiszel
95cf9c6814 fix: add support for log compaction on docker jobs (#5732)
* improve docker compact

* improve docker compact

* update ref

* update

* update agent workers
2025-05-13 21:42:15 +02:00
wendrul
4662cfd67d fix: Ansible lockfile back compatibility issue (#5731)
* fix: Ansible lockfile back compatibility issue

* Replace condition with more readable alternative
2025-05-13 16:19:18 +02:00
HugoCasa
38b0ed8c32 fix: add missing run job transaction drop (#5730) 2025-05-13 11:16:29 +02:00
Diego Imbert
25bbdba1d1 feat: sql jobs outputting to s3 + streaming for high-number of rows (#5704)
* stream to s3 boilerplate

* S3 works with new syntax

* snowflake s3 streaming support

* postgres s3 support

* fix postgres stream format

* mysql s3 streaming

* mssql s3 streaming

* new s3 mode syntax

* optional folder param

* rename folder to prefix

* json_stream_arr_values

* cargo toml rollback

* convert_ndjson with datafusion

* format conversion kinda works

* Fixed not finishing the datafusion writer

* support for pg and mssql

* fix file ext

* bigquery conversion and works with s3 streaming

* fix s3 flag parser

* snowflake s3 streaming support

* factor out duplicate code

* remove anyhow

* Err case for parse s3 mode

* Send error to mpsc

* bigquery s3 streaming fix for huge queries

* remove extra stuff

* snowflake s3 streaming support

* small regex mistake

* cfg(not(feature = "parquet"))

* fix CI (unused import)

* error handling fix (graphite)
2025-05-13 10:19:44 +02:00
HugoCasa
01906bcb55 fix: trigger event support for webhook get endpoints (#5728) 2025-05-12 18:17:37 +02:00
Ruben Fiszel
d9efdd4f6c chore(main): release 1.490.0 (#5717)
* chore(main): release 1.490.0

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
2025-05-12 11:45:00 +02:00
Ruben Fiszel
c31aedabab fix: make ansible more resilient to invalid lockfiles 2025-05-12 11:40:13 +02:00
dieriba
00faf1eefe nits: use generic deserializer for empty data (#5727)
* use generic deserializer for empty data

* update repo ref

* fix import
2025-05-12 11:00:55 +02:00
Ruben Fiszel
4bf2c38cbf nit compile 2025-05-11 11:52:42 +02:00