Commit Graph

662 Commits

Author SHA1 Message Date
Ruben Fiszel
e5366b84bb feat: refactor logging to improve performance by order of magnitude for longer jobs 2024-03-16 17:55:34 +01:00
Ruben Fiszel
ae661365e4 fix: s3 cache is an instance settings (#3421)
* s3

* s3
2024-03-15 15:09:05 +01:00
Ruben Fiszel
71f7299b6c fix: improve pip_secret interpolation 2024-03-15 11:17:41 +01:00
Ruben Fiszel
89516b922f fix: avoid unecessary re-schedule for retyied flows 2024-03-15 09:53:58 +01:00
Ruben Fiszel
e5f7bcf1a6 fix jobs metrics 2024-03-14 19:53:38 +01:00
Ruben Fiszel
47d96c0d97 add NO_LOGS_AT_ALL 2024-03-14 19:47:46 +01:00
Ruben Fiszel
df910d7441 fix: be less agressive with log streaming for long jobs 2024-03-14 19:42:41 +01:00
Ruben Fiszel
97d4f1cc26 feat: better locking (#3412)
* earlyBackendStop

* fix(frontend): Flow step input description (#3409)

* fix(frontend): Add missing descrpition in a flow step input

* fix(frontend): Add missing descrpition in a flow step input

* fix(frontend): Fix color picker layout (#3411)

* feat: add bit support in pg (#3407)

* fix sqlx

* fix: remove dependency on semver intersect for bun

* sqlx fix

* improve early kill behavior

---------

Co-authored-by: Faton Ramadani <faton.ramadani14@gmail.com>
Co-authored-by: HugoCasa <hugo@casademont.ch>
2024-03-14 13:57:54 +01:00
Ruben Fiszel
1cf6d8b462 fix: remove dependency on semver intersect for bun 2024-03-14 12:36:38 +01:00
HugoCasa
3730566844 feat: add bit support in pg (#3407) 2024-03-14 10:40:20 +01:00
Ruben Fiszel
9e0ba03e6d fix warnings 2024-03-08 23:20:54 +01:00
Ruben Fiszel
4578ed32da feat: implement s3 oidc support + azure workload identity support 2024-03-08 22:51:16 +01:00
HugoCasa
c04adcca86 fix: pg timstamptz param (#3364) 2024-03-06 12:50:01 +01:00
Ruben Fiszel
e3e86e5c34 feat: workflow as code for typescript 2024-03-05 23:14:04 +01:00
Ruben Fiszel
55c80959a0 feat: workflow as code with timelines 2024-03-05 12:45:24 +01:00
Ruben Fiszel
619e2784f0 feat: workflow as code v0 2024-03-04 20:19:34 +01:00
Ruben Fiszel
161436644e nit vacuum iterator 2024-03-02 13:51:28 +01:00
Ruben Fiszel
07fb3754af fix: fix flow progress monitor when using parallel branches and continuing long after 2024-03-01 12:01:17 +01:00
Ruben Fiszel
fc34594aeb feat: implement progress monitor for parallel branches last transition 2024-02-28 08:49:35 +01:00
Ruben Fiszel
be7c03bda2 fix: solve deadlock issues for parallel branches with new progress monitor 2024-02-27 20:59:26 +01:00
HugoCasa
1c6e767617 feat: allow to pin database in sql scripts (#3304) 2024-02-27 19:59:52 +01:00
HugoCasa
66e46990b2 fix: handle very large ints as floats in snowflake (#3302) 2024-02-27 16:40:55 +01:00
Ruben Fiszel
4285f1e47d fix: improve handling of parallel flow branches of more than 30s 2024-02-27 16:33:13 +01:00
HugoCasa
ec10b3ff81 feat: add ee flag to common (#3300) 2024-02-27 12:06:48 +01:00
Ruben Fiszel
49be282d21 fix: fix scheduling of overlapping flows 2024-02-27 00:50:03 +01:00
Ruben Fiszel
c7f6e6f9d5 fix: crash on init script failure 2024-02-26 19:50:33 +01:00
Ruben Fiszel
321da6ce30 more debug lines, remove telemetry for agents 2024-02-26 17:02:40 +01:00
HugoCasa
6a0ed19c80 fix: add bigint support to mysql (#3294) 2024-02-26 16:59:36 +01:00
Ruben Fiszel
b24225124a fix: add HOME to pip install 2024-02-26 15:33:45 +01:00
Ruben Fiszel
ee0f8b6914 fix: add HOME to pip install 2024-02-26 15:27:56 +01:00
Ruben Fiszel
024f80aee4 fix: handle better flow hanging monitor 2024-02-26 15:09:39 +01:00
Ruben Fiszel
136c04eed4 fix: improve relative bun loader 2024-02-25 19:18:10 +01:00
Ruben Fiszel
32a45b544d feat: more resilient flows in case of crash during transitions 2024-02-25 18:25:40 +01:00
Ruben Fiszel
a413541fa6 reactivate parquet features 2024-02-24 17:55:17 +01:00
Ruben Fiszel
5172a4e994 reactivate parquet features 2024-02-24 17:44:43 +01:00
Ruben Fiszel
665d0d5ef1 chore: fasten compilation time 2024-02-24 17:10:55 +01:00
Ruben Fiszel
494ce162c0 chore: fasten compilation time 2024-02-24 16:29:35 +01:00
Ruben Fiszel
0df43221ec fix: improve support for singlescriptflow 2024-02-23 21:06:55 +01:00
Ruben Fiszel
bf3e417acc fix(python): handle recursive python imports with loop 2024-02-20 19:42:11 +01:00
Ruben Fiszel
3761de874e fix: prevent bigquery/snowflake against abuse timeout 2024-02-20 01:56:04 +01:00
Ruben Fiszel
66fc78f233 feat: allow arbitrary timeout on graphql 2024-02-20 00:45:42 +01:00
Ruben Fiszel
18bb982852 feat: add support for mem peak to nativets scripts 2024-02-19 23:38:27 +01:00
Ruben Fiszel
e28fbc9c97 fix: prevent native http against timeout abuse 2024-02-19 23:28:06 +01:00
Ruben Fiszel
8e21532684 refactor future wrapper for queries 2024-02-19 22:11:45 +01:00
Ruben Fiszel
f129e75628 fix(psql): add mem peak to postgresql 2024-02-19 20:51:09 +01:00
Ruben Fiszel
a3320fe144 respect query timeout for pg queries 2024-02-19 20:11:28 +01:00
Ruben Fiszel
d35c67c9b9 fix: prevent postgres timeout abuse 2024-02-19 19:59:43 +01:00
HugoCasa
be3f9125af fix: bigquery timeout (#3244)
* fix: bigquery timeout

* fix: use default timeout instead
2024-02-19 17:56:19 +01:00
HugoCasa
6ccca62876 fix: remove oom prio macos (#3245) 2024-02-19 12:36:57 +01:00
HugoCasa
458550f314 fix: backend build on macos (#3243) 2024-02-19 09:58:12 +01:00