Commit Graph

30 Commits

Author SHA1 Message Date
Ruben Fiszel
e4a1759081 results.x returns null in non trivial evals 2023-11-09 23:36:04 +01:00
Ruben Fiszel
7c5ea569a8 feat: add global cache configuration 2023-08-30 13:35:41 +02:00
Ruben Fiszel
f420dfad3c fix worker initialization on ee 2023-08-14 18:18:37 +02:00
Ruben Fiszel
add48677c3 fix tar initialization 2023-08-14 17:49:46 +02:00
Ruben Fiszel
26cb872836 fix tar initialization 2023-08-14 17:49:03 +02:00
Ruben Fiszel
4b8d38d077 fix tar initialization 2023-08-14 16:16:42 +02:00
Ruben Fiszel
0e77e92d9e be more selective to create global cache 2023-08-14 13:36:41 +02:00
Ruben Fiszel
24a7b60e4c remove bun from the tarcache 2023-08-14 13:12:34 +02:00
Ruben Fiszel
6c3a9ae62e exclude bun from global cache 2023-07-14 16:48:15 +02:00
Ruben Fiszel
04fc0290ed make unwrap resilient for global cache 2023-07-14 16:20:35 +02:00
Ruben Fiszel
51e1447ec7 use --copy-links 2023-07-14 16:13:12 +02:00
Ruben Fiszel
da9c6340a2 fix: global cache now cache symlinks 2023-07-14 11:25:45 +02:00
Ruben Fiszel
2921649c3c feat: bun support (#1800)
* feat: bun support

* feat: bun support

* add bun support

* add bun support

* add bun support

* add bun
2023-07-06 21:19:07 +02:00
Ruben Fiszel
d76e90757e fix(backend): avoid potential conflict between pull from tar and background sync 2023-04-21 23:49:14 +02:00
Ruben Fiszel
5f8a730fdf fix(backend): global cache synco only start if all piptars have been downloaded 2023-04-21 22:21:04 +02:00
Ruben Fiszel
3d031c7017 feat(backend): only run fully deployed scripts 2023-04-21 12:49:47 +02:00
Ruben Fiszel
670ba51d9b feat(backend): workers are instantly ready and sync with global cache in background 2023-04-21 09:45:25 +02:00
Ruben Fiszel
68ab75169a improve log line for cache syncing 2023-04-21 01:54:58 +02:00
Ruben Fiszel
455e2e9c25 fix untar_all_piptars 2023-04-21 01:02:51 +02:00
Ruben Fiszel
ddc04f93c3 better rclone filters 2023-04-21 00:31:39 +02:00
Ruben Fiszel
fac32f3ebf better rclone filters 2023-04-20 23:45:31 +02:00
Ruben Fiszel
ed87020a83 set relative folder for archive creation 2023-04-20 23:33:53 +02:00
Ruben Fiszel
1f304a7c84 remove deno/gen/windmill from tmp cache 2023-04-20 21:04:17 +02:00
Ruben Fiszel
96f79bc6cc --s3-no-cache-buckets 2023-04-20 20:50:02 +02:00
Ruben Fiszel
369dd0dac6 feat(backend): global cache refactor for pip using tar for each dependency (#1443)
* cache refactor

* exclude tar from being synced to bucket

* run

* update

* update
2023-04-20 20:05:12 +02:00
Ruben Fiszel
62d196ecec add barrier when num workers > 1 2023-04-19 17:00:03 +02:00
Ruben Fiszel
29848ae466 add barrier when num workers > 1 2023-04-19 12:46:25 +02:00
Ruben Fiszel
c919827cf8 feat(ee): sync cache in background 2023-04-19 01:15:41 +02:00
Ruben Fiszel
0e77e37fbd feat(ee): sync cache in background 2023-04-19 00:55:51 +02:00
Ruben Fiszel
34f48aa1e3 split worker.rs into more files 2023-04-13 17:44:47 +02:00