Skip to content

Commit e1e5703

Browse files
committed
buildkit: deploy on meta-prod-aws-ue1 (us-east-1)
Same buildkit config as arc-cbr-production (ue2): m6id.24xlarge amd64 (2/node) + m7gd.16xlarge arm64 (4/node), autoscaling min 2/4, max 360/30, fallback 32/8. Adds keda + buildkit to the cluster's module list (keda provides the CRDs the autoscaling needs). ghstack-source-id: 47a94e8 Pull-Request: #728
1 parent 3b841e8 commit e1e5703

1 file changed

Lines changed: 17 additions & 2 deletions

File tree

osdc/clusters.yaml

Lines changed: 17 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -255,6 +255,19 @@ clusters:
255255
central_memory_limit: "50Gi"
256256
node_compactor:
257257
min_node_age_seconds: 900
258+
buildkit:
259+
amd64_instance_type: m6id.24xlarge
260+
amd64_pods_per_node: 2
261+
arm64_instance_type: m7gd.16xlarge
262+
arm64_pods_per_node: 4
263+
autoscaling:
264+
enabled: true
265+
amd64_min: 2 # 1x m6id.24xlarge (2 pods/node)
266+
amd64_max: 360 # ~90d peak ≈180, x2 for headroom
267+
arm64_min: 4 # 1x m7gd.16xlarge (4 pods/node)
268+
arm64_max: 30 # ~90d peak ≈15, x2 for headroom
269+
amd64_fallback: 32 # if KEDA can't read metrics, hold the proven fixed pool
270+
arm64_fallback: 8
258271
arc-runners:
259272
github_config_url: "https://github.com/pytorch"
260273
github_secret_name: meta-prod-aws-ue1
@@ -267,6 +280,8 @@ clusters:
267280
- arc
268281
- nodepools
269282
- arc-runners
283+
- keda
284+
- buildkit
270285
- pypi-cache
271286
- cache-enforcer
272287
- zombie-cleanup
@@ -299,9 +314,9 @@ clusters:
299314
arm64_pods_per_node: 4
300315
autoscaling:
301316
enabled: true
302-
amd64_min: 32 # warm baseline = proven fixed pool (16x m6id.24xlarge)
317+
amd64_min: 2 # 1x m6id.24xlarge (2 pods/node)
303318
amd64_max: 360 # ~90d peak ≈180, x2 for headroom
304-
arm64_min: 8 # warm baseline = proven fixed pool (2x m7gd.16xlarge)
319+
arm64_min: 4 # 1x m7gd.16xlarge (4 pods/node)
305320
arm64_max: 30 # ~90d peak ≈15, x2 for headroom
306321
amd64_fallback: 32 # if KEDA can't read metrics, hold the proven fixed pool
307322
arm64_fallback: 8

0 commit comments

Comments
 (0)