Preallocate the static KV cache with config.head_dim #4125
Triggered via pull request
September 2, 2026 01:01
ebarkhordar
ebarkhordar
review_requested
#8389
Status
Cancelled
Total duration
2s
Artifacts
–
modal-torch-latest.yml
on: pull_request_target
modal-torch-latest / collect tests
0s
modal-torch-latest / DeepSpeedAI CI
Annotations
2 errors
|
modal-torch-latest / collect tests
Canceling since a higher priority waiting request for modal-torch-latest-8389 exists
|
|
modal-torch-latest
Canceling since a higher priority waiting request for modal-torch-latest-8389 exists
|