ci(release): drop GHA build cache from docker push (unblock releases) - #1043
Merged
Conversation
The release build-and-push step used cache-to: type=gha,mode=max. On the large zeam image (prover staticlib + rust deps), with both matrix legs (amd64/arm64) writing concurrently, the GHA cache reservation fails once the repo's cache quota is exhausted, and buildkit aborts the entire build-and-push solve with: error writing layer blob: failed to reserve cache That fails the image push and blocks the release entirely. v0.5.8 and v0.5.9 both failed here. Dockerfile.prebuilt only packages an already-built binary, so the layer cache saves almost nothing; a release push must not be gated on a best-effort build cache. Remove it.
noopur23
approved these changes
Jul 14, 2026
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
The devnet5 release workflow has failed the last two releases (v0.5.8 and v0.5.9) at the docker push step:
The tags get created but no image is published (
create-manifestandcreate-github-releaseare then skipped).Root cause
The
Build and push Docker imagestep inauto-release.ymluses:failed to reserve cacheis the GitHub Actions cache backend rejecting areserveCachecall.mode=maxexports every layer of the large zeam image (the ~240 MB prover staticlib plus rust deps), and both matrix legs (amd64 + arm64) write to the same cache at once, exhausting the repo's 10 GB GHA cache quota. When the cache export fails, buildkit aborts the whole build-and-push solve, so the image never pushes. It is not transient flakiness: it fires at the same step on every run.Fix
Remove the GHA build cache from the release push.
Dockerfile.prebuiltonly packages an already-built binary, so the layer cache saves almost nothing here, and a release must never be blocked by a best-effort build cache.Follow-up (completing v0.5.9)
The
v0.5.9/Devnet5git tags already exist from the failed run, andcreate-tagshard-fails if a version tag already exists. So after this merges, the stuck v0.5.9 release needs to be re-driven with the fixed workflow, either by deleting the danglingv0.5.9/Devnet5tags and re-opening the release PR, or by cutting it as a new version label. I can do that once this is in.