Skip to content

Improve source mount recovery reliability - #857

Draft
vladem wants to merge 3 commits into
awslabs:mainfrom
vladem:check-mountpoint-fix
Draft

Improve source mount recovery reliability#857
vladem wants to merge 3 commits into
awslabs:mainfrom
vladem:check-mountpoint-fix

Conversation

@vladem

@vladem vladem commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

Issue #, if available: N/A

Description of changes:

  1. Add a test for mount recovery. Note that the workload continuously accesses (cat /mnt/volume1/file.txt) the dead mount, which might be a rare scenario.
  2. Update CheckMountpoint to detect dead mount when the stat(target) is cached in kernel
  3. Update behaviour of aws-s3-csi-mounter when waiting for mount options: instead of exiting and restarting (which might result in failed mount attempts, when backoff becomes large), it continues running until an .exit file was placed by csi-node

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Signed-off-by: Vlad Volodkin <vlaad@amazon.com>
@vladem
vladem temporarily deployed to approval-gate July 9, 2026 18:01 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to rosa-untrusted July 9, 2026 18:08 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:08 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem had a problem deploying to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Failure
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem had a problem deploying to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Failure
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem had a problem deploying to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Failure
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem had a problem deploying to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Failure
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem had a problem deploying to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Failure
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem had a problem deploying to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Failure
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem had a problem deploying to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Failure
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 9, 2026 18:15 — with GitHub Actions Inactive
Signed-off-by: Vlad Volodkin <vlaad@amazon.com>
@vladem
vladem temporarily deployed to approval-gate July 10, 2026 12:02 — with GitHub Actions Inactive
@vladem vladem changed the title Add a test for mount recovery Improve source mount recovery reliability Jul 10, 2026
@vladem
vladem temporarily deployed to rosa-untrusted July 10, 2026 12:09 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:09 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem had a problem deploying to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Failure
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
@vladem
vladem temporarily deployed to us-east-1-untrusted July 10, 2026 12:17 — with GitHub Actions Inactive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant