JuiceFS with MemoryDB (redis) IAM user and dynamic redis password

[venera70]

We would like to use JuiceFS with MemoryDB as the metadata store and S3 as the object storage.

For MemoryDB, we would like to use an IAM user instead of a literal password. Since this password is an IAM token generated dynamically from the session credentials (access key, secret key, session token), is there a way to refresh a live juicefs mount session with fresh credential set?

Is it possible to do
juicefs config ${METAURL} --access-key xxxx --secret-key xxxx --session-token xxxx
with the new MemoryDB token password specified in the ${METAURL} ?

[venera70]

Hi @davies is there a way to update a live juicefs mountpoint with a new MemoryDB password?

[davies]

Yes, with graceful upgrade/restart in v1.2

[venera70]

Thanks @davies. We have downloaded the latest release (amd64 version) but have not seen the graceful upgrade/restart in the built-in help:

./juicefs 
NAME:
   juicefs - A POSIX file system built on Redis and object storage.

USAGE:
   juicefs [global options] command [command options] [arguments...]

VERSION:
   1.2.1+2024-08-30.cd871d1

COMMANDS:
   ADMIN:
     format   Format a volume
     config   Change configuration of a volume
     quota    Manage directory quotas
     destroy  Destroy an existing volume
     gc       Garbage collector of objects in data storage
     fsck     Check consistency of a volume
     restore  restore files from trash
     dump     Dump metadata into a JSON file
     load     Load metadata from a previously dumped JSON file
     version  Show version
   INSPECTOR:
     status   Show status of a volume
     stats    Show real time performance statistics of JuiceFS
     profile  Show profiling of operations completed in JuiceFS
     info     Show internal information of a path or inode
     debug    Collect and display system static and runtime information
     summary  Show tree summary of a directory
   SERVICE:
     mount    Mount a volume
     umount   Unmount a volume
     gateway  Start an S3-compatible gateway
     webdav   Start a WebDAV server
   TOOL:
     bench     Run benchmarks on a path
     objbench  Run benchmarks on an object storage
     warmup    Build cache for target directories/files
     rmr       Remove directories recursively
     sync      Sync between two storages
     clone     clone a file or directory without copying the underlying data
     compact   Trigger compaction of chunks

GLOBAL OPTIONS:
   --verbose, --debug, -v  enable debug log (default: false)
   --quiet, -q             show warning and errors only (default: false)
   --trace                 enable trace log (default: false)
   --log-id value          append the given log id in log, use "random" to use random uuid
   --no-agent              disable pprof (:6060) agent (default: false)
   --pyroscope value       pyroscope address
   --no-color              disable colors (default: false)
   --help, -h              show help (default: false)
   --version, -V           print version only (default: false)

COPYRIGHT:
   Apache License 2.0
user@host:/mnt/Temp $ ./juicefs config --help
NAME:
   juicefs config - Change configuration of a volume

USAGE:
   juicefs config [command options] META-URL

CATEGORY:
   ADMIN

DESCRIPTION:
   
   Only flags explicitly specified are changed.

   Examples:
   # Show the current configurations
   $ juicefs config redis://localhost

   # Change volume "quota"
   $ juicefs config redis://localhost --inodes 10000000 --capacity 1048576

   # Change maximum days before files in trash are deleted
   $ juicefs config redis://localhost --trash-days 7

   # Limit client version that is allowed to connect
   $ juicefs config redis://localhost --min-client-version 1.0.0 --max-client-version 1.1.0

OPTIONS:
   --yes, -y  automatically answer 'yes' to all prompts and run non-interactively (default: false)
   --force    skip sanity check and force update the configurations (default: false)

   DATA STORAGE

   --storage value         object storage type (e.g. s3, gs, oss, cos) (default: "file")
   --bucket value          the bucket URL of object storage to store data (default: "/home/ravvij01/.juicefs/local")
   --access-key value      access key for object storage (env ACCESS_KEY)
   --secret-key value      secret key for object storage (env SECRET_KEY)
   --session-token value   session token for object storage
   --storage-class value   the default storage class
   --upload-limit value    default bandwidth limit of a client for upload in Mbps
   --download-limit value  default bandwidth limit of a client for download in Mbps

   MANAGEMENT

   --capacity value            hard quota of the volume limiting its usage of space in GiB
   --inodes value              hard quota of the volume limiting its number of inodes (default: 0)
   --trash-days value          number of days after which removed files will be permanently deleted (default: 1)
   --enable-acl                enable POSIX ACL (this flag is irreversible once enabled) (default: false)
   --encrypt-secret            encrypt the secret key if it was previously stored in plain format (default: false)
   --min-client-version value  minimum client version allowed to connect
   --max-client-version value  maximum client version allowed to connect
   --dir-stats                 enable dir stats, which is necessary for fast summary and dir quota (default: false)

 $

Could you point us to any documentation on how to use this graceful upgrade/restart with a live running juicefs mount?
Thanks!

[davies]

At first, you should upgrade the client to v1.2 (stop the apps, then umount and mount again).

After that, you can upgrade juicefs by mount command without stop the apps.