split "Latent Caching" into "Image Caching" and "Text Caching"#1462
split "Latent Caching" into "Image Caching" and "Text Caching"#1462dxqb wants to merge 1 commit into
Conversation
Rename `config.latent_caching` to `config.image_caching` and add a new orthogonal `config.text_caching` field. Adds config migration 10 -> 11 mapping the old field to both new fields, preserving existing behavior. This enables the previously-impossible (no image cache, yes text cache) configuration. Updates modelSetup placement decisions (VAE/effnet -> image_caching, text encoder -> text_caching), dataloader mixin gating, trainer cache-clear/start-next-epoch logic, UI switches, and tracked preset JSONs.
- BaseAnimaSetup: per-component checkpointing_or_offloading_enabled(), remove weight_list from create_autocast_context / disable_fp16_autocast_context - AnimaFineTune/LoRASetup: latent_caching → image_caching / text_caching - ModelType: add ANIMA to _MODEL_PARTS and supported_training_methods Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…d "Text Caching") into preview
|
Claude: While testing the Likely |
# Conflicts: # modules/ui/TrainUI.py # modules/util/config/TrainConfig.py
Anima, Lens, and Ideogram setup files used the pre-#1476/#1462 4-arg create_autocast_context/disable_fp16_autocast_context (with a weight-dtype list), the old config.gradient_checkpointing.enabled() global check, and the renamed config.latent_caching field. Update them to the current 3-arg autocast helpers, per-part checkpointing via enable_checkpointing_for_*, and config.image_caching/config.text_caching.
with text caches becoming very large on recent models, you might want to disable text caching - but still do image caching

this PR splits this setting into two: