Update python#1465
Open
renovate-bot wants to merge 1 commit into
Open
Conversation
olivi-eh
approved these changes
Sep 23, 2024
Collaborator
|
Looks like most of the issues look like this: Might need to manually bump |
2e4015a to
9815aef
Compare
89c302d to
b8a5279
Compare
096a5d6 to
9beb11e
Compare
c7294de to
089f9c7
Compare
16286e7 to
5492174
Compare
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
==3.1.6→==3.1.8==v1.0.1→==1.14.0==2.6.1→==2.7.1==2.1.3→==2.4.1==0.44.1→==0.49.2==5.5.0→==5.5.2==2024.8.30→==2024.12.14==3.4.0→==3.4.7==8.1.7→==8.4.2==3.1.0→==3.6.0==0.8.0→==0.8.2==8.15.0→==8.19.3==2.14.1→==2.15.0==0.2.13→==0.5.5==0.114.0→==0.139.0==0.115.0→==0.139.0==0.115.13→==0.139.0==2024.5.0→==2024.11.0==2026.3.0→==2026.6.0==2024.9.0→==2024.12.0==1.16.0→==1.36.1==2.22.0→==2.31.0~=2.28.1→~=2.31.0~=2.34.0→~=2.55.1==2.27.0→==2.55.1==0.2.1→==0.6.0==3.27.0→==3.30.1==3.29.0→==3.42.1==2.5.1→==2.6.0==2.23.0→==2.31.0==1.11.1→==1.18.0==1.18.0→==1.25.0~=2.23.0→~=2.39.0==2.18.2→==2.19.0==2.8.2→==2.10.0==1.2.1→==1.36.1==3.29.0→==3.42.1==1.65.0→==1.75.0==6.10.0→==6.19.0==0.13.1→==0.14.4==1.62.3→==1.81.1==1.62.3→==1.81.1==0.24.7→==0.36.2==0.4.6→==0.5.0==0.0.2→==0.0.7==0.8.1→==0.12.0==3.11.0rc1→==3.14.0==2.4.4→==2.5.1==2.2.2→==2.3.3==v0.13.2→==0.19.1==0.3.2→==0.5.0==0.4.1→==0.5.2==1.25.0→==1.28.0==6.1.0→==6.1.1==2.9.9→==2.9.12==0.4.1→==0.4.2==0.4.1→==0.4.2==2.22→==2.23==2.11.7→==2.13.4==1.24.10→==1.28.0==2026.1.post1→==2026.2==1.11.1→==1.18.0==5.0.8→==5.3.1==2.33.0→==2.34.2==2.33.1→==2.34.2==4.9→==4.9.1>=0.6,<=0.6.4→>=0.15,<=0.15.20==1.5.1→==1.9.0==1.17.1→==1.18.0==1.16.0→==1.17.0==1.54.0→==1.59.0==2.17.0→==2.21.0==0.0.3→==0.0.5==5.0.0→==5.13.0==v4.46.1→==4.57.6==v0.11.4→==0.29.1==4.15.0→==4.16.0==0.30.6→==0.50.2==0.34.0→==0.50.2==4.7.1→==4.22.0==1.23.0→==1.24.2Warning
Some dependencies could not be looked up. Check the Dependency Dashboard for more information.
Release Notes
pallets/werkzeug (Werkzeug)
v3.1.8Compare Source
Released 2026-04-02
Request.hostandget_hostreturn the empty string if the header ismissing or has invalid characters. :issue:
3142v3.1.7Compare Source
Released 2026-03-23
parse_list_headerpreserves partially quoted items, discards emptyitems, and returns empty for unclosed quoted values. :pr:
3128WWWAuthenticate.to_headerdoes not produce a trailing space when thereare no parameters. :issue:
3127Transfer-Encodingis parsed as a set. :pr:3134Request.host,get_host, andhost_is_trustedvalidate thecharacters of the value. An empty value is no longer allowed. A Unix socket
server address is ignored. The
trusted_listargument tohost_is_trustedis optional. :pr:31133088Response.make_conditionalsets theAccept-Rangesheader even if itis not a satisfiable range request. :issue:
3108merge_slashesmerges any number of consecutive slashes. :issue:3121huggingface/accelerate (accelerate)
v1.14.0: : AMD ROCm support, FSDP2 hardeningCompare Source
FSDP2 Improvements
This release brings a large batch of FSDP2 fixes and quality-of-life improvements: correct dtype handling on load, sharding of embeddings/norms, QLoRA crash prevention, and a more robust auto-wrap policy.
AMD ROCm support
Accelerate now works end-to-end on AMD ROCm devices. Thanks @Abdennacer-Badaoui!
Neuron
Further Neuron improvements to reduce recompilation and cover missing device cases.
Quantization & Offloading
We improved offloading support for quantized models, including Torchao, int8, and tied-weight handling.
Data Loading
Minor fixes
Full Changelog: huggingface/accelerate@v1.13.0...v1.14.0
v1.13.0: : Neuron support, IPEX removal, and distributed training fixesCompare Source
AWS Neuron support
We now have support for AWS Neuron (Trainium/Inferentia) devices. Thanks @michaelbenayoun for adding this.
XPU Improvements
We've removed IPEX dependency and improved device-agnostic code for XPU.
#3912
FSDP2 Improvements
We've added a bunch of important fixes for FSDP2 users: upcasting only grad-requiring params, better tied embedding errors, DCP optimizer loading, bf16 optimizer step crash fix, and torch < 2.7.0 compatibility.
DeepSpeed Sequence Parallelism
We've added several fixes to the DeepSpeed + Sequence Parallelism integration introduced in v1.12.0, including evaluation support during SP training and proper process group handling.
FP8
We've enhanced FP8 training. Thanks @shimizust for fixing torchao support.
Performance
Accelerate now imports faster by deferring heavy dependencies, and torch.compile hooks are disabled lazily.
Minor fixes
v1.12.0: : Deepspeed Ulysses/ALSTCompare Source
Deepspeed Ulysses/ALST integration
Deepspeed Ulysses/ALST is an efficient way of training on long sequences by employing sequence parallelism and attention head parallelism. You can learn more about this technology in this paper https://arxiv.org/abs/2506.13996 or this deepspeed tutorial https://www.deepspeed.ai/tutorials/ulysses-alst-sequence-parallelism/.
To enable Deepspeed Ulysses, you first need to create
ParallelismConfigand settingsprelated args:Then, you need to make sure to compute the correct loss as described on our docs
... losses_per_rank = torch.distributed.nn.functional.all_gather(loss, group=sp_group) good_tokens = (shift_labels != -100).view(-1).sum() good_tokens_per_rank = torch.distributed.nn.functional.all_gather(good_tokens, group=sp_group) total_loss = sum( losses_per_rank[rank] * good_tokens_per_rank[rank] for rank in range(sp_world_size) if good_tokens_per_rank[rank] > 0 ) total_good_tokens = sum(good_tokens_per_rank) loss = total_loss / max(total_good_tokens, 1)Thanks @S1ro1 for starting this work and for @stas00 for finishing this work. Also thanks @kashif for adding docs and reviewing/testing this PR !
This feature will also be available in HF Trainer thanks for this PR from @stas00: huggingface/transformers#41832
Minor changes
cpu_ram_efficient_loadingby @SunMarc in #3816New Contributors
Full Changelog: huggingface/accelerate@v1.11.0...v1.12.0
v1.11.0: : TE MXFP8, FP16/BF16 with MPS, Python 3.10Compare Source
TE MXFP8 support
We've added support for MXFP8 in our TransformerEngine integration. To use that, you need to set
use_mxfp8_block_scalinginfp8_config. See nvidia docs [here]. (https://docs.nvidia.com/deeplearning/transformer-engine/user-guide/examples/fp8_primer.html#MXFP8-and-block-scaling)FP16/BF16 Training for MPS devices
BF16 and FP16 support for MPS devices is finally here. You can now pass
mixed_precision = "fp16" or "bf16"when training on a mac (fp16requires torch 2.8 andbf16requires torch 2.6)FSDP updates
The following PRs add respectively support to
ignored_paramsandno_sync()for FSDPv2:Mixed precision can now be passed as a dtype string from accelerate cli flag or
fsdp_configin accelerate config file:Nd-parallel updates
Some minor updates concerning nd-parallelism.
Bump to Python 3.10
We've dropped support for python 3.9 as it reached EOL in October.
Lots of minor fixes: