Bump transformers from 4.42.4 to 4.44.1

[dependabot]

Bumps transformers from 4.42.4 to 4.44.1.

Release notes

Sourced from transformers's releases.

Patch release v4.44.1

Here are the different fixes, mostly Gemma2 context length, nits here and there, and generation issues

• is_torchdynamo_compiling -- cast a wide exception net (#32476) by @​gante
• Revert "fixes to properly shard FSDP across cpu and meta for cpu_effcient_loading for prequantized 4bit (#32276)" (#32477) by @​gante and @​matthewdouglas
• Gemma2: fix FA2 generation (#32553) by @​zucchini-nlp
• Fix: FA2 with packed training (#32487) by @​zucchini-nlp
• Fix sliding window attention used in Gemma2FlashAttention2 (#32522) by @​ArthurZucker
• Automatically add transformers tag to the modelcard (#32623) by @​LysandreJik
• add back the position ids (#32554) by @​ArthurZucker
• Use head_dim if in config for RoPE (#32495) @​suiyoubi @​ArthurZucker
• Revert PR 32299, flag users when Zero-3 was missed (#32851) by @​muellerzr
• fix multi-gpu with static cache (#32543) by @​SunMarc
• Reduce the error log when using core models that need their weights r… (#32656) by @​muellerzr
• Fix VLM generation issues (#32836) by @​zucchini-nlp
• Fix generate with inputs_embeds as input (#32493) (this PR has some cherry-pick)

Full Changelog: huggingface/transformers@v4.44.0...v4.44.1

Release v4.44.0: End to end compile generation!!! Gemma2 (with assisted decoding), Codestral (Mistral for code), Nemotron, Efficient SFT training, CPU Offloaded KVCache, torch export for static cache

This release comes a bit early in our cycle because we wanted to ship important and requested models along with improved performances for everyone!

All of these are included with examples in the awesome https://github.com/huggingface/local-gemma repository! 🎈 We tried to share examples of what is now possible with all the shipped features! Kudos to @​gante, @​sanchit-gandhi and @​xenova

💥 End-to-end generation compile

Generate: end-to-end compilation #30788 by @​gante: model.generate now supports compiling! There are a few limitations, but here is a small snippet:

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
import copy
model = AutoModelForCausalLM.from_pretrained(
"meta-llama/Meta-Llama-3.1-8B", torch_dtype=torch.bfloat16, device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Meta-Llama-3.1-8B")
compile generate
compiled_generate = torch.compile(model.generate, fullgraph=True, mode="reduce-overhead")
compiled generate does NOT accept parameterization except a) model inputs b) a generation config
generation_config = copy.deepcopy(model.generation_config)
generation_config.pad_token_id = model.config.eos_token_id
model_inputs = tokenizer(["Write a poem about the market crashing in summer"], return_tensors="pt")
model_inputs = model_inputs.to(model.device)
output_compiled = compiled_generate(**model_inputs, generation_config=generation_config)
print(output_compiled)

... (truncated)

Commits

• ca56cd7 v4.44.1
• 6e931e1 Gemma2: fix FA2 generation (#32553)
• 74f57df Fix generate with inputs_embeds as input (#32493)
• 084fe2e Merge branch 'v4.44-release' of github.com:huggingface/transformers into v4.4...
• fff9be1 Reduce the error log when using core models that need their weights renamed, ...
• 4fd0f48 Fix VLM generation issues (#32836)
• 5c4b15a fix multi-gpu with static cache (#32543)
• b51a82a Revert PR 32299, flag users when Zero-3 was missed (#32851)
• 0dca7d7 Use head_dim if in config for RoPE (#32495)
• a3e77ba add back the position ids (#32554)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #28.