Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[HuggingFace][Neuronx] Inference - Optimum Neuron 0.1.0 - Neuron sdk 2.21.1 - Transformers to 4.48.3 #4638

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

dacorvo
Copy link
Contributor

@dacorvo dacorvo commented Mar 13, 2025

Description

This updates the HuggingFace Neuron inference DLC to use AWS Neuron SDK 2.21.1 and optimum-neuron 0.1.0.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@dacorvo dacorvo requested review from a team as code owners March 13, 2025 09:45
@aws-deep-learning-containers-ci aws-deep-learning-containers-ci bot added authorized build Reflects file change in build folder huggingface Reflects file change in huggingface folder Size:S Determines the size of the PR labels Mar 13, 2025
@dacorvo dacorvo force-pushed the add-neuronx-inference-0.1.0 branch 3 times, most recently from 7390001 to 62b9d43 Compare March 13, 2025 09:58
@dacorvo dacorvo changed the title Add neuronx inference 0.1.0 [HuggingFace][Neuronx] Inference - Optimum Neuron 0.1.0 - Neuron sdk 2.21.1 - Transformers to 4.48.3 Mar 13, 2025
@dacorvo dacorvo force-pushed the add-neuronx-inference-0.1.0 branch from 62b9d43 to 9d51dfb Compare March 14, 2025 09:35
@dacorvo dacorvo force-pushed the add-neuronx-inference-0.1.0 branch from 9d51dfb to be27cf8 Compare March 17, 2025 09:34
@aws-deep-learning-containers-ci aws-deep-learning-containers-ci bot added sagemaker_tests test Reflects file change in test folder labels Mar 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
authorized build Reflects file change in build folder huggingface Reflects file change in huggingface folder sagemaker_tests Size:S Determines the size of the PR test Reflects file change in test folder
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant