Deepspeed 14.0 .whl - (python 3.11)

This release has some missing modules which couldn't be compiled, it should still function properly but can give errors in certain cases.

Precompiled Deepspeed wheels for use with Oobabooga/text-generation-webui and Alltalk_TTS

The modifications done are included incase you rather compile them yourself.
For the complete instructions see the attached readme or this link

Deepspeed windows version 14.0
Python version 3.11
CUDA version 12.1

This version is compiled with "pytorch==2.2.1 torchvision==0.17.1 torchaudio==2.2.1" incase you use an older version of text-generation-webui use deepspeed version 13.2 or lower..

Deepspeed 13.2 .whl - (python 3.11)

This release has some missing modules which couldn't be compiled, it should still function properly but can give errors in certain cases.

Precompiled Deepspeed wheels for use with Oobabooga/text-generation-webui and Alltalk_TTS

The modifications done are included incase you rather compile them yourself.
For the complete instructions see the attached readme or this link

Deepspeed windows versions 13.1, 13.2
Python version 3.11
CUDA version 12.1

Deepspeed 12.6, 12.7 .whl - (python 3.11)

This release is marked as experimental as it has some missing modules which couldn't be compiled, it should still function but might give errors in certain cases.

Precompiled Deepspeed wheels for use with Oobabooga/text-generation-webui and Alltalk_TTS

The modifications done are included incase you rather compile them yourself.
For the complete instructions see the attached readme or this link

Deepspeed windows versions 12.6, 12.7
Python version 3.11
CUDA version 12.1

Deepspeed .whl (python 3.11)

Precompiled Deepspeed wheels for use with Oobabooga/text-generation-webui and Alltalk_TTS

The modifications done are included incase you rather compile them yourself.
For the complete instructions see the attached readme or this link

• Deepspeed windows versions 11.2, 11.1, 10.3 and 9.5
• Python version 3.11
• CUDA version 12.1

• Added versions 10.3 and 9.5 incase someone needs those.
• All versions are tested on the Oobabooga build of 10 Dec 2023

Deepspeed .whl (python 3.10)

Precompiled Deepspeed wheels for use with Oobabooga/text-generation-webui and Alltalk_TTS

The modifications done are included incase you rather compile them yourself.
For the complete instructions see the attached readme or this link

• Deepspeed windows versions 11.2
• Python version 3.10
• CUDA versions 12.1 and 11.8

( Additional versions thanks to @daswer123 )

More versions for python 3.10 here: https://github.com/daswer123/deepspeed-windows-wheels/releases