Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Publish Vulkan & Metal binary wheels to PyPI #380

Open
iwr-redmond opened this issue Feb 7, 2025 · 0 comments
Open

[FEATURE] Publish Vulkan & Metal binary wheels to PyPI #380

iwr-redmond opened this issue Feb 7, 2025 · 0 comments
Labels
💡 feature request New feature or request

Comments

@iwr-redmond
Copy link

iwr-redmond commented Feb 7, 2025

Feature Description

It would be helpful to consider publishing binary builds to PyPI for each version to supplement the existing source archive: Vulkan for Windows and Linux, and Metal for OSX.

This would greatly assist users who do not use the correct --index-url or --extra-index-url parameter when installing or upgrading the Nexa SDK package and experience various challenges as result.

The Windows and OSX builds already exist and it should be trivial to publish them to PyPI instead of just the source package. However, there is currently no Vulkan build for Linux.

Similar Features or References

  • Vulkan performance statistics have recently been catalogued in llama.cpp#10879
  • Nomic takes a similar approach to the one suggested here, building with Vulkan on Linux and Windows and offering Cuda as an extra feature.
  • Both Upscayl and sd.cpp.gui.wx use Vulkan on all platforms, with the latter also offering a Cuda backend

Updates

02/11/2025: Correction regarding Vulkan, discovered while working on #386

@iwr-redmond iwr-redmond added the 💡 feature request New feature or request label Feb 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💡 feature request New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant