You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Both images have ujust commands which users of the other image could benefit from.
Each command should be considered to be placed in this repo instead.
For example, Bluefin has install-jetbrains-toolbox and pytorch, but Bazzite does not.
Notably, there is also some duplication of commands which would be fixed:
Bluefin has ollama and Bazzite has install-ollama. The code to execute is identical (except for an additional echo at the end on Bazzite).
Tried this on bazzite, just with invoking just --justfile bluefin-tools.just ollama (and ollama-web), works absolutely fine as of the build i'm on. 40.20240807.0, can see the ollama process in the container using 6GB VRAM via NVTOP on my modest 3060Ti, and the calls to a llama3:8b model seem nice and quick. will work out a PR to get this in the bazzite just files. First though, ollama container has a nicely persistent volume at ~/.ollama, but ollama-web doesn't seem to persist. which is a first friction i'd suggest might put users off.
Actually, that's entirely wrong, a previous container was there from a prior run in ~/.config/containers for ollama-web, and that quadlet didn't have the persistent named volume, so it does persist, but that does highlight potentially that versioning may be a problem as the configs get updated. deleting the ollama-web.container and reruning the just ollama-web sorted it though. to be honest this is probably fair enough functionality, as if you are playing with AI containers, you probably are savvy enough to suss this out, but it might be good to have a "ujust remove-ollama" and "ujust remove-ollama-web" equivalents for backwards and forwards....
Could do with a bit of help with the PR, a commit in my fork is pushing the limits of my shell scripting/justfile chops, @castrojo can someone help me out with the weird <<-- EOF syntax?
Both images have ujust commands which users of the other image could benefit from.
Each command should be considered to be placed in this repo instead.
For example, Bluefin has
install-jetbrains-toolbox
andpytorch
, but Bazzite does not.Notably, there is also some duplication of commands which would be fixed:
Bluefin has ollama and Bazzite has install-ollama. The code to execute is identical (except for an additional
echo
at the end on Bazzite).Relevant forum topic
The text was updated successfully, but these errors were encountered: