Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge Bluefin and Bazzite ujust commands into this repo #259

Open
Libretto7 opened this issue Apr 26, 2024 · 3 comments
Open

Merge Bluefin and Bazzite ujust commands into this repo #259

Libretto7 opened this issue Apr 26, 2024 · 3 comments
Labels
help wanted Extra attention is needed

Comments

@Libretto7
Copy link

Both images have ujust commands which users of the other image could benefit from.
Each command should be considered to be placed in this repo instead.

For example, Bluefin has install-jetbrains-toolbox and pytorch, but Bazzite does not.

Notably, there is also some duplication of commands which would be fixed:
Bluefin has ollama and Bazzite has install-ollama. The code to execute is identical (except for an additional echo at the end on Bazzite).

Relevant forum topic

@castrojo castrojo added the help wanted Extra attention is needed label May 3, 2024
@muddyfeather
Copy link

Tried this on bazzite, just with invoking just --justfile bluefin-tools.just ollama (and ollama-web), works absolutely fine as of the build i'm on. 40.20240807.0, can see the ollama process in the container using 6GB VRAM via NVTOP on my modest 3060Ti, and the calls to a llama3:8b model seem nice and quick. will work out a PR to get this in the bazzite just files. First though, ollama container has a nicely persistent volume at ~/.ollama, but ollama-web doesn't seem to persist. which is a first friction i'd suggest might put users off.

@muddyfeather
Copy link

Actually, that's entirely wrong, a previous container was there from a prior run in ~/.config/containers for ollama-web, and that quadlet didn't have the persistent named volume, so it does persist, but that does highlight potentially that versioning may be a problem as the configs get updated. deleting the ollama-web.container and reruning the just ollama-web sorted it though. to be honest this is probably fair enough functionality, as if you are playing with AI containers, you probably are savvy enough to suss this out, but it might be good to have a "ujust remove-ollama" and "ujust remove-ollama-web" equivalents for backwards and forwards....

@muddyfeather
Copy link

Could do with a bit of help with the PR, a commit in my fork is pushing the limits of my shell scripting/justfile chops, @castrojo can someone help me out with the weird <<-- EOF syntax?

ublue-os/bluefin@a20d38c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants