Iirc it can run anything llama.cpp can because it just uses that under the hood.
hyperhypervisor
joined 8 months ago
There's also llamafile, super simple: download and run it.
Iirc it can run anything llama.cpp can because it just uses that under the hood.
There's also llamafile, super simple: download and run it.
Ok. I haven't tried it so I'll take your word for it. I'm just offering an easier alternative since the topic was "getting started"