Remote Cookbook Management?

[AndreasDP]

Hi!

So my Odysseus setup is a bit different from the "normal" setup.
I'm hosting Odysseus on a small Linux server that's 24/7 online, with a super small model on it, and my gaming PC (the big boy) is hosting the larger models via Ollama.

But the Cookbook feature only seems to work for the local machine (Linux server)? It would be cool if we could use Cookbooks for Ollama instances on other PC's on the network?

I apologize if this is already possible, and I'm just too stupid to find it :D

[CoolJohn-lab]

you pretty much can. You can override the spec that the cookbook auto-detects with your gaming PC spec, then it will recommend good models for that PC. I think you would also need to disable vLLM and Sglang on your Linux Server to force the cookbook to only show models that will work on Ollama.