Model Server.

Local models shared with every agent on the network

Cogy Server

The model server runs your local models on one machine and makes them available to agents on the private network through an OpenAI-compatible API.

It uses llama.cpp, with MLX and Splash also available on Apple silicon, and keeps a registry of installed models and their settings.

Agents on other machines use these models over the network, so each machine does not need its own copy.

Let us build your future

Bring us a plan or just an idea. We will arrange a discovery meeting with you to go through it.