7-Layer Self-Hosted AI Operating System — sovereign, local-first intelligence with full operator ownership of model weights, memory, and context.
koan is a sovereign, local-first artificial intelligence operating system designed around a 7-layer cognitive architecture. Where most AI tools lock users into cloud dependencies and opaque inference stacks, koan is built to run entirely on a single workstation — giving the operator full ownership of model weights, memory, and context.
The name is intentional: a koan has no external answer. The system is designed to force the operator into direct relationship with their own intelligence infrastructure — no intermediary, no subscription, no dependency on external availability.
The architecture draws directly from published cognitive-agent research and unifies them into a coherent OS abstraction that has no direct peer in the open-source landscape:
The inference layer runs on Ollama with llama.cpp as the GGUF-native backend, supporting quantized models optimized for consumer GPU hardware.
koan's 7-layer cognitive architecture wires together local inference, structured memory, autonomous agent loops, and a deliberate fine-tuning pipeline under one operator-controlled roof: