Ollama
Make room for a model on your own machine.
Yuloy AI / Wiki
Local AI
AI software that runs on your own device or infrastructure, rather than relying entirely on a hosted model service.
The practical questions are which models fit your hardware, how they run and which applications you can connect to them.
Projects connected to this idea
Open WebUI
A web interface for working with locally run or connected language models.
TensorFold
Run language-model inference across Metal, CUDA and Vulkan backends.