AI SoftwareWeb linkPublished
Local Inference Server (Desktop Build)
Single-binary server for running open-weight models on a workstation.
About this resource
Desktop installer providing an OpenAI-compatible HTTP endpoint, model download manager, quantisation presets and GPU/CPU scheduling. Windows and macOS builds. Source: https://ollama.com/download
inferenceself-hostedopen weights