Open source
vLLM
Fast, memory-efficient engine for serving large language models
Local RunnersHigh throughput LLM serving
Alternatives to SGLang
12 tools like SGLang, chosen by what they do. About SGLang
Open source
LocalAI
Self-hosted server with an OpenAI-style API for local models
Local RunnersSelf hosted OpenAI style API
Open source
GPT4All
Desktop app for private chat with local AI models
Local RunnersPrivate local chat on your PCInactive
Curated
Msty
Private AI workspace for chatting with and organizing models
Local RunnersSimple desktop LLM client
Curated
Open WebUI
Self-hosted interface for chatting with AI models
Local RunnersSelf hosted AI chat interface
Open source
Jan
Open source app for running AI models on your own computer
Local RunnersOffline ChatGPT alternative
Open source
LibreChat
Open source chat interface for many AI model providers
Local RunnersOpen source multi model chat
Open source
AnythingLLM
Private AI assistant app that runs on your own computer
Local RunnersAll in one local AI app
Open source
Curated
Open source
Curated
Modal
Serverless cloud for running AI workloads on GPUs
Inference PlatformsServerless GPU compute for AI