Curated
Open WebUI
Self-hosted interface for chatting with AI models
Local RunnersSelf hosted AI chat interface
Alternatives to LocalAI
12 tools like LocalAI, chosen by what they do. About LocalAI
Open source
vLLM
Fast, memory-efficient engine for serving large language models
Local RunnersHigh throughput LLM serving
Open source
SGLang
Open-source framework for serving large language models
Local RunnersFast LLM serving framework
Open source
GPT4All
Desktop app for private chat with local AI models
Local RunnersPrivate local chat on your PCInactive
Open source
Jan
Open source app for running AI models on your own computer
Local RunnersOffline ChatGPT alternative
Open source
AnythingLLM
Private AI assistant app that runs on your own computer
Local RunnersAll in one local AI app
Open source
LibreChat
Open source chat interface for many AI model providers
Local RunnersOpen source multi model chat
Curated
Msty
Private AI workspace for chatting with and organizing models
Local RunnersSimple desktop LLM client
Paid
Novita AI
Model APIs, agent sandboxes and GPU instances in one cloud
Inference PlatformsModel APIs and GPU instances
Freemium
Together AI
Cloud platform for running open-source AI models via API
Model APIsRun open models in the cloud
Curated
Hyperbolic
On-demand GPUs and an API for open AI models
Inference PlatformsLow cost open model inference
Curated
Modal
Serverless cloud for running AI workloads on GPUs
Inference PlatformsServerless GPU compute for AI