Skip to content
Web Tools
WebLLM preview
Client-Side AI & WebGPUWebGPU AI

WebLLM

Run Llama 3, Mistral, and Gemma models directly inside the browser tab with hardware acceleration via WebGPU. 100% private and offline capable.

Visit website(opens in a new tab)Docs

Highlights

  • WebGPU hardware acceleration
  • Zero server inference costs
  • 100% private local execution
  • Streaming OpenAI-compatible API

Get started

npm install @mlc-ai/web-llm

Related tools

WebContainers

Bolt.new

Generative UI & Prompts

AI-powered in-browser development environment and full-stack app generator.

Vector AI

Recraft AI

Generative Media & Assets

AI design engine for generating editable vector icons, 3D assets, and illustrations.

AI IDE

Cursor AI

AI IDEs & Coding Agents

The AI-first Code Editor with deep codebase indexing and intelligent agent composer.