Helicone

Helicone is a gateway and monitoring platform for applications that call large language models. It sits between your app and the model providers so you can watch and control the traffic.

Helicone routes requests to model providers and logs what happens along the way. You can review requests, sessions and users in a dashboard, and see where an app is slow, failing or expensive. It also offers tools for working on prompts, such as datasets and a playground. You can set rate limits and alerts when something needs attention.

• Route requests to several model providers
• View requests, sessions and users in one dashboard
• Set rate limits for your app
• Set up alerts
• Test and improve prompts with datasets and a playground
• Connects with OpenAI, Anthropic, Azure and OpenRouter

Developers and product teams building AI features who want to debug problems and keep an eye on usage. Platform teams that manage several model providers may also find the gateway useful.

A 7-day free trial is offered, and the site says no credit card is required to start. Paid plans are listed on the pricing page. Because requests pass through the gateway, check how it fits your latency and data handling needs before you put it in front of production traffic.