Open source
Langfuse
Open source tracing and evals for LLM apps and AI agents
Observability and EvalsOpen source LLM observability
Alternatives to Helicone
12 tools like Helicone, chosen by what they do. About Helicone
Curated
Braintrust
Platform for tracing, evaluating and monitoring AI agents
LLM OpsEvals and AI observability
Open source
AgentOps
Tracing and debugging for AI agents, with LLM cost tracking
LLM ObservabilityAI agent monitoring
Curated
Pydantic AI
Type-safe Python agent framework with many model providers
Agent FrameworksType safe Python agents
Open source
Instructor
Library for getting structured, validated data from LLM output
Agent FrameworksStructured outputs from LLMs
Open source
Open source
Haystack
Open source framework for building search, RAG and agent pipelines
RAG FrameworksOpen framework for search, RAG
Open source
Firecrawl
Web data API that turns websites into LLM-ready data for agents
Browser AgentsTurn websites into LLM data
Open source
DSPy
Framework for programming LLM pipelines with typed signatures
Agent FrameworksProgram LLMs, not prompt them
Open source
VoltAgent
TypeScript framework for AI agents with built-in observability
Agent FrameworksTypeScript AI agent framework
Freemium
LlamaIndex
Data framework and document parsing service for LLM apps
RAG FrameworksData framework for LLM apps