OpenLLMetry

OpenLLMetry is an open source library that adds OpenTelemetry tracing to applications that call large language models. It is made by Traceloop and works with the standard OpenTelemetry tooling you may already use.

You initialize the SDK in your code, and it records calls to model providers as trace spans. Decorators let you group steps into named workflows, so you can follow a request through your code and see the model calls inside it. The traces use the OpenTelemetry format, so they can go to compatible backends.

• Two lines of code to start in Python
• TypeScript support as well
• Decorators to name workflows
• OpenTelemetry trace format
• Example setup with the OpenAI client

Developers building apps that call language models who want to see how requests move through workflow steps and model calls. Teams already using OpenTelemetry will find it a natural fit.

OpenLLMetry is free and licensed under Apache 2.0. The library runs inside your own application, and the traces are sent to a backend you choose.