Langfuse

About Langfuse

Langfuse is an open-source LLM engineering platform that helps teams collaboratively develop, monitor, evaluate, and debug AI applications. It can be self-hosted in minutes and is built on OpenTelemetry. Used by 2,300+ companies processing billions of observations per month.

Features

• LLM application observability with hierarchical traces
• Prompt management with versioning and experimentation
• LLM evaluations (automated and human annotation)
• Cost and latency analytics
• 80+ integrations (OpenAI, LangChain, LlamaIndex, LiteLLM, Vercel AI SDK)
• OpenTelemetry-native with Python and JS/TS SDKs
• Self-hostable (MIT license) or cloud-hosted

Installation

pip install langfuse