One-line integration — change your OpenAI/Anthropic base URL and get a dashboard with every prompt, response, latency, and dollar tracked. Adds caching and rate-limit handling without code changes.
Observability · Helicone
Helicone
Drop-in LLM proxy with logging, caching, and cost tracking.
Model support
Model-agnostic
Where it runs
- API
- Web
Tags
- #proxy
- #logging
- #caching
- #cost-tracking
Related in Observability
View Langfuse details ObservabilityFREEMIUMVettedLangfuse
Langfuse
Open-source LLM observability. Self-hostable, OpenTelemetry-native.
Tracing, evals, prompt management, and dataset tooling for LLM apps — self-host on your own infra or use Langfuse Cloud. The open-source default when you want full ownership of your observability stack.
- open-source
- tracing
- evals
- self-hosted
View Arize Phoenix details ObservabilityFREEMIUMArize Phoenix
Arize AI
Open-source LLM tracing + evaluation. Strong on retrieval debugging.
Phoenix is Arize's open-source observability — run locally in a notebook or as a service. Especially strong for inspecting RAG pipelines, finding bad chunks, and tracking retrieval quality over time.
- open-source
- tracing
- rag
- retrieval-debugging
View LangSmith details ObservabilityFREEMIUMLangSmith
LangChain
LangChain's hosted observability + eval platform.
Tracing, dataset management, eval orchestration, and prompt playground from the LangChain team. Pairs naturally if LangChain or LangGraph already runs in your stack, but works standalone via SDKs.
- tracing
- evals
- datasets
- langchain