llm-observability — independent software & tools

6 independent llm-observability listings the big search engines bury.

• caprock

  github · Free · by dspv

  Mission control for Claude Code — run, observe, and orchestrate your agent sessions locally. Live activity, cost & token burn, loop detection, verified multi-agent tasks.

• Spanlens

  github · Free · by spanlens

  Open source LLM observability and monitoring. Drop-in proxy for OpenAI, Anthropic, and Gemini with request logging, cost tracking, and agent tracing. Self-host with one Docker command. MIT.

• claudetrack

  github · Free · by 123affano1

  Track Anthropic Claude API tokens, forecast costs, and predict rate limits in real time with a self-hosted, zero-code tool.

• llm-drift

  github · Free · by GenesisClawbot

  LLM drift detector — know within 5 min when GPT-4o, Claude, or Gemini silently changes behaviour. Open source, self-hostable.

• AgenticLedger

  github · Free · by ShekharBhardwaj

  Local-first flight recorder for AI agents: every LLM call, tool call, cost, and loop captured by a transparent proxy. Zero code changes.

• llm-eval

  github · Free · by wahhyun

  Evaluate large language models with tools for performance and consistency scoring as part of the llm-cpp C++ infrastructure toolkit.