llm-observability — independent software & tools

4 independent llm-observability listings the big search engines bury.

• Spanlens

  github · Free · by spanlens

  Open source LLM observability and monitoring. Drop-in proxy for OpenAI, Anthropic, and Gemini with request logging, cost tracking, and agent tracing. Self-host with one Docker command. MIT.

• claudetrack

  github · Free · by 123affano1

  Track Anthropic Claude API tokens, forecast costs, and predict rate limits in real time with a self-hosted, zero-code tool.

• llm-drift

  github · Free · by GenesisClawbot

  LLM drift detector — know within 5 min when GPT-4o, Claude, or Gemini silently changes behaviour. Open source, self-hostable.

• llm-eval

  github · Free · by wahhyun

  Evaluate large language models with tools for performance and consistency scoring as part of the llm-cpp C++ infrastructure toolkit.