llm-inference — independent software & tools

5 independent llm-inference listings the big search engines bury.

• ollama-mesh

  github · Free · by Anirudhx7

  The control plane for self-hosted AI inference. Warm-state GPU routing, multi-runtime orchestration across Ollama, vLLM, llama.cpp, and TGI. Single Go binary. Apache-2.0.

• fak

  github · Free · by anthony-chaudhary

  fak — the Fused Agent Kernel: one Go binary for AI agent loops. Wrap Claude Code/Codex/Cursor, keep long sessions cache-efficient, route work per call, run local GGUF models, and adjudicate tool calls.

• llm-systems-manager

  github · Free · by llmsyscore

  LLM Systems Manager — real-time observability and control for LLM systems

• leviathan

  github · Free · by Wireclothshowyladyslipper675

  Discover and enumerate subdomains with a fast, multi-phase recon engine built from the ground up for syscall-level efficiency

• InstinctMJ

  github · Free · by PHOENIX01ALX

  Provide a native mjlab environment for Project-Instinct to support reinforcement learning in humanoid whole-body control tasks.