load-balancer — independent software & tools

2 independent load-balancer listings the big search engines bury.

• ollama-mesh

  github · Free · by Anirudhx7

  The control plane for self-hosted AI inference. Warm-state GPU routing, multi-runtime orchestration across Ollama, vLLM, llama.cpp, and TGI. Single Go binary. Apache-2.0.

• olb

  github · Free · by krisiasty

  OpenStack Load Balancer management tool