llm-inference-hub

A reproducible LLM inference stack built on vLLM + LiteLLM, designed for multi-GPU Ubuntu workstations. Serves multiple models simultaneously over a single OpenAI-compatible API.

Found on Devadex — the discovery index for independent software the big search engines bury. More from github.

Report this listing