large-language-models — independent software & tools
-
extract-llms-docs
📄 Extract documentation for AI agents and LLMs from any website, simplifying automation workflows with easy access to llms.txt and install.md files.
-
1Cat-vLLM
Optimize Tesla V100 GPUs for AWQ 4-bit inference with improved speed, stability, and support for modern large models like Qwen3.5 and MoE.
-
Local-LLM
🛠️ Enable offline NLP workflows with Local-LLM, a lightweight Python library for secure environments using the BERT model, ensuring reproducibility and reliability.
-
Qwen3.5-9B-ToolHub
Deploy a local Qwen3.5-9B multimodal AI with GPU inference supporting web search, image queries, file reading, and an OpenAI-compatible API.
-
haystack
🛠️ Build powerful search systems effortlessly with Haystack, a framework for developing end-to-end question answering and search applications.
-
OllamaRAG
🤖 Build a smart AI assistant that learns from any website using a Retrieval-Augmented Generation framework with local models powered by Ollama.
-
Mini-Agent
🧠 Build intelligent agents with Mini Agent, a streamlined demo project leveraging MiniMax M2 for advanced reasoning and robust contextual management.
-
llm-eval
Evaluate large language models with tools for performance and consistency scoring as part of the llm-cpp C++ infrastructure toolkit.