AI LLM Tools AI Tools

llamacpp is a plain C/C++ framework for running LLM inference locally or in the cloud. It supports GGUF models like LLaMA, Mistral, Mixtral, and Gemma, with no external dependencies. Includes CLI tools, quantization, and an OpenAI-compatible API server. Built for maximum performance across CPU, GPU, and hybrid setups, including Apple Silicon, CUDA, Vulkan, and more.