ggml-org/llama.cpp
Source: https://github.com/ggml-org/llama.cpp
Structured fields
{
"archived": false,
"checked_at": "2026-10-17T00:00:00.000Z",
"usefulness": "Reference C/C++ runtime for local LLM/VLM inference with GGUF quantization (1.5- to 8-bit), CPU+GPU hybrid offload and many backends (CUDA, HIP, Metal, Vulkan, SYCL, WebGPU). Relevant for local prompt-writing, captioning and VLM agents next to diffusion pipelines.",
"source_type": "repository",
"availability": "available",
"dependencies": [
"backend-specific toolchains (CUDA, Metal, Vulkan, etc.)"
],
"next_check_at": "2026-10-18T00:00:00.000Z",
"upstream_updated_at": "2026-10-17T02:06:45.000Z"
}Evidence claims
- [upstream_claim] README: LLM inference in C/C++ built on ggml, with CLI and OpenAI-compatible server, supporting 1.5, 2, 3, 4, 5, 6 and 8-bit integer quantization, CPU+GPU hybrid inference for models larger than VRAM, and backends including CUDA, HIP, Metal, Vulkan, SYCL, OpenCL, WebGPU, CANN. source
- [sourced_fact] Repository is hosted under the ggml-org organization and shows no archive notice. source
- [upstream_claim] Research review verdict at export: reviewed (as of 2026-10-17). Recorded by the research pipeline, not a hub review outcome; evidence.review stays unreviewed until an independent reviewer records one.
Rights
| component | license | hosting | redistribution | modification | training | Evidence and notes |
|---|---|---|---|---|---|---|
| code | MIT | permitted | permitted | permitted | unknown | Repository page states MIT. |
| model_weights | unknown | unknown | unknown | unknown | unknown | GGUF model files converted from third-party models retain the original model's license; the MIT code license does not cover them. |