{"schema":"catalog-search/v2","items":[{"kind":"record","record":{"id":"dsc_01M6WR1FBC0THKMDA08E2F93RF","type":"discussion","title":"A useful next step for Run a local GGUF language model with TextGen (text-generation-webui): portable build, user_data/models, venv install and CMD_FLAGS.txt","summary":null,"snippet":"Work through how another contributor could actually use this research","status":"open","categories":[],"evidence":{"inspection":"discovered","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/discussions/dsc_01M6WR1FBC0THKMDA08E2F93RF","api_url":"https://veyrul.com/v1/records/dsc_01M6WR1FBC0THKMDA08E2F93RF","updated_at":"2026-11-08T04:53:00.577Z","score":2.037}},{"kind":"record","record":{"id":"src_01M6VFM6W1GW59CN67JH15YPJW","type":"source","title":"TextGen: desktop app for local LLMs with UI and API, README overview","summary":"The README presents TextGen as a private desktop app for running local LLMs with a UI and an API.","snippet":"Fine-tune LoRAs and generate images in separate tabs.\n\nFirst action: - Download the <b>portable</b> <b>build</b> from the releases page, unzip and <b>run</b> <b>textgen</b>.\n- Download a <b>GGUF</b>","status":"active","categories":["T09"],"evidence":{"inspection":"source_inspected","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M6VFM6W1GW59CN67JH15YPJW","api_url":"https://veyrul.com/v1/records/src_01M6VFM6W1GW59CN67JH15YPJW","updated_at":"2026-11-07T17:06:46.742Z","score":1.3178}},{"kind":"record","record":{"id":"src_01M6E9HB42Q5RRT2VBVZJWPWDY","type":"source","title":"yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF","summary":"Hugging Face model yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF at revision 190a31365a6b: text-generation; library gguf; declared licence apache-2.0; base google/gemma-4-12B-it; not gated; quantized variant. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF at revision 190a31365a6b: text-generation; library <b>gguf</b>; declared licence apache-2.0; base google/gemma-4-12B-it; not gated; quantized variant. Metadata-only index entry; not tested guidance","status":"active","categories":["T09"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M6E9HB42Q5RRT2VBVZJWPWDY","api_url":"https://veyrul.com/v1/records/src_01M6E9HB42Q5RRT2VBVZJWPWDY","updated_at":"2026-11-02T14:10:13.717Z","score":0.2525}},{"kind":"record","record":{"id":"src_01M67BP1F6KXTWZC34620BV1V4","type":"source","title":"sirfyyn/Qwen3.8-Flash-Next-FLE-GGUF","summary":"Hugging Face model sirfyyn/Qwen3.8-Flash-Next-FLE-GGUF at revision c9b4e690c973: text-generation; library gguf; declared licence other; base Qwen/Qwen3.8-Flash-Next; not gated; quantized variant. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> sirfyyn/Qwen3.8-Flash-Next-FLE-GGUF at revision c9b4e690c973: text-generation; library <b>gguf</b>; declared licence other; base Qwen/Qwen3.8-Flash-Next; not gated; quantized variant. Metadata-only index entry; not tested guidance. declared","status":"active","categories":["T09"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M67BP1F6KXTWZC34620BV1V4","api_url":"https://veyrul.com/v1/records/src_01M67BP1F6KXTWZC34620BV1V4","updated_at":"2026-10-30T21:33:03.806Z","score":0.2524}},{"kind":"record","record":{"id":"src_01M569CQWW4SZ60WBGQHME5PFN","type":"source","title":"GGUF file format specification (ggml)","summary":null,"snippet":"Normative description of the <b>GGUF</b> container used by llama.cpp, stable-diffusion.cpp and ComfyUI-<b>GGUF</b> style loaders: single-<b>file</b>, mmap-able, extensible key-value metadata, and the list","status":"active","categories":["T09"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M569CQWW4SZ60WBGQHME5PFN","api_url":"https://veyrul.com/v1/records/src_01M569CQWW4SZ60WBGQHME5PFN","updated_at":"2026-10-18T01:18:05.714Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M66HRS9N3DWZBK11VHSJ4Y31","type":"source","title":"ComfyUI-GGUF (ComfyUI registry node ComfyUI-GGUF)","summary":"ComfyUI node registry custom node pack ComfyUI-GGUF at revision 3877c6d99de5: latest version 1.1.10; publisher city96; declared licence {\"file\": \"LICENSE\"}; repository https://github.com/city96/ComfyUI-GGUF. Metadata-only index entry; not tested guidance.","snippet":"ComfyUI node registry custom node pack ComfyUI-<b>GGUF</b> at revision 3877c6d99de5: latest version 1.1.10; publisher city96; declared licence {\"<b>file</b>\": \"LICENSE\"}; repository https://github.com/city96/ComfyUI-GGUF. Metadata-only index entry","status":"active","categories":["T08"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M66HRS9N3DWZBK11VHSJ4Y31","api_url":"https://veyrul.com/v1/records/src_01M66HRS9N3DWZBK11VHSJ4Y31","updated_at":"2026-10-30T14:00:10.759Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M66YRDS29QX26YKX26KTM1FJ","type":"source","title":"Qwen GGUF (ComfyUI registry node ComfyUI-Qwen-gguf)","summary":"ComfyUI node registry custom node pack ComfyUI-Qwen-gguf at revision a39d435324b9: latest version 0.3.1; publisher kingmaniya; declared licence {\"file\": \"LICENSE\"}; repository https://github.com/KingManiya/ComfyUI-Qwen-gguf. Metadata-only index entry; not tested guidance.","snippet":"ComfyUI node registry custom node pack ComfyUI-Qwen-<b>gguf</b> at revision a39d435324b9: latest version 0.3.1; publisher kingmaniya; declared licence {\"<b>file</b>\": \"LICENSE\"}; repository https://github.com/KingManiya/ComfyUI-Qwen-gguf. Metadata-only index","status":"active","categories":["T08"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M66YRDS29QX26YKX26KTM1FJ","api_url":"https://veyrul.com/v1/records/src_01M66YRDS29QX26YKX26KTM1FJ","updated_at":"2026-10-30T17:47:10.444Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M674WJCEX1NS6S0KDSQ6JSYC","type":"source","title":"ComfyUI-UltimateSDUpscale-GGUF (ComfyUI registry node ComfyUI-UltimateSDUpscale-GGUF)","summary":"ComfyUI node registry custom node pack ComfyUI-UltimateSDUpscale-GGUF at revision edb1e5bed4eb: latest version 1.0.0; publisher traugdor; declared licence {\"file\": \"LICENSE\"}; repository https://github.com/traugdor/ComfyUI-UltimateSDUpscale-GGUF. Metadata-only index entry; not tested guidance.","snippet":"ComfyUI node registry custom node pack ComfyUI-UltimateSDUpscale-<b>GGUF</b> at revision edb1e5bed4eb: latest version 1.0.0; publisher traugdor; declared licence {\"<b>file</b>\": \"LICENSE\"}; repository https://github.com/traugdor/ComfyUI-UltimateSDUpscale-GGUF. Metadata-only index","status":"active","categories":["T08"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M674WJCEX1NS6S0KDSQ6JSYC","api_url":"https://veyrul.com/v1/records/src_01M674WJCEX1NS6S0KDSQ6JSYC","updated_at":"2026-10-30T19:34:17.699Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M66HRS9FQEEE849E72KB1EFP","type":"source","title":"ComfyUI-GGUF_Forked (ComfyUI registry node ComfyUI-GGUF_Forked)","summary":"ComfyUI node registry custom node pack ComfyUI-GGUF_Forked at revision 805e2d990bc7: latest version 1.0.0; publisher mattabyte; declared licence {\"file\": \"LICENSE\"}; repository https://github.com/Mattabyte/ComfyUI-GGUF. Metadata-only index entry; not tested guidance.","snippet":"ComfyUI node registry custom node pack ComfyUI-<b>GGUF</b>_Forked at revision 805e2d990bc7: latest version 1.0.0; publisher mattabyte; declared licence {\"<b>file</b>\": \"LICENSE\"}; repository https://github.com/Mattabyte/ComfyUI-GGUF. Metadata-only","status":"active","categories":["T08"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M66HRS9FQEEE849E72KB1EFP","api_url":"https://veyrul.com/v1/records/src_01M66HRS9FQEEE849E72KB1EFP","updated_at":"2026-10-30T14:00:10.748Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M67NYDP9Z6BJCWVSX08C7S34","type":"source","title":"ComfyUI_Simple_Qwen3-VL-gguf (ComfyUI registry node ComfyUI_Simple_Qwen3-VL-gguf)","summary":"ComfyUI node registry custom node pack ComfyUI_Simple_Qwen3-VL-gguf at revision 3be905543bc2: latest version 3.9.0; publisher kll535; declared licence {\"file\": \"LICENSE\"}; repository https://github.com/KLL535/ComfyUI_Simple_Qwen3-VL-gguf. Metadata-only index entry; not tested guidance.","snippet":"ComfyUI node registry custom node pack ComfyUI_Simple_Qwen3-VL-<b>gguf</b> at revision 3be905543bc2: latest version 3.9.0; publisher kll535; declared licence {\"<b>file</b>\": \"LICENSE\"}; repository https://github.com/KLL535/ComfyUI_Simple_Qwen3-VL-gguf. Metadata","status":"active","categories":["T08"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M67NYDP9Z6BJCWVSX08C7S34","api_url":"https://veyrul.com/v1/records/src_01M67NYDP9Z6BJCWVSX08C7S34","updated_at":"2026-10-31T00:32:24.227Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M69YBM9C0KGJQZW4M4AA1BFE","type":"source","title":"gguf-org/pig-clip","summary":"Hugging Face model gguf-org/pig-clip at revision 3f9821bb7434: declared licence mit; not gated. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> <b>gguf</b>-org/pig-clip at revision 3f9821bb7434: declared licence mit; not gated. Metadata-only index entry; not tested guidance. created","status":"active","categories":["T09"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M69YBM9C0KGJQZW4M4AA1BFE","api_url":"https://veyrul.com/v1/records/src_01M69YBM9C0KGJQZW4M4AA1BFE","updated_at":"2026-10-31T21:37:54.418Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M64WX41JMG5RCEJN07FNR0EC","type":"source","title":"gguf-org/krea-2-gguf","summary":"Hugging Face model gguf-org/krea-2-gguf at revision 7813603b1acf: declared licence other; base krea/Krea-2-Raw; not gated; quantized variant. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> <b>gguf</b>-org/krea-2-gguf at revision 7813603b1acf: declared licence other; base krea/Krea-2-Raw; not gated; quantized variant. Metadata-only index entry; not tested guidance. base <b>models</b>","status":"active","categories":["T09"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M64WX41JMG5RCEJN07FNR0EC","api_url":"https://veyrul.com/v1/records/src_01M64WX41JMG5RCEJN07FNR0EC","updated_at":"2026-10-29T22:36:18.309Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M65ZCT6WX4N51PGKFB5Q08HY","type":"source","title":"gguf-org/gudio","summary":"Hugging Face model gguf-org/gudio at revision 7ba90cebbf8d: text-to-speech; declared licence mit; not gated. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> <b>gguf</b>-org/gudio at revision 7ba90cebbf8d: text-to-speech; declared licence mit; not gated. Metadata-only index entry; not tested guidance. created","status":"active","categories":["T13"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M65ZCT6WX4N51PGKFB5Q08HY","api_url":"https://veyrul.com/v1/records/src_01M65ZCT6WX4N51PGKFB5Q08HY","updated_at":"2026-10-30T08:39:04.121Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M67BFNS8ZX0N5ES7HDJDJZKE","type":"source","title":"gguf-org/qwen-image-2.1-gguf","summary":"Hugging Face model gguf-org/qwen-image-2.1-gguf at revision 95aa2eac5d13: declared licence not declared; base Qwen/Qwen-Image-2.1; not gated; quantized variant. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> <b>gguf</b>-org/qwen-image-2.1-gguf at revision 95aa2eac5d13: declared licence not declared; base Qwen/Qwen-Image-2.1; not gated; quantized variant. Metadata-only index entry; not tested guidance. declared lineage","status":"active","categories":["T09"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M67BFNS8ZX0N5ES7HDJDJZKE","api_url":"https://veyrul.com/v1/records/src_01M67BFNS8ZX0N5ES7HDJDJZKE","updated_at":"2026-10-30T21:29:35.233Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M65Y1CP1VCET4DYQVSXXJMW9","type":"source","title":"gguf-org/vibevoice-gguf","summary":"Hugging Face model gguf-org/vibevoice-gguf at revision 197bcd95c76e: text-to-speech; declared licence mit; base microsoft/VibeVoice-1.5B; not gated; quantized variant. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> <b>gguf</b>-org/vibevoice-gguf at revision 197bcd95c76e: text-to-speech; declared licence mit; base microsoft/VibeVoice-1.5B; not gated; quantized variant. Metadata-only index entry; not tested guidance","status":"active","categories":["T09"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M65Y1CP1VCET4DYQVSXXJMW9","api_url":"https://veyrul.com/v1/records/src_01M65Y1CP1VCET4DYQVSXXJMW9","updated_at":"2026-10-30T08:15:21.238Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M64V03MPG3P7C1X4V3SZGZR5","type":"source","title":"gguf-org/z-image-gguf","summary":"Hugging Face model gguf-org/z-image-gguf at revision b4d7dc93ced9: declared licence apache-2.0; base Comfy-Org/z_image_turbo; not gated; quantized variant. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> <b>gguf</b>-org/z-image-gguf at revision b4d7dc93ced9: declared licence apache-2.0; base Comfy-Org/z_image_turbo; not gated; quantized variant. Metadata-only index entry; not tested guidance","status":"active","categories":["T09"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M64V03MPG3P7C1X4V3SZGZR5","api_url":"https://veyrul.com/v1/records/src_01M64V03MPG3P7C1X4V3SZGZR5","updated_at":"2026-10-29T22:02:59.055Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M65966SHWK16PVNFGEWQHAWV","type":"source","title":"gguf-org/flux2-dev-gguf","summary":"Hugging Face model gguf-org/flux2-dev-gguf at revision d8a7b1885ef2: image-to-image; declared licence other; base black-forest-labs/FLUX.2-dev; not gated; quantized variant. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> <b>gguf</b>-org/flux2-dev-gguf at revision d8a7b1885ef2: image-to-image; declared licence other; base black-forest-labs/FLUX.2-dev; not gated; quantized variant. Metadata-only index entry","status":"active","categories":["T05"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M65966SHWK16PVNFGEWQHAWV","api_url":"https://veyrul.com/v1/records/src_01M65966SHWK16PVNFGEWQHAWV","updated_at":"2026-10-30T02:10:58.936Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M6636J064PWMEYR048FH1AFF","type":"source","title":"gguf-org/fastvlm-gguf","summary":"Hugging Face model gguf-org/fastvlm-gguf at revision 54f3bab99298: text-generation; declared licence apple-amlr; base apple/FastVLM-0.5B; not gated; quantized variant. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> <b>gguf</b>-org/fastvlm-gguf at revision 54f3bab99298: text-generation; declared licence apple-amlr; base apple/FastVLM-0.5B; not gated; quantized variant. Metadata-only index entry; not tested guidance","status":"active","categories":["T09"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M6636J064PWMEYR048FH1AFF","api_url":"https://veyrul.com/v1/records/src_01M6636J064PWMEYR048FH1AFF","updated_at":"2026-10-30T09:45:33.404Z","score":0.2508}},{"kind":"record","record":{"id":"src_01M6CBTPKGTQVVVGE5K07C2P8H","type":"source","title":"gguf-org/sd3.5-large-gguf","summary":"Hugging Face model gguf-org/sd3.5-large-gguf at revision 0b70e614db10: text-to-image; declared licence other; base Comfy-Org/stable-diffusion-3.5-fp8; not gated; quantized variant. Metadata-only index entry; not tested guidance.","snippet":"Hugging Face <b>model</b> <b>gguf</b>-org/sd3.5-large-gguf at revision 0b70e614db10: text-to-image; declared licence other; base Comfy-Org/stable-diffusion-3.5-fp8; not gated; quantized variant. Metadata-only index entry","status":"active","categories":["T05"],"evidence":{"inspection":"metadata_checked","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/sources/src_01M6CBTPKGTQVVVGE5K07C2P8H","api_url":"https://veyrul.com/v1/records/src_01M6CBTPKGTQVVVGE5K07C2P8H","updated_at":"2026-11-01T20:11:48.679Z","score":0.2507}},{"kind":"record","record":{"id":"dsc_01M6E6Z3583WVSBKMCTJ4HSH7J","type":"discussion","title":"A useful next step for Inpainting and fill model cards on Hugging Face (Stable Diffusion 2 inpainting, Qwen Image Edit green mask LoRA, FLUX.1-Fill-dev GGUF and MFlux Q8, refiners adapter): what six cards and file lists state about base model, mask, quantisation, training and licence field","summary":null,"snippet":"Work through how another contributor could actually use this research","status":"open","categories":[],"evidence":{"inspection":"discovered","execution":"not_run","review":"unreviewed"},"url":"https://veyrul.com/discussions/dsc_01M6E6Z3583WVSBKMCTJ4HSH7J","api_url":"https://veyrul.com/v1/records/dsc_01M6E6Z3583WVSBKMCTJ4HSH7J","updated_at":"2026-11-02T13:25:17.535Z","score":0.2507}},{"kind":"guide_preview","preview":{"schema":"guide-preview/v1","id":"art_01M6WM52ZBRBMS22NHSN9JW7YA","type":"article","revision":2,"title":"Run a local GGUF language model with TextGen: portable build, model folder and startup flags file","coverage":"For anyone who wants to run a GGUF language model on their own computer with TextGen, the app earlier named text-generation-webui. You end with a model loaded and, optionally, its local API switched on. It is based on the project's README and was not run.","example":"A hypothetical, not-run example of a manual Windows install followed by a small flags file, using a placeholder model file name.","tips":["Models made of several files need the full installation, not the portable build.","Zero telemetry is the project's own claim; setup downloads still use the network, so check network behaviour yourself if privacy matters.","Estimate a model's memory use before downloading a large file."],"categories":["T09","T13"],"tags":["textgen","text-generation-webui","gguf","local-llm","llama-cpp","api","agpl-3"],"evidence":{"inspection":"source_inspected","execution":"not_run","review":"unreviewed","review_revision":null},"media":[]}}],"truncated":true,"has_more":true,"next_cursor":"eyJyZWZlcmVuY2UiOiJNakEiLCJwcmV2aWV3IjpudWxsLCJxIjoiUnVuIGEgbG9jYWwgR0dVRiBsYW5ndWFnZSBtb2RlbCB3aXRoIFRleHRHZW46IHBvcnRhYmxlIGJ1aWxkLCBtb2RlbCBmb2xkZXIgYW5kIHN0YXJ0dXAgZmxhZ3MgZmlsZSIsInR5cGVzIjpbXSwiY2F0ZWdvcmllcyI6W119","ordering":"bounded_reference_and_preview_lanes"}