|
|
@@ -31,7 +31,7 @@ llama-server -hf ggml-org/gemma-3-4b-it-GGUF --no-mmproj-offload
|
|
|
|
|
|
## Pre-quantized models
|
|
|
|
|
|
-These are ready-to-use models, most of them come with `Q4_K_M` quantization by default.
|
|
|
+These are ready-to-use models, most of them come with `Q4_K_M` quantization by default. They can be found at the Hugging Face page of the ggml-org: https://huggingface.co/ggml-org
|
|
|
|
|
|
Replaces the `(tool_name)` with the name of binary you want to use. For example, `llama-mtmd-cli` or `llama-server`
|
|
|
|