Преглед на файлове

Fix inference example lacks required parameters (#9035)

Signed-off-by: Aisuko <urakiny@gmail.com>
Aisuko преди 1 година
родител
ревизия
c8ddce8560
променени са 1 файла, в които са добавени 1 реда и са изтрити 1 реда
  1. 1 1
      examples/quantize/README.md

+ 1 - 1
examples/quantize/README.md

@@ -34,7 +34,7 @@ Run the quantized model:
 
 ```bash
 # start inference on a gguf model
-./llama-cli -m ./models/mymodel/ggml-model-Q4_K_M.gguf -n 128
+./llama-cli -m ./models/mymodel/ggml-model-Q4_K_M.gguf -cnv -p "You are a helpful assistant"
 ```
 
 When running the larger models, make sure you have enough disk space to store all the intermediate files.