Преглед изворни кода

Fix inference example lacks required parameters (#9035)

Signed-off-by: Aisuko <urakiny@gmail.com>
Aisuko пре 1 година
родитељ
комит
c8ddce8560
1 измењених фајлова са 1 додато и 1 уклоњено
  1. 1 1
      examples/quantize/README.md

+ 1 - 1
examples/quantize/README.md

@@ -34,7 +34,7 @@ Run the quantized model:
 
 
 ```bash
 ```bash
 # start inference on a gguf model
 # start inference on a gguf model
-./llama-cli -m ./models/mymodel/ggml-model-Q4_K_M.gguf -n 128
+./llama-cli -m ./models/mymodel/ggml-model-Q4_K_M.gguf -cnv -p "You are a helpful assistant"
 ```
 ```
 
 
 When running the larger models, make sure you have enough disk space to store all the intermediate files.
 When running the larger models, make sure you have enough disk space to store all the intermediate files.