Kaynağa Gözat

Add chat.sh script

Georgi Gerganov 2 yıl önce
ebeveyn
işleme
dc6a845b85
2 değiştirilmiş dosya ile 10 ekleme ve 1 silme
  1. 4 1
      README.md
  2. 6 0
      chat.sh

+ 4 - 1
README.md

@@ -179,8 +179,11 @@ In this mode, you can always interrupt generation by pressing Ctrl+C and enter o
 
 
 Here is an example few-shot interaction, invoked with the command
 Here is an example few-shot interaction, invoked with the command
 ```
 ```
-./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
+# default arguments using 7B model
+./chat.sh
 
 
+# custom arguments using 13B model
+./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
 ```
 ```
 Note the use of `--color` to distinguish between user input and generated text.
 Note the use of `--color` to distinguish between user input and generated text.
 
 

+ 6 - 0
chat.sh

@@ -0,0 +1,6 @@
+#!/bin/bash
+#
+# Temporary script - will be removed in the future
+#
+
+./main -m ./models/7B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt