Przeglądaj źródła

batched: fix n_predict parameter (#8527)

Masaya, Kato 1 rok temu
rodzic
commit
da3913d8f9
1 zmienionych plików z 1 dodań i 1 usunięć
  1. 1 1
      examples/batched/batched.cpp

+ 1 - 1
examples/batched/batched.cpp

@@ -31,7 +31,7 @@ int main(int argc, char ** argv) {
     int n_parallel = params.n_parallel;
     int n_parallel = params.n_parallel;
 
 
     // total length of the sequences including the prompt
     // total length of the sequences including the prompt
-    int n_predict = 32;
+    int n_predict = params.n_predict;
 
 
     // init LLM
     // init LLM