Sfoglia il codice sorgente

Fix for main example getting stuck when -n -2 and --interactive (#2767)

* Fix for main example getting stuck when -n -2 and --interactive

* Add a comment so future generations may suffer less.
Kerfuffle 2 anni fa
parent
commit
7694adda8d
1 ha cambiato i file con 2 aggiunte e 1 eliminazioni
  1. 2 1
      examples/main/main.cpp

+ 2 - 1
examples/main/main.cpp

@@ -798,7 +798,8 @@ int main(int argc, char ** argv) {
         }
 
         // In interactive mode, respect the maximum number of tokens and drop back to user input when reached.
-        if (params.interactive && n_remain <= 0 && params.n_predict != -1) {
+        // We skip this logic when n_predict == -1 (infinite) or -2 (stop at context size).
+        if (params.interactive && n_remain <= 0 && params.n_predict >= 0) {
             n_remain = params.n_predict;
             is_interacting = true;
         }