Parcourir la source

server : disable Nagle's algorithm (#12020)

Georgi Gerganov il y a 11 mois
Parent
commit
cf756d6e0a
1 fichiers modifiés avec 2 ajouts et 0 suppressions
  1. 2 0
      examples/server/utils.hpp

+ 2 - 0
examples/server/utils.hpp

@@ -7,6 +7,8 @@
 
 // increase max payload length to allow use of larger context size
 #define CPPHTTPLIB_FORM_URL_ENCODED_PAYLOAD_MAX_LENGTH 1048576
+// disable Nagle's algorithm
+#define CPPHTTPLIB_TCP_NODELAY true
 #include "httplib.h"
 
 // Change JSON_ASSERT from assert() to GGML_ASSERT: