瀏覽代碼

model : set res->t_embd in SmallThinker models (#16782)

Sigbjørn Skjæret 2 月之前
父節點
當前提交
7cce4f8158
共有 1 個文件被更改,包括 1 次插入0 次删除
  1. 1 0
      src/llama-model.cpp

+ 1 - 0
src/llama-model.cpp

@@ -19339,6 +19339,7 @@ struct llm_build_smallthinker : public llm_graph_context{
 
 
         cur = build_norm(cur, model.output_norm, NULL, LLM_NORM_RMS, -1);
         cur = build_norm(cur, model.output_norm, NULL, LLM_NORM_RMS, -1);
         cb(cur, "result_norm", -1);
         cb(cur, "result_norm", -1);
+        res->t_embd = cur;
 
 
         // lm_head
         // lm_head
         cur = build_lora_mm(model.output, cur);
         cur = build_lora_mm(model.output, cur);