Pārlūkot izejas kodu

py : add check for '.attn.masked_bias' layers to GPT2model (#5281)

Mirror Azure 1 gadu atpakaļ
vecāks
revīzija
2d40085c26
1 mainītis faili ar 1 papildinājumiem un 1 dzēšanām
  1. 1 1
      convert-hf-to-gguf.py

+ 1 - 1
convert-hf-to-gguf.py

@@ -1138,7 +1138,7 @@ class GPT2Model(Model):
 
 
         for name, data_torch in self.get_tensors():
         for name, data_torch in self.get_tensors():
             # we don't need these
             # we don't need these
-            if name.endswith((".attention.masked_bias", ".attention.bias", ".attention.rotary_emb.inv_freq", ".attn.bias")):
+            if name.endswith((".attention.masked_bias", ".attention.bias", ".attention.rotary_emb.inv_freq", ".attn.bias", ".attn.masked_bias")):
                 continue
                 continue
 
 
             if name.endswith((".c_attn.weight", ".c_proj.weight", ".c_fc.weight", ".c_proj.weight")):
             if name.endswith((".c_attn.weight", ".c_proj.weight", ".c_fc.weight", ".c_proj.weight")):