Просмотр исходного кода

model-conversion : add note about verifying previous models (#18082)

This commit adds a note to the README in the model-conversion
examples, advising developers to verify that previous versions of models
pass logits verification before adding new models from the same family.
Daniel Bevenius 1 месяц назад
Родитель
Сommit
9963b81f63
1 измененных файлов с 7 добавлено и 0 удалено
  1. 7 0
      examples/model-conversion/README.md

+ 7 - 0
examples/model-conversion/README.md

@@ -10,6 +10,13 @@ and in some cases perplexity checked of the quantized model. And finally the
 model/models need to the ggml-org on Hugging Face. This tool/example tries to
 model/models need to the ggml-org on Hugging Face. This tool/example tries to
 help with this process.
 help with this process.
 
 
+> 📝 **Note:** When adding a new model from an existing family, verify the
+> previous version passes logits verification first. Existing models can have
+> subtle numerical differences that don't affect generation quality but cause
+> logits mismatches. Identifying these upfront whether they exist in llama.cpp,
+> the conversion script, or in an upstream implementation, can save significant
+> debugging time.
+
 ### Overview
 ### Overview
 The idea is that the makefile targets and scripts here can be used in the
 The idea is that the makefile targets and scripts here can be used in the
 development/conversion process assisting with things like:
 development/conversion process assisting with things like: