|
|
@@ -729,8 +729,6 @@ python3 convert.py pygmalion-7b/ --outtype q4_1
|
|
|
- [LLaMA 2 7B chat](https://huggingface.co/TheBloke/Llama-2-7B-chat-GGML)
|
|
|
- [LLaMA 2 13B chat](https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML)
|
|
|
- [LLaMA 2 70B chat](https://huggingface.co/TheBloke/Llama-2-70B-chat-GGML)
|
|
|
-- Specify `-eps 1e-5` for best generation quality
|
|
|
-- Specify `-gqa 8` for 70B models to work
|
|
|
|
|
|
### Verifying the model files
|
|
|
|
slaren