|
@@ -10,11 +10,11 @@ Inference of [LLaMA](https://arxiv.org/abs/2302.13971) model in pure C/C++
|
|
|
|
|
|
|
|
### Hot topics
|
|
### Hot topics
|
|
|
|
|
|
|
|
|
|
+- ⚠️ Incoming backends: https://github.com/ggerganov/llama.cpp/discussions/5138
|
|
|
- New SOTA quantized models, including pure 2-bits: https://huggingface.co/ikawrakow
|
|
- New SOTA quantized models, including pure 2-bits: https://huggingface.co/ikawrakow
|
|
|
- Collecting Apple Silicon performance stats:
|
|
- Collecting Apple Silicon performance stats:
|
|
|
- M-series: https://github.com/ggerganov/llama.cpp/discussions/4167
|
|
- M-series: https://github.com/ggerganov/llama.cpp/discussions/4167
|
|
|
- A-series: https://github.com/ggerganov/llama.cpp/discussions/4508
|
|
- A-series: https://github.com/ggerganov/llama.cpp/discussions/4508
|
|
|
-- Added Mixtral support: https://github.com/ggerganov/llama.cpp/pull/4406
|
|
|
|
|
- Looking for contributions to improve and maintain the `server` example: https://github.com/ggerganov/llama.cpp/issues/4216
|
|
- Looking for contributions to improve and maintain the `server` example: https://github.com/ggerganov/llama.cpp/issues/4216
|
|
|
|
|
|
|
|
----
|
|
----
|
Georgi Gerganov