Marian Cepok
|
c0bb1d3ce2
ggml : change ne to int64_t (#626)
|
2 years ago |
Justine Tunney
|
6f23ba5ee2
Ensure --mlock works properly with mmap() support
|
2 years ago |
Slaren
|
c03ae8dca1
Add mmap support for model files
|
2 years ago |
Stephan Walter
|
c1f885067c
ggml : introduce structs for the q4 data blocks (#356)
|
2 years ago |
comex
|
563cdc391d
Support calling mlock() on loaded model data on Linux and macOS (#453)
|
2 years ago |
Stephan Walter
|
69c92298a9
Deduplicate q4 quantization functions (#383)
|
2 years ago |
Georgi Gerganov
|
f5a77a629b
Introduce C-style API (#370)
|
2 years ago |
hoangmit
|
6eac39ba95
Add RMS norm and use it (#187)
|
2 years ago |
Georgi Gerganov
|
26c0846629
Initial release
|
2 years ago |