Georgi Gerganov
|
dcdd65e296
ggml : optimize ggml_vec_dot_q4_0_q8_0() using vectorized accumulators
|
2 år sedan |
slaren
|
315a95a4d3
Add LoRA support (#820)
|
2 år sedan |
Georgi Gerganov
|
69b740289f
ggml : avoid using ggml_fp16_to_fp32() and ggml_fp32_to_fp16() in ggml.c
|
2 år sedan |
Ivan Komarov
|
f266259ad9
Speedup the AVX-512 implementation of ggml_vec_dot_q4_0() (#933)
|
2 år sedan |
Stephan Walter
|
2f7c8e014e
Fix potential int8 overflow in non-SIMD vec_dot (#986)
|
2 år sedan |
Stephan Walter
|
0ad964631f
Refactor ggml.c for future tensor types (#1001)
|
2 år sedan |
Georgi Gerganov
|
e95b6554b4
ggml : add Q8_0 quantization for intermediate results (#951)
|
2 år sedan |
Georgi Gerganov
|
aa485cee33
ggml : use posix_memalign on non-Windows env
|
2 år sedan |
Pavol Rusnak
|
c56b715269
Expose type name from ggml (#970)
|
2 år sedan |
Kerfuffle
|
c9a59b70a5
ggml : add unary and binary map operations (#874)
|
2 år sedan |
Georgi Gerganov
|
1623a6e9b4
ggml : minor
|
2 år sedan |
Georgi Gerganov
|
c14e0d2f23
ggml : always allocate buffers with size multiple of GGML_MEM_ALIGN
|
2 år sedan |
Georgi Gerganov
|
0f07cacb05
ggml : fix q4_1 dot product types
|
2 år sedan |
Howard Su
|
c5d70f5c9e
ggml : optimize rope function to avoid call powf in the tight loop (#807)
|
2 år sedan |
Georgi Gerganov
|
a3a2a0eda8
ggml : add GGML_DEFAULT_N_THREADS
|
2 år sedan |
Georgi Gerganov
|
d990e3fffc
ggml : speed-up ggml_vec_dot_q4_1() ARM_NEON + 32-bit ARM support (#900)
|
2 år sedan |
Stephan Walter
|
6232f2d7fd
ggml : optimize non-SIMD Q4_0 vector dot product (#703)
|
2 år sedan |
Pavol Rusnak
|
6c248707f5
ggml : introduce GGML_ALIGNED_MALLOC/GGML_ALIGNED_FREE macros (#884)
|
2 år sedan |
Vladimir
|
8c3ffc2f04
ggml : update cblas_sgemm columns var to be more reasonable (#838)
|
2 år sedan |
Pavol Rusnak
|
8b679987cd
Fix whitespace, add .editorconfig, add GitHub workflow (#883)
|
2 år sedan |
Stephan Walter
|
3e6e70d8e8
Add enum llama_ftype, sync ggml_type to model files (#709)
|
2 år sedan |
comex
|
2663d2c678
Windows fixes (#890)
|
2 år sedan |
Georgi Gerganov
|
461ba9e66e
ggml : fix WASM build
|
2 år sedan |
Georgi Gerganov
|
c3ac702e5e
ggml : add ggml_cont() + optimize ggml_cpy() for contiguous dst
|
2 år sedan |
Georgi Gerganov
|
9d634ef452
ggml : remove trailing whitespaces
|
2 år sedan |
Marco Matthies
|
d9a239c410
Simplify to include lower-case windows.h always, fix compile on mingw32 (#747)
|
2 år sedan |
Georgi Gerganov
|
684da25926
ggml : fix quantize_row_q4_1() ARM_NEON (close #876)
|
2 år sedan |
comex
|
f963b63afa
Rewrite loading code to try to satisfy everyone:
|
2 år sedan |
unbounded
|
62cfc54f77
Add quantize-stats command for testing quantization (#728)
|
2 år sedan |
Georgi Gerganov
|
eeaa7b0492
ggml : multi-thread ggml_rope() (~3-4 times faster on M1) (#781)
|
2 år sedan |