Sebastián A
|
2f700a2738
Add windows to the CI (#98)
|
2 years ago |
Georgi Gerganov
|
c09a9cfb06
CMake build in Release by default (#75)
|
2 years ago |
Georgi Gerganov
|
7ec903d3c1
Update contribution section, hot topics, limitations, etc.
|
2 years ago |
Georgi Gerganov
|
4497ad819c
Print system information
|
2 years ago |
Sebastián A
|
ed6849cc07
Initial support for CMake (#75)
|
2 years ago |
Thomas Klausner
|
41be0a3b3d
Add NetBSD support. (#90)
|
2 years ago |
Pavol Rusnak
|
671d5cac15
Use fprintf for diagnostic output (#48)
|
2 years ago |
Georgi Gerganov
|
84d9015c4a
Use vdotq_s32 to improve performance (#67)
|
2 years ago |
uint256_t
|
63fd76fbb0
Reduce model loading time (#43)
|
2 years ago |
Val Kharitonov
|
2a20f48efa
Fix UTF-8 handling (including colors) (#79)
|
2 years ago |
Pavol Rusnak
|
d1f224712d
Add quantize script for batch quantization (#92)
|
2 years ago |
Georgi Gerganov
|
1808ee0500
Add initial contribution guidelines
|
2 years ago |
Matvey Soloviev
|
a169bb889c
Gate signal support on being on a unixoid system. (#74)
|
2 years ago |
Matvey Soloviev
|
460c482540
Fix token count accounting
|
2 years ago |
Georgi Gerganov
|
c80e2a8f2a
Revert "10% performance boost on ARM"
|
2 years ago |
Georgi Gerganov
|
54a0e66ea0
Check for vdotq_s32 availability
|
2 years ago |
Georgi Gerganov
|
543c57e991
Ammend to previous commit - forgot to update non-QRDMX branch
|
2 years ago |
Georgi Gerganov
|
113a9e83eb
10% performance boost on ARM
|
2 years ago |
Matvey Soloviev
|
404fac0d62
Fix color getting reset before prompt output done (#65)
|
2 years ago |
Georgi Gerganov
|
1a0a74300f
Update README.md
|
2 years ago |
Matvey Soloviev
|
96ea727f47
Add interactive mode (#61)
|
2 years ago |
Marc Köhlbrugge
|
9661954835
Fix typo in README (#45)
|
2 years ago |
Ben Garney
|
f385f8dee8
Allow using prompt files (#59)
|
2 years ago |
beiller
|
02f0c6fe7f
Add back top_k (#56)
|
2 years ago |
Sebastián A
|
eb062bb012
Windows fixes (#31)
|
2 years ago |
Georgi Gerganov
|
7027a97837
Update README.md
|
2 years ago |
Georgi Gerganov
|
2d555e5b42
Add CI (#60)
|
2 years ago |
Georgi Gerganov
|
7c9e54e55e
Revert "weights_only" arg - this causing more trouble than help
|
2 years ago |
Oleksandr Nikitin
|
b9bd1d0141
python/pytorch compat notes (#44)
|
2 years ago |
beiller
|
129c7d1ea8
Add repetition penalty (#20)
|
2 years ago |