Yoshi Suhara 2a24c8caa6 Add Nemotron/Minitron GGUF Conversion & Inference Support (#8922) 1 år sedan
..
__init__.py 672a6f1018 convert-*.py: GGUF Naming Convention Refactor and Metadata Override Refactor (#7499) 1 år sedan
constants.py 2a24c8caa6 Add Nemotron/Minitron GGUF Conversion & Inference Support (#8922) 1 år sedan
gguf.py 34b0a08207 gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981) 2 år sedan
gguf_reader.py 3fd62a6b1c py : type-check all Python scripts with Pyright (#8341) 1 år sedan
gguf_writer.py d3f0c7166a Stop the generation when <|eom_id|> token is encountered - needed for Llama 3.1 tool call support (#8858) 1 år sedan
lazy.py 3a14e00366 gguf-py : simplify support for quant types (#8838) 1 år sedan
metadata.py 1e6f6554aa server : add lora hotswap endpoint (WIP) (#8857) 1 år sedan
py.typed dc07dc492e convert : various script cleanups/fixes + merges and special token handling (#2842) 2 år sedan
quants.py 4134999e01 gguf-py : Numpy dequantization for most types (#8939) 1 år sedan
tensor_mapping.py 2a24c8caa6 Add Nemotron/Minitron GGUF Conversion & Inference Support (#8922) 1 år sedan
utility.py 328884f421 gguf-py : fix some metadata name extraction edge cases (#8591) 1 år sedan
vocab.py 9c4c9cc83f Move convert.py to examples/convert-legacy-llama.py (#7430) 1 år sedan