Aman Gupta 6d758839ff Add LLaDA-7b-MoE diffusion model (#16003) 4 месяцев назад
..
CMakeLists.txt ab14019821 Support diffusion models: Add Dream 7B (#14644) 6 месяцев назад
README.md 8a4a856277 Add LLaDA 8b Diffusion model (#14771) 5 месяцев назад
diffusion-cli.cpp 6d758839ff Add LLaDA-7b-MoE diffusion model (#16003) 4 месяцев назад

README.md

Diffusion Text Generation

This directory contains implementations for Diffusion LLMs (DLLMs)

More Info:

Example of using Dream architechture: llama-diffusion-cli -m dream7b.gguf -p "write code to train MNIST in pytorch" -ub 512 --diffusion-eps 0.001 --diffusion-algorithm 3 --diffusion-steps 256 --diffusion-visual

Example of using LLaDA architechture: llama-diffusion-cli -m llada-8b.gguf -p "write code to train MNIST in pytorch" -ub 512 --diffusion-block-length 32 --diffusion-steps 256 --diffusion-visual