Vulkan Bugfixes and Improvements (#7084) · befddd0f15 - Git

Sfoglia il codice sorgente

Vulkan Bugfixes and Improvements (#7084)

* Modify mat mat mul shader for mul_mat_id, modify mat vec mul shaders for single call batch operation

* Further work towards MoE, disabled for now

* Disable MoE code (not ready yet), fix a number of bugs in shaders and Vulkan code

* Add softmax with f16 mask and pos buffer support

* Disable mul_mat_id shaders for now

* Fix flake8

* Fix validation errors caused by empty buffers on larger batch sizes

0cc4m 1 anno fa

parent

d46dbc76f8

commit

befddd0f15

3 ha cambiato i file con 2152 aggiunte e 1114 eliminazioni

Visualizzazione separata Mostra Diff Stats

				
					File diff suppressed because it is too large
					
						+ 733
						
						- 708
					
ggml-vulkan-shaders.hpp

				
					File diff suppressed because it is too large
					
						+ 901
						
						- 250
					
ggml-vulkan.cpp

				
					File diff suppressed because it is too large
					
						+ 518
						
						- 156
					
ggml_vk_generate_shaders.py