Skip to content

Commit

Permalink
Vulkan Embedding Fix (#7360)
Browse files Browse the repository at this point in the history 
* Fix empty Vulkan host buffers

Add fp32 fp16 matmul shader

Fix matmul shader alignment

* Remove deprecated tensor->backend uses

* Fix Vulkan validation errors on embedding models with no offloaded layers

* Fix Vulkan llava segfault when not offloading layers
  • Loading branch information
@0cc4m
0cc4m authored May 19, 2024
1 parent e4e6f67 commit f030ec1
Show file tree
Hide file tree
Showing 3 changed files with 8,874 additions and 5,271 deletions.
Loading

0 comments on commit f030ec1

Please sign in to comment.