Releases: foldl/chatllm.cpp
Releases · foldl/chatllm.cpp
v0.9
- as always, more models are supported;
- Windows: prebuilt binary with Vulkan. Use
-ngl all
to run whole model on default GPU.
Note: Vulkan Runtime (included in SDK 1.4.304.1) is needed. Download it form here: https://vulkan.lunarg.com/sdk/home#windows
v0.8
- as always, more models are supported;
- Windows: prebuilt binary with Vulkan. Use
-ngl all
to run whole model on default GPU.
Note: Vulkan Runtime (included in SDK 1.4.304.1) is needed. Download it form here: https://vulkan.lunarg.com/sdk/home#windows