查了下报错日志,这玩意大模型好像对显存大小有要求,只能晚上换家里电脑(显存12G)用NSWF资料试一下,还不行这sw就算完蛋了。
ggml_vulkan: Device memory allocation of size 1063751680 failed.ggml_vulkan: vk::Device::allocateMemory: ErrorOutOfDeviceMemoryfailed to allocate Vulkan0 buffer of size 1063751680exiting due to model loading errorllama-server 已退出(代码 1)