ffhein@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · 8 days agoAnyone found "optimal" settings for llama.cpp partial offload?plus-squaremessage-squaremessage-square3fedilinkarrow-up12arrow-down10
arrow-up12arrow-down1message-squareAnyone found "optimal" settings for llama.cpp partial offload?plus-squareffhein@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · 8 days agomessage-square3fedilink