minus-squareAirBreather@lemmy.worldtoLocalLLaMA@sh.itjust.works•Anyone found "optimal" settings for llama.cpp partial offload?linkfedilinkEnglisharrow-up1·8 days agoThis comes up with some suggestions along those lines as part of its results: https://canirunthisllm.com/ linkfedilink
This comes up with some suggestions along those lines as part of its results: https://canirunthisllm.com/