minus-squarebrokenlcd@feddit.ittoLinux@lemmy.world•AMD Announces "Instella" Fully Open-Source 3B Language ModelslinkfedilinkEnglisharrow-up3·13 hours agoThe problem is… How do we run it if rocm is still a mess for most of their gpus? Cpu time? linkfedilink
brokenlcd@feddit.it to LocalLLaMA@sh.itjust.worksEnglish · 2 months agounsure on how to quantize modelplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareunsure on how to quantize modelplus-squarebrokenlcd@feddit.it to LocalLLaMA@sh.itjust.worksEnglish · 2 months agomessage-square0fedilink
The problem is… How do we run it if rocm is still a mess for most of their gpus? Cpu time?