cm0002@lemmy.world to Technology@lemmy.worldEnglish · 9 hours agoPeople are using Super Mario to benchmark AI nowtechcrunch.comexternal-linkmessage-square17fedilinkarrow-up151arrow-down15
arrow-up146arrow-down1external-linkPeople are using Super Mario to benchmark AI nowtechcrunch.comcm0002@lemmy.world to Technology@lemmy.worldEnglish · 9 hours agomessage-square17fedilink
minus-squarecatloaf@lemm.eelinkfedilinkEnglisharrow-up12·7 hours agoNo, human language. Well, they’ve also been used for code, but that’s still designed for humans. I doubt you could use something off the shelf for binaries.
minus-squarehendrik@palaver.p3x.delinkfedilinkEnglisharrow-up2·4 hours agoAnd with machine code, you got to keep track of what’s in the stack, CPU registers, … to make a sense of what the code and the next branch command does. It’s completely unalike processing human language. LLMs aren’t really set up to do it.
No, human language.
Well, they’ve also been used for code, but that’s still designed for humans. I doubt you could use something off the shelf for binaries.
And with machine code, you got to keep track of what’s in the stack, CPU registers, … to make a sense of what the code and the next branch command does. It’s completely unalike processing human language. LLMs aren’t really set up to do it.