ylai@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 10 months agoMistral CEO confirms ‘leak’ of new open source AI model nearing GPT-4 performanceventurebeat.comexternal-linkmessage-square8fedilinkarrow-up142arrow-down12cross-posted to: futurology@futurology.todayfosai@lemmy.world
arrow-up140arrow-down1external-linkMistral CEO confirms ‘leak’ of new open source AI model nearing GPT-4 performanceventurebeat.comylai@lemmy.ml to LocalLLaMA@sh.itjust.worksEnglish · 10 months agomessage-square8fedilinkcross-posted to: futurology@futurology.todayfosai@lemmy.world
minus-squareffhein@lemmy.worldlinkfedilinkEnglisharrow-up1·8 months agoGGUF q2_K works quite well IMO, I’ve run it with 12GB vram + 32GB ram
GGUF q2_K works quite well IMO, I’ve run it with 12GB vram + 32GB ram