Wilshire@lemmy.world to Technology@lemmy.worldEnglish · 11 个月前The first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square61linkfedilinkarrow-up1215arrow-down117cross-posted to: tech@programming.dev
arrow-up1198arrow-down1external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comWilshire@lemmy.world to Technology@lemmy.worldEnglish · 11 个月前message-square61linkfedilinkcross-posted to: tech@programming.dev
minus-squaresunzu@kbin.runlinkfedilinkarrow-up3arrow-down1·11 个月前Did anyone get 70b to run locally? If so what, what hardware specs?
minus-squareDarkThoughts@fedia.iolinkfedilinkarrow-up5·11 个月前Afaik you need about 40GB of vram for a 70b model.
minus-squaresunzu@kbin.runlinkfedilinkarrow-up2·11 个月前I guess time to buy some ram after spending decade at 16gb
Did anyone get 70b to run locally?
If so what, what hardware specs?
Afaik you need about 40GB of vram for a 70b model.
Can’t you offload some of it to RAM?
Same requirements, but much slower.
I guess time to buy some ram after spending decade at 16gb