schizoidman@lemm.ee to Technology@lemmy.worldEnglish · 16 days agoDeepSeek's distilled new R1 AI model can run on a single GPU | TechCrunchtechcrunch.comexternal-linkmessage-square22linkfedilinkarrow-up1177arrow-down118 cross-posted to: technology@lemmy.zip
arrow-up1159arrow-down1external-linkDeepSeek's distilled new R1 AI model can run on a single GPU | TechCrunchtechcrunch.comschizoidman@lemm.ee to Technology@lemmy.worldEnglish · 16 days agomessage-square22linkfedilink cross-posted to: technology@lemmy.zip
minus-squareLainTrain@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up7arrow-down1·15 days agoI’m genuinely curious what you do that a 7b model is “trash” to you? Like yeah sure a gippity now tends to beat out a mistral 7b but I’m pretty happy with my mistral most of the time if I ever even need ai at all.
I’m genuinely curious what you do that a 7b model is “trash” to you? Like yeah sure a gippity now tends to beat out a mistral 7b but I’m pretty happy with my mistral most of the time if I ever even need ai at all.