gogu@piefed.social to Artificial Intelligence@lemmy.worldEnglish · edit-26 days agoi just got another 10 tons of poloniummedia.piefed.socialimagemessage-square34linkfedilinkarrow-up1191arrow-down15file-text
arrow-up1186arrow-down1imagei just got another 10 tons of poloniummedia.piefed.socialgogu@piefed.social to Artificial Intelligence@lemmy.worldEnglish · edit-26 days agomessage-square34linkfedilinkfile-text
minus-squareMyNamesTotallyRobert@lemmynsfw.comlinkfedilinkEnglisharrow-up77·6 days agoSelf hosting FTW
minus-squarebulwark@lemmy.worldlinkfedilinkEnglisharrow-up12·6 days agoI also self host, but I use OpenWebUI as a front end and ollama as a backend. Which one is this?
minus-squareikidd@lemmy.worldMlinkfedilinkEnglisharrow-up7·edit-26 days agoLooks like Kobold. You can set it up as a shared LLM model server. Looks like Dark Champion model. Edit: https://huggingface.co/DavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF
minus-squareikidd@lemmy.worldMlinkfedilinkEnglisharrow-up10·6 days agoHuh, I tried that model in LMstudio and it’s quite tame. Just asks me what I want to do with it.
minus-squarerecklessengagement@lemmy.worldlinkfedilinkEnglisharrow-up4·6 days agoHahaha this is incredible. Can’t wait to try stuff like this once I get my hands on more VRAM
minus-squaremoody@lemmings.worldlinkfedilinkEnglisharrow-up15·6 days agoYeah, that’s the spirit, bro! VRAM in the butt = VRAM power!
minus-squaretrungulox@lemm.eelinkfedilinkEnglisharrow-up2·5 days agoThere’s no feeling quite like cumming with a bunch of vram inside of your urethra tho
Self hosting FTW
I also self host, but I use OpenWebUI as a front end and ollama as a backend. Which one is this?
Looks like Kobold. You can set it up as a shared LLM model server. Looks like Dark Champion model.
Edit: https://huggingface.co/DavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF
Huh, I tried that model in LMstudio and it’s quite tame. Just asks me what I want to do with it.
I’m dying. I love this so much.
Hahaha this is incredible. Can’t wait to try stuff like this once I get my hands on more VRAM
Yeah, that’s the spirit, bro! VRAM in the butt = VRAM power!
There’s no feeling quite like cumming with a bunch of vram inside of your urethra tho
Self hosted hype guy