- 1 Post
- 9 Comments
herseycokguzelolacak@lemmy.mlto Selfhosted@lemmy.world•What is a self-hosted small LLM actually good for (<= 3B)English1·1 小时前Not on top of my head, but there must be something. llama.cpp and vllm have basically solved the inference problem for LLMs. What you need is a RAG solution on top that also combines it with web search.
herseycokguzelolacak@lemmy.mlto Privacy@lemmy.ml•New US visa rules will force foreign students to unlock social media profiles7·1 小时前Wasn’t this always the case? I remember flying into the US during the Biden era as a tourist and had to declare my social media accounts.
herseycokguzelolacak@lemmy.mlto Selfhosted@lemmy.world•What is a self-hosted small LLM actually good for (<= 3B)English5·1 天前for coding tasks you need web search and RAG. It’s not the size of the model that matters, since even the largest models find solutions online.
herseycokguzelolacak@lemmy.mlto Not The Onion@lemmy.world•Marjorie Taylor Greene Says Americans 'Have Been Brainwashed' By Fox News, New York Post As She Opposes U.S. Entering Israel-Iran WarEnglish89·1 天前This is a ‘‘The worst person you know just made a great point.’’ moment, isn’t it?
herseycokguzelolacak@lemmy.mlto LocalLLaMA@sh.itjust.works•LLMs and their efficiency, can they really replace humans?English1·1 天前LLMs are great at automating tasks where we know the solution. And there are a lot of workflows that fall in this category. They are horrible at solving new problems, but that is not where the opportunity for LLMs is anyway.
herseycokguzelolacak@lemmy.mlto LocalLLaMA@sh.itjust.works•Current best local models for tool use?English1·1 天前For VLMs I love Moondream2. It’s a tiny model that packs a punch way above its size. Llama.cpp supports it.
herseycokguzelolacak@lemmy.mlto Not the Onion@lemmy.ml•[Video] Israeli does not understand why Iran attacked Israel completely unprovoked10·1 天前Israel is a terrorist entity.
herseycokguzelolacak@lemmy.mlto Palestine@lemmy.ml•Massive fire reported in Tel Aviv after Iron Dome missiles misfired and landed on nearby buildings setting them on fire.24·1 天前Iran has a right to defend itself from Israeli terrorism.
Swearing in source code points to a healthy and organic development.