I’m pretty sure that every user of Apple Intelligence could’ve told you that. If AI is good at anything, it isn’t things that require nuance and factual accuracy.
I recently had one chatbot refuse to answer a couple of questions, and another delete my question after warning me that my question was verging on breaking its rules… never happened before, thought it was interesting.
That’s why I avoid them like the plague. I’ve even changed almost every platform I’m using to get away from the AI-pocalypse.
I can’t stand the corporate double think.
Despite the mountains of evidence that AI is not capable of something even basic as reading an article and telling you what is about it’s still apparently going to replace humans. How do they come to that conclusion?
The world won’t be destroyed by AI, It will be destroyed by idiot venture capitalist types who reckon that AI is the next big thing. Fire everyone, replace it all with AI; then nothing will work and nobody will be able to buy anything because nobody has a job.
Que global economic collapse.
It’s a race, and bullshitting brings venture capital and therefore an advantage.
99.9% of AI companies will go belly up when Investors start asking for results.
ShockedPikachu.svg
BBC is probably salty the AI is able to insert the word Israel alongside a negative term in the headline
Some examples of inaccuracies found by the BBC included:
Gemini incorrectly said the NHS did not recommend vaping as an aid to quit smoking
ChatGPT and Copilot said Rishi Sunak and Nicola Sturgeon were still in office even after they had left
Perplexity misquoted BBC News in a story about the Middle East, saying Iran initially showed “restraint” and described Israel’s actions as “aggressive”
But every techbro on the planet told me it’s exactly what LLMs are good at. What the hell!? /s
Not only techbros though. Most of my friends are not into computers but they all think AI is magical and will change the whole world for the better. I always ask “how can a blackbox that throws up random crap and runs on the computers of big companies out of the country would change anything?” They don’t know what to say but they still believe something will happen and a program can magically become sentient. Sometimes they can be fucking dumb but I still love them.
the more you know what you are doing the less impressed you are by ai. calling people that trust ai idiots is not a good start to a conversation though
It’s not like they’re flat earthers they are not conspiracy theorists. They have been told by the media, businesses, and every goddamn YouTuber that AI is the future.
I don’t think they are idiots I just think they are being lied to and are a bit gullible. But it’s not worth having the argument with them, AI is going to fail on its own it doesn’t matter what they think.
I just tried it on deepseek it did it fine and gave the source for everything it mentioned as well.
Do you mean you rigorously went through a hundred articles, asking DeepSeek to summarise them and then got relevant experts in the subject of the articles to rate the quality of answers? Could you tell us what percentage of the summaries that were found to introduce errors then? Literally 0?
Or do you mean that you tried having DeepSeek summarise a couple of articles, didn’t see anything obviously problematic, and figured it is doing fine? Replacing rigorous research and journalism by humans with a couple of quick AI prompts, which is the core of the issue that the article is getting at. Because if so, please reconsider how you evaluate (or trust others’ evaluations of) information tools which might help or help destroy democracy.
Now ask it whether Taiwan is a country.
That depends on if you ask the online app (which will cut you off or give you a CCP sanctioned answer) or run it locally (which seems to give a normal answer)
I learned that AI chat bots aren’t necessarily trustworthy in everything. In fact, if you aren’t taking their shit with a grain of salt, you’re doing something very wrong.
Treat LLMs like a super knowledgeable, enthusiastic, arrogant, unimaginative intern.
I noticed that. When I ask it about things that I am knowledgeable about or simply wish to troubleshoot I often find myself having to correct it. This does make me hestitant to follow the instructions given on something I DON’T know much about.
Oh yes. The LLM will lie to you, confidently.
Super knowledgeable but with patchy knowledge, so they’ll confidently say something that practically everyone else in the company knows is flat out wrong.
This is my personal take. As long as you’re careful and thoughtful whenever using them, they can be extremely useful.
Could you tell me what you use it for because I legitimately don’t understand what I’m supposed to find helpful about the thing.
We all got sent an email at work a couple of weeks back telling everyone that they want ideas for a meeting next month about how we can incorporate AI into the business. I’m heading IT, so I’m supposed to be able to come up with some kind of answer and yet I have nothing. Even putting aside the fact that it probably doesn’t work as advertised, I still can’t really think of a use for it.
The main problem is it won’t be able to operate our ancient and convoluted ticketing system, so it can’t actually help.
Everyone I’ve ever spoken to has said that they use it for DMing or story prompts. All very nice but not really useful.
I am a creative writer (as in, I write stories and stuff) or at least I used to be. Sometimes when talking to chatGPT about ideas for writing it can be interesting, but other times it is kinda annoying since I am more into fine tuning instead of having it innudate me with ideas that I don’t find particularly interesting.
Great for turning complex into simple.
Bad for turning simple into complex.
I think my largest gripe with it is it can’t actually do anything. It can just tell you about stuff.
I can ask it how to change the desktop background on my computer and it will 100% be able to tell me, but if you then prompt it to change the background itself it won’t be able to. It has zero ability to interact with the computer, this is even the case with AI run locally.
It can’t move the mouse around it can’t send keyboard commands.
Um… yea? It’s not supposed to? Let’s ignore how dangerous and foolish it would be to allow llm’s admin control of a system. The thing that prevents it from doing that is well, the llm has no mechanism to do that. The best it could do is ask you to open a command line and give you some code to put in. Its kinda like asking siri to preheat your oven. It didn’t have access to your ovens system.
You COULD get a digital only stove, and the llm could be changed to give it to reach out side itself, but its not there yet, and with how much siri miss interprets things, there would be a lot more fires
Extremely?
You don’t say.
But the BBC is increasingly unable to accurately report the news, so this finding is no real surprise.
Why do you say that? I have had no reason to doubt their reporting
It’s a “how the mighty have fallen” kind of thing. They are well into the click-bait farm mentality now - have been for a while.
It’s present on the news sites, but far worse on things where they know they steer opinion and discourse. They used to ensure political parties has coverage inline with their support, but for like 10 years prior to Brexit, they gave Farage and his Jackasses hugely disproportionate coverage - like 20X more than their base. This was at a time when SNP were doing very well and were frequently seen less than the UK independence party. And I don’t recall a single instance of it being pointed out that 10 years of poor interactions with Europe may have been at least partially fuelled by Nidge being our MEP and never turning up. Hell we had veto rights and he was on the fisheries commission. All that shit about fisherman was a problem he made.
Current reporting is heavily spun and they definitely aren’t the worst in the world, but the are also definitely not the bastion of unbiased news I grew up with.
Until relatively recently you could see the deterioration by flipping to the world service, but that’s fallen into line now.
If you have the time to follow independent journalists the problem becomes clearer, if not, look at output from parody news sites - it’s telling that Private Eye and Newsthump manage the criticism that the BBC can’t seem to get too
Go look at the bylinetimes.com front page, grab a random story and compare coverage with the BBC. One of these is crowd funded reporters and the other a national news site with great funding and legal obligations to report in the public interest.
I don’t hate them, they just need to be better.
Look at their reporting of the Employment Tribunal for the nurse from Five who was sacked for abusing a doctor. They refused to correctly gender the doctor correctly in every article to a point where the lack of any pronoun other than the sacked transphobe referring to her with “him”. They also very much paint it like it is Dr Upton on trial and not Ms Peggie.
Turns out, spitting out words when you don’t know what anything means or what “means” means is bad, mmmmkay.
It got journalists who were relevant experts in the subject of the article to rate the quality of answers from the AI assistants.
It found 51% of all AI answers to questions about the news were judged to have significant issues of some form.
Additionally, 19% of AI answers which cited BBC content introduced factual errors, such as incorrect factual statements, numbers and dates.
Introduced factual errors
Yeah that’s . . . that’s bad. As in, not good. As in - it will never be good. With a lot of work and grinding it might be “okay enough” for some tasks some day. That’ll be another 200 Billion please.
that’s the core problem though, isn’t it. They are just predictive text machines, not understanding what they are saying. Yet we are treating them as if they were some amazing solution to all our problems
Well, “we” arent’ but there’s a hype machine in operation bigger than anything in history because a few tech bros think they’re going to rule the world.
I’ll be here begging for a miserable 1 million to invest in some freaking trains and bicycle paths. Thanks.
It found 51% of all AI answers to questions about the news were judged to have significant issues of some form.
How good are the human answers? I mean, I expect that an AI’s error rate is currently higher than an “expert” in their field.
But I’d guess the AI is quite a bit better than, say, the average Republican.
I guess you don’t get the issue. You give the AI some text to summarize the key points. The AI gives you wrong info in a percentage of those summaries.
There’s no point in comparing this to a human, since this is usually something done for automation, that is, to work for a lot of people or a large quantity of articles. At best you can compare it to other automated summaries that existed before LLMs, which might not have all the info, but won’t make up random facts that aren’t in the article.
I’m more interested in the technology itself, rather than its current application.
I feel like I am watching a toddler taking her first steps; wondering what she will eventually accomplish in her lifetime. But the loudest voices aren’t cheering her on: they’re sitting in their recliners, smugly claiming she’s useless. She can’t even participate in a marathon, let alone compete with actual athletes!
Basically, the best AIs currently have college-level mastery of language, and the reasoning skills of children. They are already far more capable and productive than anti-vaxxers, or our current president.
It’s not the people that simply decided to hate on AI, it was the sensationalist media hyping it up so much to the point of scaring people: “it’ll take all your jobs”, or companies shoving it down our throats by putting it in every product even when it gets in the way of the actual functionality people want to use. Even my company “forces” us all to use X prompts every week as a sign of being “productive”. Literally every IT consultancy in my country has a ChatGPT wrapper that they’re trying to sell and they think they’re different because of it. The result couldn’t be different, when something gets too much exposure it also gets a lot of hate, especially when it is forced down on people.
alternatively: 49% had no significant issues and 81% had no factual errors, it’s not perfect but it’s cheap quick and easy.
Flip a coin every time you read an article whether you get quick and easy significant issues
It’s easy, it’s quick, and it’s free: pouring river water in your socks.
Fortunately, there are other possible criteria.If it doesn’t work then quick cheap and easy I’d pointless.
I’ll make you dinner every night for free but one night a week it will make you ill. Maybe a little maybe a lot.
Do you dislike ai?
I don’t necessarily dislike “AI” but I reserve the right to be derisive about inappropriate use, which seems to be pretty much every use.
Using AI to find pertoglyphs in Peru was cool. Reviewing medical scans is pretty great. Everything else is shit.
I work in tech and can confirm the the vast majority of engineers “dislike ai” and are disillusioned with AI tools. Even ones that work on AI/ML tools. It’s fewer and fewer people the higher up the pay scale you go.
There isn’t a single complex coding problem an AI can solve. If you don’t understand something and it helps you write it I’ll close the MR and delete your code since it’s worthless. You have to understand what you write. I do not care if it works. You have to understand every line.
“But I use it just fine and I’m an…”
Then you’re not an engineer and you shouldn’t have a job. You lack the intelligence, dedication and knowledge needed to be one. You are detriment to your team and company.
That’s some weird gatekeeping. Why stop there? Whoever is using a linter is obviously too stupid to write clean code right off the bat. Syntax highlighting is for noobs.
I full-heartedly dislike people that think they need to define some arcane rules how a task is achieved instead of just looking at the output.
Accept that you probably already have merged code that was generated by AI and it’s totally fine as long as tests are passing and it fits the architecture.
“I can calculate powers with decimal values in the exponent and if you can not do that on paper but instead use these machines, your calculations are worthless and you are not an engineer”
You seem to fail to see that this new tool has unique strengths. As the other guy said, it is just like people ranting about Wikipedia. Absurd.
You can also just have an application designed to do that do it more accurately.
If you can’t do that you’re not an engineer. If you don’t recommend that you’re not an engineer.
Is it worse than the current system of editors making shitty click bait titles?
Surprisingly, yes
News station finds that AI is unable to perform the job of a news station
🤔
As always, never rely on llms for anything factual. They’re only good with things which have a massive acceptance for error, such as entertainment (eg rpgs)
I tried using it to spit ball ideas for my DMing. I was running a campaign set in a real life location known for a specific thing. Even if I told it to not include that thing, it would still shoe horn it in random spots. It quickly became absolutely useless once I didn’t need that thing included
Sorry for being vague, I just didn’t want to post my home town on here
You can say Space Needle. We get it.
The issue for RPGs is that they have such “small” context windows, and a big point of RPGs is that anything could be important, investigated, or just come up later
Although, similar to how deepseek uses two stages (“how would you solve this problem”, then “solve this problem following this train of thought”), you could have an input of recent conversations and a private/unseen “notebook” which is modified/appended to based on recent events, but that would need a whole new model to be done properly which likely wouldn’t be profitable short term, although I imagine the same infrastructure could be used for any LLM usage where fine details over a long period are more important than specific wording, including factual things
The problem is that the “train of the thought” is also hallucinations. It might make the model better with more compute but it’s diminishing rewards.
Rpg can use the llms because they’re not critical. If the llm spews out nonsense you don’t like, you just ask to redo, because it’s all subjective.
Or at least as an assistant on a field your an expert in. Love using it for boilerplate at work (tech).
Nonsense, I use it a ton for science and engineering, it saves me SO much time!
Do you blindly trust the output or is it just a convenience and you can spot when there’s something wrong? Because I really hope you don’t rely on it.
How could I blindly trust anything in this context?
Y’know, a lot of the hate against AI seems to mirror the hate against Wikipedia, search engines, the internet, and even computers in the past.
Do you just blindly believe whatever it tells you?
It’s not absolutely perfect, so it’s useless.
It’s all just garbage information!
This is terrible for jobs, society, and the environment!
You know what… now that you say it, it really is just like the anti-Wikipedia stuff.
In which case you probably aren’t saving time. Checking bullshit is usually harder and longer to just research shit yourself. Or should be, if you do due diligence
Its nice that you inform people that they cant tell if something is saving them time or not without knowing what their job is or how they are using a tool.
If they think AI is working for them then he can. If you think AI is an effective tool for any profession you are a clown. If my son’s preschool teacher used it to make a lesson plan she would be incompetent. If a plumber asked what kind of wrench he needed he would be kicked out of my house. If an engineer of one of my teams uses it to write code he gets fired.
AI “works” because you’re asking questions you don’t know and it’s just putting words together so they make sense without regard to accuracy. It’s a hard limit of “AI” that we’ve hit. It won’t get better in our lifetimes.
Anyone blindly saying a tool is ineffective for every situation that exists in the world is a tool themselves.
Idk guys. I think the headline is misleading. I had an AI chatbot summarize the article and it says AI chatbots are really, really good at summarizing articles. In fact it pinky promised.
But AI is the wave of the future! The hot, NEW thing that everyone wants! ** furious jerking off motion **
