While I agree that their comment didn’t add much to the discussion, it’s possible that you used more electricity to type out your response than it did for them to post theirs.
If @Empricorn@feddit.nl is on a desktop computer browsing the internet using electricity at a rate of ~150 W, and @TropicalDingdong@lemmy.world is on a smartphone, then you would only have ~16 seconds to type up a response before you begin using more electricity than they did.
I didn’t factor in mobile power usage as much in the equation before because it’s fairly negligible. However, I downloaded an app to track my phone’s energy use just for fun.
A mobile user browsing the fediverse would be using electricity around a rate of ~1 Watt (depends on the phone of course and if you’re using WiFi or LTE, etc.).
For a mobile user on WiFi:
In the 16 seconds that a desktop user has to burn through the energy to match those 2 prompts to chatGPT, that same mobile user would only use up ~0.00444 Wh.
Looking at it another way, a mobile user could browse the fediverse for 18min before they match the 0.3 Wh that a single prompt to ChatGPT would use.
For a mobile user on LTE:
With Voyager I was getting a rate of ~2 Watts.
With a browser I was getting a rate of ~4 Watts.
So to match the power for a single prompt to chatGPT you could browse the fediverse on Voyager for ~9 minutes, or using a browser for ~4.5 minutes.
I’m not sure how accurate this app is, and I didn’t test extensively to really nail down exact values, but those numbers sound about right.
Yeah, if you’re relying on them to be right about anything, you’re using it wrong.
A fine tuned model will go a lot further if you’re looking for something specific, but they mostly excel with summarizing text or brainstorming ideas.
For instance, if you’re a Dungeon Master in D&D and the group goes off script, you can quickly generate the back story of some random character that you didn’t expect the players to do a deep dive on.
While I agree that their comment didn’t add much to the discussion, it’s possible that you used more electricity to type out your response than it did for them to post theirs.
It’s estimated that a single ChatGPT prompt uses up ~0.3 Wh of electricity.
If @Empricorn@feddit.nl is on a desktop computer browsing the internet using electricity at a rate of ~150 W, and @TropicalDingdong@lemmy.world is on a smartphone, then you would only have ~16 seconds to type up a response before you begin using more electricity than they did.
Some math
150Wh/60min/60sec = 0.041666 Wh every second
Or about 2.5 Wh every minute.
Oooh, do mobile power usage next!
I didn’t factor in mobile power usage as much in the equation before because it’s fairly negligible. However, I downloaded an app to track my phone’s energy use just for fun.
A mobile user browsing the fediverse would be using electricity around a rate of ~1 Watt (depends on the phone of course and if you’re using WiFi or LTE, etc.).
For a mobile user on WiFi:
In the 16 seconds that a desktop user has to burn through the energy to match those 2 prompts to chatGPT, that same mobile user would only use up ~0.00444 Wh.
Looking at it another way, a mobile user could browse the fediverse for 18min before they match the 0.3 Wh that a single prompt to ChatGPT would use.
For a mobile user on LTE:
With Voyager I was getting a rate of ~2 Watts.
With a browser I was getting a rate of ~4 Watts.
So to match the power for a single prompt to chatGPT you could browse the fediverse on Voyager for ~9 minutes, or using a browser for ~4.5 minutes.
I’m not sure how accurate this app is, and I didn’t test extensively to really nail down exact values, but those numbers sound about right.
It’s not just about the environmental impact.
If you’re an expert in a specific field, you should interrogate these LLMs to see how accurate they actually are
When you see how fucking wrong they are about shit you have a firm grasp on, you will immediately stop trusting it regarding ANYTHING.
Yeah, if you’re relying on them to be right about anything, you’re using it wrong.
A fine tuned model will go a lot further if you’re looking for something specific, but they mostly excel with summarizing text or brainstorming ideas.
For instance, if you’re a Dungeon Master in D&D and the group goes off script, you can quickly generate the back story of some random character that you didn’t expect the players to do a deep dive on.
So one, I’m on solar, and I was on a thin and light laptop.
However, I was also running the electric kettle at the time for a nice cup of hater tears.
How much energy would the electric kettle take relative to a single push to a GPT?
Depends on the electric kettle, the first few I looked at on amazon run at ~600-800 Watts.
So, on the lower end there, you’re looking at about 0.166 Wh every second.
So a single push to chatGPT (0.3 Wh) uses about the same energy as an electric kettle does in less than 2 seconds.
so if it take 3 minutes to run the kettle, that would be around say…
150 or so calls to a GPT?
Yeah, ~100-133 depending on how much energy your electric kettle uses.