Researchers found some LLMs create four times the amount of CO2 emissions than other models with comparable accuracy. Their findings allow users to make informe
That’s a good question no one else seems to be asking. When you run local prompts, you’re using more battery on your laptop or power from your PSU, but both of those are limited by their relatively small power consumption (when compared to server farms). Therefore, it could be likened to encoding heavy video or exporting complex blender models. Are you using more electricity? Yes. Is it city-eroding amounts more? Not even close.
Does this also apply to AI models I run locally on my computer?
No they are magically free.
/s
That’s a good question no one else seems to be asking. When you run local prompts, you’re using more battery on your laptop or power from your PSU, but both of those are limited by their relatively small power consumption (when compared to server farms). Therefore, it could be likened to encoding heavy video or exporting complex blender models. Are you using more electricity? Yes. Is it city-eroding amounts more? Not even close.