OpenAI CEO Sam Altman recently revealed that including polite phrases when prompting AI systems costs the company tens of millions of dollars in additional electricity expenses. Every word we type is processed as part of a "token" — a unit of data that the AI system must analyse and respond to. The more tokens used, the more computing power and energy are required. Individually, the impact of a few extra words is trivial. But when scaled across millions of users each day, these additions significantly increase the workload on servers, resulting in higher energy consumption, greater carbon emissions, and substantial operational costs.
No comments:
Post a Comment