Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)UB
Posts
0
Comments
72
Joined
2 yr. ago

  • The real power consumption cost is from the model training. The marginal cost of running a query is small. Unless you use LLMs heavily, you probably use more power in many other ways, like if you forget to put your computer to sleep.

    More training means better models, generally. If you want to minimize that, look for smaller models on HuggingFace that are more tightly focused on whatever task you have at hand.

    Or, you could just do most of your queries when your local electricity mix has more renewables.