Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)RE
Posts
2
Comments
503
Joined
2 yr. ago

  • I do all my local LLM-ing on an M1 Max macbook pro with a power draw of around 40-60 Watts (which for my use cases is probably about 10 minutes a day in total). I definitely believe we can be more efficient running these models at home.

  • yes, 100%, do not use an LLM for anything you’re not prepared to vet and verify all of. The longer an LLM’s response the higher the odds it loses context and starts repeating or stating total gibberish or makes up data to keep going. If that’s what you want (like a list of fake addresses and phone numbers to prototype an app), great, but that’s about all it’s going to really do.

  • I know what you mean by your wording so I’m not jumping on that, but it’s worth noting that like, eating isn’t a luxury or something that smart people do or rich people or dumb people or whatever. If you have a grocery store in a town/country and it’s the only store (or the vast plurality of realistic options that are all owned by the same company with different faces), you basically don’t have a choice but to submit to this weird “math”, no matter how smart or dumb you are.

  • Yeah my MacBook is a workhorse, the kind of absurd one that actually does need to not be a tablet, but the MacBook Air and an iPad with a magic keyboard are only different in exceptionally arbitrary ways (and the iPad would be way more convenient with its touch screen, pencil support and modularity).

  • I use my iPad with a keyboard/touchpad as my primary fuck-around-the-house computer streaming my windows pc and MacBook, there’s obviously no reason an iPad couldn’t be running those OSes natively. That said I don’t really need for iPad os to be more in the way

  • Because they’re fucking terrible at designing tools to solve problems, they are obviously less and less good at pretending this is an omnitool that can do everything with perfect coherency (and if it isn’t working right it’s because you’re not believing or paying hard enough)

  • Voyager @lemmy.world

    To whomever put the additional margin in at the bottom of the page

    Asklemmy @lemmy.ml

    What's changed about Lemmy over the past year for you?