Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)RO
Posts
14
Comments
86
Joined
3 yr. ago

LocalLLaMA @sh.itjust.works

New, promising MoE model "Hunyuan" by Tencent

  • Some people on another discussion platform were praising the new Mistral Small models for agentic use. I wasn't able to try them myself yet, but with 24b params you would certainly fit a quantized version in your 24GB.

  • Thanks for the tip about kobold, didn't know about that.

    And yeah, I can understand that building your own rig might feel overwhelming at first, but there's tons of information online that I'm sure will help you get there!

  • Thanks that looks cool, I'll definitely try and report back. Do you happen to know what the hardware requirements are? I have access 64GB of RAM and 48GB of VRAM across 3 RTX2000e Ada GPUs.

  • LocalLLaMA @sh.itjust.works

    Do you quantize models yourself?

  • It really depends on how much you enjoy to set things up for yourself and how much it hurts you to give up control over your data with managed solutions.

    If you want to do it yourself, I recommend taking a look at ZFS and its RAIDZ configurations, snapshots and replication capabilities. It's probably the most solid setup you will achieve, but possibly also a bit complicated to wrap your head around at first.

    But there are a ton of options as beautifully represented by all the comments.

  • Linux @lemmy.ml

    Well, that's offending

    Selfhosted @lemmy.world

    Any experience with Pangolin?

  • TuxedoOS because my so-called "Linux-Laptop" turned out to not run mainline Linux very smoothly. But I hate that fact that it's Ubuntu-based.

    I'd use Debian, Arch or dabble with Void if I could on my laptop, my servers run Debian or Alma.

  • Permanently Deleted

    Jump
  • I've been testing Zed for the last couple weeks for some Vue / Nuxt projects. It works great for that and seems very stable so far, but is also developed by a for-profit. Curious to see how the Zedless project works out.

  • I must say I'm not 100% happy with my InfinityBook Pro 14 Gen 9 AMD. The build quality has very much improved since the Gen 7 (which I daily-drove before), but it feels like Tuxedo's take on "Linux Laptop" is rather something like "Tuxedo-OS Laptop". On Fedora I had to tweak kernel params so my laptop doesn't wake up from sleep on its own and do the same to resolve an audio issue, and my RJ45 port just simply doesn't work even with their drivers.

    And something inside the device makes a quiet but annoying beep-like noise when the fans don't spin.

    Apart from that I love the device, but if you plan to use your own distro of choice and really want a high-quality build I'd not really recommend it.

  • I recently had to use a friend's old 4gb macbook for some weeks because my laptop was stolen. I was surprised how well everything worked, even when using a few web apps in firefox. I think with using zram and avoiding web / electron apps where possible, you might get quite something out of a 4gb machine.

  • Technology @lemmy.world

    More than 140 Kenya Facebook moderators diagnosed with severe PTSD

    Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ @lemmy.dbzer0.com

    Don't forget to ...

  • How on earth does this reach a 75% approval rate?

    I apologize for being rude, but these are bold claims with no sources whatsoever. I mean I can understand that it might be frustrating to be called paranoid over using Tor, and there certainly use cases or threat models where it makes sense to use Tor. But this post is either a full-on conspiracy theory or carefully crafted troll content.

  • Selfhosted @lemmy.world

    Chaining routers and GUA IPv6 addresses

    Lemmy Shitpost @lemmy.world

    USA to be renamed to XXX

    Mildly Infuriating @lemmy.world

    Modern online banking

    Selfhosted @lemmy.world

    Any of you have a self-hosted AI "hub"? (e.g. for LLM, stable-diffusion, ...)

    Funny @sh.itjust.works

    I wonder how much storage comes with this driving school

    Selfhosted @lemmy.world

    Migrated my self-hosted Nextcloud to AIO and I absolutely love it

    Asklemmy @lemmy.ml

    What is your experience with security USB sticks (such as Nitro- or Yubikeys)?

    Asklemmy @lemmy.ml

    What kind of spirituality/religion/faith do you find support in and why?