Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)DR
Posts
0
Comments
472
Joined
2 yr. ago

  • I'm with you that he doesn't strictly need a gpu, but if the price is right (free from old gaming PC, cheap from a friend's old gaming PC, cheap old workstation card, etc) I stand by that he probably wants one. A lot less fussy, a lot more capable, nad nvenc does better quality encoding at lower bitrates (and probably less power too if you take into account time spent encoding at full tilt.)

  • Generally power supplies are the most electrically efficient at 20-60% utilization, so there's no issue with over-provisioning power, other than the (generally minor) upfront extra cost, which might very well pay for itself in the first months/years of usage. I'll take a look and see what I can find on those sites.

    Edit: okay, trying to shop through google translate / currency calculator is actually aids so I'm gonna teach a man to fish instead. This is what I should have done from the start anyway.

    Power supply: Anything from a decent brand, at basically anything >450W. a 650W or 850W is totally fine if it's at a decent price. They only draw the power they need, they don't just constantly pull 850W if the downstream components aren't calling for it.

    CPU: 12400 is a fine cpu for what you're doing. You'll transcode at 720p no problem, 1080p maybe a single stream in real-time. I wouldn't bank on more than that. Only downsides here are the relatively shallow core counts if you ever expanded into other workloads. Without access to used xeon boards/cpus, it might be a reasonable choice though. What I would say is look for something older but with more cores/threads if you can. For example, a 10900 or even 10700k would probably be a better server cpu than a 12400.

    Memory: DDR4 platforms are a great way to save money, as long as you aren't planning on expanding to inferencing on cpu. Get as much as you can. 32-64gb of ddr4 should be dirt cheap, especially if you find a cheap motherboard with 4 memory sockets.

    Motherboard: If you want this thing to be versatile, you want 2x pci-e slots. Old gaming full-sized ATX boards are the way to go here. 1 slot for an HBA, 1 slot for a GPU, and that should be all you need. Bonus for as many open sata sockets as possible. 6-8 is pretty typical on 10th-12th gen gaming ATX boards.

    GPU: gpus will be much more efficient at transcoding than an igpu, especially from older intel CPUs. A 1050, 2060, 3050, basically anything from the 10-series onward has a decent nvenc encoder that would work well with plex/jellyfin. My goto is generally old workstation cards, I use a p620 myself and it handles a single 4k encode job no problem. I'm not sure if they're viably purchasable anywhere in your area, but I'd definitely look out for a P620, P1000, or T400. Great value in those cards.

    Drives/HBA: there are inexpensive LSI HBA cards to expand how many drives you can attach to a system if you need them, all you need is a spare pci-e slot and a place to physically mount the drives. The cheapest way to start here is to look for a motherboard with 4-6 sata slots and use those. Hardware raid is functionally dead these days in the real world, just use zfs or mdadm under linux to create an array with your desired level of resiliency/capacity.

    Once you've priced out what it would cost to buy all of this new, look for prebuilt gaming PCs and office PCs that might be able to be expanded to fit these requirements. Prices look kind of steep on those markets you listed, but I'm sure something exists if you look hard enough.

  • Permanently Deleted

    Jump
  • An example of this:

    Bitcoin mining started on cpus, then moved to gpus, and now exists on dedicated asics.

    A $200 GPU vs a $200 ASIC, the ASIC is going to be a faster sha256 calculator

    A $2000 GPU vs a $200 ASIC, the GPU is going to be a faster sha256 calculator

    A $200 GPU from today vs a $200 ASIC from 10 years ago vs a $200 CPU from today?... You get the idea.

    There's no way to know without specific details which will be faster. You could be running software encryption on a raspberry pi from 5 years ago or the drive could be running an encryption ASIC from 10 years ago, etc

  • Permanently Deleted

    Jump
  • The short answer is that: all other things being equal, it will always be faster and cheaper to do things dedicated in hardware. Comparing one implementation to another, however, is always going to be an "it depends"

  • Regular Ubuntu I get; it's specifically the separation in the list between core and the standard 24.04 distro that I don't get. I can't imagine that droves of nerds are installing straight Ubuntu Core unprompted. I'd absolutely buy though that some distro or some handheld is based on one.

  • Remote assistance is not rdp, it's Microsoft's support hook over the Internet, which requires telemetry to function. It is distinctly separate from, and not a prerequisite for RDP.

    The rest of that I'll have to look into, but disabling remote assistance seems sane in that context.

    I wonder if other parts of the shutdown dialog or hover context menu have phone home functions that can only be disabled in roundabout ways; it wouldn't be the first time. It would not surprise me to learn that the "which apps are preventing shutdown" dialog would be something that triggers a call to phone that data home.

  • It's almost certainly related to cloud-init, (the canonical tool for handling deployment automation) or Ubuntu pro (extra long support for backporting security packages to older distros, plus some conveniences). They're pre installed as a convenience to paid users of those services, that's the (IMHO, quite reasonable) model they use to fund the distro. I would expect that some or all of that traffic would disappear if you disable/remove those two services.

    https://cloud-init.io/

    https://ubuntu.com/pro

  • "simple majority" is a technical term in this context, it refers to any number >50%. In the context of the Senate, that'd be a 51/49 split, or a 50/50 split broken by the VP.

    There are some procedural measures that explicitly only require this simple majority to pass; most bills require a 60/40 in practice because that's the threshold required to bypass a procedural filibuster. They at the very least require a simple majority + 0 members of a body opting to invoke filibuster.

    Say what you will about the people we've currently elected; I just stand by it being a sound procedural practice.

  • Yes they were, so I'm offering you an actual theory as to why this may actually be true, yet difficult to "prove".

    Smoking was bad for your health long before anyone sat down and took the time to prove it. Autoregressive LLM tokenizer are a very new field of computer science and it's going to take a while for the community to collectively understand everything we're currently doing by trial and error.

  • I try to keep my commentary as apolitical as possible, so what I'll say is:

    If you believe that the current ticket is the Cthulhu/Lucifer ticket, imagine what they could accomplish if every bill only required a simple majority.

  • Anecdotally, I use it a lot and I feel like my responses are better when I'm polite. I have a couple of theories as to why.

    1. More tokens in the context window of your question, and a clear separator between ideas in a conversation make it easier for the inference tokenizer to recognize disparate ideas.
    2. Higher quality datasets contain american boomer/millennial notions of "politeness" and when responses are structured in kind, they're more likely to contain tokens from those higher quality datasets.

    I haven't mathematically proven any of this within the llama.cpp tokenizer, but I strongly suspect that I could at least prove a correlation between polite token input and dataset representation output tokens