Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)GA
Posts
9
Comments
615
Joined
2 yr. ago

  • If all you care about is response times, you can easily do that by just using a smaller model. The quality of responses will be poor though, and it's not feasible to self host a model like chatgpt on consumer hardware.

    For some quick math, a small Llama model is 7 billion parameters. Unquantized that's 4 bytes per parameter (32 bit floats), meaning it requires 28 billion bytes (28 gb) of memory. You can get that to fit in less memory with quantization, basically reducing quality for lower memory usage (use less than 32 bits per param, reducing both precision and memory usage)

    Inference performance will still vary a lot depending on your hardware, even if you manage to fit it all in VRAM. A 5090 will be faster than an iPhone, obviously.

    ... But with a model competitive with ChatGPT, like Deepseek R1 we're talking about 671 billion parameters. Even if you quantize down to a useless 1 bit per param, that'd be over 83gb of memory just to fit the model in memory (unquantized it's ~2.6TB). Running inference over that many parameters would require serious compute too, much more than a 5090 could handle. This gets into specialized high end architectures to achieve that performance, and it's not something a typical prosumer would be able to build (or afford).

    So the TL; DR is no

  • I switched to and exclusively used vim for about a year. I switched back to Sublime one day, and found I was like 10x more productive and comfortable.

    Just use the editor you like. There's no right or wrong answer!

    ... And btw, Sublime 4 has improved LSP support. Just install the base LSP plugin + plugins for the languages you want. Some even give the option to install the LSP server automatically if if's not detected.

  • I think this comment encapsulates the problem well: laymen who are not involved in the process in any way (on either side) acting like armchair experts and passing harsh judgement. You're making some very unfair assumptions based on age, and nothing about the actual technical arguments.

    This is why people like Martin feel justified going on social media to publicly complain, because they know they'll get a bunch of yesmen with no credible arguments to mindlessly harrass the developers they disagree with. It's childish and unproductive, and while I've personally respected Martin as a developer for a long time, I don't believe he's mature enough to be involved in the Rust for Linux effort (tbf, he's not the only Rust dev with this attitude). If the project fails, it will be because of this behavior, not because of the "old guys" being stubborn.

  • Two things can be true at once:

    • More Rust in the Linux kernel is good
    • Brigading on social media is bad

    Open source work is collborative. No matter how good an engineer someone is, if they can't figure out how work with others, then it's better to kick them out. A potentially insecure kernel is better than a non-existent one.

  • You're not engaging in any good faith arguing here. I made a good faith argument that your focus on the "illegal" label is arbitrary and pointless, and even invited a discussion on immigration in general, but instead you came back with some terrible takes and snark. I can't tell if you're a troll or a bot.

    Good thing all of you taught my why I was wrong.

    Is that why you came here? To have people teach you why you're wrong? Because if you already know you're wrong, why are you spending so much effort arguing against people telling you what you already know? It's Saturday dude, spend it with friends and family, not bitterly debating politics with strangers on the internet.

  • Good to know! I also hate illegal immigration, which is why, at least on this issue, I'm voting for democrats for the foreseeable future. The republican party is hell bent on increasing the amount of illegal immigrantion in this country, and I just can't support that. Of course, the dems would never go so far as to eliminate illegal immigration completely (by adopting open borders), but I'm confident they're at least more open to finding a middle ground that makes most people happy.

  • So you don't care about immigration, you only care about the "illegal" aspect of it? Does that mean you're pro-immigration reform, so that more people can immigrate to the US without "breaking laws"?

  • but I’m struggling to find a reason we shouldnt deport illegal immigrants.

    Are you specifically concerned about illegal immigration, or just immigration in general? Because if it's the former, that's a silly distinction because the government (we the people, aka Elon Musk) decides what is illegal or not. If the next wave of politicians decides we should have actually open borders, then there would be no such thing as "illegal immigration".

    I’m concerned that illegal immigrant labor is akin to H1b or prison labor, where the worker has diminished rights and is abused more than other groups.

    Do you have specific examples in mind where immigrants are exploited? If you do, look at those examples and ask yourself: "could we pass laws to protect these people from abuse?", and you'll find that the answer is obviously yes.

    Maybe your definition of "abuse" is that they need to work harder to earn less? Well, that's the society we live in. Capitalism has its problems, but it has worked good enough for us for the past 248 years. For the immigrant, US minimum wage is likely far better than whatever they received in their home country, and I suspect most would happily take that deal. I think that's what they'd call "the American dream", as their children will be able to go to school and have a better future than they did.

    ...If your issue is with immigration in general, then I don't know what to tell you. That's entirely opinion based, and nobody knows what the correct answer is (despite what they might claim). 100% open borders has risks, 100% closed borders has risks.

  • There's some politics involved. Basically, everyone is rallying behind JPEGXL instead of WebP, but Google refuses to support JPEGXL in Chrome. The reasoning they gave is weak, so it's assumed that they're just trying to force the format they invented on everyone because they can.

    IIRC, performance of the two formats is similar.

  • logic error on line 2: Beer == Germans

    Beer does not equate to Germans, rather Germans equate to Beer. If we fix that error, then it doesn't fit the original pattern:

    • Germans == Beer
    • Germans == Fascists

    That would only work if Beer == Fascists, which of course is not true.

    Also, wrong does not equal stupid, rather stupid equals wrong. Which is to say, you comment is wrong, but not necessarily stupid.

  • Using a phone that long is risky due to the lack of security updates, especially if you're using it for work. People not using phones longer is a problem, but the bigger issue is manufacturers killing support so quickly to force people into upgrading.

    I recently upgraded after 5 years on an iPhone because it reached the end of its support cycle. I considered another iPhone because 5 years of support is great, but really didn't feel like paying another $1000+ for what is essentially the same phone I was already using, just with a different body. So I went with a used Pixel 7 on ebay and installed GrapheneOS on it, and I'm very happy with it. I'm getting the same 5 years of support, a more secure OS, and I'm recycling at the same time!