hendrik @ hendrik @palaver.p3x.de

A software developer and Linux nerd, living in Germany. I'm usually a chill

---

Read more

Posts

8

Comments

1,860

Joined

4 yr. ago

Out of curiosity: What's a reason to delete all the content? I don't want to imply you shouldn't be able to do so... But I often find it very annoying when people delete large quantities of stuff. Because that also deletes the comments I made, which took me time to write. It deletes my bookmarks. And sometimes people wipe their history regularly, which removes technical questions along with the correct answers and other material that might prove useful to other people, if it weren't deleted... And I had things that I'd have liked to return to, vanish into thin air multiple times now.

I'd like to understand the perspectives and two sides of that coin. And since you say you'd like to delete content, I thought I'd ask about your perspective and the why...

I've always been looking for an all-in-one mailserver with a few added features like mailing lists and something like AnonAddy (anonymous mail forwarding). Sadly there doesn't seem anything like that out there. So I have to configure postfix and dovecot myself. Or make ends meet with a bit more basic features.

Maybe try McDonald's workers for further research, if it's the constant and annoying beeping of machines. Or any Japanese store where you get 3 songs blaring at the same time from different aisles, then there's some offering on a seperate stand, of course also blinking and begging for attention with additional sounds... I believe you can simulate 10 years of UK longterm exposure with a one day trip to Japan.

I've tried enabling Vulkan on my Intel laptop without a dedicated GPU. But that just makes everything slower.
Did you try running it on the CPU only (BLAS)? Or run it just on the faster and more modern GPUs and see what they do, to compare the numbers to some sort of baseline? Or old GPU only, without more modern ones in the mix? I mean I don't really see the point here. Your computer must be splitting everything up and doing most of the compute somewhere else, if you attach a graphics card with only 1GB of VRAM and the model needs about 8GB. And I'm not sure if the added complexity just makes it slower, or whether it adds something to it. And I'm not sure if I'm missing something or if the output doesn't even show how it gets split up, and what gets executed on which GPU.

Hmm, maybe your setup is just too different from what the masses use. If you scroll through the comments on ProtonDB, you'll find most people with a Intel GPU (like you) are also reporting issues. At least in the more recent comments. And the System Requirements on the Steam page for MacOS say something about unsupported Intel Macs. So I'd say it's probably some issue with Intel GPUs. And since the majority of people use other GPUs, you'll get an overall score that doesn't match your situation. You can filter reviews on ProtonDB btw.

Wear a mask. Or a helmet.

Uh, really depends on the type of book, what kind of noise it is, and how concentrated I am. I don't think I can do it early in the morning or after a long day. I have some amount of tolerance when my brain is still well off. But there's certainly a limit. And it's different on each train. The people who commute to and from work are often considerate. But once I'm directly in between a group of people who talk to each other, I put away my book and switch to music, or doom-scrolling on my phone. But I've read quite some things at various places and on the train. So it can't be too hard for me.

Most backup software allow you to configure backup retention. I think I went with some pretty standard once per day for a week. After that they get deleted, and it keeps just one per week of the older ones, for one or two months. And after that it's down to monthly snapshots. I think that aligns well with what I need. Sometimes I find out something broke the day before yesterday. But I don't think I ever needed a backup from exactly the 12th of December or something like that. So I'm fine if they get more sparse after some time. And I don't need full backups more than necessary. An incremental backup will do unless there's some technical reason to do full ones.

But it entirely depends on the use-case. Maybe for a server or stuff you work on, you don't want to lose more than a day. While it can be perfectly alright to back up a laptop once a week. Especially if you save your documents in the cloud anyway. Or you're busy during the week and just mess with your server configuration on weekends. In that case you might be alright with taking a snapshot on fridays. Idk.

(And there are incremental backups, full backups, filesystem snapshots. On a desktop you could just use something like time machine... You can do different filesystems at different intervals...)

Seems it means all together. (5600MT/s / 1000) x 2 sticks simultaneously x 64bit / 8bits/Byte = 89.6 GB/s

or 2933/1000 x 4 x 64bit / 8 = 93.9 GB/s

so they calculated with double the DDR bus width in the one example, and 4 times the bus width in the other one. That means dual or quad channel is already factored in in those numbers. And yes, the old one seems to be slightly better than the new one. At least regarding memory throughput. I suppose everything else has been improved on. And you need to put in 4 correct RAM sticks to make use of it in the first place.

Well, the numbers I find on google are: a Nvidia 4090 can transfer 1008 GB/s. And a i9 does something like 90 GB/s. So you'd expect the CPU to be roughly 11 times slower than that GPU at fetching an enormous amount of numbers from memory.

I think if you double the amount of DDR channels for your CPU, and if that also meant your transfer rate would double to 180 GB/s, you'd just be roughly 6 times slower than the 4090. I'm not sure if it works exactly like that. But I'd guess so. And there doesn't seem to be a recent i9 with quad channel. So you're stuck with a small fraction of the speed of a GPU if you're set on an i9. That's why I mentioned AMD Epyc or Apple processors. Those have a way higher memory throughput.

And a larger model also means more numbers to transfer. So if you now also use your larger memory to use a 70B parameter model instead of an 12B parameter model (or whatever fits on a GPU), your tokens will now come in at a 65th of the speed in the end. Or phrased differently: you don't wait 6 seconds, but 6 and a half minutes.

AI inference is memory-bound. So, memory bus width is the main bottleneck. I also do AI on an (old) CPU, but the CPU itself is mainly idle and waiting for the memory. I'd say it'll likely be very slow, like waiting 10 minutes for a longer answer. I believe all the AI people use Apple silicon because of the unified memory and it's bus width. Or some CPU with multiple memory channels. The CPU speed doesn't really matter, you could choose a way slower one, because the actual multiplications aren't what slows it down. But you seem to be doing the opposite, get a very fast processor with just 2 memory channels.

I'd say this is the correct answer. If you're actually using that much RAM, you probably want it connected to the processor with a wide (fast) bus. I rarely see people do it with desktop or gaming processors. It might be useful for some edge-cases, but usually you want an Epyc processor or something like that, or it's way too much RAM that isn't connected fast enough.

In my experience, idle power consumption mainly depends on the mainboard used. The processors all(?) clock down to some more or less energy-efficient level. But the specific design of the mainboard and the components on it could double or half energy consumption.

In my experience, all the 3 big ones work just fine. Caddy, Traefik, Nginx. I use Nginx.

I think a lot comes down to usage. It just depends whether you connect 1 camera to Frigate, or 6. And if you enable some AI features. Whether you download a lot of TV series or a few and delete old stuff. Or use ZFS or other demanding things. I personally like to keep the amount of servers low. So I probably wouldn't buy server 2 and try to run those services on 1 as well. I'm not sure. You did a good job seperating the stuff. And I think you got some good advice already. I'd add more harddisks, 6TB wouldn't do it for me. And some space for backups. But you can always keep an eye on actual resource usage and just buy RAM and harddisks as needed. As long as your servers have some slots left for future upgrades. But I think you already got way more servers and RAM than you'd need. I probably run half of those services on a smaller server.

I think Kling AI offers more free credits. And they're kind of the market leader right now. But their subscription is expensive, too.

I think Germany is alright. I mean, feel free to ask any specific questions. There are a decent amount of German people here on Lemmy.

You'll certainly learn a lot of things if you're moving far away, and it'll be quite an adventure... And I suppose there are cultural differences, a slightly different mentality towards things... And I think we sometimes struggle with different problems than America. We also have a good amount of our own problems, but it'll be different ones.

Other than that, I found countries usually turn out to be different than someone would think just from reading the news. For the better or worse... But usually for the better 😆

Sure. I think being honest is a solid choice, generally speaking. There is some etiquette. If you're way too direct, you might be perceived as a creep. But you certainly have to do something, or it won't lead anywhere.

Telling people you want to stay in contact, or you think they're attractive, or you like their outfit, or whatever people do for flirting seems to be alright. Some people crack jokes and try to be funny, or interesting... Whatever floats your boat. I think the one important thing is to read the room. See if they're comfortable. And if they enjoy talking to you, or if you've just cornered them and are monologuing. Most (not all) people can do that. And I'd say as long as everyone is comfortable, it's the right thing. I mean you have to send some signals for them to know what's up with you. So yeah, that kind of directness might be helpful. And after that, spending time together (and not just in a larger group) is a signal, too, in my opinion.

I don't think there is any general, correct way of doing it. It just depends on the situation, on who you are, and especially what the other person likes.

I don't know why everyone else here says "No." Maybe it's down to preference. I usually like people not just for their outer appearance, but to a greater degree for their intelligence, wits, humor, similar perspective on life... And it just takes time to talk about all of that. So, I rather keep it down with being suggestive and just let things play out. Took me a long time. But everyone is different.

I'm not sure if I have a good definition of flirting. I'm more a problem-oriented person. I do whatever gets the job done. If I want to meet someone again, I just tell them that, as you said. And I usually don't have any ulterior motives. And I'm currently not in the dating game, so I'm pretty much relaxed on parties and social events in that regard. But I think I've always gone to social events to have fun, and not so much to do dating.

It depends a bit on who your target audience is. I think it's usually a good idea to roughly be how you are and not play some role. But I'm not a dating expert, so I might be wrong.

I'd say yes. That'd be a clear sign. And bordering on what I'd call flirting. If you say "Hey, I really enjoyed that conversation, let's meet for a coffee some day, how can I text you?"

It'd say it's polite and does the job. And there's no need to be super explicit, unless you want to initiate a one-night-stand.