marauding_gibberish142 @ marauding_gibberish142 @lemmy.dbzer0.com

Posts

16

Comments

399

Joined

4 mo. ago

Because it lets us disable Intel ME

I think Ollama supported ROCM especially with the older AMD cards?

I think pcpartpicker has different options to share with similar formatting that you could paste.

Why did you decide to change the motherboard? Is it because of Intel's issues with their chips? Wouldn't that problem be fixed with their microcode patch if you buy now?

I couldn't find a 9070XT at around MSRP anywhere, I wanted to use them in a combination with other GPUs for AI. Know where I can find some?

Funny how the desktop app doesn't work for me either

Thanks for the note OP. Which VPN providers are you looking at for public torrents?

Support for those phones will be nonexistent soon. I suggest you look at the Pixel 8 line

Any alternatives to Facebook for local buy nothing groups?

It's owned by a billionaire. I don't think enshittification is far away

I work on Linux and use Linux at home. I'll try to go through the problems you mentioned:

1. Just run the update command again in the GUI or terminal. If it doesn't work, we'll have to dig into apt with verbose logs but I haven't had apt break on me for over a decade unless I deleted something I shouldn't have.
2. Is Firefox installed as a snap/flatpak? That only happens with me occasionally when I installed flatpaks, they're just slower. Canonical can be a real arse about this stuff, they might switch packages to snaps without telling you and you might only come to know about it once you dig deeper.
3. All of these issues seem to related to your storage medium. Is the SSD OK? Open up the process monitor, sort by ascending order of disk writes/reads and open your applications one by one to see which one of them is the culprit.
4. Rebooting suddenly is not normal. Unfortunately, you'll have to go through logs for this one. Simple ones are dmesg and journalctl, we can dig deeper into them if you want to.

If I had my hands on your laptop I'd be running a vulnerability scan by now but I don't think the problem is serious enough to warrant it.

Sorry, I was wrong. I think I probably saw it in a blog post where they mentioned creating an AI search engine using SearXNG and Ollama. I don't see any mention of native Ollama integration in the SearXNG docs

Thanks man, I'll take a look

I see. Thanks

I agree with your assessment. I was indeed going to run k8s, just hadn't figured out what you told me. Thanks for that.

And yes, I realised that 10Gbe is just not enough for this stuff. But another commenter told me to look for used threadripper and EPYC boards (which are extremely expensive for me), which gave me the idea to look for older Intel CPU+Motherboard combos. Maybe I'll have some luck there. I was going to use Talos in a VM with all the GPUs passed through to it.

Specifically because PCIe slots go for a premium on motherboards and CPU architectures. If I didn't have to worry about PCIe I wouldn't care about a networked AI cluster. But yes, I accept what you say

Heavily quantized?

I think yes

I have no idea of how to do this but following

I think SearXNG already has AI integration. Not sure how it works though. I don't think that I would personally use AI for things other than summarising what I search but it is a useful feature to have