That's 128GB RAM, the GPU has 24GB VRAM. Ollama has gotten pretty smart with resource allocation. Smaller models can fit soley on my VRAM but I can still run larger models on RAM.
I've installed Ollama on my Gaming Rig (RTX4090 with 128GB ram), M3 MacBook Pro, and M2 MacBook Air. I'm running Open WebUI on my server which can connect to multiple Ollama instances. Open WebUI has it's own Ollama compatible API which I use for projects. I'll only boot up my gaming rig if I need to use larger models, otherwise the M3 MacBook Pro can handle most tasks.
I'm running a search instance on a VPS so my home IP isn't linked to my searches. The main disadvantage is that my VPS is in Toronto and I live 2hrs away so geo searches don't work very well. For instance, if I Google "restaurants" I get results for local restaurants whereas if I Gregle (I named my search engine Gregle) I get results for results near my VPS.
DM me if you want a link to my instance to check it out. It's open but I don't publicize it because bad actors could ruin my IP addresses reputation with spam queries via the API.
This is tough, the goal should be to reduce child abuse. It's unknown if AI generated CP will increase or reduce child abuse. It will likely encourage some individuals to abuse actual children while for others it may satisfy their urges so they don't abuse children. Like everything else AI, we won't know the real impact for many years.
My daily driver used to be a MacBook Air running Linux. Apple hardware is amazing, I don't give a shit about the logo on my laptop. I only switched to MacOS for a daily driver when I started working for a company that gave me a MacBook pro so I sold my Air which was just gathering dust.
I use Ubuntu on most of my servers and dual boot my gaming rig with Ubuntu Desktop mainly to host LLMs. I've been a Linux user for 25 years, I remember playing around with Red Hat pre 2000. Right now though, I want a solid distro that supports lots of hardware (my network consists of x86, ARM, Oracle Cloud, SBCs, etc), has a large community for support, and isn't likely to get abandoned. Ubuntu solves that
The neck beards that judge someone's distro choice without knowing their use cases don't represent the Linux community. Just use the best tool for the job
I'm an immigrant from Australia and I remember having to change my word choices even though Canada and Australia are nearly culturally identical. It must be a lot more work coming from less culturally similar places.
I work remote, live in Belleville, and visit our Toronto offices every couple of months. My experience with VIA Rail has been positive though I appreciate that I have a lot of flexibility. I can work while on the train so the commute isn't wasted time for me. Working while commuting is not something I could do if I drove or took a bus. The train can be late so I wouldn't organize an in-person-meeting within an hour of the scheduled arrival.
I agree that the ticketing system should be improved to encourage commuting, it would be a headache to buy tickets individually weeks in advance if I were using the service more frequently.
Renting a 3 bedroom house in Toronto is more expensive than a similar house in Belleville + $1500 in monthly VIA Rail tickets. Plus lots of jobs are partly remote which makes the equation even more appealing.
Greg Clarke @ Greg @lemmy.ca Posts 55Comments 671Joined 3 yr. ago
I'd step back at that launch