ramblinguy @ ramblinguy @sh.itjust.works

Posts

0

Comments

81

Joined

2 yr. ago

What happened? I'm assuming you're speaking from personal experience?

They also banned me for using a modded third party app, so now I can't post or interact on Reddit. Which is honestly perfectly fine with me, since I don't want it support the website by creating content for it anyways

Sorry, just seeing this now- I think with 24gb of vram, the most you can get is a 4bit quantized 30b model, and even then, I think you'd have to limit it to 2-3k of context. Here's a chart for size comparisons: https://postimg.cc/4mxcM3kX

By comparison, with 24gb of vram, I only use half of that to create a batch of 8 768x576 photos. I also sub to mage.space, and I'm pretty sure they're able to handle all of their volume on an A100 and A10G

Nvidia just has been the dominant player in workstation GPUs for so long that it's almost impossible to see AMD catching up. The hardware is one thing, but I don't see AMD closing the gap even if they had a GPU that could perform as well as Nvidia's. Just look at some of the benchmarks on stuff like blender and unreal engine. And that's not to mention all of the work that's gone on for optimizing ML and deep learning models for CUDA.

I won't pretend like I'm any sort of expert on GPUs, but I feel that Intel and AMD need to team up to create some standard software implementation for AI/ML, and then support it instead of just relying on open source (like with Pytorch and ROCm)

So now you have an ex-Twitter account. Or an X account for short.

Maybe Elon was truly 200 IQ with his naming

Am idiot, still use Instacart though because it saves me at least an hour a week (probably closer to two hours after accounting for shopping time and getting ready to leave) for $20, which is worth it to me

I can tell you from experience, there is nothing more distracting than having your manager walk up behind you and tap you on the shoulder while you're working on code. While this problem doesn't go away completely with remote work, at least you have time to compose yourself and bookmark your work before you respond

I have access to Financial Times, and this is what they showed in their article

I use All Debrid, and I can't even connect to the download servers when I turn on Mullvad

Maybe it should be called Doomer Shooter instead

I wish I did this... Diablo 4 has been such a disappointment. The story was pretty mid and the gameplay loop post MSQ is just not as fun as D3. Also, I played 5 hours this season and I was still only like level 20 or something, because of all the stuff I had to do again with waypoints, side quests for renown, and season journey in order to progress the seasonal quest. I just stopped. Kinda regretting getting the ultimate edition now

Generative art is actually much easier to run than LLMs. You can get really high resolutions on SDXL (1024x1024) using only 8gb of Vram (although it'd be slow). There's no way you can get anything but the smallest of text generative models into that same amount of VRAM.

For real, I have not gotten sick since I started working from home. I did get COVID once going to a company sponsored event with 1000 people, but I call that "going into the office". Other than that, it's been pretty nice being healthy every day

Maybe they store the punch card info locally and don't double check with any databases on their side? It sounds really dumb, but that's the only reason I can think of

You can also do the same with a custom collection on Firefox Nightly: https://blog.mozilla.org/addons/2020/09/29/expanded-extension-support-in-firefox-for-android-nightly/

Yeah I use it, but only as a rubber duckie. I never put in code unless I understand what it's doing, and most of the time I'm just using it as a sounding board. Since it never returns the right code on the first try anyways haha

Yeah I order from Instacart from a Costco like 30 minutes away, so I always feel bad and tip well.

I think it's mostly Indian phones that have this problem due to the cheaper materials? Or maybe I'm completely making this up- I just remember reading about it on the OnePlus subreddit

Yeah but I want to know just how fucked I am when I sign it

I really wonder if there's a way to use LLMs just to point out every concerning thing in a EULA/TOS