Consumer GPUs to run LLMs
marauding_gibberish142 @ marauding_gibberish142 @lemmy.dbzer0.com Posts 16Comments 399Joined 4 mo. ago
marauding_gibberish142 @ marauding_gibberish142 @lemmy.dbzer0.com
Posts
16
Comments
399
Joined
4 mo. ago
I don't mind multiple GPUs but my motherboard doesn't have 2+ electrically connected X16 slots. I could build a new homeserver (I've been thinking about it) but consumer platforms simply don't have the PCIE lanes for 2 actual x16 slots. I'd have to go back to Broadwell Xeons for that, which are really power hungry. Oh well, I don't think it matters considering how power hungry GPUs are now.