h3ndrik @ h3ndrik @feddit.de

Posts

3

Comments

469

Joined

2 yr. ago

If you rent a VPS, you're having a legally binding contract with whatever company you choose. Read that contract/agreement! It will contain information like if they snoop at your data, if you allow them to rat you out to somebody else or what is allowed and what isn't allowed and consequences if either party does something wrong. You won't find that specific information in US law or some general answer that applies to every provider.

If they say in their TOS: 'we will ban you if you do X' and you agree to that and then do X, they'll probably ban you... if they say something else in their TOS, then something else will happen. this is how contracts work.

However, i'm not sure if US law provides citizens with something like privacy. In other jurisdictions, it is forbidden to just scan through all your customer's data to see if you can find something incriminating. At least on the level of pirating some movies.

And the FBI might have real criminals to arrest. I'm not sure if they're actively looking for peanuts like one person who runs JDownloader. Unless you point them right at it. YMMV

KoboldCpp has documentation on the github page. Maybe just google for other guides if the documentation doesn't do it for you.

My advice is: Do one step at a time. Get it running first, without fancy stuff. Start with a small model and without gpu acceleration. Then get the acceleration/CUDA working. Then try with a bigger model. And then you can do the elaborate stuff like having some layers in VRAM and others in RAM and blowing up the context size past 2048/default. Don't do it all at once. That way you might figure out your problem and at which of the steps it happens.

(Edit: And make sure to always use the latest version. You're playing with pretty recent stuff that still might have bugs.)

I can't say much about the windows stuff or the state of the integration layers in oobabooga's.

Hate american legislative / politics instead? Don't hate the player, hate the game?

You're right. e2ee is a good thing.

Dude, chill. This isn't how that works. While a server that consumes as much as a few mordern lightbulbs will almost always be something like energy efficient if it does any kind of real work.... This simply isn't the case when we're talking about half a kilowatt. And you don't say my pc has X components and consumes Y amount of power, therefore it's efficient. You measure that against the job it's doing.

It's like with a big truck and fuel efficency. It would be very inefficient to buy a big truck only to drive your daughter to school. But the same big truck might be very efficient at hauling large quantities of stuff through the country. The same applies to your setup. Good for you, for owning a CPU, memory and so on. I too have a few generations old Xeon, ECC ram and hard disks. This doesn't tell me anything about efficiency without knowing what you DO with all of that energy. Hence my (implied) question...

But you're right. I wasn't paying close attention to the diagram. It is 220W - 320W for their rack/stuff and 450W when they also start up their pc.

KoboldCPP works with and without GPU. And is quite easy to install and use. I'd recommend something like that for a beginner.

wow. unless you're doing lots of compute / AI stuff /crypto or have multiple servers or a big amount of spinning storage, i bet your 450W is far from 'efficient' without 'sacrifices'. You can have one decent cpu with a few cores, one or two spinning hdd and one or two ethernet NICs idling at 20W to 40W. probably also including a few VMs with light usage.

Ah okay. Makes sense. Didn't know that. And New Zealand has cheap electricity because of big hydroelectric plants and geothermal energy? Or is that a political decision like it is subsidized by the government by taking little taxes on energy?

Well, i think i saw several posts about this topic popping up in the last few days. And posts questioning things like this one. I'm not sure. I think this is fearmongering. Other services know even more about you and they even harvest and analyze this kind of data actively... I bet your Facebook-friends also know who you are. So what's the point? True. We need GDPR compliance and to save as little data as possible. But if you want something anonymous: Install Tor or anything suited for that task. Don't write blog posts and spread FUD about this platform. (Or do it, but then don't be a hypocrite and also write about what reddit/google/twitter/amazon do with your ip and browser fingerprint)

Yeah. You can forget the .deb packages. They need dependencies and c libraries and stuff. After 2-5 years it becomes difficult and then impossible to install. You might be better off with some package format like flatpak. Or maybe better yet: the plain executable. probably with statically linked libraries. I think that should work for quite a while.

There are programs out there that come in a single executable file without requirements. they're supposed to run from an usb stick and without installation. I think you should try those. they should be pretty self contained.

Other than that... I second the question. Why do you want something like an ancient operating system combined with a brand new browser? The OS will have hundreds of security issues. And in case someone does something like plug in a recent usb stick to save some files, it won't recognize the format because exfat or something wasn't yet invented in 2007.

Well.... I just wanted to say you're supposed to distro-hop when you're young. I wasn't trying to imply you should (ever) stop. I think - generally - people are supposed to settle at about 30. Some keep being rebels, though.

I approve of the y-axis label. But everything else is kinda missing... Like the information what's depicted on the diagram. Cost of production? Price for a end-user? pre- or after tax? which country? and why did someone paint in 5 different colors? It certainly doesn't match what i'm paying.

I think at your age you're supposed to distro-hop. Catch 'em all. Try another one every two to six weeks. I know several people who did it like this ;-) But your mileage may vary.... I like debian.