KillingTimeItself @ KillingTimeItself @lemmy.dbzer0.com

Posts

0

Comments

4,358

Joined

2 yr. ago

It is for generated data, like a JSON API. Static content is often pre-compressed though, since there’s no reason to do that every request if it can be done once. Compression formats is largely limited to whatever the client supports, and gzip works pretty much everywhere, so it’s generally preferred.

yeah, if the page is dynamically generated, you would likely live compress it, but it would also be so little data that the cpu overhead would be pretty minimal, and you could still cache the compressed data if you tried hard enough. For something like steam where you're effectively shipping and unpacking a 50-200gb zip file, there's no reason not to statically compress it.

I’m not really sure how latency is related for FS operations. Are you saying if the CPU is lagging behind the read speed, it’ll mess up the stream? Or are you saying something else? I’m not an expert on filesystems.

it's important because the entire system is based on a filesystem, if you're doing regular calls to a drive, in high quantity latency is going to start being a bottleneck pretty quickly. Obviously it doesn't matter much on certain things, but after a certain point it can start being problematic. There's practically no chance of corruption or anything like that, unless you have a dysfunctional compression/decompression algorithm, but you would likely expect system performance to be noticeably slower in disk benchmarks specifically. Especially if you're running really fast drives like gen 4 NVME ssds. Ideally, it shouldn't be a huge thing, but it's something to consider if you care about it.

There are two primary things to consider when making a functional file system, one is atomicity, because you want to be able to write data, and be certain that it was written correctly (to prevent corruption) and you want to maximize performance. File IO is always one of the slowest forms of interaction, it's why you have ram, yes, and it's why your CPU has cache, but optimizing drive performance in software, is still free performance gains. That's an improvement that can make heavy read/write operations faster, more efficient, and more scalable. Which in the world of super fast modern NVMEs, is something we're all thankful for. If you remember the switch from spinning rust, to solid state storage for operating systems, you'll see a similar improvement. HDDs necessarily have really bad random IOPs performance, they literally physically find the data on the disk, and read it back, it's mechanically limited, this increases latency considerably. And SSDs don't have this problem, because they're a matrix of registers, so you can get MASSIVELY uplifted random IOPs performance from an SSD compared to a hdd. And that's still true today.

That honestly sounds like a good feature to request imo.

it would be a great feature, and considering i own like 10 games, and there are people out there who own like, 200, i'm honestly shocked this wasn't immediately included? I feel like this is such an obvious thing. i would be surprised if somebody hasn't already requested it.

Are you on the steam beta? I’ve generally had a better experience there.

no, i'm on stable, because i like my software to work, though maybe i should fuck around with my steam install sometime.

You could also try the low performance setting in steam. (steam settings > library > low performance mode)

i could, but im running a 1070 and a 5900x, im pretty sure it's not a hardware limitation. But i might mess with that later.

And the simplest solution to prevent this, is to simply not vote people who are a threat to your own country, into your own fucking government, nobody seems to understand this.

Literally all we had to do, was not ask for this. But unfortunately the entire US voting populous has the collective intelligence of a bag of rocks for some reason.

you can say this all you want, but this line of thinking is the exact reason why we're where we are today. People like you check out, and start voting for memes, or shitpost value, rather than actually fixing issues, and putting the government in a more respectable position, which leads to people like Lauren Boebert, and MTG being actual real people in the US congress.

I refuse to respect an institution that fails to acknowledge the sanctity of life, much less fulfills the needs of the people it governs.

and likewise, that government will fail to respect your wishes for a functional government that does anything at all. It's a tripping point, once you trip, you fall down the mountain, and it's really, and i mean really hard to get back up.

the government does not simply "betray us" we betrayed the government, by electing unqualified idiots to the electorate, who then fucked us over, unsurprisingly, because they're stupid.

ok fascinating question mr scientist, how do you sell products to people who don't know you exist.

That's literally the fundamental problem to solve here. If you want to argue for banning predatory advertising, sure, but you could also just install an ad blocker.

“if we increase minimum wages, X% of small businesses will fail.” I try to single out and avoid businesses that operate that way, because the workers are miserable from the low pay, me as the consumer is miserable from the poor customer service, and the owner is miserable because he isn’t taking home ‘enough’ money, even though the business is net positive cash flow.

in this case, the business fails, unless the business finds a way to pull in more total revenue, and pay their employees more, which gives them a better selection of employees, though it's generally true that for a small business the largest capital cost is labor. So being able to pay yourself, and other employees where possible, less money saves you a lot of recurring cost. Especially if you don't get consistent business.

Propping up the inefficient practices is holding everything back, if they’re pruned then new growth can take hold, and form new standards.

the problem here, is that you need a good model that indicates better complete performance of the new system, as opposed to the old system, nobody has an effective model economy for anything other than capitalism, because capitalism literally "just works" it has problems, sure, but you can fix them, or work on fixing them at least. A brand new economy may not be able to get off the ground in the first place, without failing completely.

also to be clear, in most cases "net positive cashflow" isn't a great spot to be in, what you want is consistent revenue high enough that you can pay off all of your expenses, consistently, i.e. "adjusted net positive cash flow"

Sure you can get net positive cashflow from paying everybody less, but you would be better served by paying them more. That would incentivize them to do a better job, and prevent you from paying tax on that.

the server isn't live compressing it, it's pre compressed binaries being shipped hundreds of thousands of times over, in most cases. Compression is primarily to minimize bandwidth (and also speed up downloads, since the network speed is usually the bottleneck) you can either cache the compressed files, or do a gated download, based on decompression speed.

Usually, most disks are faster than any network connection available, so it's pretty hard to hit that bottleneck these days. HDDs included, unless you're using SMR drives in a specific use case, and definitely not an SSD ever.

Although on the FS side, you would optimize for minimum latency, latency really fucks up a file system, that and corrupt data, so if you can ensure a minimal latency impact, as well as a reliable compression/decompression algorithm, you can get a decent trade off of some size optimization, for a bit of latency, and CPU time.

Whether or not fs based compression is good, i'm not quite sure yet, i'm bigger on de-duplication personally.

steam provides a lot of utility sure, that's why i even use it at all. But just because a shitty app provides a lot of utility doesn't make it a good app, if anything, the steam client is MVP, nothing more. Just barely good enough to ship to market.

an economy of whatever it currently does? I think you literally said it yourself, the handful of states are 30% the economy of the US total, the rest is still a thing, it's not going to disappear lmao. Idk how hard this is to understand.

The US primarily exports high value goods and services, tech for example, not food.

it's my understanding that on disk compression is different from networked compression, usually networked compression uses Gzip iirc, where as on disk tends to use something like LZ, file downloads are generally less important than a file system, so you can trivially get away with costly and expensive compression.

idk how bad the south is, i've never been around that area of the US, just don't know anybody down there, or really have a reason to go there anyway. But i don't think it's irreversible, i'm sure there are problematic areas, as there are in any area, but idk what the whole of it looks like.

yeah lmao

yeah but like, by that argument, burning wood is a violation of the bodily autonomy of other people.

Farting in a public space would be an equally problematic activity.

The biggest argument here is that it's "artificial" and "alters human comprehension" but i'm not really sure it would even matter, because ethically, you would have a hard time arguing against it.

Murder being illegal, is technically a violation of bodily autonomy, but we collectively agree as a society, that this should be the case, because the net effect of murder being illegal, is beneficial to society.

the worst possible case, is that it has a mortality rate, of like 0.001% or something, which would kill a lot of people, but would that even negatively impact the world? It's hard to say.

on a per game basis? Last i checked you could only enable it for all games, or no games. I don't want to manually skip compilations, i want to select a list of games that automatically compile shaders, i don't want beamng to compile 70gb of shaders because it got an update this week, unless i'm going to play it, but something i play more frequently like factorio, i would like for that to be a regular function.

I'm fairly sure it's driver related, but steam is built on electron, and chrome/firefox work perfectly fine, and so does discord electron, so my only guess is that nvidia driver gaming is happening. Or steam has the single most incompetent installation of electron across any software i use.

I have no idea why only steam would be affected. That just doesn't make any sense.

Electron has gpu suppport by default so it shouldn’t be laggy.

doesn't seem to matter whether it's enabled or not, it performs like shit, idk why. Again, firefox and chrome are fine, discord is fine (it still runs like shit, but it's discord, that's normal)

if it has no downsides, is it even against bodily autonomy?

This is like arguing you shouldn't sell farmed food in grocery stores, because it violates the bodily autonomy to starve and die in famine.

i think that institutions should be respected.

It's the number one problem in american politics right now, everything we are currently experiencing, is from people treating politics like a toy. Rather than an institution.

It's so incredibly hard to state how critically important it is for the functioning of society, that the structures running our society, are respected.

all business would fail.

that's definitely not in the range of like, super old cpus, but it's also not super fast either. Modern cpus should be like 20-30% faster i think, in single core, which is what compression uses.

Realistically compression should be as aggressive as possible, because it saves bandwidth, and it's basically a free resource,

i haven't because it's been a completely unusable buggy mess ever since i've installed it, and it transitioned to electron, routinely uses 1gb of ram, 2gb on bad days. That's 2 whole USD wasted, and that's the price of CHEAP ram.

Graphics just don't work, that might be an nvidia problem to be fair, menus are broken, buttons haven't worked, refactoring the UI seems to make it slower. Scrolling a literal single web page is practically unusable due to lag and stuttering. If you use proton, and auto shader compilation, it's useless because you can't even configure how you want it to be run. Don't want to compile 12gb of shaders for a game that's 200GB? That you play 2 times a year? Get fucked.

That's what im trying to figure out!