AtHeartEngineer @ AtHeartEngineer @lemmy.world

Aspiring polymath. Applied R&D @ Privacy and Scaling Explorations #make

---

Read more

Posts

5

Comments

301

Joined

2 yr. ago

This would have been helpful 10+ years ago

Idk why you are getting down voted, what you are saying is also how I largely understand things. Props to you for following through on replied.

What??? Libertarians are almost all against income tax, they are literally stating it's necessity to the current system. Even if you don't believe them your statement makes no sense.

Let's do it

Integrity of the model, inputs, and outputs, but with the potential to hide either the inputs or the model and maintain verifiability.

Definitely not reasoning, that's a whole can of worms.

Zk in this context allows someone to be able to thoroughly test a model and publish the results with proof that the same model was used.

Blockchain for zk-ml is actually a great use case for 2 reasons:

1. it's a public immutable database where people can commit to the hash of some model they want to hide.
2. It allows someone with a "model" (that doesn't have to be a neural net, it could be some statistical computation) and verifier to do work for others for a fee. Let's say I have a huge data set of property values/data for some given area, and I'm a real estate agent, and I want to have other people run some crazy computation on it to predict which houses will likely sell first in the next 30 days. I could post this challenge online with the data, other people could run models against that data and post their results (but not how they got them) on chain. In 30 days the real estate agent could publish the updated data and reward the best performer, and potentially "buy" their model. You could do this with a centralized service, but they would likely take a fee, keep things proprietary, and likely try to make some shady back room deals. This removes the middleman.

Ahh, ya, so this is a deep rabbit hole but I will try to explain best I can.

Zero knowledge is a cryptographic way of proving that some computation was done correctly. This allows you to "hide" some inputs if you want.

In the context of the "ezkl" library, this allows someone to train a model and publicly commit to it by posting a hash of the model somewhere, and someone else can run inference on that model, and what comes out is the hash of the model and the output of the inference along with a cryptographic "proof" that anyone can verify that the computation was indeed done with that model and the result was correct, but the person running the inference could hide the input.

Or let's say you have a competition for whoever can train the best classifier for some specific task. I could train a model and when I run it the test set inputs could be public, and I could "hide" the model but the zk computation would still reveal the hash of the model. So let's say I won this competition, I could at the end reveal the model that I tried, and anyone would be able to check that the model I revealed and the model that was ran that beat everyone else was in fact the same model.

The model that is doing the inference is committed to before hand (it's hashed) so you can't lie about what model produced the inference. That is how ezkl, the underlying library, works.

I know a lot of people in this cryptography space, and there are definitely scammers across the general "crypto space", but in the actual cryptography space most people are driven by curiosity or ideology.

Most of the people that I know that make decent money don't use the service, but the people that work at restaurants or do gig work occasionally do... I don't understand

I agree. I switched from Roku to apple tv recently (and I don't really have apple devices), and it was worth it.

Try endeavoros, it's an opinionated arch with a simple installer

OPM also houses all the clearance applications and associated investigation paperwork. Great..

Every python library that does any real work is optimized to hell. The amount of power any ML training takes has nothing to do with python. You could write it all in assembly and I doubt you would gain more than 0.01% more efficiency and it would be way more difficult to develop and test new methods, and it would be way more error prone and likely waste more energy because of that.

SLA is also a mess

Same, I've got a modded 2080ti with 22gb of vram running deepseek 32b and it's great... But it's an old card, and with it being modded idk what the life expectancy is.

If AMD was smart they would release an upper-mid range card with like 40+ gb of vram. Doesn't event have to be their high end card, people wanting to do local/self serve AI stuff would swarm on those.

The code is open source, people look at the code, I've dug through their code a fair bit. It wouldnt be quiet, and it would take major code rewrites, it would be pretty obvious

Accurate. And if you are being targeted by 5 eyes, your phone is probably fucked, one app vs another probably won't make a difference

I was thinking the same. Next year it'll be measured in milliseconds

It's that advertising money... Ads should be heavily regulated and taxed