WalnutLum @ WalnutLum @lemmy.ml

Posts

2

Comments

508

Joined

2 yr. ago

There are VERY FEW fully open LLMs. Most are the equivalent of source-available in licensing and at best, they're only partially open source because they provide you with the pretrained model.

To be fully open source they need to publish both the model and the training data. The importance is being "fully reproducible" in order to make the model trustworthy.

In that vein there's at least one project that's turning out great so far:

https://www.llm360.ai/

In all likelihood you wouldn't "hire" a dishwasher, you'd enter into a partnership with another partissier or an educational agreement with an apprentice.

Holy crap there are still working nitter instances? God bless

In my experience these open models is where the real work is being done. The large supervised models like DALL-E etc are more flashy but there's a lot more going on behind the scenes than the model itself so it feels like it's hard to gauge the real progress being done

Typically revolutions only occur when a significant number of elites defect from the current regime.

Large numbers of dissatisfied people need a Schelling Point to rally around and coordinate effectively.

Best bet for revolution right now seems to be for more elite colleges to start withholding degrees over this Israeli thing.

You could try Guix! It's ostensibly source based but you can use precompiled binaries as well (using the substitute system)

It's a source-first Functional package distro like Nix but uses Scheme to define everything from the packages to the way the init system (Shepherd) works.

It's very different from other distros but between being functional, source-first, and having shepherd, I personally love it

thinking about Werner Von Braun and the peenemunde Yea I'm not sure anyone has a leg to stand on when it comes to "stolen" technology and space

It's usually not the water itself but the energy used to "systemize" water from out-of-system sources

Pumping, pressurization, filtering, purifying all take additional energy.

The problem is notably "powerful", AIs need pretty significant hardware to run well

As an example the snapdragon NPUs I think can barely handle 7B models.

This is because all LLMs function primarily based on the token context you feed it.

The best way to use any LLM is to completely fill up it's history with relevant context, then ask your question.

Doesn't this just do what gets done through convolution anyway?

What's the point of this.

Ahhhh that makes a lot more sense, thanks!

I didn't realize you could run something like this on your phone

The project was using a way to bypass requiring a backing account to proxy the requests, but the API update broke that

The instances that chose (and choose) to go the extra mile by creating and maintaining proxy account(s) are the ones still working

If the instance gets too popular the twitter goons quickly figure out what the proxy account is and ban it, though. So it's a constant game of cat and mouse.

Seems like the thing I've always considered true: you can turn a mediocre game into a masterpiece with the right application of music.

Not that I'm saying Stardew is mediocre, but good music seems to uplift a game more than any other part.

This is a good move for international open source projects, with multiple lawsuits in multiple countries around the globe currently ongoing, the intellectual property nature of code made using AI isn't really secure enough to open yourself up to the liability.

I've done the same internally at our company. You're free to use whatever tool you want but if the tool you use spits out copyrighted code, and the law eventually has decided that model users instead of model trainers are liable for model output, then that's on you buddy.

Doing gods work here