Zworf @ Zworf @beehaw.org

Posts

0

Comments

325

Joined

2 yr. ago

I didn't think it was super creepy but I thought the voice was so overly enthusiastic and overacted and soooo sugary. bleh.

This won't work for me unless that can be customised and toned down a lot.

The audio from the AI also seemed to cut out a lot during the demo. So it does appear like no shenanigans to me.

Wow... TIL there are actually people that believe North Korea is an amazing country.

It depends on your prompt/context size too. The more you have the more memory you need. Try to check the memory usage of your GPU with GPU-Z with different models and scenarios.

Hmmm weird. I have a 4090 / Ryzen 5800X3D and 64GB and it runs really well. Admittedly it's the 8B model because the intermediate sizes aren't out yet and 70B simply won't fly on a single GPU.

But it really screams. Much faster than I can read. PS: Ollama is just llama.cpp under the hood.

Edit: Ah, wait, I know what's going wrong here. The 22B parameter model is probably too big for your VRAM. Then it gets extremely slow yes.

Training your own will be very difficult. You will need to gather so much data to get a model that has basic language understanding.

What I would do (and am doing) is just taking something like llama3 or mistral and adding your own content using RAG techniques.

But fair play if you do manage to train a real model!

And the longer the time between episodes, the smaller the chance it would generate new sales because existing users lost interest.

True, but with that particular game what didn't help either was that there were many years between episodes, it was pretty awful. It's one thing I really hate about episodic gaming. But Valve already proved it to be a failure, only Telltale And Dontnod still do it (and they do it consistently right, to be fair).

The rest of the gaming industry has gone on to "Early access" which is even more awful. Rather than buying the first part of the story for a lower fee, you now pay top dollar for a game which isn't even finished and never might be because once you pay them there is no real incentive to actually finish it :)

But really, most categories of mobile games don't interest me. Arcade and other simple crap like angry birds never interested me even in the 80s. Adventures yes but they're few and far between on mobile and if they are they're almost always desktop ports anyway. FPS really really sucks on mobile for me, the input is just too crappy and the screens too small.

For me they have always sucked. The only one I liked a bit was "1112" (also known as Fade), BUT the developer actually cancelled the last episode because they didn't feel like making it anymore 🤬 So yeah it also sucked big time.

More details: https://www.reddit.com/r/adventuregames/comments/k3wc7b/the_history_of_1112_an_ambitious_adventure_game/

The problem with the ecosystems is that evolution can't adapt fast enough.

When it takes 500-5000 years for 1 degree rise, then yeah nature adapts pretty smoothly. When it's 50 years then things get really screwed.

Obligatory XKCD but I think this one explains the problem extremely well: https://xkcd.com/1732/

Yeah and another war would cause those policies to go on the backburner immediately. For example nobody in Ukraine cares about greenhouse emissions now, they are dashing their diesel tanks through the mud like there is no tomorrow. And in fairness, if they don't do that there may not be a tomorrow for them. So a lot of this depends on world stability. Which is pretty unlikely with the type of 'leaders' the world is seeing now IMO.

The actual article is not nearly as positive as the headline :)

As they mention reducing is key. But I think it's going to be really hard to do carbon capture at a scale that actually matters. It will require a lot of additional green power generation, and the material extraction for the capture machinery, the transportation, the maintenance etc will have to be low carbon as well, otherwise there is still no point.

And there is significant inertia in greenhouse production so the greenhouse effect would keep rising for a decade even if we were at zero now.

Yeah she clarified that literally, it's not linked in the article.

https://twitter.com/RealSexyCyborg/status/1677480809450835969

I can't find the source of her saying it was about the IME thing but I recall reading that from a person close to her. She had just raised it before all this happened. Edit: Oh wait, that's here: https://skepchick.org/2023/08/maker-naomi-wu-is-silenced-by-chinese-authorities-and-why-i-blame-elon-musk/ (This was linked on wikipedia)

And yes she's a great person, she was often criticised for being a CCP stooge but that was BS. She was as outspoken as one can be being in China (and unfortunately, clearly a bit more than that).

This is something that the amazing Naomi Wu brought up for years before, and was ordered to stop publishing by the local government. It was about the same thing. It's sometimes misrepresented as being about Signal, but her point was: There's no point in using a secure messaging app like Signal if your keyboard (IME) leaks everything you write! So she was making the exact same point as in this article.

I really miss her content. 😢

The LLMs for text are also based on "theft". They're just much better at hiding it because they have a multitude more source material. Still, it does sometimes happen that they quote a source article verbatim.

But yeah basically they're just really good copy/paste engines that work with statistical analysis to determine the most likely answer based on what's written in basically the whole internet :P It's a bit hard to explain sometimes to people who think that the AI really "thinks". I always say: If that were the case, why is the response to a really complicated question just as fast as a simple one? The wait is just based on the length of the output.

In terms of the "theft" I think it's similar ethically to google cache though.

A lot of translation and summarisation. ChatGPT is extremely good in absorbing a whole mix of comments in different languages and summarising them in English (or whatever other language).

For programming I don't use it so much anymore because it hallucinates too much, calling APIs that don't even exist. And when I lower the temperature the output is too sparse.

I'm also trying to build an assistant that can also communicate proactively (I intend to auto-prompt it when things happen and then evaluate if it should cause a message to me). But I need to get a local LLM going for that because running that through the ChatGPT API will be too costly.

Also, a replacement for some of my web searches. Sometimes I just want to know something and it's refreshing that it can give me an answer (even though it does need to be validated, it's much easier to do that when you know what you're looking for!)

Well in this case it's not really about the fact that they're Belgian. Because unlike China there is a big separation between state and corporation here. It's more the fact that it's only two private concerns which is hardly competition.

Also, due them being based abroad the local legislation has less grip on them. The exact country they're from is indeed less important as long as it can be considered friendly.

Media ownership by foreign countries is indeed a worry.

Even in Holland we have this problem: 90% of the media companies (newspapers, magazines, websites) are owned by only two Belgian mediaconcerns. This is not a smart thing to do. But we never hear about that here.

Not that there's an explicit problem at the moment but such a huge imbalance is not smart IMO.

Nah. Playstation is the biggest threat to the Xbox. They sell much more than the steam deck. And they know how to sell a console by selling good games and not making only deals with repetitive "AAA" studios that poop out one remaster after another.

But this, in fact, is what actual war looks like these days: Sometimes it’s a volley of 300 missiles and drones, and sometimes it is lean, targeted, and carried out covertly. Gone are the days of vast conquering armies and conventional military confrontations between two parties.

So, like what's happening in Ukraine right now?

I mean they use drones for some deep strikes causing minor damage but most of the actual advancement is made using artillery and boots on the ground.

Meh the amount of plastic is minimal and most pens are made from renewable materials these days (Polylactic Acid).

Personally I don't use pens much at all anymore so it never really happens that I empty one of ink. If I throw one out it is because it is all dried up.