brucethemoose @ brucethemoose @lemmy.world

Posts

22

Comments

2,099

Joined

1 yr. ago

Mikupad is incredible:

https://github.com/lmg-anon/mikupad

I think my favorite feature is the 'logprobs' mouseover, aka showing the propability of each token that's generated. It's like a built-in thesaurus, a great way to dial in sampling, and you can regenerate from that point.

Once you learn how instruct formatting works (and how it auto inserts tags), it's easy to maintain some basic formatting yourself and question it about the story.

It's also fast. It can handle 128K context without being too laggy.

I'd recommend the llama.cpp server or TabbyAPI as backends (depending on the model and your setup), though you can use whatever you wish.

I'd recommend exui as well, but seeing how exllamav2 is being depreciated, probably not the best idea to use anymore... But another strong recommendation is kobold.cpp (which can use external APIs if you want).

Forza Motorsport

Yeah, it seems weird to me.

It looks like they have the framework for a more elaborate multiplayer/matchmaking system and... just didn't really use it?

I am not even touching FM now because the 10-minute races are so awful (and they got rid of all the 20 minute ones).

Yeah, Halo 3 wrote them into a corner.

Still, they could have creatively 'reset' the scope. Focus on a frontier story, a prequel, some kind of cataclysm, probably reset a lot of characters. Even if they lost the silent-chief 'feel' of the trilogy, the tone change would have been excused (like Reach to an extent).

Infinite tried this, I guess, but they hauled over too much baggage from previous games and lore.

Honestly, if I were in charge of Halo I'm not sure what I'd do now... As I'm sure 'make Halo Infinite multiplayer only, kill any semblance of story there, f that wierd stuff in the novels and start over with a narrower setting' would get shot down.

Sometimes there's a rock hard justification. Orbital mechanics is a great one. Game engines are literally not built for physics at celestial scales.

KSA's feature scope is way narrower than, say, a game with tons of NPCs and voxels and elaborate foilage and MMO-scale multiplayer and such. The DayZ guy and that studio are also pretty experienced at this point.

So yeah, I agree! And I'm glad KSA is seemingly progressing well, actually...

It's not so simple, there are papers on zero data 'self play' or other schemes for using other LLM's output.

Distillation is probably the only one you'd want for a pretrain, specifically.

Paraphrased by Wikipedia: https://en.wikipedia.org/wiki/2025_India%E2%80%93Pakistan_conflict#Analysis

[The Times] reported that India felt frustrated after Donald Trump public claims of mediating a cease-fire, presenting both countries as equals and downplaying the terrorist attack that triggered the conflict, and that India had hoped any U.S. involvement would remain discreet, and Trump's portrayal of both countries on equal terms was seen by Indian officials as politically sensitive and diplomatically frustrating...

On 21 June, Pakistan announced it would nominate Donald Trump for the Nobel Peace Prize, citing his role in brokering the ceasefire. Pakistan credited Trump's diplomatic intervention, though India denied any U.S. mediation.

Like it said, seems like India assumed the modest level of mediation would be confidential (clear miscalculus on their part), while Pakistan, err, trumped up the magnitude of the intervention to paint themselves in a better light, possibly because they're at a military disadvantage, and felt grateful for the help.

Seems like there was some backchannel involvement from many countries (like "Saudi Arabia, Iran, the UAE and the UK" and indeed the US), but Trump couldn't help himself and loudly claimed credit before the ceasefire was even announced.

Now India's annoyed (hence their flat denial).

I like this explanation, it 'fits' all the involved characters, including Trump blotting out the sun and killing any nuance to the situation.

...even after a major reboot of the game engine...

Custom engines claim another victim.

Game dev is hard. Game engines are apparently impossible and cost prohibitive these days, unless licensed out en masse. They're killing studios and franchises left and right.

Wasn't his involvement pretty minimal anyway?

https://www.news18.com/india/trump-wasnt-directly-involved-shashi-tharoor-on-india-pakistan-ceasefire-9394156.html

Or is that spin from India? Somewhere in between?

I elaborated below, but basically Musk has no idea WTF he’s talking about.

If I had his “f you” money, I’d at least try a diffusion or bitnet model (and open the weights for others to improve on), and probably 100 other papers I consider low hanging fruit, before this absolutely dumb boomer take.

He’s such an idiot know it all. It’s so painful whenever he ventures into a field you sorta know.

But he might just be shouting nonsense on Twitter while X employees actually do something different. Because if they take his orders verbatim they’re going to get crap models, even with all the stupid brute force they have.

There’s some nuance.

Using LLMs to augment data, especially for fine tuning (not training the base model), is a sound method. The Deepseek paper using, for instance, generated reasoning traces is famous for it.

Another is using LLMs to generate logprobs of text, and train not just on the text itself but on the *probability a frontier LLM sees in every ‘word.’ This is called distillation, though there’s some variation and complication. This is also great because it’s more power/time efficient. Look up Arcee models and their distillation training kit for more on this, and code to see how it works.

There are some papers on “self play” that can indeed help LLMs.

But yes, the “dumb” way, aka putting data into a text box and asking an LLM to correct it, is dumb and dumber, because:

• You introduce some combination of sampling errors and repetition/overused word issues, depending on the sampling settings. There’s no way around this with old autoregressive LLMs.
• You possibly pollute your dataset with “filler”
• In Musk's specific proposition, it doesn’t even fill knowledge gaps the old Grok has.

In other words, Musk has no idea WTF he’s talking about. It’s the most boomer, AI Bro, not techy ChatGPT user thing he could propose.

I dunno about extortion, but I’d buy bot/algo manipulation, yeah. That’s already what’s going on, in the open, and how Trump got elected.

A huge chunk of Americans enthusiastically support extensive warring with Iran (or will, soon). We are culpable.

Is it because so many of use glued to feeds and TV news? Yeah. But those are our products, and we basically elected Big Tech and Newscorp to the presidency, so... Yeah. It's not gonna be over in 3.5 years.

On the two subs I frequented:

• /r/thelastairbender is just cultish and shallow now. I abandoned it. But it's painful for me, as this is like the only sane place left the fandom has any critical mass. /c/thelastairbender is nice, but very quiet.
• /r/localllama Has... lost its intelligence? Like no one seems to experiment or talk technically anymore, good talk seems to be on github, or shattered across Discords, while the 'critical mass' is in the AI Bro black hole of Twitter and Linkedin. I read it, but never post anymore. localllama here is better, but smaller and downvoted to hell.

Also, I've been shadowbanned on like 4 accounts in 3 different IPs/machines, no explanation, no recourse. I never post anything political or even remotely provocative (unless links to Lemmy count) and only visit those two subs, so... Yeah, kinda sick of that.

Seriously though, has anyone had such an absolute grip on a US political party? Ever? George Washington had plenty of squabbling under him. Most dictators had more dissent.

Non-interventionism was an absolute core of MAGA; this would be like Hitler pronouncing "we love Jews!" and everyone lining up like ducks. And they are! /r/conservative is ecstatic...

I hate to sound preachy, but this is a good example of “rivals” peacefully meeting.

So many people I meet IRL seem conditioned to think this person they hate on the internet would be someone they’d shout at like they’re an axe murderer, in the middle of a murder. It’s the example they see. Death threats are, like, normal on Facebook or TV News or whatever they’re into, apparently.

Again at risk of reaching... this feels like positive masculinity to me.

And leaders acting like adults.

Welcome to Lemmy, heh.

Yes, and that was a cruel, stupid move on the US’s part.

…But even if cooperation continued, it still would have given Iran expertise. Further enrichment is not a huge step, especially behind the cover of real civilian power programs, and given the rhetoric the state broadcasts and their neighbor’s hostility, it seems likely.

And that’s fine IMO.

I’m hugely afraid of proliferation, but going to these lengths to worry about it while the rest of the world burns seems ridiculous.

To be fair, Iran wants a nuke down the line, and civilian uranium enrichment is a huge stepping stone. There’s lots of technical alternatives they could pursue if they really just want civilian power.

…And that’s kinda understandable. They have a neighbor that randomly bombs their civilians.

Fuck it, let them have one.

Heck, they should get a tiny bit of old Soviet+US stock in some kind of international deal, so they have credible deterrence with the guaranteed stability+security mechanisms (and oversight?) of their weapons.

(To be more specific, Cold War nukes typically have elaborate tiggers and failsafes meant to stop unauthorized parties from detonating them with any nuclear yield, and the old school Soviet and US systems are pretty good. Better for them to have that than an “insecure” home cooked design they waste money on, like the North Koreans allegedly have, IMO. On top of that, they’d have “known” detonation signatures, so if they ever go off everyone would know it’s Iran (defeating the fear of them “losing” a nuke to another party, or a false flag op against Iran)).

To expand on Shrubbery, you can read the Guardian’s editorial standards and the base ones they follow: https://image.guardian.co.uk/sys-files/Guardian/documents/2011/08/08/EditorialGuidelinesAug2011.pdf

according to people familiar with the…

In journalism, this is common lingo for “our journalists personally communicated with sources (more that one) that wish to remain anonymous.” It’s the guardian's legwork and integrity for shielding anon sources here, not them copying it from some other site (which they'd link if they did).

Exactly. Hence the importance of linking the original source…