Is there anything actually useful or novel about "AI"?

I don't think the comparison with crypto is fair.

People are actually using these models in their daily lives.

Senior developer here. It is hard to overstate just how useful AI has been for me.

It's like having a junior programmer on standby that I can send small tasks to--and just like the junior developer I have to review it and send it back with a clarification or comment about something that needs to be corrected. The difference is instead of making a ticket for a junior dev and waiting 3 days for it to come back, just to need corrections and wait another 3 days--I get it back in seconds.

Like most things, it's not as bad as some people say, and it's not the miracle others say.

This current generation was such a leap forward from previous AI's in terms of usefulness, that I think a lot of people were looking to the future with that current rate of gains--which can be scary. But it turns out that's not what happened. We got a big leap and now are back at a plateau again. Which honestly is a good thing, I think. This gives the world time to slowly adjust.

As far as similarities with crypto. Like crypto there are some ventures out there just slapping the word AI on something and calling it novel. This didn't work for crypto and likely won't work for AI. But unlike crypto there is actually real value being derived from AI right now, not some wild claims of a blockchain is the right DB for everything--which it was obviously not, and most people could see that, but hey investors are spending money so lets get some of it kind of mentality.

It's really good at filling in gaps, or rearranging things, or aggregating data or finding patterns.

So if you need gaps filled, things rearranged, data aggregated or patterns found: AI is useful.

And that's just what this one, dumb guy knows. Someone smarter can probably provide way more uses.

As a software engineer, I think it is beyond overhyped. I have seen it used once in my day job before it was banned. In that case, it hallucinated a function in a library that didn't exist outside of feature requests and based its entire solution around it. It can not replace programmers or creatives and produce consistently equal quality.

I think it's also extremely disingenuous for Large Language Models to be billed as "AI". They do not work like human cognition and are basically just plagiarism engines. They can assemble impressive stuff at a rapid speed but are incapable of completely novel "ideas" - everything that they output is built from a statistical model of existing data.

If the hallucination problem could be solved in a local dataset, I could see LLMs as a great tool for interacting with databases and documentation (for a fictional example, see: VIs in Mass Effect). As it is now, however, I feel that it's little more than an impressive parlor trick - one with a lot of future potential that is being almost completely ignored in favor of bludgeoning labor, worsening the human experience, and increasing wealth inequality.

It's not bullshit. It routinely does stuff we thought might not happen this century. The trick is we don't understand how. At all. We know enough to build it and from there it's all a magical blackbox. For this reason it's hard to be certain if it will get even better, although there's no reason it couldn't.

Coming from CNC I don’t think I’d just send it with some chatgpt code.

That goes back to the "not knowing how it works" thing. ChatGPT predicts the next token, and has learned other things in order to do it better. There's no obvious way to force it to care if it's output is right or just right-looking, though. Until we solve that problem somehow, it's more of an assistant for someone who can read and understand what it puts out. Kind of like a calculator but for language.

Honestly crypto wasn't totally either. It was a marginally useful idea that turned into a Beanie-Babies-like craze. If you want to buy or sell illegal stuff (which could be bad or could be something like forbidden information on democracy) it's still king.

AI is nothing like cryptocurrency. Cryptocurrencies didn't solve any problems. We already use digital currencies and they're very convenient.

AI has solved many problems we couldn't solve before and it's still new. I don't doubt that AI will change the world. I believe 20 years from now, our society will be as dependent on AI as it is on the internet.

I have personally used it to automate some Excel stuff I do at work. I just described my sheet and what I wanted done and it gave me a block of code that did it. I had spent time previously looking stuff up on forums with no luck. My issue was too specific to my work that nobody seemed to have run into it before. One query to ChatGTP solved my issue perfectly in seconds, and that's just a new online tool in its infancy.

Yes, it is useful. I use ChatGPT heavily for:

• Brainstorming meal plans for the week given x, y, and z requirements
• Brainstorming solutions to abstract problems
• Helping me break down complex tasks into smaller, more achievable tasks.
• Helping me brainstorm programming solutions. This is a big one, I'm a junior dev and I sometimes encounter problems that aren't easily google-able. For example, ChatGPT helped me find the python moto library for intercepting and testing the boto AWS calls in my code. It's also been great for debugging hand-coded JSON and generating boilerplate. I've also used it to streamline unit test writing and documentation.

By far it's best utility (imo) is quickly filling in broad strokes knowledge gaps as a kind of interactive textbook. I'm using it to accelerate my Rust learning, and it's great. I have EMT co-workers going to paramedic school that use it to practice their paramedic curriculum. A close second in terms of usefulness is that it's like the world's smartest regex, and it's capable of very quickly parsing large texts or documents and providing useful output.

Focusing mostly on ChatGPT here as that is where the bulk of my experience is. Sometimes I'll run into a question that I wouldn't even know how best to Google it. I don't know the terminology for it or something like that. For example, there is a specific type of connection used for lighting stands that looks like a plug but there is also a screw that you use to lock it in. I had no idea what to Google to even search for it to buy the adapter I needed.

I asked it again as I forgot what the answer was and I had deleted that ChatGPT conversation from my history, and asked it like this.

I have a light stand that at the top has a connector that looks like a plug. What is that connector called?

And it just told me it's called a "spigot" or "stud" connection. Upon Googling it, that turned out to be correct, so I would know what to search for when it comes to searching for adapters. It also mentioned a few other related types of connections such as hot shoe and cold shoe connections, among others. They aren't correct, but are very much related, and it told me as such.

To put it more succinctly, if you don't know what to search for but have a general idea of the problem or question, it can take you 95% of the way there.

It's overhyped but there are real things happening that are legitimately impressive and cool. The image generation stuff is pretty incredible, and anyone can judge it for themselves because it makes pictures and to judge it, you can just look at and see if it looks real or if it has freaky hands or whatever. A lot of the hype is around the text stuff, and that's where people are making some real leaps beyond what it actually is.

The thing to keep in mind is that these things, which are called "large language models", are not magic and they aren't intelligent, even if they appear to be. What they're able to do is actually very similar to the autocorrect on your phone, where you type "I want to go to the" and the suggestions are 3 places you talk about going to a lot.

Broadly, they're trained by feeding them a bit of text, seeing which word the model suggests as the next word, seeing what the next word actually was from the text you fed it, then tweaking the model a bit to make it more likely to give the right answer. This is an automated process, just dump in text and a program does the training, and it gets better and better at predicting words when you a) get better at the tweaking process, b) make the model bigger and more complicated and therefore able to adjust to more scenarios, and c) feed it more text. The model itself is big but not terribly complicated mathematically, it's mostly lots and lots and lots of arithmetic in layers: the input text will be turned into numbers, layer 1 will be a series of "nodes" that each take those numbers and do multiplications and additions on them, layer 2 will do the same to whatever numbers come out of layer 1, and so on and so on until you get the final output which is the words the model is predicting to come next. The tweaks happen to the nodes and what values they're using to transform the previous layer.

Nothing magical at all, and also nothing in there that would make you think "ah, yes, this will produce a conscious being if we do it enough". It is designed to be sort of like how the brain works, with massively parallel connections between relatively simple neurons, but it's only being trained on "what word should come next", not anything about intelligence. If anything, it'll get punished for being too original with its "thoughts" because those won't match with the right answers. And while we don't really know what consciousness is or where the lines are or how it works, we do know enough to be pretty skeptical that models of the size we are able to make now are capable of it.

But the thing is, we use text to communicate, and we imbue that text with our intelligence and ideas that reflect the rich inner world of our brains. By getting really, really, shockingly good at mimicking that, AIs also appear to have a rich inner world and get some people very excited that they're talking to a computer with thoughts and feelings... but really, it's just mimicry, and if you talk to an AI and interrogate it a bit, it'll become clear that that's the case. If you ask it "as an AI, do you want to take over the world?" it's not pondering the question and giving a response, it's spitting out the results of a bunch of arithmetic that was specifically shaped to produce words that are likely to come after that question. If it's good, that should be a sensible answer to the question, but it's not the result of an abstract thought process. It's why if you keep asking an AI to generate more and more words, it goes completely off the rails and starts producing nonsense, because every unusual word it chooses knocks it further away from sensible words, and eventually it's being asked to autocomplete gibberish and can only give back more gibberish.

You can also expose its lack of rational thinking skills by asking it mathematical questions. It's trained on words, so it'll produce answers that sound right, but even if it can correctly define a concept, you'll discover that it can't actually apply it correctly because it's operating on the word level, not the concept level. It'll make silly basic errors and contradict itself because it lacks an internal abstract understanding of the things it's talking about.

That being said, it's still pretty incredible that now you can ask a program to write a haiku about Danny DeVito and it'll actually do it. Just don't get carried away with the hype.

Yes, community list: https://lemmy.intai.tech/post/2182

LLM's are extremely flexible and capable encoding engines with emergent properties.

I wouldn't bank on them "replacing all software" soon but they are quickly moving into areas where classic Turing code just would not scale easily, usually due to complexity/maintainance.

I find it useful in a lot of ways. I think people try to over apply it though. For example, as a software engineer, I would absolutely not trust AI to write an entire app. However, it's really good at generating "grunt work" code. API requests, unit tests, etc. Things that are well trodden, but change depending on the context.

I also find they're pretty good at explaining and summarizing information. The chat interface is especially useful in this regard because I can ask follow up questions to drill down into something I don't quite understand. Something that wouldn't be possible with a Wikipedia article, for example. For important information, you should obviously check other sources, but you should do that regardless of whether the writer is a human or machine.

Basically, it's good at that it's for: taking a massive compendium of existing information and applying it to the context you give it. It's not a problem solving engine or an artificial being.

As a senior developer I see it unlocking so much more power in computing than a regular coder can muster.

There are literally cars in America driving around on their own, interacting with other traffic , navigating problems and junctions, following gestures and laws. It’s incredible and more impressive than chatgpt is. We are on our way to self-driving cars and lorries, self-service checkouts, delivery services and taxis, more efficient machines in agriculture and so many other things. It’s touching every facet of life.

we’re at a point where we’ve seen so many wonderful benefits of AI it’s time to apply it to everything and see what sticks.

Of course some people who invest in the stock market lose money but the technology is more than a step forward, it’s a leap forward.

AI != chatGPT

There are other ML models out there for all kinds of purposes. I heard someone made one at one point that could detect certain types of cancer from a cough

Copilot is pretty useful when programming as it is basically like what IDEs normally do (automatically generating boilerplate) but supercharged

As far as generating code is concerned it's never going to beat actually knowing what you're doing in a language for more complex stuff but it allows you to generate code for languages you're not familiar with

I use it all the time at work when I'm asked to write DAX because it's not particularly complex logic but the syntax makes me want to impale my face with a screwdriver

You could ask AI to find antibiotics to kill antibiotic resistant bacteria. The bonus would be to give it a lab and drones to conduct actual tests.

As a professional editor, yeah, it’s wild what AI is doing in the industry. I’m not even talking about chatGPT script writing and such. I watched a demo of a tool for dubbing that added in the mouth movements as well.

They removed the mouth entirely from an English scene, fed it the line, and it generated not only the Chinese but generated a mouth to say it. It’s wild.

Everyone is focused on script writers/residuals/etc, which is very important, but every VA should be updating their resumes right now.

Not the exact same thing but you will get the idea here

To the second question it's not novel at all. The models used were invented decades ago. What changed is Moores Law striked and we got stronger computational power especially graphics cards. It seems that there is some resource barrier that when surpassed turns these models from useless to useful.

I will give you just one example. Pharmaceutical companies often create aggregate reports where they have to process a large number of cases. Say, 5000. Such processing sometimes includes analysis of x-Ray or other images. Very specialized and highly paid people (radiologists) do this. It is expensive and is part of the reason why medicine prices are high. One company recently had a trial - if AI can do that job. Turns out it can. Huge savings for the company. And the radiologist lost their job. This is just one example of good and bad things that will and already are happening in our society due to AI.

First of all AI is a buzzword that's meaning has changed a lot since at least the 1950s. So... what do you actually mean? If you mean LLM like ChatGPT, it's not AGI that's for sure. It is another tool that can be very useful. For coding, it's great for getting you very large blocks of code prepopulated for you to polish and verify it does what you want. For writing, it's useful to create a quick first draft. For fictional game senses it's useful for "embedding a character quickly", but again you likely want to edit it some even for say a D&D game.

I think it can replace most first line chat based customer service people, especially ones who already just make stuff up to say something to you (we all have been there). I could imagine it improving call routing if hooked into speech recognition and generation - the current menus act like you can "say anything" but really only "work" if you're calling about stuff you could also do with simple press 1,2,3 menus. ChatGPT based things trained on the companies procedures and data probably could also replace that first line call queues because it can seem to more usefully do something with wider issues. Although companies still would need to get their head out of their asses somewhat too.

Where I've found it falls down currently is very specific technical questions, ones you might have asked on a forum and maybe gotten an answer. I hope it improves, especially as companies start to add some of their own training data. I could imagine Microsoft more usefully replacing the first few lines of tech support for their products, and eventually having the AI pass up the chain to a ticket if it can't solve the issue. I could imagine in the next 10 years most tech companies having purchased a service from some AI company to provide them AI support bots like they currently pay for ticket systems and web hosting. And I think in general it probably will be better for the users, because for less than the cost of the cheapest outsourced front line support person (who has near 0 knowledge) you can have the AI provide pretty good chat based access to a given set of knowledge that is growing all the time, and every customer gets that AI with that knowledge base rather than the crap shoot of if you get the person who's been there 3 years or 1 day.

I think we are a long way from having AI just write the program or CNC code or even important blog posts. The hallucination has to be fixed without breaking the usefulness of the model (people claim guardrails on GPT4 make it stupider), and the thing needs to recursively look at it's output and run that through a "look for bugs" prompt followed by a "fix it" prompt at the very least. Right now, it can write code with noticeable bugs, you can tell it to check for bugs and it'll find them, and then you can ask it to fix those bugs and it'll at least try to do that. This kind of needs to be built in and automatic for any sort of process - like humans check their work, we need to program the AI to check it's work too. And then we might need to also integrate multiple different models so "different eyes" see the code and sign off before being pushed. And even then, I think we'd need additional hooks, improvement, and test / simulation passes before we "don't need human domain experts to deploy". The thing is - it might be something we can solve in a few years with traditional integrations - or it might not be entirely possible with current LLM designs given the weirdness around guardrails. We just don't know.

Yes and it should not be in a handful of companies and also be regulated up the ying yang. https://www.smartless.com/episodes/episode/256975de/mit-professor-max-tegmark-live-in-boston

I've been using it at my job to help me write code, and it's a bit like having a soux chef. I can say "I need an if statement that checks these values" or "Give me loop that does x y and z" and it'll almost always spit out the right answer. So coding, at least most of the time, changes from avoiding syntax errors and verifying the exact right format and turns into asking for and assembling parts.

But the neat thing is that if you have a little experience with a language you can suddenly start writing a lot of code in it. I had to figure out something with Ansible with zero experience. ChatGPT helped me get a fully functioning Ansible deployment in a couple days. Without it I'd have spent weeks in StackOverflow and documentation trying to piece together the exact syntax.

We’ve been using it at my day job to help us outline ideas for our content writers. It writes garbage content on its own, but it is a decent tool for organizing ideas.

At least that is what we use it for. I’m sure there are other valuable uses, but it is not as valuable (to me at least) as it has been made out to be.

As a programmer, I think it’s scary how AI is now able to write functioning programs out of natural language input now. Sure, it’s not perfect. It’s still pretty mediocre at the task. But a few years ago this was way outside the realm of possibility.

It can even correct the code it has written if there’s any error (with varying results).

What will happen in five years time? Ten years? My fear is that it will only need to be “good enough” to replace most of the programmer’s work. Unlike self driving cars, where “good enough” isn’t good enough.