Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)CL
Posts
2
Comments
806
Joined
2 yr. ago

  • The ability to generate plausible language was a lack of compute power. The actual programs running the LLM is not complicate.

    The model that is produced is complex.

    Its training required compute power that was not previously available but the math/code behind these systems is not complex. They are resource intensive. There is a difference that a layperson often cannot comprehend.

  • Yes. I've used them. I have used it beyond the point of it hallucinating.

    I am also a software engineer and have deeper understanding of how these systems work than your average user.

    The software community tends to approach these things with more caution than the general population. The media overblows the capabilities of these systems.

    A more concrete example is autonomous vehicles which were promised for decades and even now with a form of them on the road, they are still closer to remote controlled vehicles than the intelligent self contained systems we have been promised.

    The difference between predictive text on a smart phone and predictive text of an LLM is my smart phone is predicting what I am likely to type next based on things i have typed in the past, while the LLM is predicting what comes next based on a larger body of work from source pulled from all across the internet. The LLM is then tuned by humans. This tuning step is under reported.

    The LLM is unable to determine the truth of its own output. I would argue that is a key to claiming intelligence but determining what intelligence means is itself a philosophical question up for debate.

  • Parlor trick is a perfect description.

    People don't get that these things aren't anymore intelligent than their smartphones predicting the next word. The main difference is instead of a couple words it has thousands to choose from.

    Half of the trick is how it uses the prompt to decided what words to start with.