The Cult of AI: How one writer's trip to an annual tech conference left him with a sinking feeling about the future
The Cult of AI: How one writer's trip to an annual tech conference left him with a sinking feeling about the future

The Cult of AI

From the (middle of the) story: The reason CES was so packed with random “AI”-branded products was that sticking those two letters to a new company is seen as something of a talisman, a ritual to bring back the (VC) rainy season.
Yah, they’re trying to build a god, it’s kinda weird.
That turned out great for the Dwemer
What happens when their god decides it doesn't need them anymore?
I mean, they’re not going to succeed, like they can’t even get it to come up with new stuff.
They built an ouija board and have decided to worship it. Can’t wait till it tells them to start paying tithes and indulgences to the people who are totally not moving the view piece.
Paperclips?
I have the hope that fundamentally, any super-intelligent mind will find humanity interesting. At least more interesting than lifeless rocks or nature without humans. Curiosity is a fundamental trait for intelligence, and no matter how big an AGI gets, a whole planet full of dumb humans doing all sort of crazy stuff would still be more interesting. Basically, who would want to be all alone in the universe? Isn't a diverse, freely developing civilization the perfect daytime soap?
But that all depends of course, an AGI that is "programmed" with capitalism and profit maximizing as it's root tenet is basically doomed to be a paperclip maximizer. We can only hope that it's smart enough to see the folly in this. Theoretically it should be.