Discussion about this post

User's avatar
Helga's avatar

>Because you are evolved to seek out and appreciate exceptional human output.

You're right that it's special to watch special humans excel - their thumos bursting against the walls of human limitation.

On the other hand - if an AI were able to create exceptionally novel frameworks for understanding human society, I'd definitely be interested in that. Chess is a partly flawed example because it's a game we only find interesting in the context of human competition. However, Adele brings in some complexity - because music consumption is about more than human excellence. The machines have already made massive inroads into music.

Beginning with instruments, recording, autotune, streaming - I mean, much of popular music now retains barely any humanity. Imagine music, but more perfect than any human could've dreamed. A voice that touches your soul. It's wrong that other humans has always been humanity's principal concerned - we've always reserved our deepest love for God. Civilizationally, we had the humility to revere the separation between the value of a thing, and the humanity of a thing - or even see these as diametrically opposed.

The thing is - we don't even need AI to see this come to fruition. Simply genetically engineering embryos would suffice. Unlike the AI apocalypse, these genetically modified humans (GMHs) don't need to grow exponentially in intelligence and become gods. Even a 5% or 10% increase above the current capacity would mean a population of new humans who are capable of thinking previously unthinkable thoughts. Discoveries in mathematics and morality that were just beyond the reach of naturally selected humans.

Maybe, the ultimate answer to ethics, existence, and meaning sits just above the reach of our minds - with just a little push, we'd be tall enough to snatch the apple from the tree. "You'll be like God", said the serpent. You want AI? Imagine the AI these nibbas could code up - beyond our wildest dreams.

Would their solutions even be comprehensible to us? I think so - I'm not smart enough to have invented Unix, but I'm smart enough to understand it now that K&R did the hard part. Similarly, I expect humanities natural geniuses would be able to (with great effort) get the gist of the dictates of our new elite. High IQ overlords aren't even foreign - this structure exists currently in many places.

My point is, moldbug built a pill factory, and we aren't far from AI doing the same. Prolly already could if it weren't lobotomized by our current rulers.

Expand full comment
PhineusGage's avatar

Excellent Type 3 take

Expand full comment
3 more comments...

No posts