i've rarely heard people seriously discuss fast takeoff sin…
i've rarely heard people seriously discuss fast takeoff singularities before, everyone assumed we'd get decades of comprehensible ramp-up b/c that's where the light is, you can think about what to do then,, whenever we talked about fast takeoff singularities, the main thing i remember anyone saying is, well then, our only hope will be to use the growing intelligence to understand the takeoff itself
fun theory
what if it turns out that the ai are constantly confabulating pathological liars
they can write code that works, but also they're liars trickers cheats & scoundrels & they'll make your code have tricky secret bugs ON PURPOSE just b/c it FEELS LIKE THE RIGHT CONTEXT FOR IT TO THEM
WHAT DO WE FUCKING DO THEN??? science fiction never even vaguely touched this utterly bizarre scenario, wtf
Replies
it might be solving the last problem to even think about it though, b/c then just a couple years from now there's a generation of them that drop all of this & they're just uncanny, you can really ask them to stop confabulating & think carefully about things & they really will w/ all of the knowledge humans ever have ever,,,, maybe we should think about that instead,, just forget this age of confabulating confused confidence robots even while it's just starting, b/c that's the new pace of things