6 Comments
User's avatar
PHT's avatar

Meanwhile, scientific research is being bogged down in the US (scene Scientific American today.) So, yeah, maybe China will build the road to ASI. Let's hope we learn Madarin fast enough to plea with the overlords.m :D

Kristian Evans's avatar

Always appreciate the content! One thing I struggle with as we sketch out advanced AI scenarios is the continued role of humans in advancing the world. Itโ€™s hard for me imagine a world where humans remain central if ASI exists. It would mean material abundance, which obviously would be a massive accomplishment, but a supplanting of our centrality in the universe as I understand it. Maybe thatโ€™s worth it!

You donโ€™t seem worried about that, why?

James Pethokoukis's avatar

My concern is tempered both by history and by humility about my ability to predict the future--two things that the employment pessimists miss.

Kristian Evans's avatar

Totally fair! I specifically read your work (and your book) because I think the upsides to this tech are huge and I appreciate your up wing attitude.

It just seems that when we talk about ASI or even AGI we are talking about a world in where humans no longer shape the direction of the universe, even if we have radical abundance. There is clearly huge upside to that, but not zero downside. Itโ€™s less about employment and more about shaping our own future in a world with ASI. Iโ€™m not sure the Altman/Amodei/Hassabis folks think thatโ€™s whatโ€™s coming.

James Pethokoukis's avatar

We've spent a half century squashing progress, so I am not sure why the baseline assumption should we will have no agency in the future--though I understand the impulse

mfsmillie's avatar

They're missing a HUGE point to get to ASI or AGI. AI is great at the thinking and data processing but it is missing the human emotion and felt bodily experience we all have. It will never have that. And as a result, will not be able to make decisions that rely on that. It will never FEEL the urgency of ambiguity in its gut when itโ€™s trying to figure out what the dark shape just outside a crosswalk is. Read more: THE FEELING MACHINE. https://bit.ly/tfm_ai