The economy and national security after AGI | Carl Shulman (Part 1)
HTML-код
- Опубликовано: 1 авг 2024
- Part 2: • Government and society...
The human brain does what it does with a shockingly low energy supply: just 20 watts - a fraction of a cent worth of electricity per hour. What would happen if AI technology merely matched what evolution has already managed, and could accomplish the work of top human professionals given a 20-watt power supply?
Many people sort of consider that hypothetical, but maybe nobody has followed through and considered all the implications as much as Carl Shulman. Behind the scenes, his work has greatly influenced how leaders in artificial general intelligence (AGI) picture the world they're creating.
Learn more and find the full transcript on the 80,000 Hours website: 80000hours.org/podcast/episod...
Carl simply follows the logic to its natural conclusion. This is a world where 1 cent of electricity can be turned into medical advice, company management, or scientific research that would today cost $100s, resulting in a scramble to manufacture chips and apply them to the most lucrative forms of intellectual labour.
It's a world where, given their incredible hourly salaries, the supply of outstanding AI researchers quickly goes from 10,000 to 10 million or more, enormously accelerating progress in the field.
It's a world where companies operated entirely by AIs working together are much faster and more cost-effective than those that lean on humans for decision making, and the latter are progressively driven out of business.
It's a world where the technical challenges around control of robots are rapidly overcome, leading to robots into strong, fast, precise, and tireless workers able to accomplish any physical work the economy requires, and a rush to build billions of them and cash in.
As the economy grows, each person could effectively afford the practical equivalent of a team of hundreds of machine 'people' to help them with every aspect of their lives.
In today's episode, Carl explains the above, and host Rob Wiblin pushes back on whether it's realistic or just a cool story.
• Cold open [00:00:00]
• Rob’s intro [00:01:00]
• Transitioning to a world where AI systems do almost all the work [00:05:21]
• Economics after an AI explosion [00:14:25]
• Objection: Shouldn’t we be seeing economic growth rates increasing today? [00:59:12]
• Objection: Speed of doubling time [01:07:33]
• Objection: Declining returns to increases in intelligence? [01:11:59]
• Objection: Physical transformation of the environment [01:17:39]
• Objection: Should we expect an increased demand for safety and security? [01:29:14]
• Objection: “This sounds completely whack” [01:36:10]
• Income and wealth distribution [01:48:02]
• Economists and the intelligence explosion [02:13:31]
• Baumol effect arguments [02:19:12]
• Denying that robots can exist [02:27:18]
• Classic economic growth models [02:36:12]
• Robot nannies [02:48:27]
• Slow integration of decision-making and authority power [02:57:39]
• Economists’ mistaken heuristics [03:01:07]
• Moral status of AIs [03:11:45]
• Rob’s outro [04:11:47]
----
The 80,000 Hours Podcast features unusually in-depth conversations about the world’s most pressing problems and what you can do to solve them.
Love Carl Shulman, always so insightful
honestly.. need part 2 ASAP
Fascinating talk and thought experiment
When will the world finally wake up to the irreversible transition society is about to undergo?
We are living at the dusk of the Old World.
They'll wake up a few months after the change takes place.
After the fact, of course haha😅
that video image is freaking me out ^^
Excellent as always
The question is why you quantize resources in $ in a AGI economy.
Because bargaining is extremely inefficient and even agi would want a clear production value of something to work out how much of what should be produced.
In what else, apples?
Agi will move the cost of labor to the cost of compute.
A infinite energy economy on the other hand is a totally different story. Thats when pricing things in $ won’t make sense.
Profoundly disagree with the anthropomorphism at the end of the conversation and giving moral status to AIs - if we build AI tools that require moral status, we have failed. Creating AI creatures, agents and fake-humans will be our downfall.
@@odiseezall I agree insofar that if we create something that requires moral status, we are not creating tools, we are creating members of our society.
That is all well and fine, unless we trying to create tools instead of companions or moral agents. The point of having a tool is that you can use them as such, and the evil of slavery was that moral agents with interests were used as tools.
Good overview on AI
Where is Jürgen?
So will robots make our "best friends". Our society has vast amount of future things to decide in the near future. I think when robots experience pain is when we really need to be careful with the idea of exploitation. How to determine the subjective experience of a robot is a hurdle we must come to terms with in the future.Woot! I listened to the whole 4 hours!
It would really be pointless and a moral evil to create a artificiell workforce with interests, at the very least interested in other things than working with producing resources for humans.
Will AGI need time off for back propagation?
gud stuff
great talk!
Wow
Economists are hesitant to extrapolate the full impacts of competent AI for fear of appearing crazy to their peers. These capabilities could indeed lead to sci-fi-like outcomes and potentially render their profession obsolete. Most economists will choose to focus on maintaining the status quo until retirement, only updating when new AI capabilities emerge.
It's a species of intellectual cowardice.
This requires packing the court. What other choice it there? But we may only have to early January 2025
Why is Elon Musk on the thumbnail?
The more poignant question is why you didn't mention Bezos and both of them seemingly in the position of waiters 😊
FIRST
WHY is he ( the host) talking so crazily fast?? Does he want folks to switch off??
Luckily the guest talks in a way much more comfortable to listen to.
Watching 2x?