We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.
We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.
from Part II - Strategies and Obstacles: The Solutions We Need, and What’s Preventing Them from Being Realized
Published online by Cambridge University Press: 13 October 2022
Whereas today’s “narrow” AI machines can be easily controlled, the probable advent over the coming decades of machines endowed with Artificial General Intelligence (AGI) will pose a far more difficult control challenge – for such machines will function as agents endowed with many human-like capabilities. The AI expert Stuart Russell has proposed a radical new design for the motivational architecture of AI machines, which he calls “humble AI.” Rather than programming AI machines to pursue specific goals, he argues, it would be much safer to give them a single broad goal, namely, maximizing the realization of human preferences. The key innovation here lies in programming the machines so that they can never be 100 percent certain about what those human preferences are – a gambit that restores ultimate control over the machines’ behavior to their human overseers. Russell argues persuasively that fundamental safety research in the field of AI needs to be pursued as a much higher priority than it currently receives today.
To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
Find out more about the Kindle Personal Document Service.
To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.
To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.
