(Joshua Fox) Informal bibliography on the Intelligence Explosion and Friendly AI

This is an informal bibliography on the Intelligence Explosion and Friendly AI.


It does not cover:

* material related to other definitions of the Singularity including technological acceleration and the superintelligence event horizon (see Yudkowsky, "Three Major Schools"),
* predictive futurism,
* existential risk,
* and the many relevant fields such as decision theory, cognitive neuroscience, and ethics.

There is an emphasis on academic work. However, the field is new and small, and much high-quality writing appears only in informal forums. Some of the best of this is listed below.

I'd like to make the bibliography comprehensive within its narrow field, so please add more items in the comments to help in future revisions

• Michael Anissimov, "Consolidation of Links on Friendly AI," Accelerating Future, 2009.
• Stuart Armstrong, "Chaining God: A qualitative approach to AI, trust and moral systems," New European Century, 2007.
• Nick Bostrom, "Ethical Issues in Advanced Artificial Intelligence," , I. Smit et al., (Eds.), Cognitive, Emotive and Ethical Aspects of Decision Making in Humans and in Artificial Intelligence, Vol. 2, 2003.
• Stephan Vladimir Bugaj and Ben Goertzel, "Five Ethical Imperatives and their Implications for Human-AGI Interaction," Dynamical Psychology, 2007.
• David Chalmers, "The Singularity: A philosophical analysis," 2010.
• Joshua Fox and Carl Shulman, "Super-intelligence does not imply benevolence," European Conference on Computing and Philosophy, 2008.
• Tim Freeman, "Using Compassion and Respect to Motivate an Artificial Intelligence," 2007-08.
• Ben Goertzel, "Thoughts on AI Morality," Dynamical Psychology, 2002.
• Ben Goertzel, "The All-Seeing (A)I," Dynamical Psychology, 2004.
• Ben Goertzel, "Encouraging a Positive Transcension" Dynamical Psychology, 2004.
• Nick Hay, "The Stamp Collecting Device", SIAI Blog.
• J. Storrs Hall, "Engineering Utopia", in Pei Wang, Benjamin Goertzel and Stan Franklin (Eds), Proceedings of the First AGI Conference, 2008.
• Bill Hibbard, "Critique of the SIAI Guidelines on Friendly AI," 2003.
• Bill Hibbard, "Critique of the SIAI Collective Volition Theory," 2005.
• Shane Legg, "Friendly AI is bunk," 2006.
• Tom McCabe, "General Summary of FAI Theory," Life, the Universe, and Everything, 2007.
• Singularity Institute for Artificial Intelligence, "Reducing long-term catastrophic risks from artificial intelligence," 2010.
• Steve Omohundro, "The Nature of Self-Improving Artificial Intelligence," Singularity Summit (textual version here), 2007.
• Steve Omohundro, "The Basic AI Drives", in Pei Wang, Benjamin Goertzel and Stan Franklin (Eds), Proceedings of the First AGI Conference, 2008.
• Steve Omohundro, "AI and the Future of Human Morality," Silicon Valley World Transhumanist Association Meetup, 2008.
• Eliezer Yudkowsky, "The Three Major Singularity Schools," Singularity Summit (textual version here), 2007.
• Eliezer Yudkowsky, "Artificial intelligence as a positive and negative factor in global risk," in N. Bostrom, & M. M. Ćirković (Eds.), Global Catastrophic Risks
• Eliezer Yudkowsky has written many of the important works in this field, mostly in non-academic contexts. See the items on the SIAI site as linked in Anissimov's bibliography. He has written dozens of important articles on the Less Wrong blog (formerly Overcoming Bias). Some of the most relevant ones are linked from the Paperclip Maximizer page.

Joshua Fox, http://www.joshuafox.com