Rationality- From AI to Zombies

by Eliezer Yudkowsky

  Plato. Great Dialogues of Plato. Edited by Eric H. Warmington and Philip G. Rouse. Signet Classic, 1999.

  Popper, Karl R. The Logic of Scientific Discovery. New York: Basic Books, 1959.

  Poundstone, William. Priceless: The Myth of Fair Value (and How to Take Advantage of It). Hill & Wang, 2010.

  Pratchett, Terry. Maskerade. Discworld Series. ISIS, 1997.

  ———. Witches Abroad. London: Corgi Books, 1992.

  Procopius. History of the Wars. Edited by Henry B. Dewing. Harvard University Press, 1914.

  Pronin, Emily. “How We See Ourselves and How We See Others.” Science 320 (2008): 1177–1180. http://psych.princeton.edu/psychology/research/pronin/pubs/2008%20Self%20and%20Other.pdf.

  Pronin, Emily, Daniel Y. Lin, and Lee Ross. “The Bias Blind Spot: Perceptions of Bias in Self versus Others.” Personality and Social Psychology Bulletin 28, no. 3 (2002): 369–381.

  Putnam, Hilary. “The Meaning of Meaning.” In The Twin Earth Chronicles, edited by Andrew Pessin and Sanford Goldberg, 3–52. M. E. Sharpe, Inc., 1996.

  Quattrone, George A., Cheryl P. Lawrence, Steven E. Finkel, and David C. Andrus. “Explorations in Anchoring: The Effects of Prior Range, Anchor Extremity, and Suggestive Hints.” Unpublished manuscript, Stanford University, 1981.

  Rhodes, Richard. The Making of the Atomic Bomb. New York: Simon & Schuster, 1986.

  Rips, Lance J. “Inductive Judgments about Natural Categories.” Journal of Verbal Learning and Verbal Behavior 14 (1975): 665–681.

  Roberts, Seth. “What Makes Food Fattening?: A Pavlovian Theory of Weight Control.” Unpublished manuscript, 2005. http://media.sethroberts.net/about/whatmakesfoodfattening.pdf.

  Robinson, Dave, and Judy Groves. Philosophy for Beginners. 1st ed. Cambridge: Icon Books, 1998.

  Rorty, Richard. “Out of the Matrix: How the Late Philosopher Donald Davidson Showed That Reality Can’t Be an Illusion.” The Boston Globe (October 2003).

  Rosch, Eleanor. “Principles of Categorization.” In Cognition and Categorization, edited by Eleanor Rosch and Barbara B. Lloyd. Hillsdale, NJ: Lawrence Erlbaum, 1978.

  Russell, Gillian. “Epistemic Viciousness in the Martial Arts.” In Martial Arts and Philosophy: Beating and Nothingness, edited by Graham Priest and Damon A. Young. Open Court, 2010.

  Russell, Stuart J., and Peter Norvig. Artificial Intelligence: A Modern Approach. 3rd ed. Upper Saddle River, NJ: Prentice-Hall, 2010.

  Ryle, Gilbert. The Concept of Mind. University of Chicago Press, 1949.

  Sadock, Jerrold. “Truth and Approximations.” Papers from the Third Annual Meeting of the Berkeley Linguistics Society (1977): 430–439.

  Sagan, Carl. The Demon-Haunted World: Science as a Candle in the Dark. 1st ed. New York: Random House, 1995.

  Saint-Exupery, Antoine de. Terre des Hommes. Paris: Gallimard, 1939.

  Sandel, Michael. “What’s Wrong With Enhancement.” Background material for the President’s Council on Bioethics. (2002).

  Schoemaker, Paul J. H. “The Role of Statistical Knowledge in Gambling Decisions: Moment vs. Risk Dimension Approaches.” Organizational Behavior and Human Performance 24, no. 1 (1979): 1–17.

  Schul, Yaacov, and Ruth Mayo. “Searching for Certainty in an Uncertain World: The Difficulty of Giving Up the Experiential for the Rational Mode of Thinking.” Journal of Behavioral Decision Making 16, no. 2 (2003): 93–106. doi:10.1002/bdm.434.

  Schwitzgebel, Eric. Perplexities of Consciousness. MIT Press, 2011.

  Serfas, Sebastian. Cognitive Biases in the Capital Investment Context: Theoretical Considerations and Empirical Experiments on Violations of Normative Rationality. Springer, 2010.

  Sherif, Muzafer, Oliver J. Harvey, B. Jack White, William R. Hood, and Carolyn W. Sherif. “Study of Positive and Negative Intergroup Attitudes Between Experimentally Produced Groups: Robbers Cave Study.” Unpublished manuscript (1954).

  Shermer, Michael. “The Unlikeliest Cult in History.” Skeptic 2, no. 2 (1993): 74–81. http://www.2think.org/02_2_she.shtml.

  Shimabukuro, Masayuki. Flashing Steel: Mastering Eishin-Ryu Swordsmanship. Frog Books, 1995.

  Slovic, Paul. “Numbed by Numbers.” Foreign Policy (March 2007). http://foreignpolicy.com/2007/03/13/numbed-by-numbers/.

  Slovic, Paul, Melissa Finucane, Ellen Peters, and Donald G. MacGregor. “Rational Actors or Rational Fools: Implications of the Affect Heuristic for Behavioral Economics.” Journal of Socio-Economics 31, no. 4 (2002): 329–342. doi:10.1016/S1053-5357(02)00174-9.

  Smith, Edward Elmer. Second Stage Lensmen. Old Earth Books, 1998.

  Smith, Edward Elmer, and Ric Binkley. Gray Lensman. Old Earth Books, 1998.

  Smith, Edward Elmer, and A. J. Donnell. First Lensman. Old Earth Books, 1997.

  Smullyan, Raymond M. What Is the Name of This Book?: The Riddle of Dracula and Other Logical Puzzles. Penguin Books, 1990.

  Soares, Nate, and Benja Fallenstein. “Toward Idealized Decision Theory.” Technical report. Berkeley, CA: Machine Intelligence Research Institute (2014). http://intelligence.org/files/TowardIdealizedDecisionTheory.pdf.

  Spee, Friedrich. Cautio Criminalis; or, A Book on Witch Trials. Edited and translated by Marcus Hellyer. Studies in Early Modern German History. 1631. Charlottesville: University of Virginia Press, 2003.

  Stanovich, Keith E., and Richard F. West. “Individual Differences in Reasoning: Implications for the Rationality Debate?” Behavioral and Brain Sciences 23, no. 5 (2000): 645–665. http://journals.cambridge.org/abstract_S0140525X00003435.

  Stewart, John E. “Defendants’ Attractiveness as a Factor in the Outcome of Trials: An Observational Study.” Journal of Applied Social Psychology 10 (4 1980): 348–361. doi:10.1111/j.1559-1816.1980.tb00715.x.

  Stiegler, Marc. David’s Sling. Baen, 1988.

  Stove, David Charles. The Plato Cult and Other Philosophical Follies. Cambridge University Press, 1991.

  Strack, Fritz, and Thomas Mussweiler. “Explaining the Enigmatic Anchoring Effect: Mechanisms of Selective Accessibility.” Journal of Personality and Social Psychology 73, no. 3 (1997): 437–446.

  Sunstein, Cass R. “Probability Neglect: Emotions, Worst Cases, and Law.” Yale Law Journal (2002): 61–107.

  Taber, Charles S., and Milton Lodge. “Motivated Skepticism in the Evaluation of Political Beliefs.” American Journal of Political Science 50, no. 3 (2006): 755–769. doi:10.1111/j.1540-5907.2006.00214.x.

  Talbott, William. “Bayesian Epistemology.” In The Stanford Encyclopedia of Philosophy, Fall 2013, edited by Edward N. Zalta.

  TalkOrigins Foundation. “Frequently Asked Questions about Creationism and Evolution.” http://www.talkorigins.org/origins/faqs-qa.html.

  Tegmark, Max. Our Mathematical Universe: My Quest for the Ultimate Nature of Reality. Random House LLC, 2014.

  ———. “Parallel Universes.” In Science and Ultimate Reality: Quantum Theory, Cosmology, and Complexity, edited by John D. Barrow, Paul C. W. Davies, and Charles L. Harper Jr., 459–491. New York: Cambridge University Press, 2004.

  Thompson, Silvanus Phillips. The Life of Lord Kelvin. American Mathematical Society, 2005.

  Thornton, Stephen. “Karl Popper.” In The Stanford Encyclopedia of Philosophy, Winter 2002, edited by Edward N. Zalta. Stanford University. http://plato.stanford.edu/archives/win2002/entries/popper/.

  Tooby, John, and Leda Cosmides. “The Psychological Foundations of Culture.” In The Adapted Mind: Evolutionary Psychology and the Generation of Culture, edited by Jerome H. Barkow, Leda Cosmides, and John Tooby, 19–136. New York: Oxford University Press, 1992.

  Tversky, Amos, and Ward Edwards. “Information versus Reward in Binary Choices.” Journal of Experimental Psychology 71, no. 5 (1966): 680–683. doi:10.1037/h0023123.

  Tversky, Amos, and Itamar Gati. “Studies of Similarity.” In Cognition and Categorization, edited by Eleanor Rosch and Barbara Lloyd, 79–98. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc., 1978.

  Tversky, Amos, and Daniel Kahneman. “E
xtensional Versus Intuitive Reasoning: The Conjunction Fallacy in Probability Judgment.” Psychological Review 90, no. 4 (1983): 293–315. doi:10.1037/0033-295X.90.4.293.

  ———. “Judgment Under Uncertainty: Heuristics and Biases.” Science 185, no. 4157 (1974): 1124–1131. doi:10.1126/science.185.4157.1124.

  ———. “Judgments of and by Representativeness.” In Judgment Under Uncertainty: Heuristics and Biases, edited by Daniel Kahneman, Paul Slovic, and Amos Tversky, 84–98. New York: Cambridge University Press, 1982.

  Tzu, Sun. The Art of War. Cloud Hands, Inc., 2004.

  Uhlmann, Eric Luis, and Geoffrey L. Cohen. “‘I think it, therefore it’s true’: Effects of Self-perceived Objectivity on Hiring Discrimination.” Organizational Behavior and Human Decision Processes 104, no. 2 (2007): 207–223.

  Vaidman, Lev. “Many-Worlds Interpretation of Quantum Mechanics.” In The Stanford Encyclopedia of Philosophy, Fall 2008, edited by Edward N. Zalta.

  Vallone, Robert P., Lee Ross, and Mark R. Lepper. “The Hostile Media Phenomenon: Biased Perception and Perceptions of Media Bias in Coverage of the Beirut Massacre.” Journal of Personality and Social Psychology 49 (1985): 577–585. http://ssc.wisc.edu/~jpiliavi/965/hwang.pdf.

  Verhagen, Joachim. http://web.archive.org/web/20060424082937/http://www.nvon.nl/scheik/best/diversen/scijokes/scijokes.txt. Archived version, October 27, 2001.

  Wade, Michael J. “Group selections among laboratory populations of Tribolium.” Proceedings of the National Academy of Sciences of the United States of America 73, no. 12 (1976): 4604–4607. doi:10.1073/pnas.73.12.4604.

  Wansink, Brian, Robert J. Kent, and Stephen J. Hoch. “An Anchoring and Adjustment Model of Purchase Quantity Decisions.” Journal of Marketing Research 35, no. 1 (1998): 71–81. http://www.jstor.org/stable/3151931.

  Warren, Adam. Empowered. Dark Horse Books, 2007.

  Wason, Peter Cathcart. “On the Failure to Eliminate Hypotheses in a Conceptual Task.” Quarterly Journal of Experimental Psychology 12, no. 3 (1960): 129–140. doi:10.1080/17470216008416717.

  Weiten, Wayne. Psychology: Themes and Variations, Briefer Version, Eighth Edition. Cengage Learning, 2010.

  West, Richard F., Russell J. Meserve, and Keith E. Stanovich. “Cognitive Sophistication Does Not Attenuate the Bias Blind Spot.” Journal of Personality and Social Psychology 103, no. 3 (2012): 506.

  Williams, George C. Adaptation and Natural Selection: A Critique of Some Current Evolutionary Thought. Princeton Science Library. Princeton, NJ: Princeton University Press, 1966.

  Wilson, David Sloan. “A Theory of Group Selection.” Proceedings of the National Academy of Sciences of the United States of America 72, no. 1 (1975): 143–146.

  Wilson, Timothy D., David B. Centerbar, and Nancy Brekke. “Mental Contamination and the Debiasing Problem.” In Heuristics and Biases: The Psychology of Intuitive Judgment, edited by Thomas Gilovich, Dale Griffin, and Daniel Kahneman. Cambridge University Press, 2002.

  Wilson, Timothy D., Douglas J. Lisle, Jonathan W. Schooler, Sara D. Hodges, Kristen J. Klaaren, and Suzanne J. LaFleur. “Introspecting About Reasons Can Reduce Post-choice Satisfaction.” Personality and Social Psychology Bulletin 19 (1993): 331–331.

  Wittgenstein, Ludwig. Philosophical Investigations. Translated by Gertrude E. M. Anscombe. Oxford: Blackwell, 1953.

  Wright, Robert. The Moral Animal: Why We Are the Way We Are: The New Science of Evolutionary Psychology. Pantheon Books, 1994.

  Yamagishi, Kimihiko. “When a 12.86% Mortality Is More Dangerous than 24.14%: Implications for Risk Communication.” Applied Cognitive Psychology 11 (6 1997): 461–554.

  Yates, J. Frank, Ju-Whei Lee, Winston R. Sieck, Incheol Choi, and Paul C. Price. “Probability Judgment Across Cultures.” In Gilovich, Griffin, and Kahneman, Heuristics and Biases, 271–291.

  Yudkowsky, Eliezer. “Artificial Intelligence as a Positive and Negative Factor in Global Risk.” In Bostrom and Ćirković, Global Catastrophic Risks, 308–345.

  ———. “Cognitive Biases Potentially Affecting Judgment of Global Risks.” In Bostrom and Ćirković, Global Catastrophic Risks, 91–119.

  ———. Timeless Decision Theory. Unpublished manuscript. Machine Intelligence Research Institute, Berkeley, CA, 2010. http://intelligence.org/files/TDT.pdf.

  Yuzan, Daidoji, William Scott Wilson, Jack Vaughn, and Gary Miller Haskins. Budoshoshinshu: The Warrior’s Primer of Daidoji Yuzan. Black Belt Communications Inc., 1984.

  Zapato, Lyle. “Lord Kelvin Quotations.” 2008. http://zapatopi.net/kelvin/quotes/.

  Zelazny, Roger. Prince of Chaos. Thorndike Press, 2001.

  Zhuangzi and Thomas Merton. The Way of Chuang Tzu. New Directions Publishing, 1965.

  Zhuangzi and Burton Watson. The Complete Works of Zhuangzi. Columbia University Press, 1968.