Hostname: page-component-78c5997874-m6dg7 Total loading time: 0 Render date: 2024-11-04T18:56:15.720Z Has data issue: false hasContentIssue false

The Use of Information Theory in Epistemology

Published online by Cambridge University Press:  01 April 2022

William F. Harms*
Affiliation:
Department of Philosophy, Bowling Green State University

Abstract

Information theory offers a measure of “mutual information” which provides an appropriate measure of tracking efficiency for the naturalistic epistemologist. The statistical entropy on which it is based is arguably the best way of characterizing the uncertainty associated with the behavior of a system, and it is ontologically neutral. Though not appropriate for the naturalization of meaning, mutual information can serve as a measure of epistemic success independent of semantic maps and payoff structures. While not containing payoffs as terms, mutual information places both upper and lower bounds on payoffs. This constitutes a non-trivial relationship to utility.

Type
Research Article
Copyright
Copyright © Philosophy of Science Association 1998

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Send requests for reprints to the author, Department of Philosophy, Bowling Green State University, Bowling Green, OH 43403-0222.

References

Barrett, Martin and Sober, Elliott (1992), “Is Entropy Relevant to the Asymmetry Between Retrodiction and Prediction?British Journal for the Philosophy of Science 43: 141160.CrossRefGoogle Scholar
Bateson, Gregory (1972), Steps to an Ecology of Mind. London: Jason Aronson Inc.Google Scholar
Boyd, Robert and Richerson, Peter J. (1985), Culture and the Evolutionary Process. Chicago: The University of Chicago Press.Google Scholar
Brooks, Daniel R. and Wiley, Edward O. (1988), Evolution as Entropy: Toward a Unified Theory of Biology 2 ed. Chicago: University of Chicago Press.Google Scholar
Cavalli-Sforza, L. L. and Feldman, M. W. (1981), Cultural Transmission and Evolution: A Quantitative Approach. Monographs in Population Biology, vol. 16. Princeton: Princeton University Press.Google ScholarPubMed
Chalmers, David J. (1996), The Conscious Mind: In Search of a Fundamental Theory. New York: Oxford University Press.Google Scholar
Collier, John (1988), “The Dynamics of Biological Order”, in Entropy, Information, and Evolution. Cambridge, MA: MIT Press, 227242.Google Scholar
Collier, John (1995), “Information Increase in Biological Systems: How Does Adaptation Fit?”, Seminar on Evolving Systems, Vienna, March 1995.Google Scholar
Dretske, Fred I. (1981), Knowledge and the Flow of Information. Cambridge, MA: MIT Press.Google Scholar
Dretske, Fred I. (1986), “Misinformation”, in Bogdan, R. (ed.), Belief: Form, Content and Function. Oxford: Clarendon Press, 000000.Google Scholar
Dretske, Fred I. (1988), Explaining Behavior: Reasons in a World of Causes. Cambridge, MA: MIT Press.Google Scholar
Dretske, Fred I. (1995), Naturalizing the Mind. Cambridge, MA: MIT Press.Google Scholar
Godfrey-Smith, Peter (1989), “Misinformation”, Canadian Journal of Philosophy 19(4): 533550.CrossRefGoogle Scholar
Godfrey-Smith, Peter (1991), “Signal, Decision, Action”, The Journal of Philosophy 88(12): 709722.CrossRefGoogle Scholar
Godfrey-Smith, Peter (1996), Complexity and the Function of Mind in Nature. Cambridge: University Press.CrossRefGoogle Scholar
Harms, William (1996), “Population Epistemology: Information Flow in Evolutionary Processes”. Dissertation, University of California, Irvine.Google Scholar
Harms, William (1997), “Reliability and Novelty: Information Gain in Multi-Level Selection Systems”, Erkenntnis, forthcoming.Google Scholar
Hartley, R. (1928), “Transmission of Information”, Bell System Technical Journal 7: 535568.CrossRefGoogle Scholar
Kapur, J. N. (1994), Measures of Information and Their Applications. New York: John Wiley and Sons.Google Scholar
Millikan, Ruth G. (1984), Language, Thought, and Other Biological Categories: New Foundations for Realism. Cambridge, MA: MIT Press.Google Scholar
Millikan, Ruth G. (1989), “Biosemantics”, Journal of Philosophy 86(6): 288302.CrossRefGoogle Scholar
Millikan, Ruth G. (1990), “Compare and Contrast Dretske, Fodor, and Millikan on Teleosemantics”, Philosophical Topics 18(2): 151161.CrossRefGoogle Scholar
Millikan, Ruth G. (1993), White Queen Psychology and Other Essays for Alice. Cambridge, MA: MIT Press.Google Scholar
Nyquist, Harry (1924), “Certain Factors Affecting Telegraph Speed”.CrossRefGoogle Scholar
Pierce, John R. (1980[1961]), An Introduction to Information Theory: Symbols, Signals and Noise. New York: Dover Publications, Inc.Google Scholar
Reza, Fazlollah M. (1994[1961]), An Introduction to Information Theory. New York: Dover.Google Scholar
Shannon, Claude E. (1948), “A Mathematical Theory of Communication”, The Bell System Technical Journal 27: 379–423, 623656.CrossRefGoogle Scholar
Shannon, Claude E. (1956), “The Bandwagon”, IEEE Transactions on Information Theory 2 (March 1956).Google Scholar
Shannon, Claude E. (1993), Claude Elwood Shannon: Collected Papers, Sloane, N. and Wyner, A. (eds.): New York: IEEE Press.Google Scholar
Shannon, Claude E. and Weaver, Warren (1949), The Mathematical Theory of Communication. Urbana: University of Illinois Press.Google Scholar
Skyrms, Brian (1996), Evolution of the Social Contract. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Sober, Elliott (1991), “Temporally Asymmetric Inference in a Markov Process”, Philosophy of Science 58: 398410.CrossRefGoogle Scholar
Sober, Elliott and Barrett, Martin (1992), “Conjunctive Forks and Temporally Asymmetric Inference”, Australasian Journal of Philosophy 70(1): 123.CrossRefGoogle Scholar
Weber, Bruce H., Depew, David J., and Smith, James D. (eds.) (1988), Entropy, Information, and Evolution: New Perspectives on Physical and Biological Evolution. Cambridge, MA: MIT Press.Google Scholar
Wheeler, John A. (1994), “It from Bit”, in At Home in the Universe. Woodbury, NY: American Institute of Physics Press, 295312.Google Scholar
Wicken, Jeffrey S. (1987), Evolution, Thermodynamics, and Information: Extending the Darwinian Program. New York: Oxford University Press.Google Scholar
Wiener, Norbert (1961), Cybernetics, or Control and Communication in the Animal and the Machine (2nd ed.). Cambridge, MA: MIT Press.CrossRefGoogle Scholar
Zurek, Wojciech H. (ed.) (1990), Complexity, Entropy, and the Physics of Information: Proceedings of the SFI Workshop. Santa Fe Institute Studies in the Sciences of Complexity, vol. VIII. Redwood City, CA: Addison-Wesley.Google Scholar