Hostname: page-component-78c5997874-v9fdk Total loading time: 0 Render date: 2024-11-08T01:20:04.015Z Has data issue: false hasContentIssue false
  • English
  • Français

Information, Entropy and Inductive Logic

Published online by Cambridge University Press:  14 March 2022

S. Pakswer
S. Pakswer*
Affiliation:
Elmhurst, Illinois
Get access Rights & Permissions [Opens in a new window]

Extract

It has been shown by several authors that in operations involving information a quantity appears which is the negative of the quantity usually defined as entropy in similar situations. This quantity ℜ = − KI has been termed “negentropy” and it has been shown that the negentropy of information and the physical entropy S are mirrorlike representations of the same train of events. In physical terminology the energy is degraded by an increase in entropy due to an increased randomness in the positions or velocities of components, wave functions, complexions in phase space; in informational terminology some information about the same components has been lost or the negentropy has been decreased. In equilibrium the system has for a given energy content maximum randomness (or minimum information is required). One consequence of this dual aspect was the idea to apply the methods of statistical mechanics to problems of communication and Brillouin showed that Fermi-Dirac statistics or generalized Fermi statistics are applicable for example to a transmission of signals such as telegrams.

Type
Research Article
Information
Philosophy of Science , Volume 21 , Issue 3 , July 1954 , pp. 254 - 259
Copyright
Copyright © Philosophy of Science Association 1954

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1. Wiener, N., Cybernetics, John Wiley & Sons, New York, 1948, p. 76.Google ScholarPubMed
2. Brillouin, L., J. of Applied Physics 22, 3, 334–337, 1951.10.1063/1.1699951CrossRefGoogle Scholar
3. Brillouin, L., J. of Applied Physics 22, 3, 338–343, 1951.10.1063/1.1699952CrossRefGoogle Scholar
4. Rothstein, Jerome, Science 114, 171–175, 1951.CrossRefGoogle Scholar
5. Rothstein, Jerome, J. of Applied Physics 23, 11, 1281–1282, 1952.CrossRefGoogle Scholar
6. Mach, Ernst, The Economy of Science. “Readings in Philosophy of Science” edited by Philip P. Wiener. Charles Scribner's Sons, New York, 1953, p. 446 ff.Google Scholar
7. Carnap, R., Logical Foundations of Probability, University of Chicago Press, 1950.Google Scholar
8. Carnap, R., The Continuum of Inductive Methods, University of Chicago Press, 1952.Google Scholar
9. Hillel, Yehoshua Bar and Carnap, R. Version of a paper read before the Symposium on Applications of Communication theory, London, Sept. 26, 1952.Google Scholar
10. Shannon, C. E. and Weaver, W., The Mathematical Theory of Communication, University of Illinois Press, 1949.Google Scholar