Norbert Wiener

Norbert Wiener (November 26, 1894 – March 18, 1964) was an American computer scientist, mathematician and philosopher. He became a professor of mathematics at the Massachusetts Institute of Technology (MIT). A child prodigy, Wiener later became an early researcher in stochastic and mathematical noise processes, contributing work relevant to electronic engineering, electronic communication, and control systems.

Wiener is considered the originator of cybernetics, the science of communication as it relates to living things and machines, "After much consideration, we have come to the conclusion that all the existing terminology has too heavy a bias to one side or another to serve the future development of the field as well as it should; and as happens so often to scientists, we have been forced to coin at least one artificial neo-Greek expression to fill the gap. We have decided to call the entire field of control and communication theory, whether in the machine or in the animal, by the name Cybernetics, which we form from the Greek κυβερνήτης or steersman." with implications for engineering, systems control, computer science, biology, neuroscience, philosophy, and the organization of society. His work heavily influenced computer pioneer John von Neumann, information theorist Claude Shannon, anthropologists Margaret Mead and Gregory Bateson, and others.

Wiener is credited as being one of the first to theorize that all intelligent behavior was the result of feedback mechanisms, that could possibly be simulated by machines and was an important early step towards the development of modern artificial intelligence.

Youth
Wiener was born in Columbia, Missouri, the first child of Leo Wiener and Bertha Kahn, Jewish immigrants from Lithuania and Germany, respectively. Through his father, he was related to Maimonides, the famous rabbi, philosopher and physician from Al Andalus, as well as to Akiva Eger, chief rabbi of Posen from 1815 to 1837.

Leo had educated Norbert at home until 1903, employing teaching methods of his own invention, except for a brief interlude when Norbert was 7 years of age. Earning his living teaching German and Slavic languages, Leo read widely and accumulated a personal library from which the young Norbert benefited greatly. Leo also had ample ability in mathematics and tutored his son in the subject until he left home. In his autobiography, Norbert described his father as calm and patient, unless he (Norbert) failed to give a correct answer, at which his father would lose his temper.

In “The Theory of Ignorance”, a paper he wrote at the age of 10, he disputed “man’s presumption in declaring that his knowledge has no limits”, arguing that all human knowledge “is based on an approximation”, and acknowledging “the impossibility of being certain of anything.”

He graduated from Ayer High School in 1906 at 11 years of age, and Wiener then entered Tufts College. He was awarded a BA in mathematics in 1909 at the age of 14, whereupon he began graduate studies of zoology at Harvard. In 1910 he transferred to Cornell to study philosophy. He graduated in 1911 at 17 years of age.

Harvard and World War I
The next year he returned to Harvard, while still continuing his philosophical studies. Back at Harvard, Wiener became influenced by Edward Vermilye Huntington, whose mathematical interests ranged from axiomatic foundations to engineering problems. Harvard awarded Wiener a PhD in June 1913, when he was only 19 years old, for a dissertation on mathematical logic (a comparison of the work of Ernst Schröder with that of Alfred North Whitehead and Bertrand Russell), supervised by Karl Schmidt, the essential results of which were published as Wiener (1914). He was one of the youngest to achieve such a feat. In that dissertation, he was the first to state publicly that ordered pairs can be defined in terms of elementary set theory. Hence relations can be defined by set theory, thus the theory of relations does not require any axioms or primitive notions distinct from those of set theory. In 1921, Kazimierz Kuratowski proposed a simplification of Wiener's definition of ordered pairs, and that simplification has been in common use ever since. It is (x, y) = {{x}, {x, y}}.

In 1914, Wiener traveled to Europe, to be taught by Bertrand Russell and G. H. Hardy at Cambridge University, and by David Hilbert and Edmund Landau at the University of Göttingen. At Göttingen he also attended three courses with Edmund Husserl "one on Kant's ethical writings, one on the principles of Ethics, and the seminary on Phenomenology." (Letter to Russell, c. June or July, 1914). During 1915–16, he taught philosophy at Harvard, then was an engineer for General Electric and wrote for the Encyclopedia Americana. Wiener was briefly a journalist for the Boston Herald, where he wrote a feature story on the poor labor conditions for mill workers in Lawrence, Massachusetts, but he was fired soon afterwards for his reluctance to write favorable articles about a politician the newspaper's owners sought to promote.

Although Wiener eventually became a staunch pacifist, he eagerly contributed to the war effort in World War I. In 1916, with America's entry into the war drawing closer, Wiener attended a training camp for potential military officers but failed to earn a commission. One year later Wiener again tried to join the military, but the government again rejected him due to his poor eyesight. In the summer of 1918, Oswald Veblen invited Wiener to work on ballistics at the Aberdeen Proving Ground in Maryland. Living and working with other mathematicians strengthened his interest in mathematics. However, Wiener was still eager to serve in uniform and decided to make one more attempt to enlist, this time as a common soldier. Wiener wrote in a letter to his parents, "I should consider myself a pretty cheap kind of a swine if I were willing to be an officer but unwilling to be a soldier." This time the army accepted Wiener into its ranks and assigned him, by coincidence, to a unit stationed at Aberdeen, Maryland. World War I ended just days after Wiener's return to Aberdeen and Wiener was discharged from the military in February 1919.

After the war
Wiener was unable to secure a permanent position at Harvard, a situation he attributed largely to anti-Semitism at the university and in particular the antipathy of Harvard mathematician G. D. Birkhoff. He was also rejected for a position at the University of Melbourne. At W. F. Osgood's suggestion, Wiener was hired as an instructor of mathematics at MIT, where, after his promotion to professor, he spent the remainder of his career. For many years his photograph was prominently displayed in the Infinite Corridor and often used in giving directions, but by 2017 it had been removed.

In 1926, Wiener returned to Europe as a Guggenheim scholar. He spent most of his time at Göttingen and with Hardy at Cambridge, working on Brownian motion, the Fourier integral, Dirichlet's problem, harmonic analysis, and the Tauberian theorems.

In 1926, Wiener's parents arranged his marriage to a German immigrant, Margaret Engemann; they had two daughters. His sister, Constance (1898–1973), married mathematician Philip Franklin. Their daughter, Janet, Wiener's niece, married mathematician Václav E. Beneš. Norbert Wiener's sister, Bertha (1902–1995), married the botanist Carroll William Dodge.

Many tales, perhaps apocryphal, were told of Norbert Wiener at MIT, especially concerning his absent-mindedness. It was said that he returned home once to find his house empty. He inquired of a neighborhood girl the reason, and she said that the family had moved elsewhere that day. He thanked her for the information and she replied, "It's ok, Daddy, Mommy sent me to get you". Asked about the story, Wiener's daughter reportedly asserted that "he never forgot who his children were! The rest of it, however, was pretty close to what actually happened…"

In the run-up to World War II (1939–45) Wiener became a member of the China Aid Society and the Emergency Committee in Aid of Displaced German Scholars. He was interested in placing scholars such as Yuk-Wing Lee and Antoni Zygmund who had lost their positions.

During and after World War II
During World War II, his work on the automatic aiming and firing of anti-aircraft guns caused Wiener to investigate information theory independently of Claude Shannon and to invent the Wiener filter. (To him is due the now standard practice of modeling an information source as a random process—in other words, as a variety of noise.) Initially his anti-aircraft work led him to write, with Arturo Rosenblueth and Julian Bigelow the 1943 article 'Behavior, Purpose and Teleology', which was published in Philosophy of Science. Subsequently his anti-aircraft work led him to formulate cybernetics. After the war, his fame helped MIT to recruit a research team in cognitive science, composed of researchers in neuropsychology and the mathematics and biophysics of the nervous system, including Warren Sturgis McCulloch and Walter Pitts. These men later made pioneering contributions to computer science and artificial intelligence. Soon after the group was formed, Wiener suddenly ended all contact with its members, mystifying his colleagues. This emotionally traumatized Pitts, and led to his career decline. In their biography of Wiener, Conway and Siegelman suggest that Wiener's wife Margaret, who detested McCulloch's bohemian lifestyle, engineered the breach.

Wiener later helped develop the theories of cybernetics, robotics, computer control, and automation. He discussed the modeling of neurons with John von Neumann, and in a letter from November 1946 von Neumann presented his thoughts in advance of a meeting with Wiener.

Wiener always shared his theories and findings with other researchers, and credited the contributions of others. These included Soviet researchers and their findings. Wiener's acquaintance with them caused him to be regarded with suspicion during the Cold War. He was a strong advocate of automation to improve the standard of living, and to end economic underdevelopment. His ideas became influential in India, whose government he advised during the 1950s.

After the war, Wiener became increasingly concerned with what he believed was political interference with scientific research, and the militarization of science. His article "A Scientist Rebels" from the January 1947 issue of The Atlantic Monthly urged scientists to consider the ethical implications of their work. After the war, he refused to accept any government funding or to work on military projects. The way Wiener's beliefs concerning nuclear weapons and the Cold War contrasted with those of von Neumann is the major theme of the book John Von Neumann and Norbert Wiener.

Wiener was a participant of the Macy conferences.

Personal life
In 1926 Wiener married Margaret Engemann, an assistant professor of modern languages at Juniata College. They had two daughters. Opinions are not all positive on Margaret's impacts on Wiener's career.

Wiener admitted in his autobiography I Am a Mathematician: The Later Life of a Prodigy to abusing benzadrine throughout his life without being fully aware of its dangers.

Wiener died in March 1964, aged 69, in Stockholm, from a heart attack. Wiener and his wife are buried at the Vittum Hill Cemetery in Sandwich, New Hampshire.

Awards and honors

 * Wiener was a Plenary Speaker of the ICM in 1936 at Oslo and in 1950 at Cambridge, Massachusetts.
 * Wiener won the Bôcher Memorial Prize in 1933 and the National Medal of Science in 1963, presented by President Johnson at a White House Ceremony in January, 1964, shortly before Wiener's death.
 * Wiener won the 1965 U.S. National Book Award in Science, Philosophy and Religion for God & Golem, Inc.: A Comment on Certain Points where Cybernetics Impinges on Religion.
 * The Norbert Wiener Prize in Applied Mathematics was endowed in 1967 in honor of Norbert Wiener by MIT's mathematics department and is provided jointly by the American Mathematical Society and Society for Industrial and Applied Mathematics.
 * The Norbert Wiener Award for Social and Professional Responsibility awarded annually by CPSR, was established in 1987 in honor of Wiener to recognize contributions by computer professionals to socially responsible use of computers.
 * The crater Wiener on the far side of the Moon is named after him.
 * The Norbert Wiener Center for Harmonic Analysis and Applications, at the University of Maryland, College Park, is named in his honor.
 * Robert A. Heinlein named a spaceship after him in his 1957 novel Citizen of the Galaxy, a "Free Trader" ship called the Norbert Wiener mentioned in Chapter 14.
 * The Norbert Wiener Center for Harmonic Analysis and Applications (NWC) in the Department of Mathematics at the University of Maryland, College Park is devoted to the scientific and mathematical legacy of Norbert Wiener. The NWC website highlights the research activities of the center. Further, each year the Norbert Wiener Center hosts the February Fourier Talks, a two-day national conference displaying advances in pure and applied harmonic analysis in industry, government, and academia.

Doctoral students

 * Shikao Ikehara (PhD 1930)
 * Dorothy Walcott Weeks (PhD 1930)
 * Norman Levinson (Sc.D. 1935)
 * Brockway McMillan (PhD 1939)
 * Abe Gelbart (PhD 1940)
 * John P. Costas (engineer) (PhD 1951)
 * Amar Bose (Sc.D. 1956)
 * George Zames (Sc.D. 1960)
 * Colin Cherry (PhD 1956)

Work
"Information is information, not matter or energy."

Wiener was an early studier of stochastic and mathematical noise processes, contributing work relevant to electronic engineering, electronic communication, and control systems. It was Wiener's idea to model a signal as if it were an exotic type of noise, giving it a sound mathematical basis. The example often given to students is that English text could be modeled as a random string of letters and spaces, where each letter of the alphabet (and the space) has an assigned probability. But Wiener dealt with analog signals, where such a simple example doesn't exist. Wiener's early work on information theory and signal processing was limited to analog signals, and was largely forgotten with the development of the digital theory.

Wiener is one of the key originators of cybernetics, a formalization of the notion of feedback, with many implications for engineering, systems control, computer science, biology, philosophy, and the organization of society. His work with cybernetics influenced Gregory Bateson and Margaret Mead, and through them, anthropology, sociology, and education.



Wiener equation
A simple mathematical representation of Brownian motion, the Wiener equation, named after Wiener, assumes the current velocity of a fluid particle fluctuates randomly.

Wiener filter
For signal processing, the Wiener filter is a filter proposed by Wiener during the 1940s and published in 1942 as a classified document. Its purpose is to reduce the amount of noise present in a signal by comparison with an estimate of the desired noiseless signal. Wiener developed the filter at the Radiation Laboratory at MIT to predict the position of German bombers from radar reflections. What emerged was a mathematical theory of great generality&mdash;a theory for predicting the future as best one can on the basis of incomplete information about the past. It was a statistical theory that included applications that did not, strictly speaking, predict the future, but only tried to remove noise. It made use of Wiener's earlier work on integral equations and Fourier transforms.

Nonlinear control theory
Wiener studied polynomial chaos, a key piece of which is the Hermite-Laguerre expansion. This was developed in detail in Nonlinear Problems in Random Theory.

Wiener applied Hermite-Laguerre expansion to nonlinear system identification and control. Specifically, a nonlinear system can be identified by inputting a white noise process and computing the Hermite-Laguerre expansion of its output. The identified system can then be controlled.

In mathematics
Wiener took a great interest in the mathematical theory of Brownian motion (named after Robert Brown) proving many results now widely known, such as the non-differentiability of the paths. Consequently, the one-dimensional version of Brownian motion was named the Wiener process. It is the best known of the Lévy processes, càdlàg stochastic processes with stationary statistically independent increments, and occurs frequently in pure and applied mathematics, physics and economics (e.g. on the stock-market).

Wiener's tauberian theorem, a 1932 result of Wiener, developed Tauberian theorems in summability theory, on the face of it a chapter of real analysis, by showing that most of the known results could be encapsulated in a principle taken from harmonic analysis. In its present formulation, the theorem of Wiener does not have any obvious association with Tauberian theorems, which deal with infinite series; the translation from results formulated for integrals, or using the language of functional analysis and Banach algebras, is however a relatively routine process.

The Paley–Wiener theorem relates growth properties of entire functions on Cn and Fourier transformation of Schwartz distributions of compact support.

The Wiener–Khinchin theorem, (also known as the Wiener – Khintchine theorem and the Khinchin – Kolmogorov theorem), states that the power spectral density of a wide-sense-stationary random process is the Fourier transform of the corresponding autocorrelation function.

An abstract Wiener space is a mathematical object in measure theory, used to construct a "decent", strictly positive and locally finite measure on an infinite-dimensional vector space. Wiener's original construction only applied to the space of real-valued continuous paths on the unit interval, known as classical Wiener space. Leonard Gross provided the generalization to the case of a general separable Banach space.

The notion of a Banach space itself was discovered independently by both Wiener and Stefan Banach at around the same time.

In popular culture
His work with Mary Brazier is referred to in Avis DeVoto's As Always, Julia.

A flagship named after him appears briefly in Citizen of the Galaxy by Robert Heinlein.

The song Dedicated to Norbert Wiener appears as the second track on the 1980 album Why? by G.G. Tonet (Luigi Tonet), released on the Italian It Why label.

Publications
Wiener wrote many books and hundreds of articles:
 * 1914, Reprinted in
 * 1930,
 * 1933, The Fourier Integral and Certain of its Applications Cambridge Univ. Press; reprint by Dover, CUP Archive 1988 ISBN 0-521-35884-1
 * 1942, Extrapolation, Interpolation and Smoothing of Stationary Time Series. A war-time classified report nicknamed "the yellow peril" because of the color of the cover and the difficulty of the subject. Published postwar 1949 MIT Press. http://www.isss.org/lumwiener.htm ])
 * 1948, Cybernetics: Or Control and Communication in the Animal and the Machine. Paris, (Hermann & Cie) & Camb. Mass. (MIT Press) ISBN 978-0-262-73009-9; 2nd revised ed. 1961.
 * 1950, The Human Use of Human Beings. The Riverside Press (Houghton Mifflin Co.).
 * 1958, Nonlinear Problems in Random Theory. MIT Press & Wiley.
 * 1964, God & Golem, Inc.: A Comment on Certain Points Where Cybernetics Impinges on Religion. MIT Press.
 * 1966, Generalized Harmonic Analysis and Tauberian Theorems. MIT Press.
 * 1993, This was written in 1954 but Wiener abandoned the project at the editing stage and returned his advance.  MIT Press published it posthumously in 1993.

Wiener's papers are collected in the following works:
 * 1964, Selected Papers of Norbert Wiener. Cambridge Mass. 1964 (MIT Press & SIAM)
 * 1976–84, The Mathematical Work of Norbert Wiener. Masani P (ed) 4 vols, Camb. Mass. (MIT Press). This contains a complete collection of Wiener's mathematical papers with commentaries, in the following volumes: Vol. 1, Mathematical philosophy and foundations; potential theory; Brownian movement, Wiener integrals, ergodic and chaos theories, turbulence and statistical mechanics (ISBN 0262230704); Vol. 2, Generalized harmonic analysis and Tauberian theory, classical harmonic and complex analysis (ISBN 0262230925); Vol. 3, The Hopf-Wiener integral equation; Prediction and filtering; Quantum mechanics and relativity; Miscellaneous mathematical papers (ISBN 0262231077); and Vol. 4, Cybernetics, science, and society; Ethics, aesthetics, and literary criticism; Book reviews and obituaries. (ISBN 0262231239)

Fiction:
 * 1959, The Tempter. Random House (on Oliver Heaviside's invention for lower distortion on telegraph lines and his fight with AT&T for the proper recognition of his analysis)

Autobiography:
 * Includes both volumes of Wiener's autobiography.
 * 1953, Ex-Prodigy: My Childhood and Youth. MIT Press.
 * 1956, I am a Mathematician. London (Gollancz).

Under the name "W. Norbert":
 * 1952, The Brain and other short science fiction in Tech Engineering News.