Joseph F. Traub

Joseph Frederick Traub (June 24, 1932 – August 24, 2015) was an American computer scientist. He was the Edwin Howard Armstrong Professor of Computer Science at Columbia University and External Professor at the Santa Fe Institute. He held positions at Bell Laboratories, University of Washington, Carnegie Mellon, and Columbia, as well as sabbatical positions at Stanford, Berkeley, Princeton, California Institute of Technology, and Technical University, Munich.

Traub was the author or editor of ten monographs and some 120 papers in computer science, mathematics, physics, finance, and economics. In 1959 he began his work on optimal iteration theory culminating in his 1964 monograph, Iterative Methods for the Solution of Equations. Subsequently, he pioneered work with Henryk Woźniakowski on computational complexity applied to continuous scientific problems (information-based complexity). He collaborated in creating significant new algorithms including the Jenkins-Traub Algorithm for Polynomial Zeros, as well as the Shaw-Traub, Kung-Traub, and Brent-Traub algorithms. One of his research areas was continuous quantum computing. As of November 10, 2015, his works have been cited 8500 times, and he has an h-index of 35.

From 1971 to 1979 Traub headed the Computer Science Department at Carnegie Mellon during a critical period. From 1979 to 1989 he was the founding Chair of the Computer Science Department at Columbia. From 1986 to 1992 he served as founding Chair of the Computer Science and Telecommunications Board, National Academies and held the post again 2005–2009. Traub was founding editor of the Annual Review of Computer Science (1986–1990) and Editor-in-Chief of the Journal of Complexity (1985–2015). Both his research and institution building work have had a major impact on the field of computer science.

Early career
Traub attended the Bronx High School of Science where he was captain and first board of the chess team. After graduating from City College of New York he entered Columbia in 1954 intending to take a PhD in physics. In 1955, on the advice of a fellow student, Traub visited the IBM Watson Research Lab at Columbia. At the time, this was one of the few places in the country where a student could gain access to computers. Traub found his proficiency for algorithmic thinking matched perfectly with computers. In 1957 he became a Watson Fellow through Columbia. His thesis was on computational quantum mechanics. His 1959 PhD is in applied mathematics since computer science degrees were not yet available. (Indeed, there was no Computer Science Department at Columbia until Traub was invited there in 1979 to start the Department.)

Career
In 1959, Traub joined the Research Division of Bell Laboratories in Murray Hill, NJ. One day a colleague asked him how to compute the solution of a certain problem. Traub could think of a number of ways to solve the problem. What was the optimal algorithm, that is, a method which would minimize the required computational resources? To his surprise, there was no theory of optimal algorithms. (The phrase computational complexity, which is the study of the minimal resources required to solve computational problems was not introduced until 1965.) Traub had the key insight that the optimal algorithm for solving a continuous problem depended on the available information. This was to eventually lead to the field of information-based complexity. The first area for which Traub applied his insight was the solution of nonlinear equations. This research led to the 1964 monograph, Iterative Methods for the Solution of Equations. which is still in print.

In 1966 Traub spent a sabbatical year at Stanford University where he met a student named Michael Jenkins. Together they developed the Jenkins-Traub Algorithm for Polynomial Zeros, which was published as Jenkins' Ph.D. thesis. This algorithm is still one of the most widely used methods for this problem and is included in many textbooks.

In 1970 Traub became a professor at the University of Washington and in 1971 he became Head of the Carnegie Mellon Computer Science Department. The Department was quite small but still included "giants" such as Allen Newell and Herbert A. Simon. By 1978, under Traub's leadership, the Department had grown to some 50 teaching and research faculty.

One of Traub's PhD students was H. T. Kung, now a chaired professor at Harvard. They created the Kung-Traub algorithm for computing the expansion of an algebraic function. They showed that computing the first $$N$$ terms was no harder than multiplying two $$N$$-th degree polynomials.

In 1973 Traub invited Henryk Woźniakowski to visit CMU. They pioneered the field of information-based complexity, co-authoring three monographs and numerous papers. Woźniakowski became a professor at both Columbia and the University of Warsaw, Poland.

In 1978, while on sabbatical at Berkeley, he was recruited by Peter Likins to become founding Chairman of the Computer Science Department at Columbia and Edwin Howard Armstrong Professor of Computer Science. He served as chair 1979–1989.

In 1980 he co-authored A General Theory of Optimal Algorithms, with Woźniakowski. This was the first research monograph on information-based complexity. Greg Wasilkowski joined Traub and Woźniakowski in two more monographs Information, Uncertainty, Complexity, Addison-Wesley, 1983, and Information-Based Complexity, Academic Press, 1988.

In 1985 Traub became founding Editor-in-Chief of the Journal of Complexity. This was probably the first journal which had complexity in the sense of computational complexity in its title.

In 1986, Traub was asked by the National Academies to form a Computer Science Board. The original name of the Board was the Computer Science and Technology Board (CSTB). Several years later CSTB was asked to also be responsible for telecommunications so it was renamed the Computer Science and Telecommunications Board, preserving the abbreviation CSTB. The Board deals with critical national issues in computer science and telecommunications. Traub served as founding chair 1986–1992 and held the post again 2005–2009.

In 1990 Traub taught in the summer school of the Santa Fe Institute (SFI). He has since played a variety of roles at SFI. In the nineties he organized a series of Workshops on Limits to Scientific Knowledge funded by the Alfred P. Sloan Foundation. The goal was to enrich science in the same way that the work of Gödel and Turing on the limits of mathematics enriched that field. There were a series of Workshops on limits in various disciplines: physics, economics, and geophysics.

Starting in 1991 Traub was co-organizer of an international Seminar on "Continuous Algorithms and Complexity" at Schloss Dagstuhl, Germany. Many of the Seminar talks are on information-based complexity and more recently on continuous quantum computing.

Traub was invited by the Accademia Nazionale dei Lincee in Rome, Italy, to present the 1993 Lezione Lincee. He chose to give the cycle of six lectures at the Scuola Normale in Pisa. He invited Arthur Werschulz to join him in publishing the lectures. The lectures appeared in expanded form as Complexity and Information, Cambridge University Press, 1998.

In 1994 he asked a PhD student, Spassimir Paskov, to compare the Monte Carlo method (MC) with the Quasi-Monte Carlo method (QMC) when calculating a collateralized mortgage obligation (CMO) Traub had obtained from Goldman Sachs. This involved the numerical approximation of a number of integrals in 360 dimensions. To the surprise of the research group Paskov reported that QMC always beat MC for this problem. People in finance had always used MC for such problems and the experts in number theory believed QMC should not be used for integrals of dimension greater than 12. Paskov and Traub reported their results to a number of Wall Street firms to considerable initial skepticism. They first published the results in 1995. The theory and software was greatly improved by Anargyros Papageorgiou. Today QMC is widely used in the financial sector to value financial derivatives. QMC is not a panacea for all high dimensional integrals. Research is continuing on the characterization of problems for which QMC is superior to MC.

In 1999 Traub received the Mayor's medal for Science and Technology. Decisions regarding this award are made by the New York Academy of Sciences. The medal was awarded by Mayor Rudy Giuliani in a ceremony in Gracie Mansion.

Traub and his colleagues have also worked on continuous quantum computing. Moore's law is an empirical observation that the number of features on a chip doubles roughly every 18 months. This has held since the early 60s and is responsible for the computer and telecommunications revolution. It is widely believed that Moore's law will cease to hold in 10–15 years using silicon technology. There is therefore interest in creating new technologies. One candidate is quantum computing. That is building a computer using the principles of quantum mechanics. The motivation is that most problems in physical science, engineering, and mathematical finance have continuous mathematical models.

In 2005 Traub donated archival material to the Carnegie Mellon University Library. This collection is being digitized.

Patents on algorithms and software
The U.S. patents US5940810 and US0605837 were issued to Traub et al. for the FinDer Software System and were assigned to Columbia University. These patents cover an application of a well known technique (low discrepancy sequences) to a well known problem (valuation of securities).

Personal life
Traub had two daughters, Claudia Traub-Cooper and Hillary Spector. He lived in Manhattan and Santa Fe with his wife, author Pamela McCorduck. He often opined on current events by writing to the New York Times, which frequently published his comments.

Selected honors and distinctions

 * Founding Chair, Computer Science and Telecommunications Board, National Academies, 1986–92, 2005–2009
 * Distinguished Senior Scientist Award, Alexander von Humboldt Foundation, 1992, 1998
 * 1993 Lezione Lincee, Accademia Nazionale dei Lincei, Rome, Italy
 * Lecture, Presidium, Academy of Sciences, Moscow, USSR 1990
 * First Prize, Ministry of Education, Poland, for the research monograph "Information-Based Complexity", 1989
 * Board of Governors, New York Academy of Sciences, 1986-9 (Executive Committee 1987–89)
 * Fellow: American Association for the Advancement of Science, 1971; ACM 1994; New York Academy of Sciences, 1999; American Mathematical Society, 2012
 * 1999 New York City Mayor's Award for Excellence in Science and Technology
 * Festschrift for Joseph F. Traub, Academic Press, 1993
 * Festschrift for Joseph F. Traub, Elsevier, 2004
 * Honorary Doctorate of Science, University of Central Florida, 2001
 * Founding Editor-in-Chief, Journal of Complexity, 1985
 * Founding Editor-in-Chief, Journal of Complexity, 1985

Selected monographs

 * Iterative Methods for the Solution of Equations, Prentice Hall, 1964. Reissued Chelsea Publishing Company, 1982; Russian translation MIR, 1985; reissued American Mathematical Society, 1998.
 * Algorithms and Complexity: New Directions and Recent Results, (editor) Academic Press, 1976.
 * Information-Based Complexity, Academic Press, 1988 (with G. Wasilkowski and H. Woźniakowski).
 * Complexity and Information, Cambridge University Press, 1998 (with A. G. Werschulz); Japanese translation, 2000.

Selected papers

 * Variational Calculations of the $$2^3P$$ State of Helium, Phys. Rev. 116, 1959, 914–919.
 * The Future of Scientific Journals, Science 158, 1966, 1153–1159 (with W. S. Brown and J. R. Pierce).
 * A Three-Stage Variable-Shift Iteration for Polynomial Zeros and Its Relation to Generalized Rayleigh Iteration, Numerische mathematik 14, 1970, 252–263 (with M. A. Jenkins).
 * Computational Complexity of Iterative Processes, SIAM Journal on Computing 1, 1972, 167–179.
 * Parallel Algorithms and Parallel Computational Complexity, Proceedings IFIP Congress, 1974, 685–687.
 * Convergence and Complexity of Newton Iteration for Operator Equations, Journal of the ACM 26, 1979, 250–258 (with H. Woźniakowski).
 * All Algebraic Functions Can Be Computed Fast, Journal of the ACM 25, 1978, 245–260 (with H. T. Kung).
 * ''On the Complexity of Composition and Generalized Composition of Power Series, SIAM Journal on Computing 9, 1980, 54–66 (with R. Brent).
 * Complexity of Linear Programming, Operations Research Letters 1, 1982, 59–62 (with H. Woźniakowski).
 * Information-Based Complexity, Nature 327, July, 1987, 29–33 (with E. Packel).
 * The Monte Carlo Algorithm with a Pseudo-Random Number Generator, Mathematics of Computation 58, 199, 303–339 (with H. Woźniakowski).
 * Breaking Intractability, Scientific American, January, 1994, 102–107 (with H. Woźniakowski). Translated into German, Italian, Japanese and Polish.
 * Linear Ill-Posed Problems are Solvable on the Average for All Gaussian Measures, Math Intelligencer 16, 1994, 42–48 (with A. G. Werschulz).
 * Faster Evaluation of Financial Derivatives, Journal of Portfolio Management 22, 1995, 113–120 (with S. Paskov).
 * A Continuous Model of Computation, Physics Today, May, 1999, 39–43.
 * No Curse of Dimensionality for Contraction Fixed points in the Worst Case, Econometrics, Vol. 70, No. 1, January, 2002, 285–329 (with J. Rust and H. Woźniakowski).
 * Path Integration on a Quantum Computer, Quantum Information Processing, 2003, 365–388 (with H. Woźniakowski).