Association of ideas

Association of ideas, or mental association, is a process by which representations arise in consciousness, and also for a principle put forward by an important historical school of thinkers to account generally for the succession of mental phenomena. The term is now used mostly in the history of philosophy and of psychology. One idea was thought to follow another in consciousness if it were associated by some principle. The three commonly asserted principles of association were similarity, contiguity, and contrast, numerous others had been added by the nineteenth century. By the end of the nineteenth century physiological psychology was so altering the approach to this subject that much of the older associationist theory was rejected.

Everyday observation of the association of one idea or memory with another gives a face validity to the notion. In addition, the notion of association between ideas and behavior gave some early impetus to behaviorist thinking. The core ideas of associationist thinking recur in some recent thought on cognition, especially consciousness.

Early theory
The associationist theory is anticipated in Plato's Phaedo, as part of the doctrine of anamnesis. The idea of Simmias is recalled by the picture of Simmias (similarity) and that of a friend by the sight of the lyre on which he played (contiguity). But Aristotle is credited with originating associationist thinking based on this passage:

""When, therefore, we accomplish an act of Reminiscence, we pass through a certain series of precursive movements, until we arrive at a movement, on which the one we are in quest of is habitually consequent. Hence too it is, that we hunt through the mental train, excogitating from the present or some other, and from its similar or contrary or coadjacent. Through this process Reminiscence is effected. For the movements are, in these cases, sometimes at the same, sometimes at the same time, sometimes parts of the same whole; so that the subsequent movement is already more than half accomplished.""

- Aristotle as translated by W. Hamilton

Both Thomas Hobbes and John Locke are accredited for the initial study of theory of association. The basis of Hobbes's theory of association is that motion is what rules and attributes to mental activity. Hobbes tells us that the associations which already exist in our minds are what rule our flow of imaginations: "But as we have no imagination, whereof we have not formerly had sense, in whole, or in part; so we have no transition from one imagination to another, whereof we never had the like before in our senses.” Much of these rules, Hobbes says, do not really apply in our dreams. The passage is obscure, but it indicates the principles known as contiguity, similarity, and contrast. Similar principles are stated by Zeno the Stoic, by Epicurus (see Diogenes Laertius vii. § 52, x. § 32), and by St Augustine of Hippo (Confessions, x. c. 19). Aristotle's doctrine was expanded and illustrated during throughout the Middle Ages, and in some cases even into the 17th century. William Hamilton listed philosophical authorities who gave prominence to the general fact of mental association - the Spanish philosopher Joannes Lodovicus Vives (1492–1540) especially being exhaustive in his account of memory.

In Thomas Hobbes's psychology much importance is assigned to what he called, variously, the succession, sequence, series, consequence, coherence, train of imaginations or thoughts in mental discourse. But not before David Hume is there an express question as to what are the distinct principles of association. John Locke had, meanwhile, introduced the phrase "association of ideas" as the title of a supplementary chapter incorporated with the fourth edition of his Essay, though with little or no suggestion of its general psychological import. Hume reduced the principles of association to three: similarity, contiguity in time and place, and cause and/or effect. Dugald Stewart suggested resemblance, contrariety, and vicinity in time and place, though he added, as another obvious principle, accidental coincidence in the sounds of words, and further noted three other cases of relation: cause and effect, means and end, and premise and conclusion, as connecting trains of thought under circumstances of special attention. Thomas Reid, made light of association, remarking that it seems to require only the power of habit to explain the spontaneous recurrence of trains of thinking, which become familiar by frequent repetition (Intellectual Powers, p. 387).

Hamilton's own theory of mental reproduction, suggestion, or association is a development of his ideas in Lectures on Metaphysics (vol. ii. p. 223, seq.), which reduced the principles of association to simultaneity and affinity, and these further to one supreme principle of redintegration or totality. In the final scheme he sets out four general laws of mental succession:
 * (1) Associability or possible co-suggestion (all thoughts of the same mental subject are associable or capable of suggesting each other);
 * (2) Repetition or direct remembrance (thoughts identical in a modification, but differing in time, tend to suggest each other);
 * (3) Redintegration, indirect remembrance or reminiscence (thoughts once identical in time, but different as mental modes, are suggestive of each other in the order they originally held);
 * (4) Preference (thoughts are suggested not merely by the general subjective relation subsisting between them, they are also suggested in proportion to the amount of interest they hold to the individual mind).

These special laws logically follow from the general laws above:
 * A - Primary - Modes of the Laws of Repetition and Redintegration:
 * (1) Law of Similars (Analogy, Affinity);
 * (2) Law of Contrast; and
 * (3) Law of Coadjacency (Cause and Effect, etc.).
 * B - Secondary - Modes of the Law of Preference, under the Law of Possibility:
 * (1) Laws of Immediacy and Homogeneity; and
 * (2) Law of Facility.

The Associationist School
The Associationist School includes the English psychologists who aimed at explaining all mental acquisitions and the more complex mental processes generally under laws under the associations which their predecessors applied only to simple reproduction. Hamilton, though professing to deal with reproduction only, formulates a number of still more general laws of mental succession: Law of Succession, Law of Variation, Law of Dependence, Law of Relativity or Integration (involving Law of Conditioned), and, finally, Law of Intrinsic or Objective Relativity. These he posits as the highest to which human consciousness is subject, but it is in a sense quite different that the psychologists of the Associationist School intend their appropriation of the principle or principles commonly signalized. In this regard, as far as can be judged from imperfect records, they were anticipated to some extent by the experientialists of ancient times, both Stoic and Epicurean (cf. Diogenes Laertius, as above).

In the period that led to modern philosophy, Hobbes was the first thinker of permanent note to whom this doctrine may be traced. Although he took a narrow view of the phenomena of mental succession, he (after dealing with trains of imagination or "mental discourse") sought in the higher departments of intellect to explain reasoning as a discourse in words, dependent upon an arbitrary system of marks, each associated with or standing for a variety of imaginations. Except for a general assertion that reasoning is a reckoning (otherwise, a compounding and resolving), he had no other account of knowledge to give. The whole emotional side of mind ("the passions") he similarly resolved into an expectation of consequences based on past experience of pleasures and pains of sense. Thus, though he made no serious attempt to justify his analysis in detail, he is undoubtedly to be classed with the associationists of the next century. They, however, were wont to trace their psychological theory no further back than to Locke's Essay. Bishop Berkeley was driven to posit expressly a principle of suggestion or association in these terms: "That one idea may suggest another to the mind, it will suffice that they have been observed to go together, without any demonstration of the necessity of their coexistence, or so much as knowing what it is that makes them so to coexist." (New Theory of Vision, § 25) and, to support the obvious application of the principle to the case of the sensations of sight and touch before him, he constantly urged that association of sound and sense of language which the later school has always put in the foreground, whether as illustrating the principle in general or in explanation of the supreme importance of language for knowledge. It was natural, then, that Hume, coming after Berkeley and assuming Berkeley's results (though he reverted to the larger inquiry of Locke), should be more explicit in his reference to association. But Hume was original also, when he spoke of it as a "kind of attraction which in the mental world will be found to have as extraordinary effects as in the natural, and to show itself in as many and as various forms." (Human Nature, i. 1, § 4)

Other inquirers about the same time conceived of association with this breadth of view, and set themselves to track, as psychologists, its effects in detail.

David Hartley
David Hartley is the thinker most precisely identified with the Associationist School. In his Observations on Man, published in 1749 (11 years after Hume's A Treatise of Human Nature and one year after the better known An Enquiry Concerning Human Understanding), opened the path for all the investigations of like nature that have been so characteristic of English psychology. A physician by profession, he sought to combine with an elaborate theory of mental association a minutely detailed hypothesis as to the corresponding action of the nervous system, based upon the suggestion of a vibratory motion within the nerves thrown out by Isaac Newton in the last paragraph of the Principia. So far, however, from promoting the acceptance of the psychological theory, this physical hypothesis proved to have rather the opposite effect, and it began to be dropped by Hartley's followers (as Joseph Priestley, in his abridged edition of the Observations, 1775) before it was seriously impugned from without. When it is studied in the original, and not taken upon the report of hostile critics, who would not, or could not understand it, no little importance must still be accorded to the first attempt, not seldom a curiously felicitous one, to carry through that parallelism of the physical and psychical, which since then has come to count for more and more in the science of mind. Nor should it be forgotten that Hartley himself, for all his paternal interest in the doctrine of vibrations, was careful to keep separate from its fortunes the cause of his other doctrine of mental association. Of this the point lay in no mere restatement, with new precision, of a principle of coherence among "ideas" (which were also called by Hartley "vestiges", "types" and "images"), but in its being taken as a clue by which to follow the progressive development of the mind's powers. Holding that mental states could be scientifically understood only as they were analysed, Hartley sought for a principle of synthesis to explain the complexity exhibited not only in trains of representative images, but alike in the most involved combinations of reasonings and (as Berkeley had seen) in the apparently simple phenomena of objective perception, as well as in the varied play of the emotions, or, again, in the manifold conscious adjustments of the motor system. One principle appeared to him sufficient for all, running, as enunciated for the simplest case, thus: "Any sensations A, B, C, etc., by being associated with one another a sufficient number of times, get such a power over the corresponding ideas a, b, c, etc., that any one of the sensations A, when impressed alone, shall be able to excite in the mind b, c, etc., the ideas of the rest." To render the principle applicable in the cases where the associated elements are neither sensations nor simple ideas of sensations, Hartley's first care was to determine the conditions under which states other than these simplest ones have their rise in the mind, becoming the matter of ever higher and higher combinations. The principle itself supplied the key to the difficulty, when coupled with the notion, already implied in Berkeley's investigations, of a coalescence of simple ideas of sensation into one complex idea, which may cease to bear any obvious relation to its constituents. So far from being content, like Hobbes, to make a rough generalization to all mind from the phenomena of developed memory, as if these might be straightway assumed, Hartley made a point of referring them, in a subordinate place of their own, to his universal principle of mental synthesis. He expressly put forward the law of association, endued with such scope, as supplying what was wanting to Locke's doctrine in its more strictly psychological aspect, and thus marks by his work a distinct advance on the line of development of the experiential philosophy.

Continuing reception
The new doctrine received warm support from some, as William Law and Priestley, who both, like Hume and Hartley himself, took the principle of association as having the like import for the science of mind that gravitation had acquired for the science of matter. The principle began also, if not always with direct reference to Hartley, yet, doubtless, owing to his impressive advocacy of it, to be applied systematically in special directions, as by Abraham Tucker (1768) to morals, and by Archibald Alison (1790) to aesthetics. Thomas Brown (d. 1820) subjected anew to discussion the question of theory. Hardly less unjust to Hartley than Reid or Stewart had been, and forward to proclaim all that was different in his own position, Brown must yet be ranked with the associationists before and after him for the prominence he assigned to the associative principle in sensory perception (what he called "external affections of mind"), and for his reference of all other mental states ("internal affections") to the two generic capacities or susceptibilities of Simple and Relative Suggestion. He preferred the word "suggestion" to "association", which seemed to him to imply some prior connecting process, for which there was no evidence in many of the most important cases of suggestion, nor even, strictly speaking, in the case of contiguity in time where the term seemed least inapplicable. According to him, all that could be assumed was a general constitutional tendency of the mind to exist successively in states that have certain relations to each other, of itself only, and without any external cause or any influence previous to that operating at the moment of the suggestion. Brown's chief contribution to the general doctrine of mental association, besides what he did for the theory of perception, was, perhaps, his analysis of voluntary reminiscence and constructive imagination, faculties that appear at first sight to lie altogether beyond the explanatory range of the principle. In James Mill's Analysis of the Phenomena of the Human Mind (1829), the principle, much as Hartley had conceived it, was carried out, with characteristic consequence, over the psychological field. With a much enlarged and more varied conception of association, Alexander Bain reexecuted the general psychological task, while Herbert Spencer revised the doctrine from the new point of view of the evolution hypothesis. John Stuart Mill made only occasional excursions into the region of psychology proper, but sought, in his System of Logic (1843), to determine the conditions of objective truth from the point of view of the associationist theory, and, thus or otherwise being drawn into general philosophical discussion, spread wider than any one before him its repute.

French and German associationists and Kant
The Associationist School was composed chiefly of British thinkers, but in France also it had distinguished representatives. Of these it will suffice to mention Condillac, who professed to explain all knowledge from the single principle of association (liaison) of ideas, operating through a previous association with signs, verbal or other. In Germany, before the time of Immanuel Kant, mental association was generally treated in the traditional manner, as by Christian Wolff.

Kant's inquiry into the foundations of knowledge, agreeing in its general purport with Locke's, however it differed in its critical procedure, brought him face to face with the newer doctrine that had been grafted on Locke's philosophy. To account for the fact of synthesis in cognition, in express opposition to associationism, as represented by Hume, was, in truth, his prime object, starting, as he did, from the assumption that there was in knowledge that which no mere association of experiences could explain.

To the extent, therefore, that his influence prevailed, all inquiries made by the English associationists were discounted in Germany. Notwithstanding, under the very shadow of his authority a corresponding, if not related, movement was initiated by Johann Friedrich Herbart. As peculiar and widely different from anything conceived by the associationists as Herbart's metaphysical opinions were, he was at one with them and at variance with Kant in assigning fundamental importance to the psychological investigation of the development of consciousness. Further, his conception of the laws determining the interaction and flow of mental presentations and representations, when taken in its bare psychological import, was essentially similar to theirs. In Friedrich Eduard Beneke's psychology also and in more recent inquiries conducted mainly by physiologists, mental association has been understood in its wider scope, as a general principle of explanation.

Differences among versions of associationist thought
The associationists differ among themselves in the statement of their principle and, when they adduce several principles, in their conception of the relative importance of these.
 * Hartley took account only of Contiguity, or the repetition of impressions synchronous or immediately successive.
 * The same is true of James Mill, though, incidentally, he made an express attempt to resolve the received principle of Similarity and, through this, the other principle of Contrast, into his fundamental law (the Law of Frequency, as he sometimes called it, because upon frequency, in conjunction with vividness of impressions, the strength of association, in his view, depended).
 * In a sense of his own, Brown also, while accepting the common Aristotelian enumeration of principles, inclined to the opinion that "all suggestion may be found to depend on prior coexistence, or at least on such proximity as is itself very probably a modification of coexistence", provided account be taken of:
 * "the influence of emotions and other feelings that are very different from ideas, as when an analogous object suggests an analogous object by the influence of an emotion which each separately may have produced before, and which is, therefore, common to both."


 * To the contrary effect, Spencer maintained that the fundamental law of all mental association is that presentations aggregate or cohere with their like in past experience, and that, besides this law, there is in strictness no other, all further phenomena of association being incidental. Thus in particular, he would have explained association by Contiguity as due to the circumstance of imperfect assimilation of the present to the past in consciousness.
 * Alexander Bain regarded Contiguity and Similarity logically, as perfectly distinct principles, though in actual psychological occurrence blending intimately with each other, contiguous trains being started by a first (it may be, implicit) representation through Similarity, while the express assimilation of present to past in consciousness is always, or tends to be, followed by the revival of what was presented in contiguity with that past.

Inseparable association
The highest philosophical interest, as distinguished from that which is more strictly psychological, attaches to the mode of mental association called Inseparable. The coalescence of mental states noted by Hartley, as it had been assumed by Berkeley, was farther formulated by James Mill in these terms: "Some ideas are by frequency and strength of association so closely combined that they cannot be separated; if one exists, the other exists along with it in spite of whatever effort we make to disjoin them." (Analysis of the Human Mind, 2nd ed., vol. i, p. 93) John Stuart Mill's statement was more guarded and particular: "When two phenomena have been very often experienced in conjunction, and have not, in any single instance, occurred separately either in experience or in thought, there is produced between them what has been called inseparable, or, less correctly, indissoluble, association; by which is not meant that the association must inevitably last to the end of life - that no subsequent experience or process of thought can possibly avail to dissolve it; but only that as long as no such experience or process of thought has taken place, the association is irresistible; it is impossible for us to think the one thing disjoined from the other." (Examination of Hamilton's Philosophy, 2nd ed., p. 191) It is chiefly by John Stuart Mill that the philosophical application of the principle has been made. The first and most obvious application is to so-called necessary truths, those that are not merely analytic judgments but involve a synthesis of distinct notions. Again, the same thinker sought to prove Inseparable Association the ground of belief in an external objective world. The former application, especially, is facilitated, when the experience through which the association is supposed to be constituted is understood as cumulative in the race, and transmissible as original endowment to individuals - endowment that may be expressed either, subjectively, as latent intelligence or, objectively, as fixed nervous connexions. Spencer, as suggested before, is the author of this extended view of mental association.

Criticism in the 19th century
In the later part of the 19th century the associationist theory was subjected to searching criticism, and it was maintained by many writers that the laws are both unsatisfactorily expressed and insufficient to explain the facts. Among the most vigorous and comprehensive of these investigations is that of F. H. Bradley in his Principles of Logic (1883). Having admitted the psychological fact of mental association, he attacks the theories of Mill and Bain primarily on the ground that they purport to give an account of mental life as a whole, a metaphysical doctrine of existence. According to this doctrine, mental activity is ultimately reducible to particular feelings, impressions, ideas, which are disparate and unconnected, until chance association brings them together. On this assumption, the Laws of Association naturally emerge in the following form:
 * The Law of Contiguity
 * "Actions, sensations and states of feeling, occurring together or in close connection, tend to grow together, or cohere, in such a way that, when any one of them is afterwards presented to the mind, the others are apt to be brought up in idea." (A. Bain, Senses and Intellect, p. 327)


 * The Law of Similarity
 * "Present actions, sensation, thoughts or emotions tend to revive their like among previous impressions or states." (A. Bain, Senses and Intellect, p. 457 – compare J. S. Mill, Logic, 9th ed., ii, p. 440)

The fundamental objection to the Law of Contiguity is that ideas and impressions, once experienced, do not recur; they are particular existences, and, as such, do not persevere to recur or be presented. So Mill is wrong in speaking of two impressions being "frequently experienced." Bradley claims thus to reduce the law to:
 * "When we have experienced (or even thought of) several pairs of impressions (simultaneous or successive), which pairs are like one another; then whenever an idea occurs which is like all the impressions on one side of these pairs, it tends to excite an idea which is like all the impressions on the other side."

This statement is destructive of the title of the law, because it appears that what were contiguous (the impressions) are not associated, and what are associated (the ideas) were not contiguous; in other words, the association is not due to contiguity at all.

Proceeding to the Law of Similarity (which in Mill's view is at the back of association by contiguity), and having made a similar criticism of its phrasing, Bradley maintains that it involves an even greater absurdity; if two ideas are to be recognized as similar, they must both be present in the mind; if one is to call up the other, one must be absent. To the obvious reply that the similarity is recognized ex post facto, and not while the former idea is being called up, Bradley replies simply that such a view reduces the law to the mere statement of a phenomenon and deprives it of any explanatory value, though he hardly makes it clear in what sense this necessarily invalidates the law from a psychological point of view. He further points out with greater force that in point of fact mere similarity is not the basis of ordinary cases of mental reproduction, inasmuch as in any given instance there is more difference than similarity between the ideas associated.

Bradley himself bases association on identity plus contiguity:
 * "Any part of a single state of mind tends, if reproduced, to re-instate the remainder."

or
 * "Any element tends to reproduce those elements with which it has formed one state of mind."

This law he calls by the name "redintegration", understood, of course, in a sense different from that in which Hamilton used it. The radical difference between this law and those of Mill and Bain is that it deals not with particular units of thoughts but with universals or identity between individuals. In any example of such reproduction, the universal appears in a particular form which is more or less different from that in which it originally existed.

Psychophysical researches
F. H. Bradley's discussion deals with the subject purely from the metaphysical side, and the total result practically is that association occurs only between universals. From the point of view of empirical psychologists Bradley's results are open to the charge which he made against those who impugned his view of the Law of Similarity, namely that they are merely a statement - not in any real sense an explanation. The relation between the mental and the physical phenomena of association has occupied the attention of all the leading psychologists. William James holds that association is of "objects" not of "ideas," is between "things thought of" - so far as the word stands for an effect. "So far as it stands for a cause it is between processes in the brain." Dealing with the Law of Contiguity he says that the "most natural way of accounting for it is to conceive it as a result of the laws of habit in the nervous system; in other words to ascribe it to a physiological cause." Association thus results because when a nerve current has once passed by a given way, it will pass more easily by that way in future; and this fact is a physical fact. He further seeks to maintain the important deduction that the only primary or ultimate law of association is that of neural habit.

The objections to the associationist theory are summed up by George F. Stout (Analytic Psychol., vol. ii. pp. 47 seq.) under three heads. Of these the first is that the theory as stated, e.g., by Alexander Bain, lays far too much stress on the mere connexion of elements hitherto entirely separate; whereas, in fact, every new mental state or synthesis consists in the development or modification of a pre-existing state or psychic whole. Secondly, it is quite false to regard an association as merely an aggregate of disparate units; in fact, the form of the new idea is quite as important as the elements which it comprises. Thirdly, the phraseology used by the associationists seems to assume that the parts that go to form the whole retain their identity unimpaired; in fact, each part or element is ipso facto modified by the very fact of its entering into such combination.

The experimental methods in vogue in the early part of the 20th century to a large extent removed the discussion of the whole subject of association of ideas, depending in the case of the older writers on introspection, into a new sphere. In such a work as Edward B. Titchener's Experimental Psychology (1905), association was treated as a branch of the study of mental reactions, of which association reactions are one division.

Today the field is studied by neuroscientists and artificial intelligence researchers as well as philosophers and psychologists.