User:TheRobotPants/sandbox

Motor control is the process of organizing and executing actions in the world, typically attributed to embodied cognitive agents such as animals, humans, and robots. Fundamentally, it is the integration of sensory information, both about the world and the current state of the body, to determine the appropriate set of muscle forces and joint actuations to generate some desired movement or action. This process requires cooperative interaction between the central nervous system and the musculoskeletal system, and is thus a problem of information processing, coordination, mechanics, physics, and cognition. Successful motor control is crucial to interacting with the world, not only determining action capabilities, but regulating balance and stability as well.

The organization and production of movement is a complex problem, so the study of motor control has been approached from a wide range of disciplines, including psychology, cognitive science, biomechanics and neuroscience. While the modern study of motor control is an increasingly interdisciplinary field, research questions have historically been defined as either physiological or psychological, depending on whether the focus is on physical and biological properties, or organizational and structural rules. Areas of study related to motor control are motor coordination, motor learning, and signal processing.

Response to Stimuli
The process of becoming aware of a sensory stimuli and using that information to influence an action occurs in stages, and reaction time of simple tasks can be used to to reveal information about these stages. Reaction time refers to the period of time between when the stimulus is presented, and the end of the response. Movement time is the time it takes to complete the movement. Some of the first reaction time experiments were carried out by Franciscus Donders, who used the difference in response times to a simple reaction task and a choice reaction task to determine the length of time needed process the stimuli and choose the correct response. While this approach is ultimately flawed, it gave rise to the idea that reaction time was made up of a stimulus identification, followed by a response selection, and then the correct movement was carried out. Further research has provided evidence that these stages do exist, but that the response selection period of any reaction time increases as the number of available choices grows, a relationship known as Hick's law.

Closed Loop Control
Most movements that are carried out during day to day activity are formed using a continual process of accessing sensory information and using it to more accurately continue the motion. This type of motor control is called feedback control, as it relies on sensory feedback to control movements. Closed loop control is a feedback based mechanism of motor control, where any act on the environment creates some sort of change that will affect future performance through feedback. Feedback control is a situated form of motor control, relying on sensory information about performance and specific sensory input from the environment in which the movement is carried out. This sensory input, while processed, does not necessarily cause conscious awareness of the action. Closed loop motor control is best suited to continuously controlled actions, but does not work quickly enough for ballistic actions. Because feedback control relies on sensory information, it is as slow as sensory processing. These movements are subject to a speed/accuracy trade-off, because sensory processing is being used to control the movement, the faster the movement is carried out, the less accurate it will become.

Open Loop Control
Some movements, however, occur too quickly to integrate sensory information, and instead must rely on feedforward control. Open loop control is a feed forward form of motor control, and is used to control rapid, ballistic movements that end before any sensory information can be processed. In order to best study this type of control, most research focuses on deafferentation studies, often involving cats or monkeys whose sensory nerves have been disconnected from their spinal cords. Monkeys who lost all sensory information from their arms resumed normal behavior after recovering from the deafferentation procedure. Most skills were relearned, but fine motor control became very difficult.

Coordination
A core motor control issue is coordinating the various components of the motor system to act in unison to produce movement. The motor system is highly complex, composed of many interacting parts at many different organizational levels. Peripheral neurons receive input from the central nervous system and enervate the muscles. In turn, muscles generate forces which actuate joints. Getting the pieces to work together is a challenging problem for the motor system and how this problem is resolved is an active area of study in motor control research.

Reflexes
In some cases the coordination of motor components is hard-wired, consisting of fixed neuromuscular pathways are called reflexes. Reflexes are typically characterized as automatic and fixed motor responses, and they occur on a much faster time scale than what is possible for reactions that depend on perceptual processing. Reflexes play a fundamental role in stabilizing the motor system, providing almost immediate compensation for small perturbations and maintaining fixed execution patterns. Some reflex loops are routed solely through the spinal cord without receiving input from the brain, and thus do not require attention or conscious control. Others involve lower brain areas and can be influenced by prior instructions or intentions, but they remain independent of perceptual processing and online control.

The simplest reflex is the monosynaptic reflex or short-loop reflex, such as the monosynaptic stretch response. In this example, Ia afferent neurons are activated by muscle spindels when they deform due the the stretching of the muscle. In the spinal cord, these afferent neurons synapse directly onto alpha motor neurons that regulate the contraction of the same muscle. Thus, any stretching of a muscle automatically signals a reflexive contraction of that muscle, without any central control. As the name and the description implies, monosynaptic reflexes depend on a single synaptic connection between an afferent sensory neuron and efferent motor neuron. In general the actions of monosynaptic reflexes fixed and cannot be controlled or influenced by intention or instruction. However, there is some evidence to suggest that the gain or magnitude of these reflexes can be adjusted by context and experience.

Polysynaptic reflexes or long loop reflexes are reflex arcs which involve more than a single synaptic connection in the spinal cord. These loops may include cortical regions of the brain as well, and are thus slower than their monosynaptic counter parts due to the greater travel time. However, actions controlled by polysynaptic reflex loops a Polysynaptic re still faster than actions which require perceptual processing. While the actions of short-loop reflexes are fixed, polysynaptic reflexes can often be regulated by instruction or prior experience. A common example of a long loop reflex is the asymmetrical tonic neck reflex observed in infants.

Synergies
A motor Synergy is a collection of motor components whose activations covary to produce some desired movement or action. The components of a synergy need not be physically connected, but instead are connected by their response to perceptual information about the particular motor task being executed. Synergies are learned, rather than being hardwired like reflexes, and are organized in a task-dependent manner; a synergy is structured for a particular action and not based on the components themselves. Nikolai Bernstein famously demonstrated synergies at work in the hammering actions of professional blacksmiths. The muscles of the arm controlling the movement of the hammer are informationally linked in such a way that errors and variability in one muscle are automatically compensated for by the actions of the other muscles. These compensatory actions are reflex-like in that they occur faster than perceptual processing would seem to allow, yet they are only present in expert performance, not in novices. In the case of blacksmiths, the synergy in question is organized specifically for hammering actions and is not a general purpose organization of the muscles of the arm. Synergies have two defining characteristics in addition to being task dependent; sharing and flexibility/stability.

"Sharing" requires that the execution of a particular motor task depends on the combined actions of all the components that make up the synergy. Often times, there are more components involved than are strictly need for the particular task (see "Redundancy" below), but the control of that motor task is distributed across all components nonetheless. A simple demonstration comes from a two-finger force production task, where participants are required to generate a fixed amount of force by pushing down on two force plates with two different fingers. In this task, participants generated a particular force output by combining the contributions of independent fingers. While the force produced by any single finger can vary, this variation is constrained by the action of the other such that the desired force is always generated.

Co-variation also provides "flexibility and stability" to motor tasks. Considering again the force production task, if one finger did not produce enough force, it could be compensated for by the other. The components of a motor synergy are expected to change their action to compensate for the errors and variability in other components that could affect the outcome of the motor task. This provides flexibility because it allows for multiple motor solutions to particular tasks, and it provides motor stability by preventing errors in individual motor components from affecting the task itself.

Synergies simplify the computational difficulty of motor control. Coordinating the numerous degrees of freedom in the body is a challenging problem, both because of the tremendous complexity of the motor system, as well as the different levels at which this organization can occur (neural, muscular, kinematic, spatial,etc.). Because the components of a synergy are functionally coupled for a specific task, execution of motor tasks can be accomplished by activating the relevant synergy with a single neural signal. The need to control all of the relevant components independently is removed because organization emerges automatically as a consequence of the systematic covariation of components. Similar to how reflexes are physically connected and thus do not require control of individual components by the central nervous system, actions can be executed through synergies with minimal executive control because they are functionally connected.

Motor Programs
While synergies represent coordination derived from peripheral interactions of motor components, motor programs are specific, pre-structured motor activation patterns that are generated and executed by a central controller (in the case of a biological organism, the brain). They represent at top-down approach to motor coordination, rather than the bottom-up approach offered by synergies. Motor programs are executed in an open-loop manner, although sensory information is most likely used to sense the current state of the organism and determine the appropriate goals. However, once the program has executed, it cannot be altered online by additional sensory information.

Evidence for the existence of motor programs comes from studies of rapid movement execution and the difficulty associated with changing those movements once they have been initiated. For example, people who are asked to make fast arm swings have extreme difficulty in halting that movement when provided a "STOP" signal after the movement has been initiated. Interestingly, this reversal difficulty persisted even if the stop signal was presented after the initial "GO" signal but before the movement actually began. This research suggests that once selection and execution of a motor program begins, it must run to completion before another action can be taken. This effect has been found even when the "movement" that is being executed by a particular motor program is prevented from occurring at all. People who attempt to execute particular movements (such as pushing with the arm), but unknowingly have the action of their body arrested before any movement can actually take place, show the same muscle activation patterns (including stabilizing and support activation that does not actually generate the movement) as when they are allowed to complete their intended action.

Although the evidence for motor programs seems persuasive, there have been several important criticisms of the theory. The first is the problem of storage. If each movement an organism could generate requires its own motor program, it would seem necessary for that organism to possess an unlimited repository of such programs and where these would be kept is not clear. Aside from the enormous memory requirements such a facility would take, no motor program storage area in the brain has yet been identified. The second problem is concerned with novelty in movement. If a specific motor program is required for any particular movement, it is not clear how one would ever produce a novel movement. At best, any new movement would have to be practiced extensively before it could be executed with any success, and at worst no new movements would be possible because no motor program would ever exist. These difficulties have led to a more nuanced notion of motor programs known as generalized motor programs. A generalized motor program is a program for a particular class of action, rather than a specific movement. This program is parameterized by the context of the environment and the current state of the organism.

Redundancy
An important issue for coordinating the motor system is the problem of the redundancy of motor degrees of freedom. As detailed in the "Synergies" section, many actions and movements can be executed in multiple ways because functional synergies controlling those actions are able to co-vary without changing the outcome of the action. This is possible because there are more motor components involved in the production of actions than are generally required by the physical constraints on that action. For example, the human arm has seven joints which determine the position of the hand in the world. However, only three spatial dimensions are needed to specify any location the hand could be placed in. This excess of kinematic degrees of freedom means that there are multiple arm configurations that correspond to any particular location of the hand.

Some of the earliest and most influential work on the study of motor redundancy came from the Russian physiologist Nikolai Bernstein. Bernstein's research was primarily concerned with understanding how coordination was developed for skilled actions. He observed that the redundancy of the motor system made it possible to execute actions and movements in a multitude of different ways while achieving equivalent outcomes. This equivalency in motor action means that there is no one-to-one correspondence between the desired movements and the coordination of the motor system needed to execute those movements. Any desired movement or action does not have a particular coordination of neurons, muscles and kinematics which will make it possible, but instead This motor equivalency problem became known as the degrees of freedom problem because it is a product of having redundant degrees of freedom available in the motor system.

Perception in Motor Control
Related, yet distinct from the issue of how the processing of sensory information affects the control of movements and actions is the question of how the perception of the world structures action. Perception is extremely important in motor control because it carries the relevant information about objects, environments and bodies which is used in organizing and executing actions and movements. What is perceived and how the subsequent information is used to organize the motor system is a current and ongoing area of research.

Model Based Control Strategies
Most model based strategies of motor control rely on perceptual information, but assume that this information is not always useful, veridical or constant. Optical information is interrupted by eye blinks, motion is obstructed by objects in the environment, distortions can change the appearance of object shape. Model based and representational control strategies are those that rely on accurate internal models of the environment, constructed from a combination of perceptual information and prior knowledge, as the primary source information for planning and executing actions, even in the absence of perceptual information.

Inference and Indirect Perception
Many models of the perceptual system assume indirect perception, or the notion that the world that gets perceived is not identical to the actual environment. Environmental information must go through several stages before being perceived, and the transitions between these stages introduce ambiguity. What actually gets perceived is the mind's best guess about what is occurring in the environment based on previous experience. Support for this idea comes from the Ames room illusion, where a distorted room causes the viewer to see objects known to be a constant size as growing or shrinking as they move around the room. The room itself is seen as being square, or at least consisting of right angles, as all previous rooms the perceiver has encountered have had those properties. Another example of this ambiguity comes from the doctrine of specific nerve energies. The doctrine presents the finding that there are distinct nerve types for different types of sensory input, and these nerves will respond in a characteristic way regardless of the method of stimulation. That is to say, the color red causes optical nerves to fire in a specific pattern that is processed by the brain as experiencing the color red. However, if that same nerve is electrically stimulated in an identical pattern, the brain could perceive the color red when no corresponding stimuli is present.

Forward Models
Forward models are a predictive internal model of motor control that takes the available perceptual information and tries to predict the outcome of the motor movement. Forward models structure action by determining how the forces, velocities, and positions of motor components will affect changes in the environment and in the individual. Forward models are closely associated with the existence of motor programs, because they are believed to take motor programs as their input in order to predict the outcome of an action. Learning is believed to take place when the predictions made by a forward model do not match the actual outcome of the movement, prompting an update of an existing model. These models explain why it is impossible to tickle yourself. A sensation is experienced as ticklish when it is unpredictable. However, forward models predict the outcome of your motor movements, meaning the motion is predictable, and therefore not ticklish.

Evidence for forward models comes from studies of motor adaptation. When a person's goal-directed reaching movements are perturbed by a force field, they gradually, but steadily, adapt the movement of their arm to allow them to again reach their goal. However, they do so in such a way that preserves some high level movement characteristics; bell-shaped velocity profiles, straight line translation of the hand, and smooth, continuous movements .These movement features are recovered, despite the fact that they require startlingly different arm dynamics (i.e. torques and forces). This recovery provides evidence that what is motivating movement is a particular motor plan, and the individual is using a forward model to predict how arm dynamics will change the movement of the arm. Differences between the expected arm movement and the observed arm movement produces an error signal which is used as the basis for learning. Additional evidence for forward models comes from experiments which require subjects to determine the location of an effector following an unvisualized movement

Inverse Models
Inverse models predict the necessary movements of motor components to achieve a desired perceptual outcome. They can also take the outcome of a motion and attempt to determine the sequence of motor commands that resulted in that state. These types of models are particularly useful for open loop control, and allow for specific types of movements, such as fixating on a stationary object while the head is moving. Complimentary to forward models, inverse models attempt to estimate how to achieve a particular perceptual outcome in order to create the appropriate motor plan. Because inverse models and forward model are so closely associated, studies of internal models are often used as evidence for the roles of both model types in action.

Motor adaptation studies, therefore, also make a case for the existence of inverse models. Motor movements seem to follow predefined "plans" which preserve certain invariant features of the movement. In the reaching task mentioned above, the persistance of bell-shaped velocity profiles and smooth, straight hand trajectories provides evidence for the existence of such plans. The movements which achieve these desired task-level outcomes are estimated by an inverse model. Adaptation therefore proceeds as a process of estimating the necessary movements with an inverse model, simulating with a forward model the outcome of those movement plans, observing the difference between the desired outcome and the actual outcome, and updating the models for a future attempt.

Information Based Control
An alternative to model based control is information based control. Informational control strategies organize movements and actions based on perceptual information about the environment, rather than on cognitive models or representations of the world. The actions of the motor system are organized by information about the environment and information about the current state of the agent. Information based control strategies often treat the the environment and the organism as a single system, with action proceeding as a natural consequence of the interactions of this system. A core assumption of information based control strategies is that perceptions of the environment are rich in information and veridical for the purposes of producing actions. This runs counter to the assumptions of indirect perception made by model based control strategies.

Direct Perception
Direct perception in the cognitive sense is related to the philosophical notion of naïve or direct realism in that it is predicated on the assumption that what we perceive is what is actually in the world. James J. Gibson is credited with recasting direct perception as ecological perception. While the problem of indirect perception proposes that physical information about object in our environment is not available due to the ambiguity of sensory information, proponents of direct perception (like Gibson) suggest that the relavant information encoded in sensory signals is not the physical properties of objects, but rather the action opportunities the environment affords. These affordances are directly perceivable without ambiguity, and thus preclude the need for internal models or representations of the world. Affordances exist only as a byproduct of the interactions between an agent and its environment, and thus perception is an "ecological" endeavor, depending on the whole agent/environment system rather than on the agent in isolation.

Because affordances are action possibilities, perception is directly connected to the production of actions and movements. The role of perception is to provide information that specifies how actions should be organized and controlled, and the motor system is "tuned" to respond to specific type of information in particular ways. Through this relationship, control of the motor system and the execution of actions is dictated by the information of the environment. As an example, a doorway "affords" passing through, but a wall does not. How an one might pass through a doorway is specified by the visual information received from the environment, as well as the information perceived about one's own body. Together, this information determines the pass-ability of a doorway, but not a wall. In addition, the act of moving towards and passing through the doorway generates more information and this in turn specifies further action. The conclusion of direct perception is that actions and perceptions are critically linked and one cannot be fully understood without the other.

Behavioral Dynamics
Building on the assumptions of direct perception behavioral dynamics is a behavioral control theory which treats perceptual organisms as dynamic systems that respond to informational variables with actions, in a functional manner. Under this understanding of behavior, actions unfold as the natural consequence of the interaction between the organisms and the available information about the environment, which specified in body-relevant variables. Much of the research in behavioral dynamics has focused on locomotion, where visually specified information (such as optic flow, time-to-contact, optical expansion, etc.) is used to determine how to navigate the environment