|
|
||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
1ATR Computational Neuroscience and 3Human Information Processing Research Laboratories, Kyoto 619-0288; 2Nagaoka University of Technology, Niigata 940-2188, Japan; and 4Institute of Neuroscience, University of Plymouth, Plymouth PL4 8AA, United Kingdom
Submitted 30 May 2003; accepted in final form 16 March 2004
|
|
ABSTRACT |
|---|
|
|
|
INTRODUCTION |
|---|
|
A similar problem has been investigated for the kinematics of movement. Given a reaching task, an infinite number of hand paths and velocities can reach the goal. One framework for selecting a trajectory is optimal control, in which the solution with the smallest cost is selected. Several cost functions (Flash and Hogan 1985
; Nakano et al. 1999
; Uno et al. 1989
; Wada et al. 2001
) have tried to account for the data, but these models are incapable of predicting a trajectory that takes into account the variance that changes according to the changes in motor commands and/or impedance. Since the minimum-jerk model is kinematic, there is no place for impedance. Similarly, the minimum-torque-change model considers joint torque but not muscle tension, so it cannot incorporate impedance within its framework. The minimum-motor-command-change model can actually deal with impedance because it models the motor command for each muscle but always predicts the minimum motor command, thus minimum impedance, which is at odds with the idea of different co-activation levels dependent on different accuracy requirements (Gribble et al. 2003
; Laursen et al. 1998
). These models neither have variance as a penalty term nor implement noise in motor commands but only deal with a mean or desired trajectory. A recent computational model of movement planning considering the presence of signal dependent noise [task optimization in the presence of signal-dependent noise (TOPS)] may provide a unifying framework that could potentially account for both the kinematics and impedance of a movement. In this framework, the motor commands are assumed to be corrupted by noise, whose SD increases with the level of the motor command(Harris and Wolpert 1998
; Jones et al. 2002
). Such signal-dependent noise (SDN) plays through the muscle dynamics and limb impedance, leading to variability in movement. Different motor commands should thus lead to different movement statistics. The TOPS model proposes that the cost depends on these statistics (Hamilton and Wolpert 2002
; Miyamoto et al. 2002
). The motor command is selected to minimize the cost, thus minimizing the deleterious effects of SDN on task performance.
As the SDN plays through the impedance of the limb, the impedance can be changed to modify the consequences of the noise. Similarly, the change in impedance alters the noise in the system because the co-contraction of muscles leads to larger muscle activities, resulting in a larger SDN. Assuming the presence of SDN, impedance should have complicated effects of both increasing and decreasing the movement accuracy. Given that changing either the motor command or impedance can affect the movement statistics, the TOPS model has a potential capability to coherently explain both trajectory planning and impedance control by including impedance parameters within its framework. Therefore the first aim of this study is to experimentally examine the effects of increased impedance on movement accuracy.
The principle of the TOPS model is that the objective of motor planning is to optimize task statistics to increase accuracy (cf. minimizing endpoint variance in Harris and Wolpert 1998
). If this principle holds, we expect the optimal impedance for minimizing movement error to be selected in voluntarily executed movements. Then, if subjects are required to specifically increase impedance during movements, a decrease in accuracy is predicted because nonoptimal impedance should generate poorer task statistics. On the contrary, if higher movement accuracy is required, subjects should utilize the same impedance as in ordinary conditions, where impedance is already optimized to maximize accuracy. The second aim of this paper is to examine whether these predictions can be experimentally confirmed.
To investigate the relationship between impedance and movement variability, we examined two tasks. In the first task (target size), accuracy constraints were varied, and movement variability and impedance were estimated. In the second task (voluntary co-contraction), impedance was voluntarily controlled, and movement variability and accuracy were examined. From the results of these two experiments, we found that impedance does have the above-mentioned complicated effects of both increasing SDN and decreasing endpoint accuracy and that the data contradicted the predictions made by the TOPS model.
|
|
METHODS |
|---|
|
Experimental apparatus
Subjects sat on a chair and rested their right elbow on a sponge fixed to a table (Fig. 1A). The table was adjusted to lift the subject's arm to shoulder level so that movements were made in a horizontal plane. The upper arm movement was constrained by fixing the shoulder position with a harness and the elbow position with the sponge. The subject's wrist was braced. To reduce friction between arm and table, the arm was attached to a board that levitated above the table by an air sled (Fig. 1A). Subjects were asked to move only their elbow joint. An OPTOTRAK 3020 was used to measure the position of a marker placed on the end of a 9-cm vertical bar, which was grasped by the subjects. The marker position was sampled at 500 Hz and projected as a cross on a cathode-ray tube (CRT) screen, placed in front of the subject, representing current hand position (Fig. 1, B and C). Subjects performed the task while looking only at the CRT screen.
|
Surface EMG activity was recorded using pairs of silver-silver chloride surface electrodes. The activities of two elbow muscles, the brachioradialis and the medial head of the triceps brachii, and two biarticular muscles, the biceps brachii and the long head of the triceps, were recorded. The EMG signals were analog filtered at 25 Hz (high pass) and 1.0 kHz (low-pass) with a Nihon Kohden amplifier (MME-3132) and sampled at 2.0 kHz. All EMG comparisons between different conditions as well as the calibration of IMCJ involved data that were recorded on the same day without removing the electrodes. From a previous study using the same methods (Osu et al. 2002
), we confirmed the stationarity of the EMG electrodes by comparing torque-EMG relationships before and after the main experiment.
Stiffness estimation by IMCJ
Gomi and Kawato (1996)
and Burdet et al. (2000
, 2001
) measured stiffness during multijoint arm movements by applying mechanical perturbations with a robotic manipulandum. Previous studies suggested linear relationships among stiffness, torque, and surface EMG activity signals (Osu and Gomi 1999
; Tsuji et al. 1995
). Based on these previous studies, Osu et al. (2002)
proposed an index of muscle co-contraction around the joint (IMCJ) to evaluate joint viscoelasticity during movements. IMCJ was defined as the summation of absolute values of antagonistic muscle torques around the joint, and it was computed from the linear relation between surface EMG activity and joint torque. Osu et al. (2002)
confirmed that IMCJ during isometric contraction, as well as during movement, correlated well with joint stiffness estimated by the conventional method, i.e., applying mechanical perturbations, and proposed a formula to estimate stiffness from EMG activity through the IMCJ. In this paper, based on the method of Osu et al. (2002)
, stiffness during movement was computed for the elbow joint in each trial. Assuming that surface EMG activity is proportional to muscle tension, elbow torque can be expressed as follows
![]() | (1) |
![]() | (2) |
We note that the estimation of stiffness from IMCJ should not be taken as a rigorous method. We well realize the existence of variable moment arms during movements, nonlinear properties of muscle tension dependent on muscle length, shortening velocity, and motor commands, all of which work against simple linear models such as IMCJ to estimate the stiffness from EMG activity. However, quantitatively speaking, IMCJ was found to be a good first approximation of stiffness even during movement, which was independently measured by mechanical perturbations (Osu et al. 2002
). At the very least, IMCJ is a much superior and more systematic way of weighting EMG activity from multiple muscles while estimating stiffness than any arbitrary method of weighting (cf. Gribble et al. 2003
). To show the robustness of the obtained results for the weighting of EMG activity from multiple muscles, we analyzed identical data using the following two different weighting methods. One is to normalize each muscle's EMG activity by its maximum value, which is the conventional normalization technique but does not lead to a stiffness estimate. The second method is to apply the smooth temporal filter from EMG activity to muscle tension proposed by Koike and Kawato (1995)
to data from both calibration and main experiments to represent the known electro-mechanical delay in computing IMCJ. All three methods of weighting EMG activity led to identical statistical results, and thus only the results obtained by IMCJ without filtering are reported here.
Furthermore, we note that hand paths were almost identical across trials and subjects because only elbow rotation was included, and the joint torques that were generated were also very severely controlled to be the same because the movement duration was experimentally controlled. With these stringent experimental paradigms, we expect that any change in EMG activity is mainly due to a change in co-contraction and stiffness, and not to changes in movement trajectory, velocity, or torque profiles. This at least validates the usage of IMCJ as a "relative" index for stiffness.
To confirm impedance changes in a more primitive way, we compared root-mean-square (RMS) EMG of each muscle. Assuming that EMG and stiffness have a monotonic relation, if the EMGs of all muscles are larger in a particular condition than in other conditions, we can conclude that stiffness was larger in that condition. The RMS EMG was computed during the latter half of the movement, i.e., 250 ms before the end of the movement to the end of the movement defined by an acceleration threshold (see Task).
Task
The task was a single-joint extension or flexion movement of the elbow, and it followed the experimental paradigm of Gottlieb et al. (1989)
. In the target-size experiment, subjects were asked to move their hand from a start circle with a radius of 1.0 cm and enter a target circle with a different radius displayed on a CRT within a desired movement duration (Fig. 1B). In the voluntary co-contraction experiment, subjects were asked to move their hand from a start circle with a radius of 1.0 cm and come as close as possible to a small target point (3 mm radius) displayed on the CRT within a desired movement duration (Fig. 1C). The shoulder angle (q1) was fixed to 94°. The start and target positions were either an elbow angle (q2) of 41 or 97°, depending on whether the movement was extension or flexion (Fig. 1A). Extension movements were first conducted in a batch, and then flexion movements were carried out. The out-and-in movement duration was defined as the time (s) between when the hand exited the start circle and entered the target circle and was used throughout the experimental task control. Following the isometric force generation, subjects conducted flexion and extension movements of 20 trials each (preparatory experiment). Because this preparatory experiment was conducted, we did not observe any apparent learning effects in the main experiments. The desired out-and-in movement duration was predetermined by its average over the last 10 trials during the preparatory experiment to make the movement duration comfortable for each subject. The desired out-and-in movement durations ranged between 0.232 and 0.325 s for all subjects in the target-size experiment and between 0.250 and 0.334 s in the voluntary co-contraction experiment. For each subject, only movements with an allowable error of ±10% of the prespecified out-and-in desired movement duration were recorded as successful movements. A computer program checked whether the movement duration was within the allowable range, and a warning of "too early," "too late," or "out of target" was fed back to the subjects after each trial when the hand entered the target circle too soon, too late, or did not end within the target circle, respectively. For the target-size experiment, average success rates across subjects for large, medium, and small targets were 70 ± 14, 62 ± 14, and 45 ± 13% (SD), respectively. For the voluntary co-contraction experiment, average success rates across subjects for normal, medium, and high co-contraction were 58 ± 20, 66 ± 11, and 62 ± 25%, respectively.
Experiment I: changed target size
The task was to move (flex or extend) the hand to different-sized target circles. The radii of the target circles were 3.5, 2.5, and 1.5 cm for large, medium, and small conditions, and they were presented in this order to subjects. Subjects were requested to bring their hand within a target at the end of the movement. We recorded 40 successful trials in which the hand reached the target within the allowable time range for each target size and for either flexion or extension; 240 successful trials (2 directions x 3 sizes x 40 trials) were recorded and used for analysis. The desired out-and-in movement duration was corrected for the different distances that were traveled to the different target sizes. No instructions were given on co-contraction. Although EMG signals were recorded, muscle activity was not fed back to the subjects (Fig. 1B).
Experiment II: changed co-contraction level
The task was to execute extension or flexion movement under three levels of muscle co-contraction: a normal level with elbow muscles relaxed; a high level in which elbow muscles were strongly co-contracted so that the arm became stiff; and a medium level of co-contraction between normal and high. To avoid presentation of the target region that explicitly instructs the permitted endpoint variability, a small target point was presented instead of a target circle. The subjects moved their hand from a start circle to as close as possible to the target point. The out-and-in movement duration was measured as the time interval between when the hand exited the start circle and entered a virtual endpoint-domain circle with a radius of 5 cm, whose range was shown by two tangent lines on the CRT (Fig. 1C).
In the medium and high levels, subjects had to voluntarily co-activate their muscles during movements. Because the strength of muscles varies between subjects, the activation levels were set before the main experiment in preparatory trials. In this phase, 20 trials each for the normal and high conditions, in which the arm was relaxed or stiffened, and for both flexion and extension, were preliminarily recorded when the hand reached the virtual endpoint-domain circle within the time limit. The elbow stiffness in 80 movement trials (2 co-contraction conditions x 2 directions x 20 trials) was estimated by IMCJ. For each subject, the observed IMCJ range was divided into high, medium, and low ranges. For each trial in the main experiment, elbow IMCJ was computed to determine whether it was within the predetermined range of the corresponding co-contraction condition. The success or failure of achieving this required IMCJ level was fed back to the subject at the end of each trial. To help subjects set an appropriate co-contraction, the recorded EMG signals were shown on the CRT in real-time to the subjects from before the start of movement (Fig. 1C). We recorded 40 successful trials for each level of co-contraction and for each direction of flexion and extension. Altogether, 240 successful trials were obtained (3 stiffness conditions x 2 directions x 40 trials). The order of the three co-contraction conditions was counterbalanced across subjects.
Analysis
Position data were digitally filtered by a third-order Butterworth filter with an upper cutoff frequency of 15 Hz. Derivatives of the position data were computed by applying a three-point local polynomial approximation. The start and endpoints of each movement were determined using an angular acceleration with a 1.0 rad/s2 threshold. The movement duration determined from these start and endpoints was called kinematic movement duration, and it was nearly two times longer than the out-and-in movement duration. The out-and-in movement duration was used only to control the movement duration during the main experiment, and the kinematic movement duration was used for all data analyses. The averages of kinematic movement durations for the three target sizes and for individual subjects were within the range of 0.4620.533 s, and those for the voluntary co-contraction experiment were within 0.5200.616 s. The actuated torque of the elbow
was calculated as the product of the estimated inertial moment of the forearm from each subject's body size and the angular acceleration of the elbow joint. We did not include a viscosity term in the calculation of the torque because most of the viscosity measured around a joint arises from biochemical and mechanical processes within the muscle rather than from the properties of the joint (Akazawa 1994
). The effect of gravity was ignored because the arm was supported against gravity by the air sleds to reduce friction.
We examined whether experimental conditions such as target sizes and the level of co-contraction affect EMG activity, torque, position, and endpoints. Accordingly, we first computed the ensemble-averaged temporal profiles over 40 trials of each signal. Ensemble-averaged rectified EMG activity of the ith muscle at time t was as follows
![]() | (3) |
![]() | (4) |
j(t) denotes torque at time t of the jth trial. Similarly, ensemble-averaged x- and y-position were computed as follows
![]() | (5) |
![]() | (6) |
![]() | (7) |
![]() | (8) |
![]() | (9) |
![]() | (10) |
![]() | (11) |
![]() | (12) |
![]() | (13) |
|
To examine the effect of the target-size or muscle co-contraction levels on mean performance, we carried out a two-way repeated measures ANOVA (target-size or co-contraction levels x movement directions), with subjects as a random factor, for time-averaged IMCJ, time-averaged deviations of EMG activity, torque and position, and endpoint, as well as endpoint errors and RMS EMG using data for all subjects. F-ratios were computed by treating the target size or co-contraction levels and movement directions as within-subject factors. This was followed by Tukey's HSD test.
|
|
RESULTS |
|---|
|
To examine SDN during movements, we computed signal magnitude and its deviation at each time point of movements. Because EMG signals during movements are not stationary, time courses of EMG magnitude were computed as an ensemble average of rectified EMG time course over 40 trials (Eq. 3). Time courses of EMG deviations were computed as the root mean square of difference between each one and the ensemble-averaged EMG time course over 40 trials (Eq. 7). EMG deviation at each time point was plotted against EMG magnitude at that time point for each muscle and each movement direction, for each condition of each experiment, and for each subject. Figure 2 shows plots of a typical subject during a voluntary co-contraction experiment. Blue, red, and green dots denote normal, medium, and high co-contraction conditions, respectively. In all comparisons, EMG deviation linearly increased with EMG magnitude. The mean and SD of correlation coefficients across muscles, subjects, and conditions were 0.843 ± 0.092 for extension and 0.821 ± 0.099 for flexion in the target-size experiment and 0.814 ± 0.087 for extension and 0.814 ± 0.088 for flexion in the voluntary co-contraction experiment. We also computed slopes between EMG mean and deviation for each comparison. Figure 3 shows the histogram of the slopes for each movement direction. The slopes widely ranged from
0.5 to 3, with a mean of 1.192 ± 0.422, which includes the predicted slopes of uniform, Gaussian, and Laplacian distribution (0.58, 0.76, and 1.00, respectively) within the 2 SD region, suggesting that the observed linear relationship is not a trivial mathematical result (see DISCUSSION for detail). The slopes were significantly larger when muscles were working as antagonists than as agonists for both target size (t-test, t(214) = 4.72; P < 0.0001) and voluntary co-contraction experiment (t(214) = 3.60; P < 0.0005).
|
|
The averages of the kinematic movement durations across subjects for the large, medium, and small target sizes were 0.498 ± 0.069, 0.497 ± 0.069, and 0.491 ± 0.062 s, respectively, and were not significantly different. Figure 4 shows the hand paths, endpoint distributions (A), angular velocity profiles (B), torque profiles (C), EMG time courses of the four muscles (D), and stiffness profiles (E) of a typical subject recorded for the different target sizes for extension movements. These characteristics are in good agreement with previous studies (Gottlieb et al. 1989
). The endpoints of the hand were distributed along an arc within target circles (Fig. 4A). Therefore the endpoint deviation increased as the target size increased in accordance with our experimental design (see Fig. 7F for statistics). The angular velocity profiles were bell-shaped, and corrective movements were not observed. In Fig. 4, although the hand paths (A), velocity (B), and torque profiles (C) were similar for the three different target sizes, co-activation of bi-articulator muscles (D) and resulting IMCJ increase (E) were evident in the latter half of movement for the more stringent accuracy requirements.
|
|
|
|
Similar trends to Figs. 5 and 7 were observed when EMG activity, torque, and position ensemble averages were calculated using the shortest movement duration of each condition (2nd method; see METHODS) or when using duration of each movement and extrapolate by the final value until longest movement duration (3rd method; see METHODS). The summed EMG activity (F(2,16) = 8.35; P < 0.005 for shortest movement duration, F(2,16) = 11.90; P < 0.001 for longest movement duration) and IMCJ (F(2,16) = 9.12; P < 0.005 for shortest movement duration, F(2,16) = 11.85; P < 0.001 for longest movement duration) were significantly different and were largest for the small targets.
Experiment II: changed muscle activation level
The means of the kinematic movement durations across subjects for the normal, medium, and high co-contraction conditions were 0.581 ± 0.073, 0.558 ± 0.071, and 0.537 ± 0.062 s, respectively, and decreased significantly for the higher co-contraction level, although the predetermined desired out-and-in movement duration was the same for the three conditions. Figure 8 shows the hand paths, endpoint positions, angular velocity profiles, torque profiles, EMG time courses of the four muscles, and IMCJ profiles recorded for the three levels of co-contraction for the same subject, in a similar format to Fig. 4. The endpoints of the hand were distributed along an arc around the target point more narrowly for the larger co-contraction level (Fig. 8A). The angular velocity profiles were bell-shaped, and corrective movements were not observed. Although the EMG activity of all four muscles (Fig. 8D) and IMCJ (Fig. 8E) were much larger over the entire movement duration for the higher level of co-contraction, the ensemble-averaged hand paths (Fig. 8A), velocity (Fig. 8B), and torque profiles (Fig. 8C) were similar among the three co-contraction conditions. However, we must note that the velocity profiles for high co-contraction were more symmetrical than those for low co-contraction (Figs. 8B and 9D). The velocity peak in low co-contraction condition was slightly, but significantly, earlier than in medium and high co-contraction conditions (F(2,16) = 20.50; P < 0.0001). Mean velocity peak in low co-contraction condition was significantly earlier than the midpoint of movement duration (t-test, t(8) = 2.67; P < 0.05 for extension, t(8) = 3.41; P < 0.01 for flexion), while that in high co-contraction condition was not significantly different (t(8) = 1.05; P = 0.32 for extension, t(8) = 1.83; P = 0.10 for flexion), suggesting that velocity profiles for high co-contraction condition were significantly more symmetrical.
|
|
Figure 10 shows observations similar to those shown in Fig. 9 and their statistics in time-averaged data. Figure 10, A and B, shows the mean across all subjects of the time-averaged summed EMG activity and time-averaged IMCJ, respectively, for each co-activation requirement. The gray lines denote extension, and the black lines denote flexion. The horizontal lines indicate significant comparisons in posthoc tests (P < 0.05). The main effect of the muscle co-activation requirement was significant for the amount of muscle activity in terms of time-averaged summed EMG activity (F(2,16) = 29.09; P < 0.0001) as well as time-averaged IMCJ (F(2,16) = 17.16; P < 0.0005). Furthermore, the muscle activity, i.e., arm IMCJ, was significantly smallest in the normal level and significantly largest in the high level. Accordingly, the main task design of the voluntary co-contraction experiment was fulfilled. Other figures show that the co-activation level has different effect on different deviations. Figure 10, CE, shows the means across all subjects for time-averaged deviations of EMG activity, torque, and position, respectively, for each co-contraction requirement. Figures 10F and G show the means across all subjects for the position deviation at the endpoint as well as the endpoint error for each co-contraction requirement. A larger variability in EMG activity, torque, and position was observed for the higher muscle activation level, although there was no such trend for the endpoint deviation, and the relationship was reversed for the endpoint error. The main effects of the muscle activation level were significant for variabilities in EMG activity (F(2,16) = 40.04; P < 0.0001), torque (F(2,16) = 66.53; P < 0.0001), position (F(2,16) = 11.74; P < 0.001), and endpoint error (F(2,16) = 6.26; P < 0.01). The variabilities in EMG activity and torque were significantly larger in the high level and smaller in the normal level. The endpoint error in the normal level was significantly larger than in the medium and high levels for both extension and flexion.
|
The observed reversed relationship between motor command magnitude and endpoint error suggests that SDN is attenuated as the space shifts from intrinsic motor command space to extrinsic task space. Noise was highly positively correlated with magnitude of motor command at EMG or torque level but was negatively correlated at target achievement level. To further show the degradation of correlation between motor command magnitude and deviations, we computed the correlation coefficients between the co-contraction magnitude and EMG deviation, torque deviation, position deviation, endpoint deviation, and endpoint error on a trial-by-trial basis (Fig. 11). For each movement trial of an individual subject, such as those shown in Fig. 8, the following seven quantities were first computed. The first two were the summed rectified EMG activity and its deviation, both of which were time-averaged over movement duration. The equations are given in METHODS (Eqs. 9 and 11). The third to fifth were IMCJ and the deviations of torque and position, all of which were time-averaged over movement duration. The equations are given in METHODS (Eqs. 10, 12, and 13). The last two quantities were endpoint deviation and endpoint error. Then, for each subject and for each movement direction, a correlation coefficient was computed from 120 movement trials (40 trials x 3 stiffness conditions) between two quantities for each of the following five pairs. The first is between the time-averaged summed EMG activity and its time-averaged deviation. The second is between the time-averaged IMCJ and the time-averaged torque deviation. The third is between the time-averaged IMCJ and the time-averaged position deviation. The fourth is between the time-averaged IMCJ and the endpoint deviation. The fifth is between the time-averaged IMCJ and the endpoint error. Figure 11A plots these 18 correlation coefficients (2 movement directions x 9 subjects) for the voluntary co-contraction experiment while connecting the same subject by the thin line and representing the same movement direction by the same symbol. The light and dark shaded regions show the insignificance ranges of correlation coefficients, outside of which the coefficient is statistically different from zero for an individual data item and the data from all subjects, respectively. For the relationship between EMG activity and EMG variability, the correlation coefficients of all subjects were positive and very close to 1 (Fig. 11A, left). The correlation coefficients of IMCJ and torque variability were positive and relatively high and significant for all but one subject (Fig. 11A, 2nd). The correlation coefficients of IMCJ and position variability were positive for 15 of 18 cases and relatively small and insignificant for most subjects (Fig. 11A, middle). The correlation between IMCJ and endpoint deviation was positive or negative depending on the subject and movement direction, and most coefficients were small in magnitude and insignificant (Fig. 11A, 4th). The correlation coefficients between IMCJ and endpoint error were negative in 13 of 18 cases, and some were significant (Fig. 11A, right). Figure 11A also shows, by thick black lines and asterisks, the correlation coefficients for the five relationships computed from all 2,160 trials of all subjects. The correlation coefficient was close to 1 and significant for EMG deviation. It was positive and significant for torque deviation. It was slightly positive but significant for position deviation. It was slightly negative but significant for endpoint deviation and negative and significant for endpoint error. Figure 11B plots the same correlation coefficients for the relationships from the target-size experiment and shows similar trends.
|
|
DISCUSSION |
|---|
|
SDN during movement
When subjects were asked to move with larger co-contraction levels, they increased the motor command signals of the flexor and extensor simultaneously. It has been suggested that the SD of the neuromotor commands increases with its mean based on both motoneuronal firing studies (Clamman 1969
; Matthews 1996
) and surface rectified EMG signals (Clancy and Hogan 1999
; St-Amant et al. 1998
) during static force tasks. Psychophysical studies of isometric force production have shown a strong relationship between mean force level and force variability as measured by SD (Jones et al. 2002
; Schmidt et al. 1979
; Sherwood and Schmidt 1980
; Sherwood et al. 1988
). Sherwood et al. (1988)
also reported a strong relationship between mean force level and force variability in the elbow-joint movement task when different loads were added to a hand-held bar.
These previous behavioral studies investigated the change in force variability in isometric tasks (Jones et al. 2002
; Schmidt et al. 1979
; Sherwood and Schmidt 1980
) or moving conditions under normal co-contraction (Sherwood et al. 1988
). This study is the first to examine the relationships between stiffness, EMG activity, torque, and position variabilities and endpoint deviation and error during movements. Analysis of EMG variability showed a strong linear relationship with the rectified EMG level (Fig. 2). This is not a trivial mathematical result of rectifying an AC signal. For a stochastic variable x with zero mean and even probability distribution, there is generally no linear relationship between the SD and mean of the rectified signal. If the distribution changes its shape with different motor command levels, not only the linear relationship but also the monotonically increasing relationship of the deviation as a function of mean may not hold. For an evenly distributed zero-mean random variable x, the variance of the rectified signal is given as follows: V(|x|) = V(x) E(|x|)2. From this, the observed linear relationship holds if and only if V(x) is proportional to E(|x|)2, which is not a generic property of the zero-mean even distribution. This condition is satisfied for well-known uniform, Gaussian, and Laplacian distributions, where the predicted slopes are
0.58, 0.76, and 1.00, respectively. That is, if either uniform, Gaussian, or Laplace distribution is maintained for different levels of motor commands, the linear relationship between the mean and the SD is mathematically derived. For our data, the slope between EMG deviation and magnitude widely raged with a mean larger than that of Laplace distribution (Fig. 3), suggesting that the EMG signal is corrupted by larger noise when the mean level of the signal becomes large. Our results also suggest that movement EMG distributions ranged wider than those in a constant-force, constant-angle condition, which fell between Gaussian and Laplacian distributions (Clancy and Hogan 1999
). Furthermore, the deviation is measured as an RMS distance from the ensemble-averaged rectified trajectory, showing true variability in the nonstationary signal. This allows EMG variability to be measured during movement for the first time. Consequently, SDN was confirmed during single-joint movements.
Negative correlation of endpoint error with stiffness
Analysis of torque variability in the voluntary co-contraction experiment (Figs. 10D and 11A) showed that it increased with stiffness but with a weaker correlation than EMG variability. The positional variability averaged over the movement duration also increased significantly with IMCJ, but with an even weaker correlation (Figs. 10E and 11A). In stark contrast, the final endpoint error was significantly larger for the lowest co-contraction level than for the medium or high level (Figs. 10G and 11A). For the higher accuracy requirements of the target-size experiment, subjects chose a higher IMCJ level and achieved a lower endpoint deviation (Fig. 7). Therefore subjects exploited the relationship between stiffness and accuracy as the task demands changed.
Although these findings seem counterintuitive because higher stiffness involves larger motor commands, resulting in larger SDN, they can be reconciled within the extended TOPS framework as will be explained later. Co-contraction has two effects within this model. First, it increases the noise produced by the actuators; although some of the forces in co-contraction cancel each other out, the variabilities from both agonist and antagonist are additive. Second, it changes the impedance of the limb. The impedance determines how the noise plays through the motor apparatus into the endpoint error. Figure 11 most markedly demonstrates this effect of decreased and reversed correlation with IMCJ as the signal is transformed from EMG activity to torque, to position, to endpoint variability, and finally to endpoint error.
Decreased endpoint error under higher co-contraction might be explained by two control mechanisms. One is the impedance control that utilizes the muscle's intrinsic spring properties to realize a desired trajectory or endpoint in negative feedback control (Burdet et al. 2001
; Franklin et al. 2003
; Hogan 1985
; Osu et al. 2002
). When muscle stiffness is increased by feedforward and predictive co-contraction, the increased feedback gains bring higher accuracy. The achievement of the desired trajectory and endpoint is suggested because the endpoint error decreased while the endpoint deviation showed no definite trend as IMCJ increased in the co-contraction control experiment (Fig. 10, F and G). Furthermore, in the target size experiment, the positional deviation decreased with higher stiffness (small target size) only in the late stage of movement (Fig. 5G), corresponding to the larger EMG activity and IMCJ in only the latter half of movement duration (Fig. 5, A and B). A second possible control mechanism is the optimal feedback control proposed by Todorov and Jordan (2002)
, where time variant feedback gains are optimally selected based on neural feedback computations rather than muscle co-contraction. This computational theory seems to suggest larger torque variability for higher gains of neural feedback loops, which seems at odds with our results showing higher stiffness and accuracy with little change in torque variability (Fig. 7, D and F). Therefore we may conclude that co-contraction leads to a trade-off between increased noise and reduced consequences due to the changed impedance. In our experiment, the increased variability of position seen during movement can be interpreted as the effects of increased SDN, whereas the reduced final error may be due to the impedance change, which reduces variability.
In the co-contracted state, the limb is clearly more stable against external noise or perturbations. However, because there was no explicit external perturbation in the current experiments, it is not appropriate to ascribe the observed reduction of final task error to the rejection of external perturbation. One possible explanation is other uncontrolled internal processes that can have an effect on final accuracy, such as an increase in the overall level of attention, were triggered by the increase of co-contraction. That is, accuracy and impedance are independently regulated and subject generated higher levels of co-contraction while producing less variable feedforward commands. Another possible explanation is that at some level of co-contraction the limb may also be more stable against internally generated noise. How the impedance could reduce the internally generated noise is an open question because the reference trajectory, or the equilibrium position itself, could be perturbed by internally generated noise. Assuming that muscle visco-elasticity changes according to muscle activation (Bizzi et al. 1984
), the equilibrium position can be expressed as the difference of two antagonistic muscles' activation divided by the summation of their activation (co-contraction), i.e., (uflex uext)/(uflex + uext) (Hogan 1984
). When noise is added to one or both of the two antagonistic muscles, changes in the equilibrium position generated by the noise are smaller when the denominator, i.e., the amount of co-contraction, is larger. Therefore the effect of internally generated noise on the reference trajectory may possibly smaller when stiffness is larger. Thus co-contraction could possibly be one of factors in reducing the effect of internally generated noise on the final endpoint variability.
Shorter movement duration with higher stiffness
In the co-contraction control experiment, a significantly shorter kinematic movement duration was observed with larger co-contraction, although the required out-and-in movement duration was constant irrespective of the co-contraction level. In the target-size experiment, the same effect was observed, although it was much smaller and not significant. A shorter movement duration for higher accuracy is apparently contrary to Fitts' law (Fitts 1954
; Hirayama et al. 1993
) and to TOPS model, which predicts Fitts' law (Harris and Wolpert 1998
). A shorter movement duration with higher stiffness may be interpreted as a consequence of the mechanical resonant frequency of the forearm link, which increases in proportion to the square root of the elbow stiffness. The shorter movement duration with the same movement amplitude leads to higher acceleration and larger EMG activity, but this effect is negligible compared with large differences in EMG levels. That is, movement duration change was only 1.48 and 7.52%, while stiffness increase was 11 and 196% in the target-size and co-contraction control experiments, respectively. Assuming that EMG linearly increases with muscle torque and stiffness, it is expected that joint torque, and thus the reciprocal component of EMG, change with the square of duration change. Although a higher-order relationship between EMG and duration might exist because of the nonlinearity between EMG and stiffness, the order-of-magnitude smaller change of movement duration compared with IMCJ increase suggests that IMCJ increase was not merely due to reciprocal activation caused by joint torque increase but mainly due to additional co-contraction. The movement trajectories and torque profiles were very similar between different experimental conditions (see Figs. 5, C and D, and 9, C and D), and their differences were too small to explain differences in EMG activity and IMCJ changes. Because the kinematic and dynamic features of the movements are almost invariant across different experimental conditions, IMCJ could be regarded at least as a good relative measure for stiffness (see METHODS). For similar movement trajectory, IMCJ has been shown to linearly increase with stiffness (Osu et al. 2002
). Thus we conclude that the stiffness changes were caused by the different accuracy requirements and voluntary co-contraction.
Stiffness control dependence on tasks
The largest endpoint errors were observed when subjects did not increase co-contraction above the normal level. Similarly, subjects could increase their accuracy in response to a smaller target by increasing co-contraction. Consequently, without the need for greater accuracy, subjects accepted worse performance but with lower stiffness. This contradicts the principle of TOPS and suggests that minimizing the endpoint deviation or endpoint error alone may not be the sole consideration for task optimization. There is an extra dimension to stiffness control, which increases accuracy but also leads to undesirable factors. For example, the CNS may adopt criteria such as minimization of fatigue (Dul et al. 1984
), energy consumption (Alexander 1997
), commanded torque change (Nakano et al. 1999
), or motor command change (Kawato 1992
) in combination with the maximization of task achievement. Miyamoto et al. (2002)
and Nagata et al. (2002)
showed that the TOPS-
model, where a cost term in the motor command magnitude multiplied by
is added to the task achievement term, gives better prediction of trajectories than the TOPS model for a large number of point-to-point movements. The TOPS-
model combines maximization of task achievement and minimization of motor command magnitude. The relative contribution of these two terms to the overall cost is determined by the coefficient
, which is the weighting constant for motor command magnitude. If
is zero, the TOPS-
model is the same as the TOPS model, which maximizes task achievement. If
is large, the motor command magnitude is reduced at the expense of performance. The TOPS-
model is consistent with the current results in the sense that, without the need for the greatest accuracy, subjects accept worse performance but with lower stiffness, resulting in reducing motor command magnitude. Slightly different movement duration and velocity profiles for different co-contraction levels may also suggest that desired trajectories were computed taking into account the magnitude of stiffness.
The results of our experiments suggest that the CNS somehow acquires the knowledge of the relationship between stiffness level and size of endpoint deviation and error allowing it to generate the stiffness necessary for difficult tasks. Furthermore, stiffness is reduced as long as the task demand is satisfied under skilled and natural movements. Optimal impedance control may be accomplished to generate the proper trajectory for the task requirements through a trade-off between the stiffness level and task achievement.
Generalization to multi-joint movements
The required movements were unnatural, and most subjects never rotated only the elbow without friction or gravity. There were three major reasons for this experimental setting. First, by minimizing the gravity and frictional forces during the movements, we could reliably estimate dynamic torques from surface EMG recordings. This was important for stiffness estimation via IMCJ. Second, by avoiding the shoulder freedom, we did not need to record from many shoulder muscles, thus shortening the experimental duration and simplifying the IMCJ computation. Finally, and most importantly, the hand path was forced to be identical between trials and subjects, and movement variability could result only from changes in velocity profiles. This is very important because we wanted to examine the effect of stiffness control on movement accuracy while minimizing changes in trajectory shapes. For multi-joint movements, it is known that the hand paths themselves fluctuate between trials and change systematically between subjects. Laursen et al. (1998)
and Gribble et al. (2003)
examined multi-joint movements and measured muscle activation by EMG activity for different accuracy requirements. Although, unlike us, they did not estimate joint stiffness and did not examine voluntary co-contraction, they found qualitatively similar results for the effects of accuracy requirements on co-contraction. Thus we expect that at least a part of our results could be extended to more natural movements.
GRANTS
This study was supported by the National Institute of Information and Communications Technology and by grants to M. Kawato from the Human Frontier Science Program.
|
|
ACKNOWLEDGMENTS |
|---|
|
|
|
FOOTNOTES |
|---|
Address for reprint requests and other correspondence: M. Kawato, ATR Computational Neuroscience Labs., 2-2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-0288 Japan (E-mail: kawato{at}atr.jp).
|
|
REFERENCES |
|---|
|
Alexander RM. A minimum energy cost hypothesis for human arm trajectories. Biol Cybern 76: 97105, 1997.[CrossRef][Web of Science][Medline]
Bizzi E, Accornero N, Chapple W, and Hogan N. Posture control and trajectory formation during arm movement. J Neurosci 4: 27382744, 1984.[Abstract]
Burdet E, Osu R, Franklin D, Milner TE, and Kawato M. A method for measuring endpoint stiffness during multi-joint arm movements. J Biomechanics 33: 17051709, 2000.[CrossRef][Web of Science][Medline]
Burdet E, Osu R, Franklin D, Milner T, and Kawato M. The central nervous system stabilizes unstable dynamics by learning optimal impedance. Nature 414: 446449, 2001.[CrossRef][Medline]
Clamman PH. Statistical analysis of motor unit firing pattern in human skeletal muscle. Biophysics J 9: 12331251, 1969.
Clancy EA and Hogan N. Probability density of the surface electromyogram and its relation to amplitude detectors. IEEE Trans Biomed Eng 46: 730739, 1999.[CrossRef][Web of Science][Medline]
Darling WG and Cooke JD. Movement related EMGs become more variable during learning of fast accurate movements. J Motor Behav 19: 311331, 1987.[Web of Science][Medline]
Dul J, Johnson GE, Shiavi R, and Townsend MA. Muscular synergismII. A minimum-fatigue criterion for load sharing between synergistic muscles. J Biomech 17: 675684, 1984.[CrossRef][Web of Science][Medline]
Fitts PM. The information capacity of the human motor system in controlling the amplitude of movement. J Exp Psychol 47: 381391, 1954.[Medline]
Flash T and Hogan N. The coordination of arm movements: an experimentally confirmed mathematical model. J Neurosci 5: 16881703, 1985.[Abstract]
Franklin DW, Osu R, Burdet E, Kawato M, and Milner TE. Adaptation to stable and unstable environments achieved by combined impedance control and inverse dynamics model. J Neurophysiol 90: 32703282, 2003.
Gomi H and Kawato M. Equilibrium-point control hypothesis examined by measured arm-stiffness during multijoint movement. Science 272: 117120, 1996.[Abstract]
Gomi H and Osu R. Task-dependent viscoelasticity of human multijoint arm and its spatial characteristics for interaction with environments. J Neurosci 18: 89658978, 1998.
Gottlieb GL, Corcos DM, and Agarwall GC. Organizing principles for single-joint movements. I. A speed-insensitive strategy. J Neurophysiol 62: 342357, 1989.
Gribble PL, Mullin LI, Cothros N, and Mattar A. Role of cocontraction in arm movement accuracy. J Neurophysiol 89: 23962405, 2003.
Hamilton A and Wolpert DM. Controlling the statistics of action: obstacle avoidance. J Neurophysiol 87: 24342440, 2002.
Harris C and Wolpert DM. Signal-dependent noise determines motor planning. Nature 394: 780784, 1998.[CrossRef][Medline]
Hirayama M, Kawato M, and Jordan MI. The cascade neural network model and a speed-accuracy trade-off of arm movement. J Motor Behav 25: 162174, 1993.[Web of Science][Medline]
Hogan N. Adaptive control of mechanical impedance by coactivation of antagonist muscles. IEEE Trans Auto Cont 29: 681690, 1984.[CrossRef]
Hogan N. The mechanics of multi-joint posture and movement control. Biol Cybern 52: 315331, 1985.[CrossRef][Web of Science][Medline]
Jones K, Hamilton A, and Wolpert DM. The sources of signal dependent noise during isometric force production. J Neurophysiol 88: 15331544, 2002.
Kawato M. Optimization and learning in neural networks for formation and control of coordinated movement. In: Attention and Performance XIV, edited by Meyer DE and Kornblum S. Cambridge, MA: MIT Press, 1992, p. 821849.
Koike Y and Kawato M. Estimation of dynamic joint torques and trajectory formation from surface electromyography signals using a neural network model. Biol Cybern 73: 291300, 1995.[Web of Science][Medline]
Lacquaniti F, Carrozzo M, and Borghese NA. Time-varying mechanical behavior of multijointed arm in man. J Neurophysiol 69: 14431464, 1993.
Laursen B, Jensen BR, and Sjogaard G. Effect of speed and precision demands on human shoulder muscle electromyography during a repetitive task. Eur J Appl Physiol Occup Physiol 78: 544548, 1998.[CrossRef][Medline]
Matthews PBC. Relationship of firing intervals of human motor unit to the trajectory of post-spike after-hyperpolarization and synaptic noise. J Physiol 492: 597628, 1996.
McIntyre J, Mussa-Ivaldi FA, and Bizzi E. The control of stable postures in the multijoint arm. Exp Brain Res 110: 248264, 1996.[Web of Science][Medline]
Milner TE and Cloutier C. Compensation for mechanically unstable loading in voluntary wrist movement. Exp Brain Res 94: 522532, 1993.[Web of Science][Medline]
Miyamoto H, Nakano E, Wolpert DM, and Kawato M. TOPS (task optimization in the presence of signal-dependent noise) model. IEICE Trans Inform Syst J85-DII: 940949, 2002.
Miyamoto H, Wolpert DM, and Kawato M. Computation of optimal trajectory of arm movement with signal-dependent noise: the maximum task achievement model. In: Biologically Inspired Robot Behavior Engineering, edited by Dura RJ, Santos J, and Grana M. Heidelberg: Physica-Verlag, 2002, p. 395415.
Mussa-Ivaldi FA, Hogan N, and Bizzi E. Neural, mechanical, and geometric factors subserving arm posture in humans. J Neurosci 5: 27322743, 1985.[Abstract]
Nagata Y, Miyamoto H, Nakano E, and Kawato M. Quantitative examinations of trajectory planning criteria in multijoint movementTOPS model. Tech Rep Inst Electr Inform Commun Engineer NC2002-70: 2535, 2002.
Nakano E, Imamizu H, Osu R, Uno Y, Gomi H, Yoshioka T, and Kawato M. Quantitative examination of internal representations for arm trajectory planning: Minimum commanded torque change model. J Neurophysiol 81: 21402155, 1999.
Osu R, Burdet E, Franklin DW, Milner TE, and Kawato M. Different mechanisms involved in adaptation to stable and unstable dynamics. J Neurophysiol 90: 32553269, 2003.
Osu R, Franklin DW, Kato H, Gomi H, Domen K, Yoshioka T, and Kawato M. Short- and long-term changes in joint co-contraction associated with motor learning as revealed from surface EMG. J Neurophysiol 88: 9911004, 2002.
Osu R and Gomi H. Multijoint muscle regulation mechanisms examined by measured human arm stiffness and EMG signals. J Neurophysiol 81: 145868, 1999.
Schmidt RA, Zelaznik H, Hawkins B, Frank JS, and Quinn JT Jr. Motor-output variability: a theory for the accuracy of rapid motor acts. Psychol Rev 86: 415451, 1979.[CrossRef][Web of Science]
Sherwood DE and Schmidt RA. The relationship between force and force variability in minimal and near-maximal static and dynamic contractions. J Motor Behav 12: 7589, 1980.[Web of Science][Medline]
Sherwood DE, Schmidt RA, and Walter CB. The force/force-variability relationship under controlled temporal conditions. J Motor Behav 20: 106116, 1988.[Web of Science][Medline]
St-Amant Y, Rancourt D, and Clancy EA. Influence of smoothing window length on electromyogram amplitude estimates. IEEE Trans Biomed Eng 45: 795799, 1998.[CrossRef][Web of Science][Medline]
Todorov E and Jordan M. Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 12261235, 2002.[CrossRef][Web of Science][Medline]
Tsuji T, Morasso PG, Goto K, and Ito K. Human hand impedance characteristics during maintained posture. Biol Cybern 72: 475485, 1995.[Web of Science][Medline]
Uno Y, Kawato M, and Suzuki R. Formation and control of optimal trajectory in human multijoint arm movement: minimum torque-change model. Biol Cybern 61: 89101, 1989.[CrossRef][Web of Science][Medline]
Wada Y, Kaneko Y, Nakano E, Osu R, and Kawato M. Quantitative examinations for multi joint arm trajectory planningusing a robust calculation algorithm of the minimum commanded torque change trajectory. Neural Networks 14: 381393, 2001.[CrossRef][Web of Science][Medline]
This article has been cited by other articles:
![]() |
R. Laboissiere, D. R. Lametti, and D. J. Ostry Impedance Control and Its Relation to Precision in Orofacial Movement J Neurophysiol, July 1, 2009; 102(1): 523 - 531. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Wong, E. T. Wilson, N. Malfait, and P. L. Gribble Limb Stiffness Is Modulated With Spatial Accuracy Requirements During Movement in the Absence of Destabilizing Forces J Neurophysiol, March 1, 2009; 101(3): 1542 - 1549. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Wong, E. T. Wilson, N. Malfait, and P. L. Gribble The Influence of Visual Perturbations on the Neural Control of Limb Stiffness J Neurophysiol, January 1, 2009; 101(1): 246 - 257. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. W. Franklin, G. Liaw, T. E. Milner, R. Osu, E. Burdet, and M. Kawato Endpoint Stiffness of the Arm Is Directionally Tuned to Instability in the Environment J. Neurosci., July 18, 2007; 27(29): 7705 - 7716. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Trainin, R. Meir, and A. Karniel Explaining Patterns of Neural Activity in the Primary Motor Cortex Using Spinal Cord and Limb Biomechanics Models J Neurophysiol, May 1, 2007; 97(5): 3736 - 3750. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. A. Christou, B. Poston, J. A. Enoka, and R. M. Enoka Different Neural Adjustments Improve Endpoint Accuracy With Practice in Young and Old Adults J Neurophysiol, May 1, 2007; 97(5): 3340 - 3350. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. P. J. Selen, J. H. van Dieen, and P. J. Beek Impedance Modulation and Feedback Corrections in Tracking Targets of Variable Size and Frequency J Neurophysiol, November 1, 2006; 96(5): 2750 - 2759. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. W. Franklin, U. So, M. Kawato, and T. E. Milner Impedance Control Balances Stability With Metabolically Costly Muscle Activation J Neurophysiol, November 1, 2004; 92(5): 3097 - 3105. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |