JN Fuel your research with LabChart
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Neurophysiol 93: 2873-2886, 2005. First published December 22, 2004; doi:10.1152/jn.00200.2004
0022-3077/05 $8.00
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
93/5/2873    most recent
00200.2004v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Citing Articles
Right arrow Citing Articles via ISI Web of Science (1)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Li, L.
Right arrow Articles by Stone, L. S.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Li, L.
Right arrow Articles by Stone, L. S.

Effect of Contrast on the Active Control of a Moving Line

Li Li1,2, Barbara T. Sweet1 and Leland S. Stone1

1Human Information Processing Research Branch, National Aeronautics and Space Administration, Ames Research Center, Moffett Field, California; and 2San Jose State University, San Jose, California

Submitted 2 March 2004; accepted in final form 18 December 2004


    ABSTRACT
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
In many passive visual tasks, human perceptual judgments are contrast dependent. To explore whether these contrast dependencies of visual perception also affect closed-loop manual control tasks, we examined visuomotor performance as humans actively controlled a moving luminance-defined line over a range of contrasts. Four subjects were asked to use a joystick to keep a horizontal line centered on a display as its vertical position was perturbed by a sum of sinusoids under two control regimes. The total root mean square (RMS) position error decreased quasi-linearly with increasing log contrast across the tested range (mean slope across subjects: –8.0 and –7.7% per log2 contrast, for the two control regimes, respectively). Frequency–response (Bode) plots showed a systematic increase in open-loop gain (mean slope: 1.44 and 1.30 dB per log2 contrast, respectively), and decrease in phase lag with increasing contrast, which can be accounted for by a decrease in response time delay (mean slope: 32 and 40 ms per log2 contrast, respectively). The performance data are well fit by a Crossover Model proposed by McRuer and Krendel, which allowed us to identify both visual position and motion cues driving performance. This analysis revealed that the position and motion cues used to support manual control under both control regimes appear equally sensitive to changes in stimulus contrast. In conclusion, our data show that active control of a moving visual stimulus is as dependent on contrast as passive perception and suggest that this effect is attributed to a shared contrast sensitivity early in the visual pathway, before any specialization for motion processing.


    INTRODUCTION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Research over the past decade has shown that in passive speed-matching tasks, the perceived speed of moving one-dimensional (1-D) stimuli (e.g., a sine grating or line) depends on contrast with little sign of saturation at high contrast (Hawken et al. 1994Go; Muller and Greenlee 1994Go; Stone and Thompson 1992Go; Thompson 1982Go; however, see McKee et al. 1986Go). In general, reducing contrast causes a reduction in perceived speed. This effect has been observed not only for 1st-order motion of luminance sine gratings, but also for 2nd-order motion of contrast-modulated noise patterns (Ledgeway and Smith 1995Go), self-motion through optic flow (Distler and Bülthoff 1996Go), and motion-in-depth from looming (Blakemore and Snowden 1999Go) or binocular cues (Brooks 2001Go). Such perceptual effects are likely the consequence of the fact that, throughout much of the primate visual pathway, neural responses increase monotonically with increasing stimulus contrast, across a wide range of contrasts (e.g., Albrecht and Hamilton 1982Go; Sclar et al. 1990Go), making the neural disambiguation of changes in contrast from those of other signal properties problematic (see Adelson and Bergen 1986Go; Heeger et al. 1996Go; Stone et al. 1990Go; Thompson et al. 1996Go; Watson and Ahumada 1985Go).

Although it has clearly been established that human speed judgments during passive psychophysical testing depend on contrast, it is less clear to what extent this contrast dependency of motion perception might impact active control tasks. It has been argued that perceptual judgments and visually controlled actions involve separate, independent visual pathways (Goodale and Milner 1992Go; Milner and Goodale 1995Go). One piece of evidence for this view, relevant to the issue of contrast, is that the smooth pursuit eye movement response to constant-velocity target motion increases only slightly (about 10%) over a narrow range of target contrast above threshold (0.3 log unit), and then saturates (Haegerstrom-Portnoy and Brown 1979Go). This finding suggests that a steady-state motor response during a closed-loop tracking task can be relatively insensitive to changes in contrast.

Other studies, however, have shown that visually controlled actions can exhibit performance limitations similar to those shown for perception, evidenced both in accuracy (Beutter and Stone 1998Go; Franz et al. 2000Go; Krukowski and Stone 2005Go; Li and Warren 2002Go; Smeets and Brenner 1995Go; Soechting et al. 2001Go; Zivotofsky et al. 1996Go) and precision (Kowler and McKee 1987Go; Stone and Krauzlis 2003Go; Watamaniuk and Heinen 1999Go). In particular, Snowden et al. (1998)Go found that, when subjects were deprived of speedometer readings in a driving simulator, they drove faster when asked to maintain forward speed as the simulated scene became foggier (lower contrast), consistent with findings from their parallel passive viewing study that subjects perceived the foggier scenes as moving more slowly.

The purpose of the current study is to investigate systematically to what extent visually guided manual control is affected by display contrast. Specifically, we used a closed-loop active control task in which subjects were asked to use a joystick to control a moving horizontal luminance-defined line whose vertical position was perturbed in a pseudorandom manner. Although this task is quite simplified, it shares some essential features with real vehicular control tasks; helicopter pilots, for instance, among other tasks, must stabilize the horizon displayed on a panel to maintain a constant attitude while facing random perturbations produced by wind. Using a similar task, Zacharias and Levison (1979)Go previously observed a drop in gain and an increase in time delay in the control performance for a diffused line display with reduced contrast. In our study, we systematically examined the effect of changing the line contrast on control performance [in particular on total root mean square (RMS) position error, response gain, and time delay] under two different control regimes. In the velocity-control condition, the joystick displacement generated a command proportional to the rate of change of line position; in the acceleration-control condition, the joystick displacement generated a command proportional to the rate of change of line velocity. Velocity control is commonly experienced in many modern-world situations, such as control of an automobile in which the rate of change of direction is proportional to the steering wheel displacement. Acceleration control, although less common, less intuitive and therefore more challenging, can be mastered with practice, such as control of a spacecraft (Jagacinski and Flach 2003Go).

In passive speed-matching tasks, one can force observers to rely exclusively on speed information to perform the task by randomizing the temporal duration and the initial position of the moving visual stimulus to make position information irrelevant (see e.g., McKee 1981Go). In closed-loop active control of a moving line, however, it is difficult to separate the operator's reliance on target speed from that on target position or mere motion direction. Visual feedback data of the line speed, position, or motion direction could all be used to continuously adjust the joystick to perform the task of keeping the line centered on the screen. Given that velocity control requires the operator merely to respond to the line position, whereas acceleration control requires the operator to use feedback of the line velocity for accurate closed-loop control (Jagacinski and Flach 2003Go), one might expect the different joystick command dynamics of the two control regimes to influence the type of visual information subjects use for the control performance and therefore possibly to modulate any contrast sensitivity as well. To quantitatively evaluate the contrast effects on subjects' sensitivity to visual speed and position information and to determine to what extent human performance in the two control regimes may be differentially affected, we fit the performance data using a Crossover Model (McRuer and Krendel 1974Go; McRuer et al. 1965Go), tailored to assess the specific visual cues used to support performance (Sweet 1999Go; Sweet et al. 2003Go). This analysis enabled us to tease apart the overall response gain into its position and velocity components, to allow a separate examination of the contrast sensitivity of each component.


    METHODS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Subjects

Four staff members (two naïve as to the specific goals of the study), between the ages of 26 and 33, at the NASA Ames Research Center participated.

Stimulus generation and control

The stimulus, which consisted of a Gaussian-blurred horizontal line (34° H x 1.8° V),1 was displayed on a FlexScan F980 Eizo 19-in. monitor (1,240 x 1,028 pixels, 34° x 26°) refreshing at 60 Hz. We presented the line at five positive contrast levels (2, 3, 4, 8, and 16%) with a background luminance of 22 cd/m2. The line contrast was defined by the Michelson contrast formula (Lmax – Lmin)/(Lmax + Lmin), where Lmax is the luminance of the line and Lmin is the luminance of the background.

During a trial, the participant was asked to use a spring-restrained joystick (B&G Systems, JF3) to keep the line centered on the monitor screen as its position was perturbed by the sum of 10 harmonically independent sinusoids. The input position perturbation u had the following form as a function of time t

(1)
Table 1 lists the actual values of a, k, and resulting frequencies ({omega} = 2{pi}k/240) used for the study. D was set to a value of 0.8° and the phase offset ({rho}i) was randomly varied from –{pi} to {pi}. The use of harmonically independent sum-of-sines not only made the line motion on the screen appear random, but also allowed for a frequency-based analysis of the linear component of the control response, while minimizing artifacts from nonlinearities that might produce harmonic distortion. The average speed of the uncorrected input disturbance was 2.25°/s (peak: 8.51°/s).


View this table:
[in this window]
[in a new window]
 
TABLE 1. Magnitude and frequencies of the 10 harmonically independent sinusoids in the input position perturbation u of Eq. 1

 
Two types of joystick control regimes were tested: the joystick displacement was proportional either to the rate of change of line position (velocity control) or to the rate of change of line velocity (acceleration control). The control regimes are specified by the controlled element dynamics Yc implemented in software by the display computer (Fig. 1)



View larger version (13K):
[in this window]
[in a new window]
 
FIG. 1. Simplified block diagram of our active control task. Human operator transfer function Yp captures the operator's control compensation, and the controlled element dynamics Yc specifies the control regime.

 
For velocity control


(2)

For acceleration control2


(3)

The joystick position was sampled at 60 Hz (i.e., every frame of the display). Thus the system feedback delay was 1 frame or 16.67 ms, which is a small fraction of the total human reaction time. Joystick displacement values ranged arbitrarily from –1 to 1, corresponding to the full backward and forward positions, respectively.

Procedure

On each trial, a stationary line appeared and began moving when the subject pulled the trigger of the joystick. The line started moving according to the sum-of-sines perturbation input, and the subject's task was to move the joystick forward and backward to keep the line centered on the monitor screen. The duration of each trial was 245 s.

Six sessions, each containing 10 trials or conditions (5 contrast levels x 2 control regimes), were run. Each subject ran one session per day for six days. Trials were blocked by control regimes and contrast levels were randomized within blocks. There was a 30-s break between trials and a 4-min break between the two blocks. To make sure subjects understood the task and became familiar with the control regimes, they received one session of practice trials before data acquisition began. An experimental session typically lasted about 1 h.

Data analysis

To investigate different aspects of the impact of contrast on performance, we used several metrics. Total performance error was measured as the RMS of the time series of recorded line position relative to the center of the screen in degrees of visual angle. We analyzed data beginning 5 s after the start of the trial to ensure that we skipped the initial transient response. To examine the operator's control response specific to the input perturbation frequencies, we performed frequency (Bode) analyses to compute both the closed-loop and open-loop describing functions from our closed-loop performance data (Fig. 1).

For the closed-loop Bode analysis, we Fourier-analyzed the input position perturbation and the line position command to obtain the relevant signal amplitudes and phases. It is possible (and in some cases desirable) to physically open the loop of a closed-loop biological control system, either by physically imposing an uncorrectable error (e.g., Jagacinski 1977Go; Jagacinski and Flach 2003Go; Pola and Wyatt 1989Go; Stone and Lisberger 1990Go) or by examining transient responses (e.g., Lisberger and Westbrook 1985Go). However, the problem with imposing the sustained, uncorrectable error needed to perform a steady-state Bode analysis is that the subject will likely notice this fact and will therefore change his/her strategy (e.g., either give up or work harder). Therefore a system running in such artificial open-loop conditions may not actually reflect the true open-loop transfer function of the corresponding closed-loop system. Here, we have chosen another approach; we have simply allowed the system to run in a closed loop, but have recorded the actual driving input signal throughout the trial (i.e., the imposed input partially corrected by feedback). Assuming linearity, we can derive the open-loop transfer function using the measured input and output. This approach has the advantage that we are sure that the strategy yielding the open-loop and closed-loop performance is actually the same. Thus for the open-loop Bode analysis, we Fourier-analyzed the visual position error and the line position command to obtain the relevant signal amplitudes and phases.

In both cases, for each contrast level, we took ratios of response amplitudes and differences between the phases to compute the gain and phase lag, respectively, at each perturbation frequency, averaged across six sessions. We then used the phase of the highest contrast level (16%) as the reference and computed the relative response delay in milliseconds for the other four contrast levels. To determine the effect of contrast on performance, we conducted regression analyses on each of the above performance metrics as a function of contrast. For the slope calculations, we used data points at the lowest contrast level (2%) as the reference to calculate the percentage increase per log2 unit of increasing contrast. For subject RNE, we excluded his data at 2% and 3% contrast from the analysis of his RMS error for acceleration control, because he reported that he could not see the line clearly at these contrast levels and at times lost sight of the line on some of the trials, thereby causing large and uninformative RMS errors for these two conditions in the acceleration control regime.

Modeling

Our closed-loop active control task allows subjects to use the visual feedback of both line speed and position to continuously adjust the joystick to minimize the line motion and position offset on the screen. To quantitatively evaluate the contrast effects on their reliance on speed and position information in our task, we modeled the open-loop performance data using a modified McRuer Crossover Model, a linear dynamic model that describes the control compensation that humans provide for a wide variety of closed-loop manual control tasks (McRuer and Krendel 1974Go; McRuer et al. 1965Go). To illustrate the model, a simplified block diagram of the system is shown in Fig. 1.

In the model, the control compensation provided by the human operator is captured by transfer function Yp

(4)
where {tau} represents the sum of the perceptual and motor delays that specify the operator's overall response time delay, Kv represents the sensitivity of the operator to stimulus speed, Kp represents the sensitivity to stimulus position offset, parameters {omega}n and {xi}n represent the fixed 2nd-order response dynamics of the human operator independent of the visual stimulus, and s is the Laplace transform variable.

Model parameters were determined by a best fit to the open-loop describing function using a weighted (by SE) least-squares procedure (for details see Sweet et al. 2003Go). The Pearson correlation coefficients for the model estimates of subjects' average Bode plots ranged from 0.93 to 0.99 and from 0.96 to 0.9997 across subjects, for velocity and acceleration control, respectively. This indicates that between 86 and 99.94% of the variance in the individual Bode plots can be accounted for by the Crossover Model. The reduced {chi}2 for the model fits to the performance data, however, ranged from 2.3 to 5.6 and from 2.8 to 5.2 across subjects, for the two control regimes respectively, indicating that, although the simple linear Crossover Model is a good fit to the data, it does not fully account for all aspects of performance. Indeed, it cannot account for any nonlinearities.


    RESULTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Overall performance

Figure 2 plots typical raw data of the visual position error and the line position command during a typical velocity control trial. In general, as expected, the joystick response is a scaled and delayed version of the input visual error signal, with a clear fall-off in the response at the highest frequencies.



View larger version (14K):
[in this window]
[in a new window]
 
FIG. 2. Typical raw performance data of the input visual position error (solid line) and the output line position command (dashed line). Note that the output is a low-pass–filtered and delayed version of the input.

 
The mean RMS error averaged across six sessions is plotted as a function of log2 contrast for each subject in Fig. 3. As expected, the RMS error for velocity control was smaller than that for acceleration control [mean: 1.70 vs. 2.68°, t(17) = 6.89, P < 0.001], consistent with the latter task's greater difficulty. The mean RMS error averaged across subjects showed a significant linear trend with log contrast for both control regimes (r2 = 0.97, P < 0.01 for both velocity and acceleration control). For three subjects, individual regression showed that RMS error decreased quasi-linearly with increasing log contrast across the tested range for both velocity and acceleration control (r2 > 0.92, P < 0.05 and r2 > 0.87, P < 0.05, respectively). For the remaining subject (AEK), the linear trend was marginally significant for velocity control, but was significant for acceleration control (r2 = 0.76, P = 0.052 and r2 = 0.97, P < 0.01, respectively). The mean slope (±SE across subjects) was –8.0 ± 1.0 and –7.7 ± 1.1% decrease in RMS error per log2 contrast unit for velocity and acceleration control, respectively. There is no significant difference between these slopes [t(3) = –1.0, P = 0.39].



View larger version (13K):
[in this window]
[in a new window]
 
FIG. 3. Root mean square (RMS) error as a function of log2 contrast for velocity control (A) and acceleration control (B). Error bars represent SEs across six sessions.

 
The RMS error measures the total performance error, both visually and nonvisually driven, and does not distinguish between errors arising from an inappropriate response amplitude from those attributed to response delay. The errors specific to the perturbation frequencies, however, are a better measure of the visually driven response specific to the moving visual stimulus, and Fourier analysis allows us to segregate response-amplitude and response-delay effects. To depict how the control response varies with contrast at each of the input temporal frequencies, we computed the closed-loop describing function (the ratio of the Fourier transform of the line position command to that of the input position perturbation; see Fig. 1). Figure 4, A and B, plots closed-loop gain and phase (of the command with respect to the input) as a function of perturbation temporal frequency for naïve subject RNE. The frequency–response (or Bode) plot shows that, for both velocity and acceleration control, gain is near unity (approximately 0 dB) with little phase lag (approximately 0°) at low frequencies and shows progressive roll-off at higher frequencies. In addition, gain systematically increased and phase lag systematically decreased with increasing contrast, especially in the high-frequency range. These overall features were similar for all four subjects and the mean response is illustrated in Bode plots averaged across subjects for the lowest (2%) and the highest (16%) contrast levels (Fig. 4, C and D).



View larger version (23K):
[in this window]
[in a new window]
 
FIG. 4. Closed-loop frequency–response (Bode) plots. Top panels: mean gain and phase averaged over six sessions as a function of perturbation frequency for a naïve subject (RNE) for velocity control (A) and acceleration control (B). Error bars represent SEs across six sessions. Bottom panels: mean gain and phase averaged over four subjects as a function of perturbation frequency for velocity control (C) and acceleration control (D). Error bars represent SEs across subjects (some of them are smaller than the data symbols). Solid curves in C and D represent the best-fitting simulations of the Crossover Model, with Kv = 0.029% max/deg x s, Kp = 0.021% max/deg, and {tau} = 329 ms for 2% contrast in C; Kv = 0.059% max/deg x s, Kp = 0.031% max/deg, and {tau} = 251 ms for 16% contrast in C; Kv = 0.030% max/deg x s, Kp = 0.003% max/deg, and {tau} = 345 ms for 2% contrast in D; and Kv = 0.043% max/deg x s, Kp = 0.006% max/deg, and {tau} = 267 ms for 16% contrast in D.

 
Open-loop performance

The closed-loop performance of any negative feedback system is designed to be robust to large differences in the internal workings of the system (i.e., negative feedback generates nearly unity closed-loop gain over a wide range of internal gains and therefore obscures how well the internal system is performing). To further analyze how well our subjects were performing at each of the perturbation frequencies, we also computed the overall open-loop describing function (the ratio of the Fourier transform of the line position command to that of the visual position error; see Fig. 1). Figure 5, A and B, plots the overall open-loop gain and phase as a function of frequency for naïve subject RNE. Similar to the closed-loop Bode plots, the open-loop Bode plots show overall low-pass characteristics with gain increasing systematically and phase lag decreasing systematically with increasing contrast. Unlike the closed-loop gain, the open-loop gain tends to be >1 (0 dB) and the command phase lags the input by about 90° at low frequencies, and both gain and phase roll off faster at high frequencies (e.g., Hess 1997Go; Jagacinski and Flach 2003Go), revealing a larger effect of contrast. Again, these overall features were similar for all four subjects and are illustrated in Bode plots averaged across subjects for the lowest (2%) and the highest (16%) contrast levels (Fig. 5, C and D).



View larger version (26K):
[in this window]
[in a new window]
 
FIG. 5. Open-loop frequency–response (Bode) plots. Top panels: mean gain and phase averaged over six sessions as a function of perturbation frequency for a naïve subject (RNE) for velocity control (A) and acceleration control (B). Error bars represent SEs across six sessions. Bottom panels: mean gain and phase averaged over four subjects as a function of perturbation frequency for velocity control (C) and acceleration control (D). Error bars represent SEs across subjects (some of them are smaller than the data symbols). Solid curves in C and D represent the best-fitting simulations of the Crossover Model, with the same parameter values as in Fig. 4.

 
To quantify the change of open-loop response gain with contrast, we plotted gain averaged across subjects as a function of log2 contrast for each of the frequencies ≥0.1 Hz (Fig. 6, A and B). We discovered gains at the lowest three frequencies (0.02, 0.03, and 0.05 Hz) because performance measurements are noisy at these ultralow frequencies.3 Overall, the gain for velocity control was nearly double that for acceleration control [mean: –3.47 and –8.37 dB, t(34) = 4.93, P < 0.001], consistent with the latter being a more difficult task. The overall gain averaged across frequencies showed a significant linear trend with log contrast for both control regimes (r2 = 0.95, P < 0.01 and r2 = 0.97, P < 0.01 for velocity and acceleration control, respectively). The overall slope (±SE across frequencies) was 1.44 ± 0.18 and 1.30 ± 0.21 dB per log2 change in contrast for velocity and acceleration control, respectively. For all subjects, individual regression analysis showed that overall gain averaged across frequencies increased quasi-linearly with increasing log contrast across the tested range (r2 > 0.87, P < 0.05 and r2 > 0.79, P < 0.05, for velocity and acceleration control, respectively). The mean slope (± SE across subjects) at each frequency is plotted for each control regime in Fig. 6C. A 2 x 7 repeated-measures ANOVA on the slopes revealed that the main effect of control regime was not significant and that that of frequency was borderline [F(1,3) = 4.03, P = 0.14 and F(6,18) = 2.42, P = 0.07, respectively]. However, the interaction between control regime and frequency was highly significant [F(6,18) = 5.18, P < 0.01]. There was a tendency for both control regimes to show higher slopes (i.e., bigger contrast effects) at the lowest and highest frequencies, but velocity control's U-shaped curve appears to be shifted to the right with higher values than those for acceleration control in the midrange frequencies (Fig. 6C).



View larger version (23K):
[in this window]
[in a new window]
 
FIG. 6. Mean open-loop gain at each perturbation frequency averaged over four subjects as a function of log2 contrast for velocity control (A) and acceleration control (B). C: mean slopes of the trends in A and B as a function of perturbation frequency. Error bars represent SEs across subjects.

 
To analyze the effect of contrast on open-loop response phase, we first plotted mean phase as a function of log2 contrast (Fig. 7, A and B), averaged across subjects for the three highest perturbation frequencies (0.75, 1.30, and 2.17 Hz), chosen because the contrast effect was most reliable there (see Fig. 5). We then converted response phase to effective response time delay and plotted the mean relative delay with respect to the 16% contrast condition (Fig. 7, C and D). Although the phases at the three frequencies were quite different, as can be seen in Fig. 7, A and B, the overlap of the data in Fig. 7, C and D, shows that they nonetheless all correspond to a single response delay that varies with contrast. The overall slope (±SE across frequencies) was 32 ± 0.6 and 40 ± 2.7 ms per log2 change in contrast. There was no significant difference in these two slopes [t(2) = –2.74, P = 0.11]. Last, individual regression analysis showed that the delay increased quasi-linearly with decreasing log contrast for all subjects, across the tested contrast range, for both velocity and acceleration control (r2 > 0.96, P < 0.01and r2 > 0.97, P < 0.01, respectively).



View larger version (20K):
[in this window]
[in a new window]
 
FIG. 7. Mean phase (deg) and mean relative response delay (ms) averaged over four subjects for the three highest frequencies (0.75, 1.30, and 2.17 Hz) as a function of log2 contrast for velocity control (A and C, respectively) and acceleration control (B and D, respectively). Error bars represent SEs across subjects.

 
Modeling

The Crossover Model allows us to perform a quantitative evaluation of the contrast effect on human sensitivity to visual speed and position information in our active control task. The velocity sensitivity Kv and the position sensitivity Kp capture the control characteristics subjects have in performing the task, and the time delay {tau} captures the overall response delay to the moving visual stimulus. Figure 8 shows the describing function of the model and illustrates how varying Kv, Kp, and {tau} affects overall open-loop gain and phase for the two control regimes. Specifically, increasing Kv, while keeping Kp and {tau} constant, causes gain in the high-frequency domain to increase (Fig. 8, A and B); increasing Kp, while keeping Kv and {tau} constant, causes gain in the low-frequency domain to increase (Fig. 8, C and D); and increasing {tau}, while keeping Kv and Kp constant, causes the phase to increase at high frequencies (Fig. 8, E and F). The solid and dashed curves in Fig. 4, C and D and Fig. 5, C and D show that the model does a good job of describing both mean closed-loop and mean open-loop performance, except for the noisy data at the three lowest frequencies under acceleration control (see footnote 3 above; see also Fig. 5D).



View larger version (21K):
[in this window]
[in a new window]
 
FIG. 8. Bode plots depicting effects of varying Kp, Kv, and {tau} on YpYc of the Crossover Model under velocity control (A, C, and E, respectively) and acceleration control (B, D, and F, respectively).

 
From the open-loop describing function, we estimated Kv, Kp, and {tau} for the human transfer function Yp (Fig. 1 and Eq. 4) for all contrast and control regime conditions for each subject. We fixed {omega}n and {xi}n across contrast conditions, but let them vary across control regimes. Kv, Kp, and {tau} were thus not directly comparable across the two control regimes, but the contrast effect (the slope as a function of contrast) was. We graph Kv and Kp4 as a function of contrast for each subject in log–log plots (Fig. 9). Log Kv averaged across subjects showed a significant linear trend with log contrast for both control regimes (r2 = 0.97, P < 0.01 and r2 = 0.93, P < 0.01 for velocity and acceleration control, respectively; Fig. 9, A and B). For three subjects, individual regression analyses showed that log Kv increased quasi-linearly with increasing log contrast for both velocity and acceleration control (r2 > 0.95, P < 0.01 and r2 > 0.81, P < 0.05, respectively). For subject LLI, the linear trend was significant for velocity control, but was only borderline for acceleration control (r2 = 0.92, P < 0.05 and r2 = 0.72, P = 0.07, respectively). The mean slope (±SE across subjects) was 1.53 ± 0.34 and 1.16 ± 0.40 dB change in Kv per log2 change in contrast. The slope for velocity control was significantly larger than that for acceleration control [t(3) = 5.35, P < 0.05], which may be related to our finding that the contrast effect on gain is higher for velocity control at the midrange frequencies (Fig. 6C).



View larger version (20K):
[in this window]
[in a new window]
 
FIG. 9. Best-fitting model gain parameters for each subject as a function of log2 contrast. Kv for velocity control (A) and acceleration control (B); Kp for velocity control (C) and acceleration control (D).

 
Similarly, log Kp averaged across subjects showed a significant linear trend with log contrast for both control regimes (r2 = 0.93, P < 0.01 and r2 = 0.92, P < 0.05 for velocity and acceleration control, respectively; Fig. 9, C and D). For subjects AEK and RNE, individual regression analyses showed that log Kp increased quasi-linearly with increasing log contrast for both velocity and acceleration control (r2 > 0.78, P < 0.05 and r2 > 0.82, P < 0.05, respectively). For LLI, the linear trend was significant for velocity control and nearly significant for acceleration control (r2 = 0.99, P < 0.01 and r2 = 0.77, P = 0.0501, respectively). For subject KRB, the linear trend was not significant for either velocity or acceleration control (r2 = 0.17, P = 0.50 and r2 = 0.66, P = 0.09, respectively). The mean slope (±SE across subjects) was 1.57 ± 0.41 and 1.51 ± 0.27 dB increase in Kp per log2 change in contrast. These two slopes are not significantly different [t(3) = 0.14, P = 0.90].

The model estimates of time delay {tau} are plotted as a function of log2 contrast for each subject in Fig. 10. The time delay averaged across subjects showed a significant linear trend with log contrast for both control regimes (r2 = 0.92, P < 0.01 and r2 = 0.99, P < 0.01 for velocity and acceleration control, respectively). For three subjects, individual regression analysis showed that {tau} decreased quasi-linearly with increasing log2 contrast across the tested range for both velocity and acceleration control (r2 > 0.91, P < 0.05 and r2 > 0.98, P < 0.01, respectively). For subject RNE, the linear trend was borderline for velocity control, but was significant for acceleration control (r2 = 0.75, P = 0.06 and r2 = 0.99, P < 0.01, respectively). The mean slope (±SE across subjects) was –38 ± 11.4 and –33 ± 6.0 ms per log2 increase in contrast. These two slopes are not significantly different [t(3) = –0.85, P = 0.46].



View larger version (12K):
[in this window]
[in a new window]
 
FIG. 10. Best-fitting model delay parameter for each subject as a function of log2 contrast. {tau} for velocity control (A) and acceleration control (B).

 

    DISCUSSION
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Our model-independent and model-dependent analyses both show that the active control of a moving line depends on contrast across the entire range tested (2–16%) with little sign of saturation. For an average perturbation speed of 2.25°/s using a line of width of 1.8°, a factor of 2 increase in contrast produces an approximately 8% reduction in total RMS error, a 17% (1.4 dB) increase in internal gain, and a 35-ms decrease in reaction time, for both the velocity and acceleration control regimes. Our data also confirm that humans behave differently when interacting with velocity and acceleration control. We find, however, that the contrast effect on performance is largely independent of the control regime, suggesting that the contrast effect is largely determined by neural signals early in the visual pathway, thus producing a similar impact on both static and motion visual processing.

Reliance on position versus speed information

Humans can detect small spatial displacements and discriminate the direction of 1-D motion with performance saturating at near-threshold contrasts (Derrington and Goddard 1989Go; Muller and Greenlee 1994Go; Nakayama and Silverman 1985Go; Watson and Robson 1981Go; Wright and Johnson 1985Go). Our finding that active control of a moving line shows little evidence of saturation at contrasts more than an order of magnitude above threshold therefore suggests that, under both velocity and acceleration control regimes, humans do not rely merely on visual information about spatial displacement and binary 1-D motion direction to control a moving line.

Human speed perception has been shown to be dependent on contrast over a wide range of contrasts, showing little saturation (e.g., Hawken et al. 1994Go; Ledgeway and Smith 1995Go; Stone and Thompson 1992Go). Comparing the contrast effect in our active control task with that in passive speed-matching tasks in previous studies, we find that the magnitudes of the contrast effect are reasonably similar. For example, for a sine grating moving at 2°/s (1.5 cpd at 3 Hz), Stone and Thompson (1992)Go found that the contrast effect on perceived speed is quasi-linear in log contrast with the mean slope at 9% change per log2 contrast (Fig. 4 in Stone and Thompson 1992Go). Using a sine grating moving at 1.25°/s (4 cpd at 5 Hz) and 5°/s (1 cpd at 5 Hz), Ledgeway and Smith (1995)Go found slopes of about 18% change per log2 contrast (Figs. 7 and 8 in Ledgeway and Smith 1995Go). These values are similar to those found for RMS error and open-loop gain in this study.

The human ability to detect small visual position offsets also depends on contrast over a wide range of contrasts (from 4 to 75%) with vernier thresholds increasing for decreasing contrast (Krauskopf and Farell 1991Go; Wehrhahn and Westheimer 1990Go; Westheimer et al. 1999Go). Assuming that the contrast effect on vernier thresholds is quasi-linear in log contrast, the mean slope of the trend is about 20% change per log2 contrast in both Krauskopf and Farell (1991Go; Fig. 4 therein) and Westheimer et al. 1999Go; (Table 2 therein). This slope is also in reasonable agreement with those for passive speed perception described above and those observed for our active control task. The fact that the contrast effects on position and speed discrimination have similar slopes may explain why the large difference in overall control performance observed for velocity and acceleration control was nonetheless associated with similar contrast effects for the two control regimes. Thus manipulating contrast in an active control task, unfortunately, cannot by itself be used to disambiguate the human sensitivity to visual speed and position information when performing the task.

We therefore used a model-based analysis to address this issue. The modified McRuer Crossover Model is able to capture the characteristics of the velocity sensitivity, the position sensitivity, and the time delay in the human manual control response. The model enabled us to evaluate quantitatively the effects of contrast on the subject's reliance on speed and position information in our task. We found that both velocity and position sensitivities (Kv and Kp) increase quasi-linearly with log contrast across the tested range with slopes (1.35 and 1.54 dB per log2 contrast, respectively) comparable to that of the overall open-loop gain (1.37 dB per log2 contrast). This finding suggests that humans use both speed and position information in our active control task and that both inputs are similarly affected by contrast. Although some studies have argued that humans act simply like position servo systems when performing manual control tasks (e.g., Navas and Stark 1968Go), our data are consistent with previous findings that show that both visual position and motion signals are used to control steady-state smooth-pursuit eye movements (Morris and Lisberger 1987Go; Pola and Wyatt 1980Go) and pointing/pursuit hand movements (Engel and Soechting 2000Go; Paillard 1996Go; Saunders and Knill 2004Go). Indeed, performance in our manual control task is qualitatively consistent with models that use feedback of both visual position and velocity signals for the control of motor action (e.g., Lisberger et al. 1987Go; Saunders and Knill 2004Go). Furthermore, the observed contrast effects on RMS error, gain, and time delay are consistent with a contrast-dependent, visual, front-end nonlinearity, followed by a threshold (see next section). However, our data are silent on many other important issues that constrain manual control models, such as the role of feed-forward or other predictive mechanisms, of proprioceptive feedback, of training, and so forth. In particular, our highly constrained 1-D joystick control paradigm did not allow us to differentiate between trajectory-based and goal-based control algorithms (see Todorov and Jordan 2002Go).

Time delay

The model estimates of the time delay ({tau}) cluster in the range of 230 to 360 ms across contrasts and control regimes. These values are well within the range expected from previous studies of both the reaction time of transient responses and the time delay of steady-state responses in manual control tasks (e.g., about 250 ms in Craik and Vince 1963Go; about 230 ms in Engel and Soechting 2000Go; about 340 ms in Masson et al. 1995Go; about 260–340 ms in Miall 1996Go; about 250 ms in Navas and Stark 1968Go), although longer than those found in some step–response studies (about 135 ms in Carlton 1981Go; about 110 ms in Gibbs 1965Go; about 155 ms in Prablanc and Martin 1992Go; about 175 ms in Saunders and Knill 2004Go). The temporally and spatially unpredictable nature of the visual signal experienced during the closed-loop control of our pseudorandom motion stimulus (see Carlton 1981Go), as well as the relatively low stimulus contrast, likely contributed to the relatively long latencies observed in our study.

The contrast effect on the best-fitting time delay in the model corresponds well to that obtained from our direct analysis of the performance phase (38 vs. 32 ms per log2 contrast for velocity control and 33 vs. 40 ms per log2 contrast for acceleration control). Similarly, previous studies have reported that contrast affects reaction times for detecting both stimulus and motion onset for sinusoidal gratings (Burr et al. 1998Go; Harwerth and Levi 1978Go; Lupp et al. 1976Go; Mihaylova et al. 1999Go; Tartaglione et al. 1975Go). The contrast effect on simple reaction times for detecting stationary sinusoidal gratings has a mean slope increase of about 8 ms per log2 contrast decrease at 0.5 cpd (Fig. 2 in Mihaylova et al. 1999Go) and of about 5 ms per log2 contrast at 1 cpd (Table 3 in Tartaglione et al. 1975Go). The contrast effect on reaction times for detecting the motion onset of sinusoidally modulated luminance gratings has slopes ranging from about 8 to about 35 ms increase per log2 contrast decrease depending on observer and base speed, with smaller contrast effects as the speed approaches 10°/s (Fig. 4 in Burr et al. 1998Go). The latter study also found that reaction time appears pseudolinearly related to perceived speed (i.e., well fit by Pieron's formula with a mean exponent of 1.05; see their Table 1), consistent with the view that perceived speed is computed at an early stage in a process that partially confounds stimulus motion and contrast. This finding suggests that reaction time is largely determined by a minimum critical apparent displacement (more specifically, the integral of perceived speed over time), acting as a threshold. Furthermore, if perceived target speed rather than actual target speed provides a component of the open-loop drive, the reduction of this signal at low contrast together with the elimination of small responses by a threshold could also act to reduce overall gain and increase RMS error.

A contrast effect on reaction time has also been reported in studies of visual search (Nasanen et al. 2001Go) and on visuomotor control of eye movements (Haegerstrom-Portnoy and Brown 1979Go; Ludwig et al. 2004Go; Mulligan and Stevenson 2003Go; van Asten et al. 1988Go). In general, visual search time or response delay increases with decreasing contrast. Haegerstrom-Portnoy and Brown (1979)Go first reported that the size of the contrast effect on the latency of the initial saccadic eye movement to a ramp target is about a 50-ms decrease per log2 contrast. More recently, Ludwig and colleagues (2004)Go found that saccadic latency to stationary Gabor patches increases by nearly 40 ms per log2 decrease in contrast (their Table 1 using fits to data normalized for threshold differences across spatial frequency). However, using a cross-correlation analysis, Mulligan and Stevenson (2003)Go found that the pursuit response to a target moving randomly with a mean speed of 3.4°/s shows an increase in response delay of only about 15 ms per log2 decrease in contrast.

Neurophysiological effects of contrast

The fact that previous studies have shown similar effects of contrast on both static and motion visual tasks together with our finding that significant changes in control behavior are not associated with changes in contrast sensitivity argues that the contrast-dependent effects described above are a manifestation of processing early in the visual pathway, before any specialization for motion processing. Indeed, it is well known that the activity of neurons in LGN and V1 is monotonically related to stimulus contrast, saturating only at high contrast levels (C50 of 33% contrast; Table 1 in Sclar et al. 1990Go). Later in the visual cortical pathway, the activity of most neurons in extrastriate cortical area MT saturates at relatively low contrast (C50 of 7% contrast, Table 1 in Sclar et al. 1990Go). Although MT has been demonstrated to play a critical role in direction perception (Newsome and Pare 1988Go; Salzman et al. 1990Go, 1992Go), its role in speed perception is less clear (however, see Churchland and Lisberger 2001Go; Perrone and Thiele 2001Go; Priebe et al. 2003Go), which may explain why 1-D direction judgments saturate at low contrast (e.g., Nakayama and Silverman 1985Go; Watson and Robson 1981Go), whereas perceived speed does not (e.g., Hawken et al. 1994Go; Stone and Thompson 1992Go).

In conclusion, this study provides a quantitative description, analysis, and functional model of the effects of luminance contrast on a closed-loop manual control task. We conclude that 1) human performance in closed-loop control of a moving line is highly contrast dependent over a wide range of contrasts, showing an approximately 17% decrease in internal gain for each halving of contrast; 2) this overall contrast effect is generally similar for both velocity and acceleration control, but there appear to be subtle differences in the frequency or speed dependence of this effect in the two control regimes; 3) both the modeled velocity and position sensitivities increase quasi-linearly with log contrast with similar slopes, indicating that the speed and position cues used to control a moving line are similarly contrast sensitive; and 4) contrast has a dramatic effect on response delay, adding about 35 ms of delay for every halving of contrast.


    GRANTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
This research was supported by National Aeronautics and Space Administration Human Measures and Performance (WBS 711-80-03) and Human Systems Research and Technology (WBS 111-10-10) Programs.


    ACKNOWLEDGMENTS
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
We thank M. Kaiser, B. Beutter, and A. Krukowski for helpful comments on a previous draft.


    FOOTNOTES
 
The costs of publication of this article were defrayed in part by the payment of page charges. The article must therefore be hereby marked "advertisement" in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

1 The width of the luminance-defined line without Gaussian blurring ({sigma} = 0.5°) was 1.3°. Thus, the luminance profile of the line was 1.3 + 0.5° wide. Back

2 Note that our acceleration control regime was not a perfect acceleration control system of 1/s2. We added a damping factor of 0.2s to reduce task difficulty. Back

3 The measurements at these low frequencies are noisy because there are so few cycles available for Fourier analysis given the limited duration of a trial. Back

4 We correlated visual position error and joystick displacement (before it goes through the control element Yc) to estimate the model parameters for the operator transfer function Yp. The units for position sensitivity Kp are thus a percentage of maximum joystick displacement per degree of visual angle of the line position error on the screen. For velocity sensitivity Kv, these units are then multiplied by time in seconds. Back

Address for reprint requests and other correspondence: L. Li, NASA Ames Research Center, MS 262-2, Moffett Field, CA 94035 (E-mail: lli{at}mail.arc.nasa.gov)


    REFERENCES
 TOP
 ABSTRACT
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 GRANTS
 ACKNOWLEDGMENTS
 REFERENCES
 
Adelson EH and Bergen JR. The Extraction of Spatio-Temporal Energy in Human and Machine Vision. Charleston, SC: Institute of Electrical and Electronic Engineers Computer Society, 1986, p. 135–139.

Albrecht DG and Hamilton DB. Striate cortex of monkey and cat: contrast response function. J Neurophysiol 48: 217–237, 1982.[Free Full Text]

Beutter BR and Stone LS. Human motion perception and smooth eye movements show similar directional biases for elongated apertures. Vision Res 38: 1273–1286, 1998.[CrossRef][ISI][Medline]

Blakemore MR and Snowden RJ. The effect of contrast upon perceived speed: a general phenomenon? Perception 28: 33–48, 1999.[CrossRef][ISI][Medline]

Brooks KR. Stereomotion speed perception is contrast dependent. Perception 30: 725–731, 2001.[CrossRef][ISI][Medline]

Burr DC, Fiorentini A, and Morrone C. Reaction time to motion onset of luminance and chromatic gratings is determined by perceived speed. Vision Res 38: 3681–3690, 1998.[CrossRef][ISI][Medline]

Carlton LG. Processing visual feedback information for movement control. J Exp Psychol Hum Percept Perform 7: 1019–1030, 1981.[CrossRef][ISI][Medline]

Churchland MM and Lisberger SG. Shifts in the population response in the middle temporal visual area parallel perceptual and motor illusions produced by apparent motion. J Neurosci 21: 9387–9402, 2001.[Abstract/Free Full Text]

Craik KJW and Vince MA. Psychological and physiological aspects of control mechanisms with special reference to tank gunnery. Part II. Ergonomics 6: 419–440, 1963.

Derrington AM and Goddard PA. Failure of motion discrimination at high contrasts: evidence for saturation. Vision Res 29: 1767–1776, 1989.[CrossRef][ISI][Medline]

Distler H and Bülthoff HH. Velocity perception in 3-D environments. Perception Suppl 25: 58, 1996.

Engel KC and Soechting JF. Manual tracking in two dimensions. J Neurophysiol 83: 3483–3496, 2000.[Abstract/Free Full Text]

Franz VH, Gegenfurter KR, Bülthoff HH, and Fahle M. Grasping visual illusions: no evidence for a dissociation between perception and action. Phychol Sci 11: 20–25, 2000.

Gibbs CB. Probability learning in step-input tracking. Br J Psychol 56: 233–242, 1965.[ISI][Medline]

Goodale MA and Milner AD. Separate visual pathways for perception and action. Trends Neurosci 15: 20, 1992.[CrossRef][ISI][Medline]

Haegerstrom-Portnoy G and Brown B. Contrast effects on smooth-pursuit eye movement velocity. Vision Res 19: 169–174, 1979.[CrossRef][ISI][Medline]

Harwerth RS and Levi DM. Reaction time as a measure of suprathreshold grating detection. Vision Res 18: 1579–1586, 1978.[CrossRef][ISI][Medline]

Hawken MJ, Gegenfurter KR, and Tang C. Contrast dependence of colour and luminance motion mechanisms in human vision. Nature 367: 268–270, 1994.[CrossRef][Medline]

Heeger DJ, Simoncelli EP, and Movshon JA. Computational models of cortical visual processing. Proc Natl Acad Sci USA 93: 623–627, 1996.[Abstract/Free Full Text]

Hess RA. Feedback control models: manual control and tracking. In: Handbook of Human Factor and Ergonomics, edited by Salvendy G. New York: Wiley, 1997.

Jagacinski RJ. A qualitative look at feedback control theory as a style of describing behavior. Human Factors 19: 331–347, 1977.

Jagacinski RJ and Flach JM. Control Theory for Humans. Mahwah, NJ: Erlbaum, 2003.

Kowler E and McKee SP. Sensitivity of smooth eye movement to small differences in target velocity. Vision Res 27: 993–1015, 1987.[CrossRef][ISI][Medline]

Krauskopf J and Farell B. Vernier acuity: effects of chromatic content, blur and contrast. Vision Res 31: 735–749, 1991.[CrossRef][ISI][Medline]

Krukowski AE and Stone LS. Expansion of direction space around the cardinal axes revealed by smooth pursuit eye movements. Neuron 45: 315–323, 2005.[CrossRef][ISI][Medline]

Ledgeway T and Smith AT. The perceived speed of second order motion and its dependence on stimulus contrast. Vision Res 35: 1421–1434, 1995.[CrossRef][ISI][Medline]

Li L and Warren WH. Retinal flow is sufficient for steering during observer rotation. Psychol Sci 13: 485–491, 2002.[CrossRef][ISI][Medline]

Lisberger SG, Morris EJ, and Tychsen L. Visual motion processing and sensory-motor integration for smooth pursuit eye movements. Annu Rev Neurosci 10: 97–129, 1987.[CrossRef][ISI][Medline]

Lisberger SG and Westbrook LE. Properties of visual inputs that initiate horizontal smooth pursuit eye movements in monkeys. J Neurosci 5: 1662–1673, 1985.[Abstract]

Ludwig CJ, Gilchrist ID, and McSorley E. The influence of spatial frequency and contrast on saccade latencies. Vision Res 44: 2597–2604, 2004.[CrossRef][ISI][Medline]

Lupp U, Hauske G, and Wolf W. Perceptual latencies to sinusoidal gratings. Vision Res 16: 969–972, 1976.[CrossRef][ISI][Medline]

Masson G, Proteau L, and Mestre DR. Effects of stationary and moving textured backgrounds on the visuo-oculo-manual tracking in humans. Vision Res 35: 837–852, 1995.[CrossRef][ISI][Medline]

McKee SP. A local mechanism for differential velocity detection. Vision Res 21: 491–500, 1981.[CrossRef][ISI][Medline]

McKee SP, Silverman GH, and Nakayama K. Precise velocity discrimination despite random variations in temporal frequency and contrast. Vision Res 26: 609–619, 1986.[CrossRef][ISI][Medline]

McRuer DT and Krendel ES. Mathematical models of human pilot behavior, NASA Technical Report. AGARD-AG-188, 1974.

McRuer DT, Krendel ES, and Reisener W. Human pilot dynamics in compensatory systems, Wright–Patterson Air Force Base Technical Report. AFFDL-TR-65-15, 1965.

Miall RC. Task-dependent changes in visual feedback control: a frequency analysis of human manual tracking. J Mot Behav 28: 125–135, 1996.