|
|
||||||||
1Department of Rehabilitation for Sensory Functions and 2Department of Rehabilitation for Movement Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, Tokorozawa, Saitama, Japan
Submitted 11 November 2004; accepted in final form 13 February 2005
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
In conventional studies of timing, the probabilistic structure of the external targets that we encounter in our daily life has been largely ignored, although many studies have focused on the properties of the variability in the processing system, i.e., the brain (e.g., Ding et al. 2002
; Gibbon et al. 1997
; Vorberg and Wing 1996
; Wing and Kristofferson 1973
). The Bayesian framework (Bayes 1763
; Bernardo and Smith 1994
) tells us that our CNS can estimate objects or events in the environment optimally by integrating the current sensory input and prior knowledge of the probabilistic structure of these objects or events. Phenomena that are consistent with Bayesian integration have been shown in studies of visual perception (Guo et al. 2004
; Kersten et al. 1997
; Liu et al. 1995
; Rao 1999
; Weiss et al. 2002
). Recently, it was reported that Bayesian integration is used for optimal estimation in the control of sensorimotor tasks, such as spatial reaching (Körding and Wolpert 2004
) and force-amplitude matching (Körding et al. 2004
). In this study, we tested whether Bayesian integration is also implemented in the coincidence-timing type of sensorimotor control by manipulating the width of the prior distribution of target timing.
| METHODS |
|---|
|
|
|---|
Twelve right-handed subjects (10 males and 2 females; age range, 2535 yr) participated in this study after giving their informed consent. This study was approved by the ethics committee of the National Rehabilitation Center for Persons with Disabilities.
Apparatus
The stimulus was presented visually using three red LEDs (S1, S2, and S3) that were placed in a horizontal array (Fig. 1A). Each LED was 5 mm in diameter, and the centers of the neighboring LEDs were 20 mm apart. The stimulus set was placed 1.25 m in front of the seated subjects. The LEDs were connected to a pulse generator (AMPI Master-8-vp) that was controlled by a personal computer. The LEDs were lit one after the other in the order S1
S2
S3 (Fig. 1B). The duration of illumination of each LED was 100 ms. In each trial, the temporal interval between S1 and S2 was identical to that between S2 and S3. The time interval between the neighboring LEDs (T) was drawn randomly from a prior Gaussian distribution p(Ttrue) with a mean of 400 ms, and the SD (
prior) depended on the experimental conditions. The SD was 20 ms for the "narrow distribution" condition and 40 ms for the "wide distribution" condition.
|
Task and procedure
The subjects were required to press the button such that its onset coincided with the onset of S3 based on the perceived information on interval S1-S2 in each trial.
All of the subjects performed 480 trials of this task for each of the two conditions (narrow/wide distribution, see Apparatus); consequently, 960 trials were performed in all. Six subjects first experienced the narrow distribution (narrow
wide group), and the remaining six first experienced the wide distribution (wide
narrow group). The intertrial interval was 2.5 s. To maintain a high level of alertness, the subjects were given a 1-min rest between every 80 trials. The subjects were allowed a 20-min rest when changing from one distribution condition to the next.
Data acquisition
The stimuli and switch responses were recorded simultaneously using a data acquisition system (Biopac Systems MP-150); they were digitized at 1,000 Hz and stored on a hard disk during the experiment. Using these records, the timing deviation of the switch onset from the S3 onset (
t) was measured for each trial (Fig. 1B). Positive
t values imply premature responses relative to the S3 onset, and negative values imply delayed responses.
Computational models and predictions
Based on the Bayesian framework, the target time interval that the subjects estimated (Testimated) in the current trial can be computed using two parameters: the target time interval that the subjects sensed (Tsensed) and the prior distribution of the target time interval p(Ttrue). Depending on the manner in which the subjects used the prior distribution p(Ttrue), the following three different estimation models can be considered (see Körding et al. 2004
). To test which model best accounts for the actual human timing estimation, we used the systematic (average) timing deviation 
t
of the subjects. 
t
is the systematic deviation of Testimated from the true target timing, Ttrue, i.e., 
t
Ttrue Testimated
, where any possible timing bias of the motor responses accounted for by another mechanism (Haggard et al. 2002
) is ignored for the sake of approximation. Each of the three models predicts a different behavior of 
t
versus Ttrue.
Model 1: Naive estimation
In this model, to obtain Testimated, the subjects ignore p(Ttrue) and depend fully on Tsensed. Assuming that there is no bias in the sensory perception,
t should be zero on average for any Ttrue. Therefore if the subjects use this model, the plots of 
t
versus Ttrue should be flat under both the narrow and wide distribution conditions.
Model 2: Optimal Bayesian estimation
In this model, Testimated is obtained by integrating Tsensed and p(Ttrue). The optimal Bayesian estimation can be formulated as follows
![]() |
sensed represents innate noise (variability) in the subject's sensors. Therefore Testimated can be calculated as a weighted sum of the mean of p(Ttrue) (= 400 ms) and Tsensed. This equation implies that when the uncertainty (SD) of the prior distribution decreases, the estimation of the time interval depends more on the mean of the prior; conversely, when the uncertainty of the prior distribution increases, the estimation depends more on the sensed time interval in each trial. Theoretically, this estimation should always result in a smaller mean squared error in comparison with the naive estimation (Körding and Wolpert 2004
Assuming that there is no bias in the sensory perception, on average, Tsensed can be approximated by Ttrue. Therefore this model predicts that 
t
(
Ttrue Testimated
) is linearly dependent on Ttrue, and the slope decreases as
prior increases, i.e., if the subjects use the optimal Bayesian estimation, the regression line relating 
t
to Ttrue should have a greater slope in the narrow distribution condition and a smaller slope in the wide distribution condition.
Model 3: Bayesian estimation with one fixed prior distribution
In this model, although the subjects can use the prior distribution, there is only one fixed prior distribution that is innately defined or cannot be modulated once acquired. It predicts that the plot of 
t
against Ttrue should form a sloping line, but its slope should be constant for all values of
prior, i.e., if subjects use this strategy, the regression line relating 
t
to Ttrue should have the same slope in both the narrow and wide distribution conditions. Moreover, note that this model involves an extreme case that is mentioned below. Takahashi et al. (2001)
reported that, when subjects experienced a randomly varying force field, they learned the mean of the forces. It has been suggested that subjects cannot learn the distribution of forces in a similar random environment (Scheidt et al. 2001
). In case the subjects in our experiment learn and use only the mean of the prior, the slope of the regression line should always be unity (slope = 1), regardless of the width of the prior distribution.
| RESULTS |
|---|
|
|
|---|

t
as a function of the true time interval, Ttrue, for a typical subject (A: narrow distribution; B: wide distribution). These plots were constructed from the second half of the trials (i.e., the last 240 trials) for each condition. The plots of 
t
against Ttrue are linear under both conditions, and the regression slope under the narrow distribution condition (0.82) is greater than that under the wide distribution condition (0.40).
|
In addition, we assessed the uncertainty of the sensory noise,
sensed, using the measured slopes (see Körding et al. 2004
).
sensed was 42.03 ± 2.72 ms for the narrow distribution condition and 35.49 ± 4.70 ms for the wide distribution condition; the difference was not significant (P = 0.12).
There was a positive shift in the relation 
t
versus Ttrue along the vertical axis (see Fig. 2, A and B). The across-subject values of the shift were 21.66 ± 7.83 and 16.21 ± 6.73 ms for the narrow and wide distribution conditions, respectively, indicating that the subjects' motor responses were apt to occur earlier than S3. The Bayesian model does not predict this. Such a premature motor response relative to actual target onset is often observed in human sensorimotor synchronization (e.g., Aschersleben and Prinz 1995
; Chen et al. 1997
), which can be accounted for by the fact that self-generated movements are perceived as occurring later than they actually do (Haggard et al. 2002
).
To detail the time-course involved in learning the prior distribution, we show the slopes as a function of the trial bin for the narrow
wide and wide
narrow groups (Fig. 3), where the bin size used to calculate the slope was 240 trials, and the window used to examine a bin was shifted by increments of 80 trials in each distribution condition. A three-factor ANOVA with two repeated measures revealed that the main effect of group and the interactions of group x distribution condition and group x distribution condition x trial bin were significant (P < 0.01). Comparing the slopes across groups, for the first prior distribution, the difference between the narrow and wide prior distributions did not reach significance at the earliest stage, i.e., for the 1240 trial bin (P = 0.063, t-test). The differences were significant for the 81320, 161400, and 241480 trial bins (P < 0.001). This indicates that the subjects could attain the appropriate systematic timing behavior for the optimal Bayesian integration by 320 trials at the latest. For the second prior distribution, the difference between narrow and wide distributions was significant only for the 241480 trial bin (P < 0.05). Attending to the within-group change of the slope, for the narrow
wide group, two-way repeated-measure ANOVA revealed that the main effect of the distribution condition was significant (P < 0.05), whereas the main effect of the trial bin and the interaction of the distribution condition x trial bin were not significant (P > 0.4). A posthoc test (Tukey's HSD) revealed that the decrease of the slope in the second prior distribution was significant for all trial bins as compared with that for the 241480 trial bin in the first prior distribution. For the wide
narrow group, a two-way repeated-measure ANOVA revealed that, whereas the main effect of the distribution condition was not significant (P = 0.09), the main effects for the trial bin and the interaction of the distribution condition x trial bin were significant (P < 0.05). The posthoc test revealed that, compared with the 241480 trial bin in the first prior distribution, the increase in the slope in the second prior distribution was significant for the 81320, 161400, and 240481 trial bins (P < 0.05), but it was not significant in the first stage, i.e., for the 1240 trial bin (P = 0.48). These results indicate that the subjects could modulate their systematic timing behavior according to the change in the width of the prior distribution from wide to narrow and from narrow to wide. In addition, more trials are needed for the modulation to reach significance in the wide
narrow group as compared with the narrow
wide group.
|
| DISCUSSION |
|---|
|
|
|---|
In this study, we tested whether Bayesian integration is implemented in human coincidence timing by manipulating the width of the prior distribution for the target timing. The systematic timing behavior of the subjects agreed with the prediction of the optimal Bayesian model (model 2). Although a large number of studies based on psychophysical measures have reported the property or mechanism of various biological timing processes (e.g., Delignières et al. 2004
; Dunlap 1910
; Gibbon et al. 1984
; Lee 1976
; Spencer et al. 2003
; Tresilian 1995
; Yamamoto and Kitazawa 2001
), to the best of our knowledge, our report is the first to show that the optimal Bayesian model can be applied to such a domain. Our finding that the human sensorimotor system should use Bayesian integration while performing a timing task, as well as spacing (Körding and Wolpert 2004
) and force-grading (Körding et al. 2004
) tasks, supports the argument that Bayesian integration might be fundamental to all aspects of human sensorimotor control and learning (Körding and Wolpert 2004
).
Adaptability to the novel prior distribution: differences from a study of force grading
A similar manipulation of the prior distribution was used in a study of force-amplitude matching (Körding et al. 2004
). In that task,
1,000 learning trials were needed before the significant difference predicted by the optimal (full) Bayesian model was found in the systematic force-grading behavior between two groups that encountered narrow and wide prior distributions. In contrast, in our timing task, the systematic timing behavior of the two groups differed within several hundred trials of learning. Furthermore, in force grading, the subjects who experienced the narrow prior distribution condition first were able to adjust their systematic force-grading behavior according to the subsequent wider distribution, whereas the subjects who experienced the wide prior distribution condition first could not significantly adjust their behavior according to the subsequent narrower distribution. In contrast, in our experiment, the subjects were able to adjust their behavior significantly, as predicted by the optimal Bayesian model, not only when the prior distribution was switched from narrow to wide but also when it was switched from wide to narrow. The differences between the two results suggest that the human sensorimotor system has greater flexibility in acquiring and updating prior knowledge for time estimation than in the case of force estimation.
Guo et al. (2004)
argued that the prior knowledge used for the Bayesian estimation in visual perception could be classified into built-in and experience-based types. The former depends on the invariant statistics in the natural environment and is probably permanently embedded in relatively lower cortical areas, such as V1. The latter depends on the recent experience of the observer and might involve higher cortical areas. This argument attributes the presence of plasticity of prior knowledge to where it is represented in the brain. Brain imaging and neurophysiological studies indicate that different brain areas engage in the execution of time- and force-relevant tasks, whereas some areas in close proximity work on both tasks in common. Rao et al. (2001)
showed that the basal ganglia, bilateral premotor cortex, right inferior parietal cortex, and right dorsolateral prefrontal cortex are associated with the processes involved in time-interval discrimination. Meck and Benson (2002
) emphasized the role of the frontal-striatal circuit in interval timing. In addition, the cerebellum is considered to play a crucial role in timing (Ivry and Spencer 2004
). In a precision-grip task, relevant activation was observed in the right ventral premotor area, rostral cingulate motor area, and several locations in the posterior parietal and prefrontal areas (Ehrsson et al. 2000
). Perhaps the difference in behavioral flexibility to a change in the prior distribution is accounted for by the difference in the brain areas that engage in acquiring or storing the prior information for either timing or force grading, although we cannot yet nominate the area(s) involved.
Adaptability to the novel prior distribution: a common property with a study of force grading
Although the subjects were able to adjust their behavior significantly, as predicted by the optimal Bayesian model, even when the prior distribution was switched from wide to narrow in our timing task, a difference was observed in the speed of the adjustment. More trials were needed for the adjustment to reach significance when the prior distribution was switched from wide to narrow than vice versa. Note that the difference in the adjustment speed agreed with the above-mentioned result for force-amplitude matching. If the number of trials for the second prior distribution had been increased in the experiment by Körding et al., the adjustment of behavior might have reached significance even when the prior distribution was switched from wide to narrow. Therefore the observations for both force-grading and timing tasks indicate that, whereas the human sensorimotor system is swift to adapt to a narrow-to-wide change in the prior distribution, it is slow to adapt to a wide-to-narrow change. If further studies confirm that such a difference in adaptation speed is a universal property of Bayesian integration in sensorimotor learning, this will provide a clue to how prior distribution is acquired and maintained in the human CNS.
| ACKNOWLEDGMENTS |
|---|
|
|
|---|
| FOOTNOTES |
|---|
Present address for reprint request and other correspondence: M. Miyazaki, Advanced Research Center for Human Sciences, Waseda University, 2-579-15 Mikajima, Tokorozawa, Saitama 359-1192, Japan (E-mail: miyazaki{at}aoni.waseda.jp, miyazaki_mkt{at}yahoo.co.jp)
| REFERENCES |
|---|
|
|
|---|
Bayes T. Essay towards solving a problem in the doctrine of chances. Phil Trans R Soc Lond B 53: 370418, 1763.
Bernardo JM and Smith AFM. Bayesian Theory. New York: Wiley, 1994.
Chen Y, Ding M, and Kelso JAS. Long memory process (1/f
type) in human coordination. Phys Rev Lett 79: 45014504, 1997.[CrossRef]
Delignières D, Lemoine L, and Torre K. Time intervals production in tapping and oscillatory motion. Hum Mov Sci 23: 87103, 2004.[CrossRef][Web of Science][Medline]
Ding M, Chen Y, and Kelso JAS. Statistical analysis of timing errors. Brain Cogn 48: 98106, 2002.[CrossRef][Web of Science][Medline]
Dunlap K. Reactions to rhythmic stimuli, with attempts to synchronize. Psychol Rev 17: 399416, 1910.[CrossRef][Web of Science]
Ehrsson HH, Fagergren A, Jonsson T, Westling G, Johansson RS, and Forssberg H. Cortical activity in precision- versus power-grip tasks: an fMRI study. J Neurophysiol 83: 528536, 2000.
Gibbon J, Church RM, and Meck WH. Scalar timing in memory. In: Timing and Time Perception, edited by Gibbon J and Allan L. New York: New York Academy of Sciences, 1984, p. 5277.
Gibbon J, Malapani C, Dale CL, and Gallistel CR. Toward a neurobiology of temporal cognition: advances and challenges. Curr Opin Neurobiol 7: 170l84, 1997.[CrossRef][Web of Science][Medline]
Guo K, Nevado A, Robertson RG, Pulgarin M, Thiele A, and Young MP. Effects on orientation perception of manipulating the spatio-temporal prior probability of stimuli. Vision Res 44: 23492358, 2004.[CrossRef][Web of Science][Medline]
Haggard P, Clark S, and Kalogeras J. Voluntary action and conscious awareness. Nat Neurosci 5: 382385, 2002.[CrossRef][Web of Science][Medline]
Ivry RB and Spencer RMC. The neural representation of time. Curr Opin Neurobiol 14: 225232, 2004.[CrossRef][Web of Science][Medline]
Kersten D, Mamassian P, and Knill DC. Moving cast shadows induce apparent motion in depth. Perception 26: 171192, 1997.[Web of Science][Medline]
Körding KP, Ku S, and Wolpert DM. Bayesian integration in force estimation. J Neurophysiol 92: 31613165, 2004.
Körding KP and Wolpert DM. Bayesian integration in sensorimotor learning. Nature 427: 244247, 2004.[CrossRef][Medline]
Lee DN. A theory of visual control of braking based on information about time-to-collision. Perception 5: 437459, 1976.[Web of Science][Medline]
Liu Z, Knill DC, and Kersten D. Object classification for human and ideal observers. Vision Res 35: 549568, 1995.[CrossRef][Web of Science][Medline]
Meck WH and Benson AM. Dissecting the brain's internal clock: how frontal-striatal circuitry keeps time and shifts attention. Brain Cogn 48: 195211, 2002.[CrossRef][Web of Science][Medline]
Rao RPN. An optimal estimation approach to visual perception and learning. Vision Res 39: 19631989, 1999.[CrossRef][Web of Science][Medline]
Rao SM, Mayer AR, and Harrington DL. The evolution of brain activation during temporal processing. Nat Neurosci 4: 317323, 2001.[CrossRef][Web of Science][Medline]
Ripoll H and Latiri I. Effect of expertise on coincident-timing accuracy in a fast ball game. J Sports Sci 15: 573580, 1997.[CrossRef][Web of Science][Medline]
Scheidt RA, Dingwell JB, and Mussa-Ivaldi FA. Learning to move amid uncertainty. J Neurophysiol 86: 971985, 2001.
Spencer RMC, Zelaznik HN, Diedrichsen J, and Ivry RB. Disrupted timing of discontinuous but not continuous movements by cerebellar lesions. Science 300: 14371439, 2003.
Takahashi CD, Scheidt RA, and Reinkensmeyer DJ. Impedance control and internal model formation when reaching in a randomly varying dynamical environment. J Neurophysiol 86: 104751, 2001.
Tresilian JR. Perceptual and cognitive processes in time-to-contact estimation: analysis of prediction-motion and relative judgment tasks. Percept Psychophys 57: 231245, 1995.[Web of Science][Medline]
van Beers RJ, Baraduc P, and Wolpert DM. Role of uncertainty in sensorimotor control. Phil Trans R Soc Lond B 357: 11371145, 2002.
Vorberg D and Wing A. Modeling variability and dependence in timing. In: Handbook of Perception and Action, edited by Heuer H and Keele SW. London: Academic Press, 1996, vol. 2, p. 181262.
Weiss Y, Simoncelli EP, and Adelson EH. Motion illusions as optimal percepts. Nat Neurosci 5: 598604, 2002.[CrossRef][Web of Science][Medline]
Williams LRT, Katene WH, and Fleming K. Coincidence timing of a tennis stroke: effects of age, skill level, gender, stimulus velocity, and attention demand. Res Q Exerc Sport 73: 2837, 2002.[Web of Science][Medline]
Wing AM and Kristofferson AB. The timing of interresponse intervals. Percept Psychophys 13: 455460, 1973.
Yamamoto S and Kitazawa S. Reversal of subjective temporal order due to arm crossing. Nat Neurosci 4: 759765, 2001.[CrossRef][Web of Science][Medline]
This article has been cited by other articles:
![]() |
D. W. Franklin and D. M. Wolpert Specificity of Reflex Adaptation for Task-Relevant Variability J. Neurosci., December 24, 2008; 28(52): 14165 - 14175. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Pressman, L. J. Welty, A. Karniel, and F. A. Mussa-Ivaldi Perception of Delayed Stiffness The International Journal of Robotics Research, November 1, 2007; 26(11-12): 1191 - 1203. [Abstract] [PDF] |
||||
![]() |
H. Tassinari, T. E. Hudson, and M. S. Landy Combining Priors and Noisy Visual Cues in a Rapid Pointing Task J. Neurosci., October 4, 2006; 26(40): 10154 - 10163. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Visit Other APS Journals Online |