Earlier studies suggest that the inferior temporal (IT) cortex of the monkey plays a key role in color discrimination. Here, we examined the quantitative relationship between color judgment in monkeys and the responses of color-selective neurons in the anterior part of the IT cortex (area TE) by comparing neuronal activity and behavior recorded simultaneously while the monkeys performed a color judgment task. We first compared the abilities of single neurons and monkeys to discriminate color. To calculate a neuron's ability to discriminate color, we computed a neurometric function using receiver-operating-characteristics analysis. We then compared the neural and behavioral thresholds for color discrimination and found that, in general, the neural threshold was higher than the behavioral threshold, though occasionally the reverse was true. Variation in the neural threshold across the color space corresponded well with that of the behavioral threshold. We then calculated the Choice Probability (CP), which is a measure of the correlation between the trial-to-trial fluctuations in neuronal responses and the monkeys' color judgment. On average, CPs were slightly but significantly larger than 0.5, indicating the activities of these TE neurons correlate positively with the monkeys' color judgment. This suggests that individual color-selective TE neurons only weakly contribute to color discrimination and that a large population of color-selective TE neurons contribute to the performance of color discrimination.