UCI.  Psych 269  Winter 2004  George Sperling

* indicates required reading for all participants

SENSORY MEMORY
Review Articles

Famous review article (comprehensive historical review)
Coltheart, M. (!980). Iconic memory and visual persistence.
Perception and Psychophysics, 27, 183-228.  [Exclusively visual system]

* Massaro, Dominic W.; Loftus, Geoffrey R. (1996).
Sensory and perceptual storage: Data and theory.
In: Elizabeth Ligon Bjork &  Robert A. Bjork, Eds.  Memory.
Academic Press, Inc: San Diego, CA. 67-99.

Abstract: chapter review the literature aimed at describing characteristics
of initial visual storage and briefly sketch early conceptualizations of
iconic memory; present an analogous treatment of initial auditory storage;
use a semichronological organization to present findings from the 3 major
tasks that have been used to study both visual and auditory sensory storage:
partial report, backward masking, and subjective estimation of phenomenal
presence; address how the early conceptions of the icon have changed
over recent years; discuss a new linear-systems approach for thinking about
iconic storage and visual information processing that reconciles these
apparently contradictory results within a unitary framework; review the
evidence for multiple types of perceptual memories as opposed to stores
for more abstract or symbolic information; discuss the issues of how such
perceptual memories or stores should be represented, if at all, within
models of information processing.


* Crowder, R. G. (1978).  Sensory memory systems.
In E.C. Carterette and M. P.  Friedman [eds.], Handbook of Perception, vol. 8.
New York:  Academic Press.  Pp. 343-373. [Mainly auditory system]

 --------------------------------------------------------------------------
Visual Sensory Memory
Short Historical Articles

*Sperling, G. (1963).  A model for visual memory tasks. [Gerhardt]
Human Factors, 5, 19-31.

* Sperling, G., Budiansky, J., Spivak, J. G., and Johnson, M. C. (1971). [Lyu]
Extremely rapid visual search: the maximum rate of scanning letters for the
presence of a numeral.
Science, 174, 307-311.

*Adelson, E.H. (1978).  Iconic storage:  the role of rods. [Jeter]
Science, 201, 544-546.

*Hogben, J. H. and Di Lollo, V.  (1974). [Kong]
Perceptual integration of brief visual stimuli. Vision Research, 14, 1059-1069.

*Scarborough, Don L. (1972).  [Hsieh]
Memory for brief visual displays of symbols.  Cognitive Psychology, 3, 408-429.

*Phillips, W. A. (1974). [Truong]
On the distinction between sensory storage and short-term visual memory,
Perception and Psychophysics, 16, 283-290.

*Rensink R. A., O'Regan J. K, and Clark J. J. (1997). [Appelbaum]
To See or Not to See: The Need for Attention to Perceive Changes in Scenes.
Psychological Science., 368-373.
    http://www.psych.ubc.ca/~rensink/publications/download/PsychSci97-RR.pdf
    Demo:  http://www.usd.edu/psyc301/ChangeBlindness.htm

*Weichselgartner, E., and Sperling, G. (1985).  Continuous measurement [Lin]
of visible persistence.  Journal of Experimental Psychology, 11, 711-725.

*Loftus, G. R., Shimamura, A. P., and Johnson, C. A. (1985). [Tabuchi]
How much is an icon worth?
Journal of Experimental Psychology: Human Perception and Performance, 11, 1-13.

 -------------

Theoretical papers

Gegenfurtner, K. and Sperling, G. (1993).
Information transfer in iconic memory experiments.
Journal of Experimental Psychology:  Human Perception and Performance,
1993, 19, 845-866.

Abstract: To report letters from briefly exposed letter arrays, subjects
must transfer information from a rapidly decaying trace (iconic memory)
to more durable storage. In a partial-report paradigm, the proportion (P)
of trials with a long cue delay relative to a short cue delay was
systematically varied. Practiced Subjects used the same transfer strategy
independent of P. Data from a partial-report-plus-masking experiment were
used to construct a computational model that accurately predicted
partial- and whole-report performance with and without masks.
Assumptions: Prior to a cue, Subjects attend primarily to the middle row
of a 3-row display, resulting in nonselective transfer. After the cue,
they attend only to the cued row. Transfer rate is the product of iconic
legibility (which depends on the time and retinal location) and attention
allocation (which shifts after a cue). Cumulative transfer is limited by
the capacity of durable storage.

Busey, Thomas A. and Loftus, Geoffrey R. (1994).
Sensory and cognitive components of visual information acquisition.
Psychological Review, 101, 446-469

Abstract: Describes a theory of visual information acquisition and visual
memory. The theory has 2 major components. First, the visual system's
initial sensory response to a short-duration, low-contrast stimulus is
generated by a linear, low-pass temporal filter that operates on the
stimulus's temporal waveform. Second, information is acquired from a
stimulus through an independent-sampling process whose sampling rate
at time t following stimulus onset is jointly proportional to (1) the
magnitude by which the sensory response exceeds some threshold and (2)
the proportion of still unacquired information. The theory was successfully
tested in 5 variants of a digit recall task in which temporal waveform of
the stimulus was systematically manipulated.  In a final experiment,
the theory simultaneously accounted for performance in detection and
identification tasks. Implications for visual information processing,
low-contrast detection, and binocular combination of information are
discussed.

Update on Busey & Loftus
Loftus, G. R.; Irwin, D. E. (1998). [Appelbaum]
On the relations among different measures of visible and informational
persistence. Cognitive Psychology. 35, 135-199.

Abstract: In this paper, the authors first consider the question of whether
3 measures of visible and informational persistence (performance in
temporally integrating 2 successively presented stimuli, subjective rating
of the degree to which 2 successively presented stimuli appear to constitute
a single or a dual temporal event, and partial-report performance) all
measure the same underlying mental entity. The authors answer this question
using the dissociation logic called state-trace analysis, and by conducting
7 experiments. The authors then extend and apply a theory to data acquired
from these 7 experiments. The authors contend that this theory is highly
successful in accounting for their temporal-integration and
completeness-rating data, and is moderately successful in accounting for
partial-report data.

 -----------------
   
BRAIN IMAGING - EEG.  (Habituation)

Lu, Z.-L. and Sperling, G. (2003). [Ding]
Habituation and auditory sensory memory. 
In Magnetic Imaging of the Human Brain, Edited by Z-L Lu and L. Kaufman.
Pp. 319-342.

Staddon, J. E. R., Chelaru, I. M., Higa, J. J. (2002).  [Ding]
Habituation, memory and the brain: the dynamics of interval timing.
Behavioral Processes, 57, 71-88.

Yang, W. (1999).
Lifetime of human visual sensory memory: Properties and neural substrate.
PhD Thesis, New York University, March, 1999.

BRAIN IMAGING - MEG  (Habituation)

*Lu, Z.-L., Williamson, S. J. & Kaufman, L.  (1992). [Lin]
Behavioral lifetime  of  human auditory sensory  memory predicted by
physiological measures. Science, 258: 1668-1670.   

*Uusitalo, M. A., Williamson, S. J., and Seppa, M. T. (1996). [Hsieh]
Dynamical organisation of the human visual system revealed by lifetimes of
activationtraces.  Neuroscience Letters, 213, 149-152.
       
Uusitalo, M. A., Jousmaki, V., Hari, R. (1997). [Hsieh]
Activation trace lifetime of human cortical responses evoked by apparent
visual motion.  Neuroscience Letters, 224, 45-48,

 -----------------
    AUDITORY SENSORY STORAGE  (omitted in Winter 2004)

Crowder (see above)

Representative short articles:

Darwin, C. J., Turvey, M. T., and Crowder, R. G. (1972).
An auditory analogue of the Sperling partial report procedure:
Evidence for brief auditory storage.
Cognitive Psychology, 3, 255-267.

Glucksberg, S. and Cowen, G. N., Jr. (1970).
Memory for unattended auditory material.
Cognitive Psychology, 1, 149-156.

 ------------

Loftus, Geoffrey R., Duncan, Janine, Gehrig, Paul. (1992).
On the time course of perceptual information that results from a brief
visual presentation.
Journal of Experimental Psychol.: Human Perception & Performance, 18, 530-549.
[Read this paper for the general paradigm, not for the details.]
Similar to Psych Rev  (1994, Loftus & Busey)

 ==============================================================================

Questions for thought, discussion:

1. Colthart (for example) argues that iconic memory and visible persistence
are different phenomena.
  (a) Explain what these terms are intended to mean.
  (b) Explain Colthat's reasoning for this distinction.
  (c) What do you think? Explain.
  (d) Consider the visual trace (persistence or memory) in Sperling's partial
report experiments, in Scarborough's experiment, and in Weichselgartner &
Sperling's temporal brightness response, and relate them to your answers above.
 
2. Sensory memory:
  (a) Is visible persistence subserved by the same structures as informational
persistence, or can the apparent differences be accounted for by different
strategies of using the same structures?
  (b) How might this distinction be approached by brain imaging?

   Suggestion for answering: 1. Define both terms. 2. Explain the
structures (components) that YOU postulate are involved in each case.
3. Consider various tasks that relate to visible persistence and to
informational persistence and explain how the results on these task have
previously been interpreted in terms of being compatible or incompatible
with the unitary visual storage hypothesis. 4. Explain how the component
processes that you have postulated carry out (account for) the observed
performances.  5.  Consider tasks (if any) that can't fit into your schema,
and speculate on what the difficulties might be.


3a. Sperling introduced visual post-exposure noise fields in an experiment
to measure the rate of reading briefly exposed letter arrays. Describe
briefly the logic of the method.

3b. (a) Is the use of a post-exposure masking field always a good procedure
in experiments that seek to measure the rate of "information extraction"
from briefly exposed visual stimuli? If not, can you think of experiments
in which post-exposure noise fields would be inappropriate or misleading?
            
4. Sensory memory/Short-term memory.
 (a)  How many kinds of visual SM/STM are there? Characterize it (them).
 (b)  How can they be distinguished.
 (c)  How many kinds of auditory SM/STM are there? Characterize it (them).
 (d)  Which of these visual memories correspond(s) to auditory SM/STM(s).
Explain the functional similarities and differences
between the visual and auditory memories upon which you base you answer.

 ==============================================================================

MEMORY SEARCH

*Sternberg, Saul.  High-speed scanning in human memory.  Science, 1966, 153,
652-654 (The original paper; primarily of historical interest). [ALL]

Sternberg, Saul.  The discovery of processing stages:  Extensions of Donders'
method.  In G. Koster (Ed.), Attention and Performance II, Acta Psychologica,
1969, 30, 276-315. [Gerhardt]

*Dosher, B. A. and McElree, B. (1992). [ALL]
Memory search.  In Encyclopedia of Learning and Memory, Larry R. Squire (Ed.).
New York: Macmillan.  Pp. 398-406. 

Reed, A. V. (1973).  Speed-accuracy trade-off in recognition memory.
Science, 181, 574-576.  [Tabuchi]

McElree, B. and Dosher, B. A. (1990). [Jeter]
Serial position and set size in short-term memory: The time course of
recognition.  Journal of Experimental Psychology: General, 118, 346-373.

 ==============================================================================

BRAIN IMAGING ATTENTION

Single-neuron recording in awake behaving monkeys

*Moran, J., & Desimone, R. (1985).
Selective attention gates visual processing in the extrastriate cortex.
Science, 229, 782-784. [Tuong]

fMRI
*Matthews, P. M. (2001).  An introduction to functional magnetic resonance
imaging of the brain.  In Jezzard, P., Matthews, P. M., and Smith, S. M.
Oxford, UK: Oxford University Press.  Pp. 3-34. [ALL]

Kastner, S. (1994).  Towards a neural basis of human visual attention:
Evidence from functional brain imaging.  In Attention and Performance, 
  [Hsu: distractor filtering; Lin: LGN]

Seiffert, A. E., Somers, D. C., Dale, A. M., and Tootell, R. B. H.  (2003).
Functional MRI studies of human visual motion perception: Texture, Luminance,
Attention, and after-effects.  Cerebral Cortex, 13, 340-349.  [Appelbaum]

Claeys, K. G., Lindsey, D. T., Schutter, E. De, & Orban, G. A. (2003).
A higher order motion region in human inferior parietal lobule:
Evidence from fMRI.  Neuron, 40, 631-642.  [Lyu]

Reynolds, J. H, Chelazzi, L, & Desimone, R. (1999).
Competitive mechanisms subserve attention in macaque areas V2 and V4.
Journal of Neuroscience, 19, 1736-1753.

 --------------------------------------------------------------------------

 If time  permits:  Attention: fMRI: DeYoe, Boynton;  EEG: Hillyard x2