SlideShare a Scribd company logo
Automatic Filtering for the
Assignment of Indexes
Multitons – Counting – locating and
various other things
‘Filtering Out’
• “The visual system must be able to do the
equivalent of ‘filtering out’ some of the
potential false alarm causing signals … All
we can do in the filtering is attempt to
capitalize on some physically specifiable
detectable property that is …used to
distinguish those from other stimuli.”
(Is vision continuous with cognition? Brain Behavior Sciences 1999, 22, 341-423)
The First Stage
• A two-stage model has
been proposed for the
tracking task,
(McKeever, 1991,
Sears, 1991 and Sears
and Pylyshyn, 1995).
• The first stage can be
thought of as the
assignment of indexes,
which is automatic and
driven to objects via
primitive features
The Assignment of Indexes
• If the assignment of indexes is based on
what Muller & Findlay (1988) call the
automatic component of attention, then …
The Binding Problem
• Anne Treisman
– Some notes
• Features of surface-defining properties – luminance,
color, texture, motion, stereoscopic depth
• Features of shape-defining boundaries – orientation,
curvature, and closure
– She reviews the relevant research which seems
to be in conflict with the notion that binding
requires serial processing.
– Current Opinion in Neurobiology, 6, 171-178
Resolution
• “One resolution is that parallel search
reflects not preattentive processing but
global attention to the scene as a whole
with no individuation of separate
elements.”
• Therefore, a discrepant object is seen as a
break in the global structure of the three-
dimensional array..
Is Color-Change Primitive?
• Jacquie Burkell & Zenon Pylyshyn
– “It seems that when (a color change of any
kind) is in fact detected it can be perfectly
localized, even when the changed item is in
now different from its distracters.”
Location Encoding
• “If the indicated location did not match the
target location, but fell within one potential
display position of the actual target location
(i.e., .9 degrees of visual angle), the
response was recorded as ‘near’… if not
far.” (from Burkell and Pylyshyn)
Serial and parallel processing of
visual feature conjunctions
• “If one of the dimensions in a conjunctive
search is stereoscopic disparity, a second
dimension of either color or motion can be
searched in parallel … these conjunctive
tasks (were such that) the observer had the
distinct impression that each plane could be
search effortlessly, in turn.”
• Ken Nakayama & Gerald Silverman (Nature, V. 320 20 March 1986 264-265)
Color is Powerful 1
• Subjects could determine the orientation of
the target – i.e., a T amongst Ls when they
were cued symbolically by color, as when
cued by color at location, and a luminance
location cue.
– Efficiency of selective attention: selection by colour and location compared Jari Laarni
Mika Koski and Gote Nyman (Perception, 1996, V 25, 1401-1418)
Color is Powerful 2
• What is important here is that subjects could
selectively attend to a group of objects that
were one color, and perform better on the
discrimination and the orientation tasks,
when selectively attending to a subset of
items that were set apart via color.
– Can one pay attention to a particular color Peter Brawn and Robert Snowden
(Perception and Psychophysics V 61(5) July 1999, 860-873
Open Questions
• Can we extend the previous research that
involves the detection of single items to the
detection of multiple items
• Does location encoding requires serial
visitation?
• What is the duration of that initial
assignment?
Some More Questions
• What is the capacity of the assignment of indexes?
– What does it mean for an index to be assigned?
• Does that mean that it can be enumerated?
• Does it mean that it can be located?
• Conjunctions
– What is the influence of a conjunction of features on
the assignment of indexes?
– What about the search for multiple items in a
conjunction search?
Our results show that when the targets in an MOT task are
indicated by temporally making them a different color than
the non-targets, observers track just as well (or better) than when
they are indicated by flashing the targets.
This increase in performance holds even when the indication
interval is greatly reduced. In fact, in this case, color signaling
is noticeably better than flashing.
In fact, for the color signaling condition, performance remains
relatively unaffected when the indication interval is reduced from
900ms to 50ms!
This an outstanding, unexpected result.
The results clearly show that color signaling is a much
stronger INDEX ATTRACTOR than flashing the targets.
Points to consider:
The onset of the color on the targets cannot be useful to the observer
because all objects are colored. The only useful information is the color
of the targets versus the non-targets.
So how does the system assign indexes to the targets under
these conditions?
Two possibilities:
1. Particular colors automatically attract indexes. By coincidence,
we selected the right color.
2. The visual system is able to perform a fast top-down color
filtering for specific pre-determined colors.
Point 1:
Is not supported by data. Observers track both target (red or green) and
complement set (red or green) equally well.
Point 2:
How fast is this filtering process? It must be faster than automatic
indexing!!! At 50ms, tracking green is 87% as compared to the
flash case which is 65%.
But …

More Related Content

PDF
1705.07543
PDF
Deep Neural NEtwork
DOCX
Local directional number pattern for face analysis face and expression recogn...
PDF
2018 09
PDF
Local Gray Code Pattern (LGCP): A Robust Feature Descriptor for Facial Expres...
PPSX
The effects of visual realism on search tasks in mixed reality simulations-IE...
PPTX
Effect of Object Discriminability on Multiple Object Tracking
PPTX
Identifying vs. Enumerating Objects
1705.07543
Deep Neural NEtwork
Local directional number pattern for face analysis face and expression recogn...
2018 09
Local Gray Code Pattern (LGCP): A Robust Feature Descriptor for Facial Expres...
The effects of visual realism on search tasks in mixed reality simulations-IE...
Effect of Object Discriminability on Multiple Object Tracking
Identifying vs. Enumerating Objects

Similar to Automatic Filtering for the Assignment of Indexes (7)

PDF
Poster_aug10_Lassonde
PDF
Intro to data visualization
PPT
Introduction vision
PPTX
Computer vision - light
PDF
DMTM 2015 - 06 Introduction to Clustering
PDF
Visual Interpretation satellite Images.pdf
PDF
Shadow Detection and Removal Techniques A Perspective View
Poster_aug10_Lassonde
Intro to data visualization
Introduction vision
Computer vision - light
DMTM 2015 - 06 Introduction to Clustering
Visual Interpretation satellite Images.pdf
Shadow Detection and Removal Techniques A Perspective View
Ad

More from John Dennis (14)

PPTX
Representing “Novel” Experiences
PPTX
Making Sense Of It All: Mapping the Current to the Past
PPTX
Time: Narratives & Time
PPTX
Time :The role of agency in temporal metaphors
PPTX
Time: Structural alignment and retrospective duration estimates
PPTX
THE CASE FOR INDUCTION Why Psychology needs it so bad
PPTX
AISC 2011 Conference: GENETIC ALGORITHMS AS A MODEL OF HUMAN CREATIVITY?
PPTX
LeHo project: 6 six key educational factors
PPTX
LeHo project: Drawing together
PPT
Structuring abstract concepts
PPT
Are abstract concepts structured via more concrete concepts
PPTX
From ICT focus group analysis in home/hospital education: the LeHo project
PPTX
Key educational Factors and Focus Groups
PDF
JOHN_DENNIS_PSYCH_OF_ART_STUDENT_PROJECT
Representing “Novel” Experiences
Making Sense Of It All: Mapping the Current to the Past
Time: Narratives & Time
Time :The role of agency in temporal metaphors
Time: Structural alignment and retrospective duration estimates
THE CASE FOR INDUCTION Why Psychology needs it so bad
AISC 2011 Conference: GENETIC ALGORITHMS AS A MODEL OF HUMAN CREATIVITY?
LeHo project: 6 six key educational factors
LeHo project: Drawing together
Structuring abstract concepts
Are abstract concepts structured via more concrete concepts
From ICT focus group analysis in home/hospital education: the LeHo project
Key educational Factors and Focus Groups
JOHN_DENNIS_PSYCH_OF_ART_STUDENT_PROJECT
Ad

Recently uploaded (20)

PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PPTX
Cell Structure & Organelles in detailed.
PDF
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PPTX
Lesson notes of climatology university.
PPTX
Pharmacology of Heart Failure /Pharmacotherapy of CHF
PPTX
Pharma ospi slides which help in ospi learning
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
PPTX
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
A systematic review of self-coping strategies used by university students to ...
PDF
Computing-Curriculum for Schools in Ghana
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PDF
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
PDF
Classroom Observation Tools for Teachers
PDF
Complications of Minimal Access Surgery at WLH
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
Cell Structure & Organelles in detailed.
3rd Neelam Sanjeevareddy Memorial Lecture.pdf
Final Presentation General Medicine 03-08-2024.pptx
Lesson notes of climatology university.
Pharmacology of Heart Failure /Pharmacotherapy of CHF
Pharma ospi slides which help in ospi learning
FourierSeries-QuestionsWithAnswers(Part-A).pdf
A GUIDE TO GENETICS FOR UNDERGRADUATE MEDICAL STUDENTS
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
A systematic review of self-coping strategies used by university students to ...
Computing-Curriculum for Schools in Ghana
202450812 BayCHI UCSC-SV 20250812 v17.pptx
Final Presentation General Medicine 03-08-2024.pptx
RTP_AR_KS1_Tutor's Guide_English [FOR REPRODUCTION].pdf
Classroom Observation Tools for Teachers
Complications of Minimal Access Surgery at WLH
O5-L3 Freight Transport Ops (International) V1.pdf

Automatic Filtering for the Assignment of Indexes

  • 1. Automatic Filtering for the Assignment of Indexes Multitons – Counting – locating and various other things
  • 2. ‘Filtering Out’ • “The visual system must be able to do the equivalent of ‘filtering out’ some of the potential false alarm causing signals … All we can do in the filtering is attempt to capitalize on some physically specifiable detectable property that is …used to distinguish those from other stimuli.” (Is vision continuous with cognition? Brain Behavior Sciences 1999, 22, 341-423)
  • 3. The First Stage • A two-stage model has been proposed for the tracking task, (McKeever, 1991, Sears, 1991 and Sears and Pylyshyn, 1995). • The first stage can be thought of as the assignment of indexes, which is automatic and driven to objects via primitive features
  • 4. The Assignment of Indexes • If the assignment of indexes is based on what Muller & Findlay (1988) call the automatic component of attention, then …
  • 5. The Binding Problem • Anne Treisman – Some notes • Features of surface-defining properties – luminance, color, texture, motion, stereoscopic depth • Features of shape-defining boundaries – orientation, curvature, and closure – She reviews the relevant research which seems to be in conflict with the notion that binding requires serial processing. – Current Opinion in Neurobiology, 6, 171-178
  • 6. Resolution • “One resolution is that parallel search reflects not preattentive processing but global attention to the scene as a whole with no individuation of separate elements.” • Therefore, a discrepant object is seen as a break in the global structure of the three- dimensional array..
  • 7. Is Color-Change Primitive? • Jacquie Burkell & Zenon Pylyshyn – “It seems that when (a color change of any kind) is in fact detected it can be perfectly localized, even when the changed item is in now different from its distracters.”
  • 8. Location Encoding • “If the indicated location did not match the target location, but fell within one potential display position of the actual target location (i.e., .9 degrees of visual angle), the response was recorded as ‘near’… if not far.” (from Burkell and Pylyshyn)
  • 9. Serial and parallel processing of visual feature conjunctions • “If one of the dimensions in a conjunctive search is stereoscopic disparity, a second dimension of either color or motion can be searched in parallel … these conjunctive tasks (were such that) the observer had the distinct impression that each plane could be search effortlessly, in turn.” • Ken Nakayama & Gerald Silverman (Nature, V. 320 20 March 1986 264-265)
  • 10. Color is Powerful 1 • Subjects could determine the orientation of the target – i.e., a T amongst Ls when they were cued symbolically by color, as when cued by color at location, and a luminance location cue. – Efficiency of selective attention: selection by colour and location compared Jari Laarni Mika Koski and Gote Nyman (Perception, 1996, V 25, 1401-1418)
  • 11. Color is Powerful 2 • What is important here is that subjects could selectively attend to a group of objects that were one color, and perform better on the discrimination and the orientation tasks, when selectively attending to a subset of items that were set apart via color. – Can one pay attention to a particular color Peter Brawn and Robert Snowden (Perception and Psychophysics V 61(5) July 1999, 860-873
  • 12. Open Questions • Can we extend the previous research that involves the detection of single items to the detection of multiple items • Does location encoding requires serial visitation? • What is the duration of that initial assignment?
  • 13. Some More Questions • What is the capacity of the assignment of indexes? – What does it mean for an index to be assigned? • Does that mean that it can be enumerated? • Does it mean that it can be located? • Conjunctions – What is the influence of a conjunction of features on the assignment of indexes? – What about the search for multiple items in a conjunction search?
  • 14. Our results show that when the targets in an MOT task are indicated by temporally making them a different color than the non-targets, observers track just as well (or better) than when they are indicated by flashing the targets.
  • 15. This increase in performance holds even when the indication interval is greatly reduced. In fact, in this case, color signaling is noticeably better than flashing. In fact, for the color signaling condition, performance remains relatively unaffected when the indication interval is reduced from 900ms to 50ms!
  • 16. This an outstanding, unexpected result. The results clearly show that color signaling is a much stronger INDEX ATTRACTOR than flashing the targets.
  • 17. Points to consider: The onset of the color on the targets cannot be useful to the observer because all objects are colored. The only useful information is the color of the targets versus the non-targets. So how does the system assign indexes to the targets under these conditions? Two possibilities: 1. Particular colors automatically attract indexes. By coincidence, we selected the right color. 2. The visual system is able to perform a fast top-down color filtering for specific pre-determined colors.
  • 18. Point 1: Is not supported by data. Observers track both target (red or green) and complement set (red or green) equally well. Point 2: How fast is this filtering process? It must be faster than automatic indexing!!! At 50ms, tracking green is 87% as compared to the flash case which is 65%. But …