16
Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad M. Ruprecht Texas Christian University A spatial task was used to investigate if a stimulus could set the occasion for responding to a landmark. Pigeons were trained with a positive occasion setter (OS; a colored background display) signaling the contingency between a landmark (LM; visual patterned stimulus) and the location of a rewarded response. The two most common tests of an OS (transfer tests and post-training extinction of the OS) were then conducted. In Experiment 1, two occasion setting pairs were trained (¢XA/YB¡/A/B) with unique spatial relationships to a reinforced goal location. Transfer tests (XB and YA) revealed more responding to a landmark when paired with the same OS from training (e.g., XA) than on transfer tests, which was greater still than landmark-only trials (A). Three pigeons demonstrated good spatial control of responding by the LM on transfer tests. In Experiment 2, the contingency and spatial relationship (e.g., left or right) between LM A and the goal were signaled by the OS (¢XA/YA¡/¢ZB/C¡/A/B). LM C was trained without an OS to assess the role of training history during transfer. Transfer tests again indicated an OS could facilitate responding and the LM controlled the location of responding. Training history affected spatial control, but not facilitation, by LM C. Lastly, post-training extinction of X had no effect on facilitation or spatial control during subsequent XA trials. These experiments are the first to evaluate conditional control of spatial information by landmarks using both of the standard tests for occasion setting. Keywords: occasion setting, spatial learning, landmarks, conditional discrimination, pigeons Supplemental materials: http://dx.doi.org/10.1037/xan0000048.supp In nature, whether or not a response leads to an outcome (e.g., courtship behavior and copulation, respectively) is often influ- enced by the presence or absence of a discriminative stimulus (DS; e.g., a receptive female) in the environment. Furthermore, several DSs may be structured in a hierarchical fashion. For example, in an operant serial feature-positive procedure, reinforcement is deliv- ered when a response occurs in the presence of a DS (A; e.g., a tone), but only if DS A was preceded by another stimulus, X (e.g., a light). Within an associative learning framework, the second stimulus, X, can be described as setting the occasion for a rein- forced response in the presence of the DS (i.e., occasion setting). Hierarchical accounts of occasion setting assume that stimuli are represented individually and hierarchically. More specifically, these accounts state that the DS and occasion setter (OS) are encoded by the subject as individual elements, and the OS mod- ulates the information value of the DS. Herein we refer to the modulator element as an OS, and the element that is the target of the modulation as the DS, or landmark, if it provides stable spatial information (e.g., distance and direction) regarding the location of a reinforced response. Procedures in which the outcome is deliv- ered when A is paired with X (XA), but not in its absence (A), are referred to as occasion-setting training, though we discuss other methods of solving this discrimination. In an operant serial feature-positive procedure, the task can be solved by modulation of A by X, such as using an if–then rule to respond to DS (A) only if it is preceded by the OS (X¡A). However, a feature-positive discrimination can also be solved without modulation. For example, X could come to control re- sponding as a DS itself by forming a direct connection to the reinforced response during XA trials or by entering into a unique configuration with A (e.g., p a unique configuration of X and A; Pearce, 1987). Previous research has identified two training pa- rameters critical to observing modulation; the onset of the OS should precede that of the DS, and the DS should be more salient than the OS. After successful acquisition of occasion setting, an OS exhibits several unique properties, including (a) modulation of responding to a DS by an OS transfers to other DSs to the degree that the transfer DS has a history of partial reinforcement (e.g., Rescorla, 1986b), and (b) trials of the OS unpaired with the DS or outcome (i.e., extinction) should not disrupt subsequent modula- tion of responding to the DS in the presence of the extinguished OS (e.g., Rescorla, 1986a). Holland (1995) investigated both characteristics of an OS within an operant serial feature-positive procedure. During training, rats received two occasion-setting pairs (X¡A/A/Y¡B/B), as well as exposure to a third DS (C) trained without an OS. Holland (Experiment 1) tested whether modulation by an OS (X) This article was published Online First December 8, 2014. Kenneth J. Leising, Jordan S. Hall, Chad M. Ruprecht, and Joshua E. Wolf, Department of Psychology, Texas Christian University. Correspondence concerning this article should be addressed to Kenneth J. Leising, Department of Psychology, Texas Christian University, 2800 S. University Drive, Box 298920, Fort Worth, TX 76129. E-mail: k.j.leising@ tcu.edu This document is copyrighted by the American Psychological Association or one of its allied publishers. This article is intended solely for the personal use of the individual user and is not to be disseminated broadly. Journal of Experimental Psychology: Animal Learning and Cognition © 2014 American Psychological Association 2015, Vol. 41, No. 2, 163–178 2329-8456/15/$12.00 http://dx.doi.org/10.1037/xan0000048 163

Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

  • Upload
    others

  • View
    10

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

Occasion Setting During a Spatial-Search Task With Pigeons

Kenneth J. Leising, Jordan S. Hall,Joshua E. Wolf, and Chad M. Ruprecht

Texas Christian University

A spatial task was used to investigate if a stimulus could set the occasion for responding to alandmark. Pigeons were trained with a positive occasion setter (OS; a colored background display)signaling the contingency between a landmark (LM; visual patterned stimulus) and the location ofa rewarded response. The two most common tests of an OS (transfer tests and post-trainingextinction of the OS) were then conducted. In Experiment 1, two occasion setting pairs were trained(�¢XA/YB¡�/A�/B�) with unique spatial relationships to a reinforced goal location. Transfertests (XB� and YA�) revealed more responding to a landmark when paired with the same OS fromtraining (e.g., XA) than on transfer tests, which was greater still than landmark-only trials (A�).Three pigeons demonstrated good spatial control of responding by the LM on transfer tests. InExperiment 2, the contingency and spatial relationship (e.g., left or right) between LM A and thegoal were signaled by the OS (�¢XA/YA¡�/�¢ZB/C¡�/A�/B�). LM C was trained withoutan OS to assess the role of training history during transfer. Transfer tests again indicated an OS couldfacilitate responding and the LM controlled the location of responding. Training history affectedspatial control, but not facilitation, by LM C. Lastly, post-training extinction of X had no effect onfacilitation or spatial control during subsequent XA trials. These experiments are the first to evaluateconditional control of spatial information by landmarks using both of the standard tests for occasionsetting.

Keywords: occasion setting, spatial learning, landmarks, conditional discrimination, pigeons

Supplemental materials: http://dx.doi.org/10.1037/xan0000048.supp

In nature, whether or not a response leads to an outcome (e.g.,courtship behavior and copulation, respectively) is often influ-enced by the presence or absence of a discriminative stimulus (DS;e.g., a receptive female) in the environment. Furthermore, severalDSs may be structured in a hierarchical fashion. For example, in anoperant serial feature-positive procedure, reinforcement is deliv-ered when a response occurs in the presence of a DS (A; e.g., atone), but only if DS A was preceded by another stimulus, X (e.g.,a light). Within an associative learning framework, the secondstimulus, X, can be described as setting the occasion for a rein-forced response in the presence of the DS (i.e., occasion setting).Hierarchical accounts of occasion setting assume that stimuli arerepresented individually and hierarchically. More specifically,these accounts state that the DS and occasion setter (OS) areencoded by the subject as individual elements, and the OS mod-ulates the information value of the DS. Herein we refer to themodulator element as an OS, and the element that is the target ofthe modulation as the DS, or landmark, if it provides stable spatialinformation (e.g., distance and direction) regarding the location of

a reinforced response. Procedures in which the outcome is deliv-ered when A is paired with X (XA�), but not in its absence (A�),are referred to as occasion-setting training, though we discussother methods of solving this discrimination.

In an operant serial feature-positive procedure, the task can besolved by modulation of A by X, such as using an if–then rule torespond to DS (A) only if it is preceded by the OS (X¡A).However, a feature-positive discrimination can also be solvedwithout modulation. For example, X could come to control re-sponding as a DS itself by forming a direct connection to thereinforced response during XA trials or by entering into a uniqueconfiguration with A (e.g., p � a unique configuration of X and A;Pearce, 1987). Previous research has identified two training pa-rameters critical to observing modulation; the onset of the OSshould precede that of the DS, and the DS should be more salientthan the OS. After successful acquisition of occasion setting, anOS exhibits several unique properties, including (a) modulation ofresponding to a DS by an OS transfers to other DSs to the degreethat the transfer DS has a history of partial reinforcement (e.g.,Rescorla, 1986b), and (b) trials of the OS unpaired with the DS oroutcome (i.e., extinction) should not disrupt subsequent modula-tion of responding to the DS in the presence of the extinguishedOS (e.g., Rescorla, 1986a).

Holland (1995) investigated both characteristics of an OS withinan operant serial feature-positive procedure. During training, ratsreceived two occasion-setting pairs (X¡A�/A�/Y¡B�/B�), aswell as exposure to a third DS (C�) trained without an OS.Holland (Experiment 1) tested whether modulation by an OS (X)

This article was published Online First December 8, 2014.Kenneth J. Leising, Jordan S. Hall, Chad M. Ruprecht, and Joshua E.

Wolf, Department of Psychology, Texas Christian University.Correspondence concerning this article should be addressed to Kenneth J.

Leising, Department of Psychology, Texas Christian University, 2800 S.University Drive, Box 298920, Fort Worth, TX 76129. E-mail: [email protected]

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

Journal of Experimental Psychology: Animal Learning and Cognition © 2014 American Psychological Association2015, Vol. 41, No. 2, 163–178 2329-8456/15/$12.00 http://dx.doi.org/10.1037/xan0000048

163

Page 2: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

would transfer to a DS (B) trained in a separate occasion-settingrelationship (Y¡B) and to a DS (C) with no previous pairingswith an OS, as well as whether control by the OS would surviveextinction treatment (X�). Transfer tests showed good transfer ofX to B, weak transfer to C, and no disruption of control by Xfollowing extinction. Close inspection of these data indicate thatalthough transfer of control by X to B did occur, it was incompleterelative to responding to the originally trained OS–DS pair(X¡A). Incomplete transfer is a common finding in the literature(see Bonardi, 1996, for a review).

In occasion setting, the OS can modulate if a subject responds inthe presence of a conditional stimulus (CS) or DS, but anotherinteresting question is whether the OS can modulate when andwhere a subject responds. The effectiveness of X in facilitatingresponding to A is determined both by its contingency and itstemporal contiguity with A (Bonardi & Jennings, 2007; Holland,1986, 1998; Holland, Hamlin, & Parsons, 1997; Miller & Ober-ling, 1998; Nakajima, 2009). Furthermore, by plotting the tempo-ral distribution of responding (Roberts, 1981), research on occa-sion setting has demonstrated that the expected time of anunconditioned stimulus (US; e.g., food) delivery can be modulated(Bonardi & Jennings, 2007; Nakajima, 2009) by an OS. Bonardiand Jennings (2007) reported evidence that rats learned to predictthat food was delivered 6 s after A when it was preceded by X, but30 s after A when it was preceded by Y. Additional tests revealedmodulation by X and Y, and not direct X-food and Y-food tem-poral control by the OS. Occasion setting of temporal relations hasalso been reported in an operant task with pigeons (Nakajima,2009). Much less research has investigated whether an OS cancontrol where a subject responds.

Previous research has demonstrated a role for spatial context(i.e., where) in setting the occasion for a visuomotor association inrats (Eacott, Easton, & Zinkivskay, 2005), bees (T. S. Collett,Fauria, Dale, & Baron, 1997; see Zhang, Si, & Pahl, 2012, for areview), ants (Wehner & Srinivasan, 1981), and humans (Molet,Gambet, Bugallo, & Miller, 2012). Few studies have investigatedhow a context or stimulus can set the occasion for the correctspatial response relative to a landmark. T. S. Collett and Kelber(1988) trained honeybees to search for sucrose relative to the sametwo yellow and blue cylinders (landmarks) in identical huts (Con-texts X and Y) positioned at different locations in the environment.In Context X, the location of sucrose was between the two yellowcylinders, whereas in Context Y, the sucrose was at a differentposition to the east of the two blue triangles. On test trials withoutsucrose, the bees searched more often in the expected location ofsucrose appropriate for that context. This result demonstrates thatcontextual stimuli (trees, buildings, etc.) can set the occasion for aspatial response to landmarks.

Though parallels have been found between occasion setting bycontexts (combinations of cues present throughout a session) anddiscrete cues (distinct cues with clear onsets and terminationsduring a session; e.g., Hall & Mondragón, 1998), the vast majorityof research investigating occasion setting has used discrete cuesfor both the OSs and the DS or CS. Additionally, nearly allprevious experiments on contextual control of visual or spatialdiscriminations report acquisition data, but do not include the typesof postacquisition tests (e.g., extinction of the OS and transfer toDSs with different training histories) needed to thoroughly inves-tigate occasion setting of spatial information. Lastly, to our knowl-

edge, there has been no research investigating occasion setting ofspatial information in pigeons. To evaluate the role of spatialinformation with discrete cues in an occasion-setting task, wetrained pigeons on landmark tasks and conducted both of thestandard tests for occasion setting. Instead of using static land-marks, which remain in the same position throughout an experi-ment and typically compete with other cues to control behavior(e.g., T. S. Collett & Kelber, 1988), we used a dynamic landmarkthat changed position across trials but always maintained a stablespatial relationship to the goal. A dynamic landmark should reducecompetition from other cues that are less stable in signaling thegoal location across trials.

Spatial learning theories explain how different properties oflandmarks influence spatial behavior. Most cues can be spatiallyinformative with respect to a reward (e.g., a mate, food source, orpredator). Ruprecht, Wolf, Quintana, and Leising (2014) extendedprevious discussions on factors controlling spatial behavior (e.g.,Nardini, Jones, Bedford, & Braddick, 2008; Ratliff & Newcombe,2008) by identifying three orthogonal properties that determine thedegree to which a cue (i.e., as a landmark) comes to control spatialbehavior: (a) proximity, (b) stability, and (c) reliability of the cuein relation to the goal. Proximity was defined as a pure measure ofthe spatial distance between a landmark and a goal. When beesestimated the distance to fly down a tunnel to reach a food source,landmarks more proximal to the source better controlled behavior(M. Collett, Harland, & Collett, 2002; Srinivasan, Zhang, &Bidwell, 1997). Second, stability was defined as the variance of alandmark’s vector (distance and direction) to the goal across trials.Accuracy during the presentation of any one landmark, for in-stance, varies as a function of whether the distance and direction ofthe landmark was more or less stable across trials (e.g., Biegler &Morris, 1993). Lastly, reliability was defined as the probability thatreward will occur in the presence of a landmark, irrespective of itsproximity or stability. This dimension is inherently nonspatial andreflects the contingencies encountered during training. We inves-tigated how the reliability and stability of an OS and landmarkwould influence spatial control by each cue during occasion-setting training and subsequent transfer tests of novel pairings ofan OS and landmark.

In two experiments, pigeons received trials that consisted of anOS (X, a colored background), followed a few seconds later by avisual landmark (A) positioned at one location within a row ofeight response locations (see Figure 1). The landmark signaledwhich of the remaining locations was designated as the goal ontrials in which the landmark was preceded by the colored back-ground. No goal was present on other trials of the landmark alone.We refer to the colored background in the current experiments asan OS, and the DS that is the target of the modulation as thelandmark. Experiment 1 investigated whether a colored back-ground, high in reliability (trials with an OS always signaled thesubsequent opportunity for reward) but low in stability (the dis-tance and direction of the background to the goal changed acrosstrials), could control responding to a landmark that was lower inreliability (the landmarks themselves were paired with the oppor-tunity for reward on half of the trials) but higher in stability (thelandmarks maintained a consistent distance and direction to thegoal location across trials) and proximity (temporal and spatial).Though the colored background and landmark were both spatiallyproximal to the goal, the value of that proximity (e.g., in signaling

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

164 LEISING, HALL, WOLF, AND RUPRECHT

Page 3: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

the location of the goal) was greater for the landmark because ofits asymmetry with respect to the goal (i.e., the background couldnot signal the goal to its left or right because it covered the entiresearch space). If the influence of each cue on spatial behavior inour task was based solely on its proximity and stability to the goal,spatial learning models would predict that responding would al-ways be strongly biased in the direction of the landmark indicatedby the most proximal and stable cue, the landmark. However, inour task, the reliability of the spatial information provided by thelandmarks was dependent on the presence of an OS. In Experiment2, the spatial proximity of the landmark to the goal was main-tained, but the stability of a landmark was manipulated acrosstrials. Spatial learning models are equipped to predict spatialaccuracy in the presence of a landmark (e.g., Battaglia, Jacobs, &Aslin, 2003; Biegler & Morris, 1993; Byrne & Crawford, 2010;Cheng, Shettleworth, Huttenlocher, & Rieser, 2007; Miller &Shettleworth, 2007; Ratliff & Newcombe, 2008), whereas hierar-chical theories from the associative literature are best poised topredict modulation by an OS (Bonardi, Bartle, & Jennings, 2012;Holland, 1983, 1985; Rescorla, 1985).

The current research aimed to address two questions regardingoccasion setting within the spatial domain. First, do pigeons en-code the identity of a landmark in an occasion-setting task or doesthe OS provide the critical information regarding where to respond(e.g., T. S. Collett & Kelber, 1988)? Second, if critical informationis encoded by the subject as part of a landmark–outcome associ-ation, will an OS’s modulation transfer to other landmarks withsimilar or different training histories? These questions mirror thosethat have been asked in traditional occasion-setting paradigms:Does the OS act directly on a specific CS, on the response evokedby the CS, on a specific CS–outcome association, or on the

threshold for activation of the outcome representation (Bonardi etal., 2012; Swartzentruber, 1995)? Importantly, the inclusion of aspatial component allows us to investigate the nature of stimuluscontrol by the OS and landmark using two measures (amount ofresponding and spatial control).

Experiment 1

During operant occasion setting, a stimulus (the OS) signals thecontingency between a discriminative stimulus (e.g., landmark)and a reinforced response (e.g., goal). In Experiment 1, twooccasion-setting pairs (e.g., XA�/A�/YB�/B�) were trainedwith unique spatial relationships to a reinforced goal location(e.g., �¢XA/YB¡�; see Figure 1). The experimental design forExperiment 1 is described in Table 1. The procedure used inExperiment 1 (and Experiment 2) was selected to encourage hier-archical learning. In occasion setting, many of the conditions thatsupport hierarchical learning are contradictory to the conditionsthat support configural learning (Miller & Oberling, 1998). Two ofthese conditions are temporal priority of the OS and enhancedsalience of the landmark. In our procedure, the OS preceded theonset of the landmark, and the landmark was expected to beperceived as more salient than the OS via its stable spatial rela-tionship and more proximal spatiotemporal relationship to thelocation of the hidden goal. Following training, nonreinforcedtransfer trials (XB� and YA�) were presented.

Transfer tests (e.g., XB�) were used to evaluate whether an OSwould continue to facilitate responding when paired with a differ-ent landmark, and whether the spatial information provided by theLM or OS during training determined the spatial distribution ofresponding. We predicted more responding on a trial when alandmark was paired with a different OS from training than onlandmark-only trials, but less responding than on trials of the LMpaired with the same OS from training. Regarding spatial controlof behavior, on a transfer trial like XB, there are at least threepossible results. The first is that OS X signals the B–goal spatialrelationship based on previous training of X with A(e.g., �¢XA, �¢XB), henceforth referred to as OS control.Second, the landmark present on the trial (e.g., B) with OS Xsignals the location of the goal based on the B–goal spatialrelationship encountered during training (e.g., YB¡�, XB¡�),henceforth referred to as landmark control. Lastly, the OS and LMboth signal the goal location, and the result of direct competitionwould be similar levels of responding at both sides of the landmark(i.e., the goals signaled by the OS and B). Spatial learning modelspredict that the stable landmark should control the location ofresponding during transfer tests more than the unstable OS, andhierarchical accounts of occasion setting predict that the OS shouldcontrol whether or not responding occurs in the presence of thelandmark. Furthermore, hierarchical theories predict that transferof modulation by the OS would be specific to the LM–goalassociation encountered during training (e.g., �¢XA), and con-sequently limited to the generalization that occurs between the twolandmarks, A and B.

Method

Subjects. Six White Carneaux pigeons (Columba livia; Dou-ble T Farm, Glenwood, IA), between 18 and 24 months old at the

Figure 1. Trial types used in Experiment 1. (a) The ITI (middle panel)and two landmark-only trials are shown. (b) The period with an OSpreceding the onset of a landmark on OS-landmark trials. OSs X and Yappeared for 10 s, on average, before the onset of A or B, respectively. (c)The location of the goal is illustrated in trials of XA and YB. DuringOS-landmark trials, the hidden goal (“G”) always appeared one location tothe left of A or to the right of B, but the location of A and B changed acrosstrials.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

165OCCASION SETTING DURING SPATIAL SEARCH

Page 4: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

time of testing, served as subjects. Pigeons were maintained at80% to 85% of their free-feeding weights. They were individuallyhoused in a colony with a 12-hr light–dark cycle and had freeaccess to water and grit. Experimental procedures occurred duringthe light portion of the cycle. Subjects previously participated inthree operant studies investigating timing behavior, reward sensi-tivity, and working memory, but the pigeons were naïve to thestimuli and procedures used in this study.

Apparatus. Training and testing were conducted in a flat-black Plexiglas chamber (45 cm wide � 41 cm deep � 46 cmhigh). All stimuli were presented by computer on a color LCDmonitor (L1750; Hewlett-Packard, Palo Alto, CA) visible througha 33 � 40 cm viewing window in the middle of the front panel ofthe chamber. The bottom edge of the viewing window was 12 cmabove the chamber floor. Pecks to the monitor were detected by aninfrared touch screen (EZ-170-WAVE; ezscreen, Houston, TX)mounted on the front panel. A 28-V houselight located in theceiling of the box was illuminated at all times. A food hopper(Coulbourn Instruments, Allentown, PA) was located in the centerof the front panel, its access hole flush with the floor. All exper-imental events were controlled and recorded with a computer. Avideo card controlled the monitor in the SVGA graphics mode(800 � 600 pixels). All experimental events were orchestrated viaMicrosoft Visual Basic 6.0 software.

Stimulus displays. There were three types of visual stimuli:response locations, OSs (X and Y), and landmarks (A and B).Response locations were a series of eight squares that were 2 cm2.OS X and Y were red- or blue-colored backgrounds that filled theentire display except for the predesignated response locations (seeFigure 1). In the absence of an OS, the background appeared black.If a response location was selected to be a landmark, it was

replaced with an image of a 2-cm2 green box with thin verticalwhite stripes or a yellow box with thick white horizontal stripes.Assignment of OS color (red or blue) to landmark color (green oryellow) was counterbalanced across birds.

Procedure.Training. The subjects were initially trained via a mixed

Pavlovian-instrumental procedure to peck a white circle displayedin the center of the monitor. After pecking was reliable, eightsquares were arranged in a row in the center of the monitor. Oneach trial, one of the eight squares was selected as the goal andmarked by being filled white to full brightness, whereas the re-maining squares were filled to 35% brightness. Within and acrosssessions, the brightness of the goal location was reduced to 50%brightness, and responses at the goal were reinforced on a contin-uous reinforcement (CRF), Random Ratio (RR) 2, and then RR4,schedule (cf. Leising, Sawa, & Blaisdell, 2012). Subjects advancedto a new reinforcement schedule and a dimmer goal marker with10 consecutive correct trials, or regressed with five consecutiveincorrect trials.

OS training consisted of four types of trials: �¢XA; YB¡�;A�; and B- (see Table 1 and Figure 1). A square that served as alandmark (A) was replaced with one of the two color-line patternsdescribed previously. On A-only and B-only trials, the landmarkwas presented for 30 s, with no opportunity for reinforcement. OnXA trials, the color of the entire display (X) changed for afixed-time 40-s interval. The onset of A was delayed according toa variable-time 10-s schedule (ranging from 5 s to 15 s in incre-ments of 5 s), but always coterminated with X. Thus, A waspresented for a mean duration of 30 s during XA trials. The goalwas always one location to the left of A, and pecks during A werereinforced until offset. YB trials were conducted in a similar

Table 1Experimental Design and Predictions

Experiment 1 Test trials

Train �¢XA/A�/ YB¡� /B� Previously trained Novel combo

Experiment 1Test predictions A B XA YB XB YAOS ¢ ¡ ¢ ¡

Landmark ¢ ¡ ¢ ¡ ¡ ¢

Spatial control L H M

Experiment 2 Test trials

Train �¢XA/YA¡�/ A�/ZB¡�/B�/ �¢C/

Previously trained(included inTests 1–4)

Test 1novel

incong.

Test 2novelcong.

Test 3novelambig.

Test 4post ext.of C & X

Experiment 2Test predictions A B XA YA ZB C YB XC XB YC ZA XB YCOS ¢ ¡ ¢ ¡ ¢ ¢ ¡ ¢ ¢ ¡

Landmark ? ¢ ? ? ¢ ¡ ¢ ¡ ¢ ¡ ? ¢ ¡

Spatial control L H M H M H M M H

Note. The columns indicate separate trial types that were tested following successful acquisition of OS training.Extinction of C and X occurred after Test 3 in the 2 days immediately prior to Test 4. The arrows indicate thespatial relationship of each stimulus to the hidden goal (based on the landmark): “¢” � the goal was locatedleft of the landmark; “¡” � the goal was located to the right of the landmark; “?” � the direction indicated bythe landmark is not clearly known; empty cells indicate no predicted relation. The predicted amount of peckingduring test was high (H), medium (M), or low to none (L). The amount of responding represents the sum ofresponses across all of the response locations.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

166 LEISING, HALL, WOLF, AND RUPRECHT

Page 5: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

manner, with the exception that the goal was one location to theright of B. The placement of a landmark within the responsesquares varied from one trial to the next. Goal locations wereselected randomly without replacement from Locations 3 through6. Thus, there was an unstable relationship between the location ofa landmark and the OS, the OS and hidden goal, and between thelandmark and the context; the spatial relationship between thelandmark and goal, however, remained stable across all trials. Wedid not expect the black background on landmark-only trials toserve as a negative OS because of the presence of the blackbackground without a landmark during the intertrial interval and atthe beginning of each session (see Figure 1). At the start of OStraining, the location of the goal was marked with a white squareat 50% brightness, whereas the remaining locations were filled to35% brightness. Within and across sessions, the brightness of thegoal marker was reduced to 35% brightness, and responses at thegoal were reinforced on a CRF, RR2, and then RR4, schedule.Subjects advanced to a new reinforcement schedule and a dimmergoal marker with 10 consecutive correct trials, or regressed withfive consecutive incorrect trials. Sessions initially consisted of 48trials with 12 trials of each type. Once subjects reached the RR4schedule of reinforcement, the number of trials per session wasincreased to 64, with an equal number of the four trial types.

After the brightness of the goal was reduced to 35%, it wasindistinguishable from the remaining response locations; thus,subjects were required to search for the hidden goal location basedsolely on its spatial relationship to the landmark. All of the pigeonswere simultaneously advanced to novel-combo testing only afterall six subjects completed two sessions with (a) the goal unmarked,(b) responses reinforced on an RR4 schedule, (c) the correctresponse on 80% of occasion-setting trials, and (d) the discrimi-nation ratio (pecks at the correct location divided by all responses)greater than or equal to .60. The video in the online supplementalmaterials shows one full trial with a pigeon on an RR4 scheduleand the goal indistinguishable from the other locations.

Novel-combo test. The order of test trials each day wascounterbalanced across all subjects. On Sessions 73 to 78,subjects received one nonreinforced test trial of A, B, XA, YB,XB, and YA per session for six sessions. A test session beganwith 48 training trials, followed by a block of test trials and anadditional 16 training trials. A test session consisted of (a) anequal number of reinforced (XA� and YB�) and nonreinforcedtrials (A� and B�), as in training; and (b) a block of sixconsecutive nonreinforced test trials. On occasion-setting testtrials, the landmark always appeared 10 s after the OS, andlandmark-only trials were always 30 s in duration.

Measures. The amount of responding was the sum of pecks toall response locations. This measure indicates the overall excit-atory strength of the stimuli, irrespective of spatial accuracy.Regarding spatial control, the test data were collected such that thedirection of the “goal” during a trial was always designated rela-tive to the landmark and consistent with the landmark–goal rela-tionship encountered during training. On novel-combo trials, theOS and landmark predicted the goal in different directions (i.e., ondifferent sides of the landmark). We first calculated the proportionof pecks at each location by dividing the pecks at that location bythe sum of pecks at all locations. Spatial control was calculated asthe proportion of pecks to the goal location predicted by thelandmark (based on training), minus the proportion of pecks to the

response location to the immediate other side of the landmark,which was the goal location signaled by the OS (based on train-ing). This measure differentiates between spatial control by a cueas a landmark or as a beacon (e.g., Mackintosh, 2002). Thedifference from 0 indicates the strength of spatial control (i.e.,larger values indicating greater spatial control), and the sign of thevalue indicates the direction of control (i.e., positive values indi-cate more landmark control).

Statistical analysis. We report the results of repeated mea-sures analysis of variance (ANOVA) tests conducted on either theamount of responding or spatial control of responding, with TrialType as the repeated measure. Tukey’s honestly significant differ-ence (HSD) post hoc tests were then conducted to isolate differ-ences within a main effect of trial type. Single-sample t testscomparing the spatial difference score (i.e., spatial control) withzero were used to evaluate OS versus landmark control at test.Positive difference scores that are greater than zero indicate morelandmark control, scores less than zero indicate more OS control,and no statistical difference from zero indicates equal control bythe OS and landmark. Effect sizes and confidence intervals forANOVAs, t tests, and post hoc tests were computed using SPSS(IBM, New York, NY) code published by Smithson (2001). Con-fidence intervals for Tukey post hoc tests were computed using thet value and degrees of freedom from the equivalent paired t test(Rosenthal, 1991). Effect sizes and confidence intervals are re-ported for every F test or t test comparison at the level of p � .10.

Results

During testing, the onset of the landmark on occasion-settingtrials was fixed at 10 s after the OS. To equate the duration ofoccasion-setting trials with landmark-only trials (30 s), only re-sponses occurring during the last 30 s of occasion-setting trials(when the landmark was present) were included in the analysis.The two trial types in each condition were functionally equivalent(trained, XA and YB; novel-combo, XB and YA; landmark-only,A and B), but differed in the direction of the goal relative to thelandmark. Before collapsing, we tested separately for any direc-tional biases in the amount of responding (the sum of pecks to alleight response locations) or spatial control (pecks to the goallocation divided by pecks made to all eight locations). Trial Type(trained, XA and YB; novel-combo, XB and YA; landmark-only,A and B) and Direction (Left vs. Right) were included as repeatedmeasures in an ANOVA conducted on amount of responding orspatial control, which revealed main effects of Trial Type for both,Fs(2,10) � 105.30, ps � .0001 (�2 � .95, 95% CIs [.81 � �2 �.97]), but no main effects of Direction, Fs(1,5) � 2.84, ps � .10(�2 � .36, 95% CIs [.00 � �2 � .68]), and no interaction foreither, Fs(2,10) � 1.43, ps � .10. The subsequent analyses col-lapsed across similar trial types and we refer to them as trained,novel-combo, and landmark-only.

Figure 2 displays the mean total responses (i.e., to any locationin the array) across days of testing for the two types of test trials.Across test days, we expected more extinction during novel-combotrials than the previously trained trials because none of the novel-combo trials were ever reinforced, whereas the majority of thepreviously trained trials were reinforced during each test session.To determine if and when a significant drop occurred in respond-ing during novel-combo transfer trials, we compared the mean

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

167OCCASION SETTING DURING SPATIAL SEARCH

Page 6: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

during Day 1 with subsequent days using paired-samples t tests(see Figure 2). No difference was found between Days 1 and 2,t(6) � .10, p � .92, but the amount of responding was significantlyless on Day 3 compared with Day 1, t(5) � 2.59, p � .05 (d � .60,95% CI [.13, 1.06]). Consequently, all of the remaining analyseswere performed with Days 1 and 2 of testing.

OS training. All birds advanced to testing after 72 sessions(including pretraining).

Novel-combo test.Amount of responding. Figure 3 displays the amount of

responding for each trial type. Responding during the transfertrials was lower than the training trials, but greater thanlandmark-only trials. This observation was confirmed by arepeated measures ANOVA conducted on amount of respond-ing, with Trial Type (trained, novel-combo, landmark-only) asthe repeated measure, which revealed a significant main effectof Trial Type, F(2, 10) � 52.75, p � .0001 (�2 � .91, 95% CI[.66, .95]). Tukey’s HSD post hoc tests revealed that trained testtrials differed from all other trial types, ps � .001 (ds � 1.79,95% CIs [.58 � d � 12.57]); additionally, responding onnovel-combo test trials was greater than landmark-only testtrials, p � .01 (d � 1.53, 95% CI [.42, 2.85]).

Spatial control. One pigeon emitted a mean of one peck (i.e.,to any location) across both days of testing during both novel-combo trials (YA and XB), which was much less than the groupmean of 21 (SD � 13.16) and much less than even the bird withthe next fewest pecks (13.25). With so few responses, this sub-ject’s proportion data were unreliable, and consequently, the fol-lowing analysis contains only the remaining subjects (n � 5).Figure 4 shows spatial control during trained and novel-combo test

trials. Spatial control followed a similar pattern to that of theamount of responding, responding above landmark-only on novel-combo trials, but below trained trials. This observation was sup-ported by a paired-samples t test revealing greater spatial controlby the LM on trained than novel-combo test trials, t(4) � 5.55, p �.02 (d � 2.48, 95% CI [.60, 4.33]). No pecks at the goal weredetected during landmark-only test trials, preventing a direct com-parison of spatial control on novel-combo and landmark-onlytrials.

We compared the difference scores for each landmark with zerousing single-sample t tests, which revealed that the LM exertedgreater spatial control over responding than the OS during trainedtests, t(4) � 6.59, p � .002 (d � 2.69, 95% CI [.96, 4.89]), and toa lesser degree during novel-combo tests, t(4) � 2.29, p � .08(d � .93, 95% CI [�.08, 2.06]). Figure 4b displays the datagrouped by birds that showed some degree of spatial control by thelandmark or OS (n � 3), as measured by the difference score (M �43.79, SD � 12.36), and by birds with no evidence of spatialcontrol by either cue (n � 2; M � �.07, SD � 1.99). No birdsshowed evidence for control by the OS (i.e., negative values).Comparison of each group’s data with zero indicated good spatialcontrol by the LM in the spatial control group on novel-combotrials, t(2) � 6.14, p � .03 (d � 1.51, 95% CI [.86, 4.59]), whereasspatial control in the other group of pigeons did not differ fromzero, t(1) � .04, p � .97.

Discussion

The aim of Experiment 1 was to evaluate spatial control by an OSand LM during transfer tests following training in an operant feature-

Figure 3. Mean sum of pecks at all eight locations during transfer tests inExperiment 1. The trained trials were XA and YB, the novel-combo trialsincluded XB and YA, and the LM-only trials consisted of A and B alone.All test trials were nonreinforced. Error bars represent the standard error ofthe mean.

Figure 2. Mean sum of pecks at all eight locations per session duringtesting. Data are from transfer test trials of the previously trained (XA andYB) and novel combinations (XB and YA) of an OS and LM in Experi-ment 1. Error bars represent the standard error of the mean.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

168 LEISING, HALL, WOLF, AND RUPRECHT

Page 7: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

positive spatial task. The novel-combo transfer tests indicated that theOS facilitated responding to the landmark above that of responding tothe landmark-only test, but to a lesser degree than on test trials of theOS with the same landmark from training. This is consistent withmuch of the literature on occasion setting (see Schmajuk & Holland,1998, for a review). A similar pattern of results was also found whenevaluating the spatial distribution of responding.

These results partially address the questions raised earlier. First,the amount of responding on novel-combo transfer trials (in whicha previously trained landmark was paired with a different OS fromtraining) was below that of trials of the landmarks paired with thesame OS from previous training, indicating that amount of re-sponding was not simply the summation of OS–outcome andlandmark–outcome associations. Rather, as predicted, the amountof responding was largely controlled by the OS facilitating re-sponding to specific landmark–goal associations. Second, evalu-ation of the spatial distribution of responding on the trained OS-landmark and novel-combo test trials indicated that, as predicted,spatial search was primarily controlled by the landmark. On novel-combo trials, the spatial information provided by the OS andlandmark were incongruent. If responding were controlled solelyby the OS, then we would have expected responding to have beento the side of the landmark away from the goal in Figure 4b. If thelandmark and OS shared control equally, or if the landmark simplyserved as a beacon for where to respond, then the proportion ofresponding should have been the same to the left and right of thelandmark (see the “Other” group in Figure 4b). Lastly, if thelandmark primarily controlled search, then most of the respondingshould have been to the right of the landmark in Figure 4b (at thegoal). Data from three pigeons indicated some degree of spatialcontrol by the OS or landmark. These pigeons responded predom-inantly to the right of the landmark at the location of the goal

signaled by the landmark. Two pigeons responded indiscriminatelyto the left and right of the landmark, which could be indicative ofcontrol by both the OS and LM. In sum, these data indicate that for allbirds, the excitatory strength of responding to an OS–LM pair wasreduced during the novel-combo transfer tests. For three birds, re-sponding during novel-combo test trials reflected their learning ofspecific landmark–goal associations encountered during training.

In previous research with honeybees, specific landmark–goalassociations also determined search behavior in a spatial task. T. S.Collett and Kelber (1988, Experiment 2) trained honeybees tosearch for the location of sucrose relative to two yellow cylinderspresent in Context X, and at a different location signaled by twoblue triangles (the yellow cylinders were not present) present inContext Y. After training, novel-combo transfer tests with thelandmarks switched to the other context (e.g., blue triangles inContext X) indicated that bees searched at the position defined bythe landmarks, not the context. Furthermore, the switch caused nonoticeable deficit in spatial accuracy. Similar to honeybees, but incontrast to pigeons, humans tested in a comparable design also dis-played good spatial control by the landmark (i.e., no deficit in spatialaccuracy) during novel-combo transfer tests (Ruprecht et al., 2014).This difference may reflect differences in experience with hierarchicalrelations and landmarks, or an innate propensity for learning aboutspecific items (pigeons) versus the relationship between items (hu-mans; e.g., Wright, 1997; see Shanks, 2010, for a review).

The results of Experiment 1 indicate that the stability of thelandmark was weighted heavier than the reliability of the coloredbackground with respect to control of spatial search. The specificlandmark–goal associations from training best matched spatialresponding during transfer tests of the landmark paired with adifferent OS from training. The aims of Experiment 2 were to usea more complex occasion-setting task to reduce the stability of LM

Figure 4. Spatial control of responding during testing in Experiment 1. (a) The mean difference score (see textfor details) is shown for the trained and novel-combo test trials. The difference from zero indicates the strengthof spatial control (i.e., larger values indicating greater spatial control), and the sign of the value indicates thedirection of control (i.e., positive values indicate more responses in the direction of the goal predicted by thelandmark). (b) Left panel: The distribution of responding across locations during the trained and novel-combotest trials. The data are standardized with respect to the position of the predicted goal based on the LM–goalspatial relationship during training. LM represents the position of the landmark. The position of the LM on trialsof YB and XB was reflected around the goal so that the landmark could be displayed to the left of the goal forall trial types. On novel-combo trials, the OS predicted the goal to left of the LM at position �2. Right panel:The data are split into birds that showed spatial control by the LM or OS (spatial control) and birds with noevidence of spatial control (other). The number of subjects per group is listed in parentheses. Error bars representthe standard error of the mean.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

169OCCASION SETTING DURING SPATIAL SEARCH

Page 8: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

A, and to further investigate the nature of the deficit duringincongruent trials in Experiment 1.

Experiment 2

The preponderance of evidence in Experiment 1 indicated thatmore spatial control was exerted by the landmark–goal associationlearned during training than the direct OS–goal association. This isconsistent with much of the occasion-setting research, which hasreported modulation by an OS of a specific CS–outcome associ-ation (Holland, 1983). In occasion setting of timing behavior, itwas similarly found that the CS–outcome association (i.e., not theOS–outcome) controlled the timing of the response (Bonardi &Jennings, 2007; see also Nakajima, 2009, for an operant proce-dure). However, Experiment 1 and previous research have notinvestigated whether training that encourages modulation of spa-tial or temporal information by the OS (e.g., �¢XA�/YA¡�/A�) will result in transfer of OS control to another DS (e.g.,Bonardi & Jennings, 2007; T. S. Collett & Kelber, 1988; Naka-jima, 2009). In Experiment 1, the information value of the OS wasminimal. Each distinct landmark (A and B) was associated with aunique spatial relationship to the goal (left or right of the land-mark), and thus the OS was simply needed to determine whetheror not a response in the presence of a landmark would lead toreward. There are many manipulations to reduce the value of thelandmark, including those applicable outside (e.g., lowering thebrightness of the LM) and within the domain of spatial learning(e.g., increasing proximity or lowering stability). In Experiment 2,the spatial proximity of the landmark to the goal was maintained,but the stability of a landmark was manipulated across trials.Consequently, a high reliability but low stability and proximity OSwas paired with a landmark that was low in reliability and stabilitybut high in proximity. We expected this manipulation to increasecontrol of spatial behavior by the LM–goal spatial relationshipsignaled by the OS.

In Experiment 2, the same landmark (A) was trained with twoOSs, such that the spatial relationship of the landmark to thehidden goal was ambiguous without exposure to the preceding OS(�¢XA/YA¡� /A�). This type of training should encouragereliance on X and Y to disambiguate the direction in which torespond to LM A. We also included training trials with anotherOS–landmark pair (�¢ZB/B�), as well as a DS/LM (C¡�) thatdid not rely on an OS to signal the contingency or direction of thegoal. After training, various transfer tests were used to determinethe influence of each cue on the amount of responding and spatialcontrol. A key procedural difference between this study and mostprevious studies was that we did not extinguish C prior to transfertesting (see Swartzentruber, 1995, for a review). We were inter-ested in whether the amount of responding and spatial control byC would be affected if the OS and landmark were both at fullexcitatory strength during novel pairings (cf., Bonardi, 1996).

The first set of transfer tests (novel incongruent, YB�) inExperiment 2 was similar to the novel-combo test (YA�) inExperiment 1, but with the addition of a transfer test with alandmark not previously trained with an OS (XC�). During train-ing, specific LM–goal associations were expected to control spa-tial accuracy in the presence of LMs B and C. Additionally, somedegree of stimulus equivalence was expected between LMs A andB because of their common training history (i.e., being paired with

an OS during training), which LM C did not share. Consequently,OS Y should be better able to facilitate responding to B (instead ofA) than OS X to C (instead of A). Any decrement that occurredduring novel-incongruent tests could be the result of externalinhibition, generalization decrement, or spatial incongruence. Onthe second set of transfer tests, the OS and landmark providedcongruent spatial information regarding the direction of the goalrelative to the landmark. On these tests, no difference was ex-pected between an OS paired with a landmark with or withoutprevious occasion-setting training. However, the match in spatialinformation provided by each cue may increase the amount ofresponding and spatial control relative to the novel-incongruenttest. Bonardi et al. (2012) manipulated the outcome associatedwith a CS in two occasion-setting pairings (X¡A¡sucrose, andY¡B¡oil). Transfer of performance (responses per minute, oramount of responding) was better to other CSs (C and D) when theoutcome paired with the transfer CS matched that paired with theOS during occasion-setting training. In our experiment, the out-come was the same, but the direction of the goal relative to thelandmark differed. We predicted that X and Y would facilitatemore responding when paired with landmarks that shared a com-mon spatial relationship (e.g., �¢XA and �¢ZB) during train-ing.

Following transfer testing, we extinguished OS X and LM C.The goal of extinction of X was to determine whether X wouldcontinue to facilitate responding to A after weakening any directconnection between X and the rewarded goal. If X was acting tofacilitate responding via a direct connection, then responding to Ashould be diminished. However, if X was acting independent ofany direct connection, responding to A should be unchangedfollowing extinction of X. Additionally, previous research hasfound some evidence for enhanced transfer of modulation by anOS following extinction of the OS (Holland, 1989).

Method

Subjects. Six White Carneaux pigeons (Columba livia; Dou-ble T Farm, Glenwood, IA) served as subjects. Pigeons werebetween 18 and 24 months at the time of testing. Pigeons weremaintained and housed as in Experiment 1. All birds were exper-imentally naïve prior to the start of the experiment.

Apparatus. Training and testing were conducted in an appa-ratus identical to Experiment 1.

Stimulus displays. Stimuli were identical to that of Experi-ment 1, with the exception of an additional colored background(cyan).

Procedure.Training. Pretraining was identical to that of Experiment 1.

The experimental design for Experiment 2 is described in Table 1.Occasion-setting sessions consisted of six trial types: �¢XA;YA¡�; �¢ZB; C¡�; A�; and B�. On XA and ZB trials, thehidden goal was one response location to the left of the landmark.On YA and C trials, the hidden goal was one response location tothe right of the landmark. Trials were presented in the samemanner as in Experiment 1, with the exception of C trials. On Ctrials, the background remained black throughout the trial andresponses at the hidden goal were reinforced in a manner identicalto A on YA trials. Sessions initially consisted of 48 trials, witheight trials of each type. Once subjects reached the RR4 schedule

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

170 LEISING, HALL, WOLF, AND RUPRECHT

Page 9: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

of reinforcement, the number of trials per session was increased to64, with an equal number of the six trial types.

In contrast to Experiment 1, birds were independently advancedto testing based on their performance. After each subject com-pleted two sessions in which the correct response was made on80% of all occasion-setting trials, and the discrimination ratio(pecks at the correct location divided by all responses) was greaterthan or equal to .60, the subject was advanced to the next testcondition. A minimum of 30 retraining sessions were required inbetween each test.

Novel-incongruent test. Novel-incongruent testing occurredfor 2 days. The order of test trials each day was counterbalancedacross all subjects in each testing condition. All subjects receivedone nonreinforced trial of XA, ZB, YA, YB, XC, C, A, and B persession for two sessions. A test session began with 48 trainingtrials, followed by a block of test trials, and an additional 24training trials. A test session consisted of (a) an equal number ofreinforced (XA, YA, ZB, and C) and nonreinforced trials (A andB), as in training; and (b) a block of eight consecutive nonrein-forced test trials. On occasion-setting test trials, the landmarkalways appeared 10 s after the OS, and landmark-only trials werealways 30 s in duration.

Novel-congruent test. All subjects received one nonrein-forced trial of XA, YA, ZB, A, B, C, YC, and XB per sessionfor two sessions. Trials were presented as in the first transfertest session.

Novel-ambiguous test. All subjects received one nonrein-forced trial of XA, YA, ZB, YB, XC, C, ZA, and ZC per sessionfor two sessions. The direction of the goal relative to the landmarkon ZA trials was ambiguous, as A had been paired with X (goal toleft of A) and Y (goal to right of A) during training. The directionof the goal relative to the OS (X) was incongruent with thatpredicted by the landmark on XC, YB, and ZC trials.

Postextinction test. During two extinction sessions, pigeonsreceived pseudorandom presentations of X and C without theopportunity for reinforcement. Each session consisted of 16 trialsof X and C, with the constraint that neither trial type could occurmore than 3 times in a row. Following extinction, test sessions ofonly nonreinforced test trials of XA, YA, ZB, YC, XB, A, B, andC were given.

Measures and statistical analysis. The measures and statisti-cal analyses were identical to those used in Experiment 1.

Results

A program error led to a shortened duration of nonreinforcedtest trials of C (15 s) relative to the other landmark-only testtrials (30 s). This undoubtedly influenced the overall amount ofresponding on test trials with C, but should not have greatlyinfluenced spatial control by C. (And the statistical analysis ofspatial control by C supports this.) Consequently, the amount ofresponding on C trials was not analyzed. The spatial distribu-tion of responding during each test can be found in the onlinesupplemental material.

Training. Subjects achieved the necessary response criterionto advance to testing during OS training with a mean of 41 (SD �4) sessions. One subject’s training was discontinued after failing to

meet the criterion to advance to testing after 60 sessions of training(n � 5).

Novel-incongruent test.Amount of responding. Novel-incongruent transfer tests eval-

uated the number of pecks during two transfer trials, XC and YB.The direction of the goal relative to the OS and landmark wasincongruent in each combination of OS and landmark, such thatduring training the OS and landmark signaled the goal in oppositedirections. Figure 5 displays the amount of responding, in the samemanner as Experiment 1. Landmarks A and B elicited no responsesfor any bird and thus could not be included in the statisticalanalysis. A repeated measures ANOVA conducted on mean re-sponses across all eight response locations, with Trial Type (XA,ZB, YA, XC, and YB) as the repeated factor, revealed a significantmain effect of Trial Type, F(4, 16) � 15.23, p � .0001 (�2 � .79,95% CI [.44, .85]). Post hoc analysis (Tukey’s HSD) revealed thatXA, ZB, and YA differed from XC and YB, ps � .001 (ds � 1.33,95% CIs [.06 � d � 2.85]), but did not differ from each other,ps � .62. Responding on XC did not differ from YB, p � .60.

Spatial control. Figure 5 shows the spatial difference score ofresponses during Trial Types XA, ZB, YA, C, XC, and YB. A highpercentage of pecks occurred at the goal predicted by the landmarkon the previously trained OS pairings (XA, YA, and ZB), amoderate level was observed during the novel-incongruent YBtransfer tests, and spatial control by the landmark was lowestduring XC transfer tests. These observations were supported by arepeated measures ANOVA conducted on mean percentage ofpecks to the goal with Trial Type (XA, ZB, YA, XC, and YB),which revealed a significant main effect of Trial Type, F(5, 20) �5.77, p � .002 (�2 � .59, 95% CI [.15, .69]). Post hoc analysisrevealed that spatial control by the landmark during XA, YA, ZB,and C differed from XC, ps � .05 (ds � .1.32, 95% CIs [.05 �ds � 2.84]), but not YB, ps � .27. However, XC and YB did notstatistically differ from one another, p � .23.

Figure 5. Mean sum of pecks at all eight locations and spatial controlduring Test 1 of Experiment 2. The mean difference score is shown fortests of trials presented during training (XA, YA, and ZB) and novel-incongruent (XC and YB) trials. The difference from zero indicates thestrength of spatial control (i.e., larger values indicating greater spatialcontrol), and the sign of the value indicates the direction of control (i.e.,positive values indicate more responses in the direction of the goal pre-dicted by the LM–goal spatial relationship during training). All test trialswere nonreinforced. Error bars represent the standard error of the mean.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

171OCCASION SETTING DURING SPATIAL SEARCH

Page 10: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

We compared the spatial control by the landmark during eachtrial type with zero. Separate single-sample t tests revealed controlby the landmark during trials XA, ZB, YA, C, and novel-incongruent trial YB, ts(4) � 3.60, ps � .05 (ds � .1.61, 95% CIs[.22 � ds � 3.31]), all differed significantly from zero, whereascontrol during XC was not significantly different from zero, t(4) �.49, p � .65.

Novel-congruent test. Subjects were advanced to novelcongruent testing following a mean of 32 additional trainingsessions (SD � 3.1; i.e., Session 73). A paired-samples t testcomparing the amount of responding during the two novel-configuration transfer tests across Test Session 1 and TestSession 2 revealed a significant reduction in responding acrosssessions, t(4) � 3.56, p � .02 (d � .1.59, 95% CI [.21, 3.28]),which was not found during the previous novel-incongruenttransfer test, t(4) � .35, p � .75. As previously mentioned, weare most interested in evaluating responding before significantextinction occurs. Consequently, all subsequent analyses in-clude data only from Test Session 1.

Amount of responding. The amount of responding and spatialdistribution of pecks were recorded during two novel-congruenttransfer trials, XB and YC, and during the previously trained OSpairs. On novel-congruent trials, the direction of the goal relativeto the OS and landmark was congruent in each novel configurationof a landmark with a different OS from training. Figure 6 displaysthe amount of responding across all locations during each test trial.Landmarks A and B elicited no responses for any bird, and thuscould not be included in the statistical analysis. A repeated mea-sures ANOVA conducted on mean responses across all eightresponse locations, with Trial Type (XA, ZB, YA, XB, YC) as therepeated measure, revealed a significant main effect of Trial Type,F(4, 16) � 7.47, p � .01 (�2 � .65, 95% CI [.19, .75]). Post hocanalysis revealed that ZB and YA differed from XB and YC, ps �.05 (ds � .1.13, 95% CIs [�.07 � ds � 2.52]), but not from eachother p � .98. Similarly, more responding was observed on XAthan XB and YC, but was only marginally nonsignificant, ps � .06(ds � .1.08, 95% CIs [�.10 � ds � 2.43]), but did not differ

significantly from ZB and YA, ps � .80. Responding duringnovel-configuration XB and YC trials did not differ from oneanother, p � .99.

Spatial control. Spatial control was analyzed as in the pre-vious tests. Figure 6 also shows spatial control by the landmarkduring test trials XA, YA, ZB, C, XB, and YC. Spatial controlby LMs B and C on transfer test trials is similar to that of thelandmarks on the other test trials. A repeated measures ANOVAconducted on the difference score with Trial Type (XA, ZB,YA, C, XB, and YC) revealed weak evidence for a main effectof landmark, F(5, 20) � 2.68, p � .05 (�2 � .40, 95% CI [.00,.53]). Post hoc analysis (Tukey’s HSD) revealed weak evidencefor more spatial control by XA, ZB, and YC than XB, ps � .07(ds � .65, 95% CIs [�.23 � ds � 1.76]), but all othercomparisons revealed nonsignificant differences, ps � .12.

We also compared spatial control during each trial type to zero.Separate single-sample t tests revealed all trial types significantlydiffered from zero, ts(4) � 3.65, ps � .05 (ds � .1.63, 95% CIs[.23 � ds � 182.47]).

Novel-ambiguous test. Subjects were advanced to testing fol-lowing a mean of 38 additional training sessions (SD � 1.8; i.e.,Session 111). No responses were recorded to any location on XCtrials. The analysis below includes only the critical tests with ZAand ZC compared with ZB.

Amount of responding. Figure 7 displays the amount of re-sponding during tests of the original training trials, as well as twonovel-configuration transfer trials, ZA and ZC. The direction ofthe goal relative to A on novel pairings of Z and A was ambiguous,whereas during the other test trial, Z and C signaled conflictingspatial information regarding the goal location. A repeated mea-sures ANOVA conducted on mean responses to all eight responselocations, with Trial Type (ZB, ZA, and ZC) as the repeated factor,revealed a significant main effect of Trial Type, F(2, 8) � 7.33,p � .02 (�2 � .65, 95% CI [.03, .79]). Post hoc analysis revealedthat ZB differed from ZC, p � .02 (d � 1.59, 95% CI [.21, 3.28]),but not from ZA, p � .48. The difference between ZA and ZC wasnonsignificant, p � .08 (d � 1.59, 95% CI [.21, 3.28]).

Figure 6. Mean sum of pecks at all eight locations and spatial controlduring Test 2 of Experiment 2. Test trials include those presented duringtraining (XA, YA, and ZB) and novel-congruent (XB and YC) transfertrials. All test trials were nonreinforced. Error bars represent the standarderror of the mean.

Figure 7. Mean sum of pecks at all eight locations and spatial controlduring Test 3 of Experiment 2. Test trials include those presented duringtraining (XA, YA, and ZB), and novel-incongruent (XC, YB, and ZC) andnovel-ambiguous (ZA) transfer trials. All test trials were nonreinforced.Error bars represent the standard error of the mean.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

172 LEISING, HALL, WOLF, AND RUPRECHT

Page 11: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

Spatial control. Figure 7 also shows spatial control during eachtest trial. There were no responses to the goal during trials of ZC, andonly two responses across all birds to any location, which preventedany meaningful comparisons. Given the direction of the goal relativeto A was ambiguous on ZA trials, we specified the direction of thegoal based on training trials of ZB (i.e., to the left of A, as the goaloccurred to the left of B during ZB training trials). A paired-samplest test compared spatial control on trials of ZB and ZA trials and foundno reliable difference, t(4) � 1.18, p � .30.

We also compared the difference score from each trial type tozero. Separate single-sample t tests revealed good spatial controlduring trials of ZB, t(4) � 85.24, p � .0001 (d � 38.12, 95% CI[14.82, 71.15]), and ZA, t(4) � 3.95, p � .02 (d � 1.77, 95% CI[.30, 3.58]).

Postextinction test.Extinction of C and X. Subjects were advanced to extinction

training following a mean of 43.2 additional training sessions(SD � 0.5; i.e., Session 154). Figure 8 shows responding acrosssessions of extinction trials with X and C.

Amount of responding. There were no responses recorded onB or XB trials during testing, and only two birds responded to YC,thus preventing any meaningful comparisons. LM A elicited re-sponses from only one bird and thus could not be included in thestatistical analysis. Responding during trials of an OS with thesame landmark from training remained reliable. Figure 9 displaysdata from the remaining test trials. A repeated measures ANOVA

conducted on mean responses across all eight response locationsduring test trials of the training stimuli (XA, YA, and ZB) revealedno statistical difference between the trial types, F(2, 8) � .01, p �.91. Critically, XA (M � 25.20, SEM � 12.40) did not differ fromYA (M � 29.20, SEM � 20.75), t(4) � .44, p � .68.

Spatial control. Too few pigeons responded to the goal on YCor XB trials to make meaningful comparisons. Figure 9 displaysspatial control during the remaining test trials. Paired-samples ttests were used to compare spatial control during XA and YA,which found no reliable difference, t(4) � .84, p � .45, or betweenZB and XA, t(4) � 1.32, p � .26. We also compared the differencescore during tests of these trial types to zero. Single-sample t testsrevealed the difference score significantly differed from zero dur-ing training trials XA, t(4) � 54.66, p � .0001 (d � 24.44, 95%CI [9.48, 45.64]), ZB, t(4) � 3.82, p � .02 (d � 1.71, 95% CI [.27,3.48]), and YA, t(4) � 4.00, p � .02 (d � 1.79, 95% CI [.31,3.62]), whereas C did not, t(4) � 1.00, p � .37.

Discussion

In Experiment 2, the spatial relationship of a landmark (A) to ahidden goal was determined by the OS (X or Y) that preceded it.Pigeons learned the task quickly and to a high degree of accuracy(M � 87.14% pecks at goal, SD � 4.64, across all four types oftraining trials during Test 1). During novel-incongruent tests, wereplicated the effect found in Experiment 1 (novel-combo test withYA), such that the amount of responding during the novel-incongruent transfer test with YB was found to be greater than Balone, but also lower than trials of the previously trained OS-landmark pairing (YA). Unlike Experiment 1, the spatial distribu-tion of responding on YB trials indicated spatial control by B to thesame degree as the previously trained YA (exactly like the humansbehaved in Experiment 1 of Ruprecht et al., 2014). On the othernovel-incongruent trial XC, responding to C during XC trials wasweak and indicated poor spatial control (see Figure 5). On novel-congruent trials, spatial control during XB was unchanged,

Figure 8. Mean sum of pecks at all eight locations per session duringextinction treatment in Experiment 2. Error bars represent the standarderror of the mean.

Figure 9. Mean sum of pecks at all eight locations and spatial controlduring Test 4 of Experiment 2. Extinction of C and X occurred during the2 days immediately prior to Test 4. Test trials include those presentedduring training (XA, YA, and ZB) and novel-congruent (XB and YC)transfer trials. All test trials were nonreinforced. Error bars represent thestandard error of the mean.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

173OCCASION SETTING DURING SPATIAL SEARCH

Page 12: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

whereas control by C improved when it was paired with OS Y(which signaled congruent spatial information regarding the direc-tion of the hidden goal). On novel-ambiguous test trials, A waspaired with Z and the location of responding relative to A wascontrolled by OS Z. Lastly, extinction of OS X did not disruptsubsequent modulation of A by X.

Congruence and training history. Training history did nothave a noticeable effect on the amount of responding observedduring novel pairings of X and Y with B or C during the novel-incongruent or congruent tests. During the novel-incongruent test,more responding was observed during previously trained OS-landmark pairs (XA, YA, and ZB) than novel-configuration trans-fer tests (XC and YB), but no statistical differences were foundbetween trial types within each category. The same pattern ofresponding was observed during the novel-congruent (XB and YC)test. Thus, the training history of B and C did not influence theamount of responding on transfer trials. The effect of congruenceon amount of responding should be most apparent when compar-ing novel-incongruent to novel-congruent transfer tests, but nostatistical difference was found. This suggests that reduced re-sponding on the novel-incongruent transfer trials in Experiment 2(and likely on novel-combo trials in Experiment 1) was the resultof changes in the stimulus conditions (e.g., generalization decre-ment or external inhibition) at test, and not competition betweenOS and LM control.

Spatial control by LM B, which was paired with an OS duringtraining, was insensitive to changes in stimulus conditions andspatial interference during transfer tests (XB and YB). Spatialcontrol during transfer tests of LM B paired with a different OSfrom training was similar to control during tests of the previouslytrained OS–landmark pairs (e.g., ZB), which indicates an insensi-tivity to changes in the stimulus conditions (i.e., novel configura-tions). Insensitivity of OS modulation to spatial interference wassupported by the absence of a reliable difference in spatial controlduring novel-incongruent versus congruent transfer tests. The in-fluence of training history on OS modulation can be evaluated bycomparing performance during transfer tests of B with perfor-mance during transfer tests of a landmark without prior occasion-setting training (XC and YC). Spatial control by C during YCnovel-congruent trials, but not XC (incongruent), was comparablewith that of the previously trained OS–landmark pairs (see Figures6 and 7). This contrasts with that observed on transfer tests withLM B, which suggests training history influenced transfer perfor-mance. Regarding spatial interference, there was a large differencein spatial control by C when paired with X (incongruent) and Y(congruent). Because the overall change in the stimulus conditions(e.g., generalization decrement) was identical on XC and YC trials,the difference in performance between trials is best explained byconflicting spatial information (i.e., spatial interference) regardingthe location of the goal signaled by the OS and the landmark.Spatial control during a transfer test with C was disrupted byspatial interference (e.g., XC), but not by changes in the stimulusconditions of C at test (e.g., YC).

This result is consistent with previous research reported byBonardi (1996) on the role of generalization decrement duringtransfer testing. Pigeons were trained with two Pavlovianoccasion-setting pairs (XA�/A�/YB�/B�) and two pseudooccasion-setting pairs (XC�/C�/YD�/D�). Transfer tests withnovel pairings of CSs and OSs from training revealed incomplete

transfer on XB trials but complete transfer on XD trials. This resultdemonstrates that incomplete transfer when an OS is paired with adifferent CS (or DS) from training may be caused by factors otherthan the novelty of the pairing (e.g., generalization decrement).

In Experiment 2, spatial interference reduced spatial controlonly when an OS was paired with a landmark that did not previ-ously participate in occasion setting. Training history played a rolein determining how well an OS facilitated where, but not howmuch, subjects responded to a landmark (see Ruprecht et al., 2014,for a comparison with performance by humans in the same task).

Spatial control by an OS. In Experiment 2, we reduced thestability of LM A and expected that this manipulation would resultin greater spatial control of responding by the OS when paired witha different LM during transfer testing. As reported earlier, goodspatial control on YB transfer tests was observed; however, thelocation of responding was again consistent with the LM–goalassociation from training, and inconsistent with the LM–goalassociation signaled by the OS. One strategy for interpreting theseeffects involves retrieval of the LM–goal memories from trainingat the time of testing (e.g., T. S. Collett & Kelber, 1988; Holland,1989). According to the retrieved-memory interpretation, on YBtests, Y should have retrieved a memory for responding to the leftof A, which was weighted less than the memory retrieved by B(i.e., respond to the right). On XC, X should have retrieved amemory of responding to the right of A, which competed equallywith the memory retrieved by C (i.e., respond to the left). Bothtrials types were disrupted (i.e., fewer mean pecks than previouslytrained OS pairs), but B continued to control spatial behavior,whereas C did not. This difference can be attributed to the traininghistories of B and C, but these data do not allow us to dissociatebetween the various explanations of why training history mattered.One intriguing possibility relates to Rescorla’s (1985) suggestionthat the OS lowers the threshold for activation of the US repre-sentation in the presence of a DS previously trained with an OS. Inthis manner, OS Y lowered the threshold for activation of the LMB–goal, but not C–goal, association despite never being pairedwith B or C during training. In sum, despite the increased weightexpected to OSs X and Y, the landmark continued to control thelocation of responding during novel-incongruent transfer tests.

During novel-ambiguous tests, Z was paired with A and C onseparate trials. The direction of the goal relative to A was ambig-uous without a previously trained OS (X or Y). If the landmarkwas again given more weight than the OS, then on ZA trials, theLM A–goal associations from training would result in equal re-sponding to left and right of A at test. Alternatively, if the OS wasweighted higher than LM A, then the LM B–goal associationsignaled by OS Z would result in responding to the side of Aconsistent with the direction signaled by Z during training trials ofZB. On ZC trials, OS Z (goal to the left) and LM C (goal to theright) signaled conflicting spatial information regarding the loca-tion of the hidden goal. Test data revealed that pigeons respondedto the side of A on ZA trials consistent with the B–goal associationduring training with ZB. Indeed, there was no difference in theamount of responding or spatial control of responding between ZB(previously trained) and ZA (ambiguous), though ZB did differfrom ZC (incongruent) in both measures. Once again, respondingto C, a landmark with no prior OS-landmark training, was dis-rupted when there was spatial incongruence between the goalsignaled by the OS (Z) and the landmark (C).

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

174 LEISING, HALL, WOLF, AND RUPRECHT

Page 13: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

Based on the retrieved-memory interpretation, during the ZAtest, Z should have retrieved a memory for responding to the rightof B, which was not incongruent with the memory retrieved by A(to the left or right). However, on ZC trials, Z should haveretrieved a memory of responding to the right of B, which wasincongruent with the memory retrieved by C (to the left). Respond-ing on ZA trials was the only case in which both the amount ofresponding and spatial control did not differ from the previouslytrained trials. Why so much responding during ZA? Was it that theidentity of A was completely ignored and mistaken for B? Theresults of ZC trials eliminate this possibility. If the identity ofLandmarks C and A were not detected following Z, then theamount of responding and spatial control on ZA and ZC trialswould have been similar. Another possibility, consistent with ahierarchical account, is that prior training of A and B increasedgeneralization between them. However, that does not explain whyZA elicited more responding than XB trials. In previous cases (YBand XB), two unambiguous memories regarding the location of thegoal were always retrieved (e.g., memory based on Y and B), buton ZA, only one unambiguous memory based on OS Z would havebeen retrieved. Enhanced performance may be the result of acombination of the lack of spatial interference between retrievedmemories of the OS and LM, and acquired equivalence between Aand B. Lastly, the ZC test also rule out an alternative interpretationto the role of spatial interference with LM C during XC and YC inTests 1 and 2, respectively. It is possible that improved perfor-mance on YC trials in Test 2 may have been related to attenuatedgeneralization decrement following exposure to XC in the first setof transfer tests. However, ZC represents a third exposure in whichgeneralization decrement should be further reduced, but spatialincongruence should still be present. Weak performance during ZCtrials suggests spatial incongruence was the cause of disruptedcontrol by C on XC and ZC trials.

Posttraining extinction. A hallmark of an OS is that modu-lation of a DS (or CS) is resistant to extinction of the OS. X wasextinguished across two sessions (see Figure 8). Following extinc-tion of X, performance on a test with XA showed no disruption inamount of responding or spatial control (see Figure 9). Spatialcontrol by C, however, was disrupted by extinction. An additionalprediction that has received some support is that extinction of anOS enhances transfer to other CSs previously trained with an OS(Holland, 1989). However, extinction of X and C in our taskeliminated transfer to XB and YC. It is unclear why we failed tofind modulation postextinction; however, one explanation maysimply be an overall reduction in responding on novel-configuration transfer trials. Though the novel configuration of ZAelicited reliable responding in the third set of tests, the postextinc-tion test was the fourth testing condition in Experiment 2, and littleresponding was observed in either transfer test. Regardless oftransfer success, performance on postextinction XA trials indicatesan OS within a spatial-search task is resistant to extinction.

Regarding the questions posed at the beginning of the article, weagain have evidence that the OS primarily controlled whether ornot the LM elicited any responses, but the location of the responsewas consistent with the specific landmark–outcome associationlearned during training. This was most clearly evidenced by respond-ing to the goal signaled by the landmark on novel-incongruent testtrials. However, in the absence of good spatial information (i.e.,

provided by the landmark), the OS can signal the location of anexpected goal (e.g., on novel-ambiguous ZA trials).

Our results are inconsistent with Bonardi et al. (2012), whoreported that transfer of performance (responses per minute) wasbetter to other CSs (C and D) when the outcome paired with thetransfer CS matched the outcome paired with the OS duringoccasion-setting training. One critical difference is that we manip-ulated the spatial location of an outcome signaled by a cue (i.e.,goal to the left vs. right), whereas Bonardi et al. manipulated thequality of the outcome (i.e., oil vs. sucrose). Transfer performance(amount of responding and spatial accuracy) in our task was notfacilitated by a match in the expected location of the outcomebased on the OS and landmark. The quality of an outcome is likelymore biologically significant to rats than the direction of the outcomerelative to a landmark for pigeons, which may explain why congru-ence did not affect performance in our task. For humans completinga task and transfer tests nearly identical to Experiment 2, however,spatial congruence did increase the amount of responding at the goalsignaled by the landmark relative to the novel-incongruent test (Ru-precht et al., 2014).

General Discussion

A spatial-search task was used to explore how conditionalcontrol of behavior could be extended to the spatial domain.During occasion-setting training, a colored background stimulus(the OS) signaled the contingency between a landmark (e.g., adiscriminative stimulus) and a reinforced response location (i.e.,goal). There were at least two distinct possibilities regarding therole of the OS in a landmark task. The first is that an OS–goalassociation would control the amount of responding and locationof behavior. In Experiment 1, the OS was a perfect predictor ofthe landmark–goal contingency and spatial relationship; thus, thelandmark could be largely ignored minus a role for anchoring theresponse (e.g., see Experiment 3 in T. S. Collett & Kelber, 1988).The second is that the OS would facilitate responding to specificlandmark–goal spatial associations. In this scenario, the identity ofthe landmark would be critical as the pigeons learned to respond tothe left or right of specific landmarks. Figure 10 displays the meandifference score (i.e., spatial control) for the proportion of re-sponses at the goal signaled by the LM, minus the proportion ofresponses at the goal signaled by the OS across each testingcondition and experiment. Experiment 1 demonstrated that if con-trol by either the LM or OS was observed, it was the landmark-retrieved memory, not the OS, that controlled search for thelocation of the hidden goal. This is consistent with findings fromthe temporal domain suggesting that subjects encode specificCS–outcome intervals when trained in occasion-setting tasks(Bonardi & Jennings, 2007; Nakajima, 2009). Experiment 2 fur-ther explored conditional control by manipulating the stability ofthe spatial relationship of a landmark (A) to the goal. Pigeonslearned the task, and transfer tests indicated that congruent spatialinformation from the OS- and LM-retrieved memories matteredonly when the OS was paired with a landmark that had not beenpreviously trained with an OS (see Figure 10). Lastly, posttrainingextinction of X did not disrupt modulation of A by X duringsubsequent testing. Taken together, these results suggest that spa-tial control of responding is similar to that of temporal control, and

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

175OCCASION SETTING DURING SPATIAL SEARCH

Page 14: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

furthermore, modulation by an OS in a spatial task is similar to thatobserved in more conventional occasion-setting tasks.

Cheng et al. (2007) applied Bayesian principles to model howmultiple landmarks compete for spatial control of behavior in taskssimilar to Experiments 1 and 2. Bayes’s (1763) theorem suggeststhat a cue’s contribution to the control of behavior, includingspatial behavior, should be weighted inverse to its variance. Forexample, Cheng et al. described spatial overshadowing, in whichthe presence of a more proximal landmark reduced spatial controlby a distal landmark (Leising, Garlick, & Blaisdell, 2011; Spetch,Cheng, & Mondloch, 1992), as the result of the distal landmarkgiven less weight because of the increased variance inherent in therelatively longer distance of the distal than proximal landmark tothe goal. Thus, different weightings are assigned to cues accordingto Bayesian principles. In another example, T. S. Collett andKelber (1988) found that proximal landmarks were weighted morethan distal landmarks on transfer tests when the search space wasenclosed, but when the bees searched on an open platform, themore proximal landmarks were weighted less than the distal land-marks. In this case, the higher variance of spatial informationprovided by distal cues must have been weighted less than (orcounteracted by) the reduced variance provided by the high sa-lience of the distal cues from the open platform. In the currentexperiments, we have cues that differed in proximity, stability, andreliability. When the stability of the LM was reduced in Experi-ment 2, our results indicate that more weight was given to theLM–goal memory retrieved by the OS. Bayesian models may beable to model our data, but more experiments that vary each

dimension are critical to determining how weights are assigned, aswell as how weights from different dimensions are combined todetermine overall variance.

Configural theory (Pearce, 1987, 1994) also makes predictionsregarding how cues come to control behavior. Our results areinconsistent with traditional configural theory, which predicts thatthe configuration of X and A present on XA trials would berepresented in memory as a unique configuration (e.g., X � X,A � A, p � X � A). The configurations formed by novelcombinations of the OSs and landmarks (e.g., q � X � B) wouldbear little resemblance to the original XA configuration. Aftertraining on XA and YB (Experiment 1), the novel test configura-tion of XB should elicit little responding, according to a configuralaccount, but reliable responding was observed. Responding on XBtrials could be explained by a configural account by appealing togeneralization between configurations. But three pieces of evi-dence argue against this account of the results of Experiments 1and 2. First, in both experiments, the LM and OS (colored back-ground) were not paired in the same spatial arrangement with eachother across trials. Within each trial type (e.g., XA), the LM andgoal appeared in four different positions across trials, which wouldrequire four different configurations of the background and LM foraccurate responding to the goal for one trial type and 16 config-urations for all trial types in Experiment 2. With 16 configurations,and four for each trial type, explanations based on generalizationbetween configurations become less plausible. Second, from aconfigural perspective, there is no explanation for more accurateresponding on YB than XC trials, or why accuracy would improvefrom XC to YC trials. In both cases, the pairings were equallynovel and should have resulted in the same amount of generaliza-tion decrement. Third, in previous studies with honeybees, the OSwas contextual information located outside of the search space(e.g., a hut). T. S. Collett and Kelber (1988) trained honeybees toenter separate huts to search for sucrose at different locationsrelative to the same four landmarks. The bees searched near thelandmarks inside each hut (OS), so they could not form a config-uration of the hut and landmarks together. These data are similarto the findings we report in Experiment 2, which suggests that atthe very least, the configural account is not necessary to explainour results.

Newer conceptions of configural learning (e.g., Honey & Watt,1998; Kutlu & Schmajuk, 2012; Brandon, Vogel, & Wagner,2000) are more relevant to Experiment 2 because they include arole for both elements and configurations through connections to ahidden unit. At present, hierarchical and neo-configural theoriesmake so many of the same predictions that there is little room forempirical evidence to distinguish between them (e.g., Bonardi etal., 2012). Additionally, there is no reason to assume these learningmechanisms are mutually exclusive. In other tasks, it has beenfound that different learning mechanisms can occur simultane-ously during training and that the conditions (e.g., stimuli) at testmay result in the expression of one over the other (Packard &McGaugh, 1996). Furthermore, we suggest there is no reason toassume that the various mechanisms for occasion setting, includingCS-specific, US-specific, and CS-US specific (see Swartzentruber,1995, for a review) are mutually exclusive. It is likely that undermost conditions, each mechanism contributes to OS performance,and under certain conditions, one mechanism will predominate.The inclusion of spatial or temporal information in occasion-

Figure 10. Spatial control across experiments. The mean difference score(see text for details) for data collected in Experiments 1 and 2. The datafrom Experiment 2 are displayed separately for each novel-configurationtransfer test and the postextinction test of XA. “Incon.” refers to the testtrials in which the location of the goal signaled by the OS and landmarkwere incongruent, compared with trials in which both cues providedcongruent spatial information, or “Cong.” “Ambig.” refers to the test trialin which the direction of the goal relative to A was ambiguous, and “Post.”refers to test trials conducted after the extinction of OS X. Error barsrepresent the standard error of the mean.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

176 LEISING, HALL, WOLF, AND RUPRECHT

Page 15: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

setting tasks may prove fruitful for researchers try to determine theconditions that engage each mechanism.

Research conducted from an associative learning perspective onthe amount of behavior elicited during occasion-setting procedureshas identified many of the factors that distinguish the hierarchicalaccount from configural and other accounts (e.g., Bonardi et al.,2012; Schmajuk & Holland, 1998; Swartzentruber, 1995). How-ever, analyzing data only in one dimension (amount of responding)neglects much of the richness of behavior (it occurs in space andtime). One aim of these experiments was to introduce a procedurethat connects previous research on amount of responding withnonspatial cues to spatial control by landmarks, to encourage moreresearch on occasion setting by those working from within asso-ciative and spatial frameworks. In particular, future work canexamine the role of conditional if–then relationships betweenlandmarks, meaning both OS and landmark will need to have aclear spatial role (unlike the current experiments). The use of atouchscreen procedure enables work with rats, pigeons, monkeys,and apes to be conducted with the same apparatus. The resultsreported here highlight the need for additional research modelingspatial behavior in occasion-setting tasks, manipulating the vari-ance of factors influencing spatial control, and on the comparativeanalysis of occasion setting in spatial tasks.

References

Battaglia, P. W., Jacobs, R. A., & Aslin, R. N. (2003). Bayesian integrationof visual and auditory signals for spatial localization. Journal of theOptical Society of America, A, Optics, Image Science & Vision, 20,1391–1397. http://dx.doi.org/10.1364/JOSAA.20.001391

Bayes, T. (1763). An essay towards solving a problem in the doctrine ofchances. Philosophical Transactions of the Royal Society of London, 53,370–418. http://dx.doi.org/10.1098/rstl.1763.0053

Biegler, R., & Morris, R. G. (1993). Landmark stability is a prerequisite forspatial but not discrimination learning. Nature, 361, 631–633. http://dx.doi.org/10.1038/361631a0

Bonardi, C. (1996). Transfer of occasion setting: The role of generalizationdecrement. Animal Learning & Behavior, 24, 277–289. http://dx.doi.org/10.3758/BF03198976

Bonardi, C., Bartle, C., & Jennings, D. (2012). US specificity of occasionsetting: Hierarchical or configural learning? Behavioural Processes, 90,311–322. http://dx.doi.org/10.1016/j.beproc.2012.03.005

Bonardi, C., & Jennings, D. (2007). Occasion setting of timing behavior.Journal of Experimental Psychology: Animal Behavior Processes, 33,339–348. http://dx.doi.org/10.1037/0097-7403.33.3.339

Brandon, S. E., Vogel, E. H., & Wagner, A. R. (2000). A componentialview of configural cues in generalization and discrimination in Pavlov-ian conditioning. Behavioral Brain Research, 110, 67–72.

Byrne, P. A., & Crawford, J. D. (2010). Cue reliability and a landmarkstability heuristic determine relative weighting between egocentric andallocentric visual information in memory-guided reach. Journal of Neu-rophysiology, 103, 3054–3069. http://dx.doi.org/10.1152/jn.01008.2009

Cheng, K., Shettleworth, S. J., Huttenlocher, J., & Rieser, J. J. (2007).Bayesian integration of spatial information. Psychological Bulletin, 133,625–637. http://dx.doi.org/10.1037/0033-2909.133.4.625

Collett, M., Harland, D., & Collett, T. S. (2002). The use of landmarks andpanoramic context in the performance of local vectors by navigatinghoneybees. The Journal of Experimental Biology, 205, 807–814.

Collett, T. S., Fauria, K., Dale, K., & Baron, J. (1997). Places and patterns:A study of context learning in honeybees. Journal of ComparativePhysiology, 181, 343–353. http://dx.doi.org/10.1007/s003590050120

Collett, T. S., & Kelber, A. (1988). The retrieval of visuo-spatial memoriesby honeybees. Journal of Comparative Physiology, 163, 145–150. http://dx.doi.org/10.1007/BF00612004

Eacott, M. J., Easton, A., & Zinkivskay, A. (2005). Recollection in anepisodic-like memory task in the rat. Learning & Memory, 12, 221–223.http://dx.doi.org/10.1101/lm.92505

Hall, G., & Mondragón, E. (1998). Contextual control as occasion setting.In N. Schmajuk & P. C. Holland (Eds.), Occasion setting: Associativelearning and cognition in animals (pp. 199–222). Washington, DC:American Psychological Association.

Holland, P. C. (1983). Occasion setting in Pavlovian feature: Positivediscriminations. In M. L. Commons, R. J. Herrnstein, & A. R. Wagner(Eds.), Quantitative analyses of behavior: Vol. IV. Discrimination pro-cesses (pp. 183–206). Cambridge, MA: Ballinger.

Holland, P. C. (1985). The nature of conditioned inhibition in serial andsimultaneous feature negative discriminations. In R. R. Miller & N. E.Spear (Eds.), Information processing in animals: Conditioned inhibition(pp. 267–297). Hillsdale, NJ: Erlbaum.

Holland, P. C. (1986). Temporal determinants of occasion setting in featurepositive discriminations. Animal Learning & Behavior, 14, 111–120.http://dx.doi.org/10.3758/BF03200045

Holland, P. C. (1989). Feature extinction enhances transfer of occasion setting.Animal Learning & Behavior, 17, 269–279. http://dx.doi.org/10.3758/BF03209799

Holland, P. C. (1995). Transfer of occasion setting across stimulus andresponse in operant feature positive discriminations. Learning and Mo-tivation, 26, 239–263. http://dx.doi.org/10.1016/0023-9690(95)90014-4

Holland, P. C. (1998). Temporal control in Pavlovian occasion setting.Behavioural Processes, 44, 225–236. http://dx.doi.org/10.1016/S0376-6357(98)00051-5

Holland, P. C., Hamlin, P. A., & Parsons, J. P. (1997). Temporal specificityin serial feature-positive discrimination learning. Journal of Experimen-tal Psychology: Animal Behavior Processes, 23, 95–109. http://dx.doi.org/10.1037/0097-7403.23.1.95

Honey, R. C., & Watt, A. (1998). Acquired relational equivalence: Impli-cations for the nature of associative structures. Journal of ExperimentalPsychology: Animal Behavior Processes, 24, 325–334. http://dx.doi.org/10.1037/0097-7403.24.3.325

Kutlu, M. G., & Schmajuk, N. A. (2012). Solving Pavlov’s puzzle: Atten-tional, associative, and flexible configural mechanisms in classical con-ditioning. Learning & Behavior, 40, 269–291. http://dx.doi.org/10.3758/s13420-012-0083-5

Leising, K. J., Garlick, D., & Blaisdell, A. P. (2011). Overshadowing byproximity with pigeons in an automated open-field and touch screen.Journal of Experimental Psychology: Animal Behavior Processes, 37,488–494.

Leising, K. J., Sawa, K., & Blaisdell, A. P. (2012). Factors that influencenegative summation in a spatial-search task with pigeons. BehaviouralProcesses, 90, 357–363. http://dx.doi.org/10.1016/j.beproc.2012.03.018

Mackintosh, N. J. (2002). Do not ask whether they have a cognitive map,but how they find their way about. Psicológica, 23, 165–185.

Miller, N. Y., & Shettleworth, S. J. (2007). Learning about environmentalgeometry: An associative model. Journal of Experimental Psychology:Animal Behavior Processes, 33, 191–212.

Miller, R. R., & Oberling, P. (1998). Analogies between occasion settingand Pavlovian conditioning. In N. A. Schmajuk & P. C. Holland (Eds.),Occasion setting: Associative learning and cognition in animals (pp.3–35). Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10298-001

Molet, M., Gambet, B., Bugallo, M., & Miller, R. R. (2012). Spatialintegration under contextual control in a virtual environment. Learningand Motivation, 43, 1–7. http://dx.doi.org/10.1016/j.lmot.2012.01.003

Nakajima, S. (2009). Feature-short and feature-long discrimination learn-ing in the pigeon: Conditional control of a two-event temporal map.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

177OCCASION SETTING DURING SPATIAL SEARCH

Page 16: Occasion Setting During a Spatial-Search Task With Pigeons...Occasion Setting During a Spatial-Search Task With Pigeons Kenneth J. Leising, Jordan S. Hall, Joshua E. Wolf, and Chad

Behavioural Processes, 80, 80–89. http://dx.doi.org/10.1016/j.beproc.2008.10.001

Nardini, M., Jones, P., Bedford, R., & Braddick, O. (2008). Developmentof cue integration in human navigation. Current Biology, 18, 689–693.http://dx.doi.org/10.1016/j.cub.2008.04.021

Packard, M. G., & McGaugh, J. L. (1996). Inactivation of hippocampus orcaudate nucleus with lidocaine differentially affects expression of placeand response learning. Neurobiology of Learning and Memory, 65,65–72. http://dx.doi.org/10.1006/nlme.1996.0007

Pearce, J. M. (1987). A model for stimulus generalization in Pavlovianconditioning. Psychological Review, 94, 61–73. http://dx.doi.org/10.1037/0033-295X.94.1.61

Pearce, J. M. (1994). Similarity and discrimination: A selective review anda connectionist model. Psychological Review, 101, 587–607. http://dx.doi.org/10.1037/0033-295X.101.4.587

Ratliff, K. R., & Newcombe, N. S. (2008). Reorienting when cues conflict:Evidence for an adaptive-combination view. Psychological Science, 19,1301–1307. http://dx.doi.org/10.1111/j.1467-9280.2008.02239.x

Rescorla, R. A. (1985). Conditioned inhibition and facilitation. In R. R.Miller & N. E. Spear (Eds.), Information processing in animals: Con-ditioned inhibition (pp. 299–326). Hillsdale, NJ: Erlbaum.

Rescorla, R. A. (1986a). Extinction of facilitation. Journal of ExperimentalPsychology: Animal Behavior Processes, 12, 16–24. http://dx.doi.org/10.1037/0097-7403.12.1.16

Rescorla, R. A. (1986b). Facilitation and excitation. Journal of Experimen-tal Psychology: Animal Behavior Processes, 12, 325–332. http://dx.doi.org/10.1037/0097-7403.12.4.325

Roberts, S. (1981). Isolation of an internal clock. Journal of ExperimentalPsychology: Animal Behavior Processes, 7, 242–268. http://dx.doi.org/10.1037/0097-7403.7.3.242

Rosenthal, R. (1991). Meta-analytic procedures for social research. New-bury Park, CA: Sage. http://dx.doi.org/10.4135/9781412984997

Ruprecht, C. M., Wolf, J. E., Quintana, N., & Leising, K. J. (2014).Feature-positive discriminations during a spatial-search task with hu-mans. Learning & Behavior, 42, 215–230.

Schmajuk, N. A., & Holland, P. C. (Eds.). (1998). Occasion-setting:Associative learning and cognition in animals. Washington, DC: Amer-ican Psychological Association.

Shanks, D. R. (2010). Learning: From association to cognition. AnnualReview of Psychology, 61, 273–301. http://dx.doi.org/10.1146/annurev.psych.093008.100519

Smithson, M. (2001). SPSS syntax scripts for computing noncentral con-fidence intervals. Retrieved from http://psychology3.anu.edu.au/people/smithson/details/CIstuff/CI.html

Spetch, M. L., Cheng, K., & Mondloch, M. (1992). Landmark use bypigeons in a touch-screen spatial search task. Animal Learning & Be-havior, 20, 281–292. http://dx.doi.org/10.3758/BF03213382

Srinivasan, M., Zhang, S., & Bidwell, N. (1997). Visually mediated odom-etry in honeybees. The Journal of Experimental Biology, 200, 2513–2522.

Swartzentruber, D. (1995). Modulatory mechanisms in Pavlovian condi-tioning. Animal Learning & Behavior, 23, 123–143. http://dx.doi.org/10.3758/BF03199928

Wehner, R., & Srinivasan, M. W. (1981). Searching behaviour of desertants, genus Cataglyphis (Formicidae, Hymenoptera). Journal ofComparative Physiology, 142, 315–338. http://dx.doi.org/10.1007/BF00605445

Wright, A. A. (1997). Concept learning and learning strategies. PsychologicalScience, 8, 19–23. http://dx.doi.org/10.1111/j.1467-9280.1997.tb00693.x

Zhang, S., Si, A., & Pahl, M. (2012). Visually guided decision making inforaging honeybees. Frontiers in Neuroscience, 6, 88.

Received November 2, 2013Revision received September 9, 2014

Accepted September 12, 2014 �

E-Mail Notification of Your Latest Issue Online!

Would you like to know when the next issue of your favorite APA journal will be availableonline? This service is now available to you. Sign up at http://notify.apa.org/ and you will benotified by e-mail when issues of interest to you become available!

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

178 LEISING, HALL, WOLF, AND RUPRECHT