Date of Award:
Master of Science (MS)
Timothy A. Shahan
Resistance to extinction of single-schedule performance is negatively related to the reinforcer rate that an organism experienced in the pre-extinction context. This finding opposes the predications of behavioral momentum theory, which states that resistance to change, in general, is positively related to reinforcer rates. The quantitative model of extinction provided by behavioral momentum theory can describe resistance to extinction following single schedules in a post-hoc fashion, and only if the parameters of the model are allowed to vary considerably from those typically derived from multiple- schedule preparations. An application of the principles of Bayesian inference offers an alternative account of extinction performance following single schedules. According to the Bayesian change-detection algorithm, the temporal intervals of non-reinforcement that an organism experiences during extinction are compared to the temporal distribution of reinforcers that the organism experienced during baseline. A transition to extinction is more readily detectable when the previously collected distribution of reinforcers in time
is populated with relatively short intervals (i.e., when more frequent reinforcement was experienced during baseline). The Bayesian change-detection algorithm also suggests that changes in reinforcer rates are more detectable when organisms have temporally proximal experience with frequently changing rates. The current experiment investigated this novel prediction. Pigeons pecked keys for food under schedules of reinforcement that arranged either relatively dynamic reinforcer rates or relatively static rates across conditions. Following each period of reinforcement, resistance to extinction was assessed. Persistence was greater following static contingencies than following dynamic contingencies for the majority of subjects. These data provide support for the Bayesian approach to understanding operant extinction and might serve to extend behavioral momentum theory by offering change detection as an additional mechanism through which extinction occurs.
Craig, Andrew R., "A Comparison of Resistance to Extinction Following Dynamic and Static Schedules of Reinforcement" (2013). All Graduate Theses and Dissertations. 2012.
Copyright for this work is retained by the student. If you have any questions regarding the inclusion of this work in the Digital Commons, please email us at .