schedules of reinforcement
a program that determines when a response will be followed by a reinforcer; influences how a response is learned and maintained
continuous reinforcement (CRF)
every occurrence of instrumental response is followed by reinforcer delivery; FR1
Partial or Intermittent reinforcement
responding is reinforced only some of the time (VR, VI, FI, FR, beyond1)
fixed ratio (FR)
set ratio between number of responses and number of reinforcers (FR1, FR5, FR100)
postreinforcement pause or preratio pause
zero ratio of responding after each reinforcement; longer with higher ratio requirements, procrastination may be explained by this
ratio run or run rate
high and steady rate or responding to complete ratio requirement
variable ratio (VR)
different number or responses required for reinforcement, numerical value indicates average number of responses; more steady pattern of responding, less likely to have predictable pauses
interval schedules
response is reinforced for the first time it occurs after a time interval has passed
fixed interval (FI)
response is reinforced if it occurs a set amount of time after last reinforcement; does not guarantee that the organism will be reinforced at fixed intervals of time
fixed interval characteristics
fixed interval scallop on cumulative record; organism waits to respond until the end of fixed interval; postreinforcement pauses
variable interval (VI)
responses are reinforced if they occur after a variable interval of time since delivery of previous reinforcer; varies around some average; produces steady rates of responding without predictable pauses
limited hold for VI or FI schedules
a restriction on how long reinforcer is available
response rate schedules
for this, organisms must respond at a particular rate to get reinforced
differential reinforcement of high rates (DRH)
encourages responding at high rates, minimum number of responses has to occur in given period of time to get reinforced; ex: response is only reinforced if it occurs within 5 seconds after preceding response
differential reinforcement of low rates (DRL)
encourages responding at lower rates; behavior is reinforced only if certain amount of time has passed since the last performance of the behavior; interval starts over when behavior occurs
fixed time
reinforcer given after certain amout of time, regardless of behavior; don't have to respond to get reinforced
variable time
reinforcer given after variable interval or time, regardless of behavior
fixed duration
behavior has to be performed continuously for duration of time for reinforcer to occur
variable duration
duration of time varies around some average
fixed interval
reinforced the first time after the behavior occurs each time
stretching the ratio
thinning the schedule or gradually shaping the organism to work longer or harder for less reinforcement
ratio strain
if ratio is stretched too far or too quickly, the behavior will break down
discrimination hypothesis
harder to tell difference between PR and extinction than between CR and extinction
Amsel's frustration hypothesis
the nonreinforcement of previously reinforced Bx is frustrating (aversive); in CR, no frustration, in extinction, frustration so quit responding; on PR at some point organism is frustrated, responds anyway and is rewarded; learn to respond when frustrated, frustration is cue to respond
Capaldi's sequential hypothesis
on CR, all lever presses reinforced, reinforcement is cue to keep responding; in extinction, no reinforcement, so quit responding; on PR the sequence includes nonreinforced responses followed by reinforced response; the sequence (or memory of non reward) becomes cue for continued responding
partial reinforcement effect (PRE)
organism is more resistant to extinction following PR schedule than following CR schedule; paradoxical b/c or Law of Effect: unreinforced Bx should be weakened
response unit hypothesis
define response as what is required to get reinforcement; PRE is an illusionBa/Bb=R1/R2
cooperative schedules
reinforcement depends on Bx of 2 or more individuals; reinforcement dependent, in part, on Bx of other
concurrent schedules
2 or more schedules available at the same time; organism can choose which one to work on and can switch back and forth