classical conditioning
a types of learning through which an organism learns to associate one stimulus with another. Classical pairs a neutral stimulus with an unconditioned stimulus.
stimulus
any event or object in the environment to which an organism responds; plural is stimuli
reflex
an involuntary response to a particular stimulus, such as the eyeblink reponse to a puff of air or salivation when food is placed in the month
conditioned reflex
a learned involuntary response. Pavlov's dogs salivating at the sight of food or rattling of food dishes was an example of this reflex.
unconditional response
a response that is elicited by an unconditioned stimulus without prior learning. Synonymous with unlearned.
unconditioned stimulus
a stimulus that elicits a specific unconditioned response without prior learning.
The tone was this type of stimulus in Pavlov's studies. The water spray in our classroom was the unconditioned stimulus. Paired up with the unconditioned response enough and both become conditioned.
conditioned stimulus
a neutral stimulus that, after repeated pairing with an unconditioned stimulus, becomes associated with it and elicits a conditioned repsonse
conditioned response
the learned response that comes to be elicited by a conditioned stimulus as a result of its repeated pairing with an unconditioned stimulus
higher-order conditioning
conditioning that occurs when conditioned stimuli are linked together to form a series of signals. Going to the doc to get blood drawn..
.starts with sitting in that chair, then the turniquet is wrapped around the arm, etc. Each step is tellin you pain is about to happen causing additional conditioned responses to occur.
spontaneous recovery
the reappearance of an extinguished response (in a weaker form) when an organism is exposed to the original conditioned stimulus following a rest period
generalization
in classical conditioning, the tendency to make a conditioned response to a stimulus that is similar to the original conditioned stimulus
taste aversion
the intense dislike and/or avoidance of a particular food that has been associated with nausea or discomfort. Helped prove Seligman's theory that humans are prepared to associate certain stimuli with particular consequences.
trial and error learning
learning that occurs when a response is associated with a successful solution to a problem after a number of unsuccessful responses
law of effect
one of thorndike's laws of learning, which states that the consequence, or effect of a response will determine whether the tendency to respond in the same way in the future will be strengthened or weakened
operant conditioning
a type of learning in which the frequency of a voluntary behavior changes because of the consequences that the behavior produces
reinforcer
anything that follows a response and strengthens it or increases the probability that it will occur
shaping
an operant conditioning technique that consists of gradually molding a desired behavior (response) by reinforcing any movement in the direction of the desired response, thereby gradually guiding the responses toward the ultimate goal
skinner box
a soundproof chamber with a device for delivering food to an animal subject used in operant conditioning experiments
successive approximations
a series of gradual steps, each of which is more similar to to the final desired response
extinction
in operant conditioning, the weakening and eventual disappearance of the conditioned response as a result of the withholding of reinforcement
generalization
in operant conditioning, the tendency to make the learned response to a stimulus similar to that for which the response was originally reinforced
discriminative stimulus
a stimulus that signals whether a certain response or behavior is likely to be rewarded, ignored, or punished
reinforcement
an increase in the frequency of a behavior that occurs as the result of the consequence that the behavior produces.
Reinforcement increases or strengthens a behavior.
positive reinforcement
any pleasant or desirable consequence that increases the probability that the response will be repeated.
negative reinforcement
an increase in behavior that occurs because increasing the behavior results in the termination of an unpleasant condition or stimulus
primary reinforcer
a reinforcer that fulfills a basic physical need for survival and does not depend on learning
secondary reinforcer
a reinforcer that is acquired or learned through association with other reinforcers
cognitive processes
mental processes such as thinking, knowingm problem solving, remembering, and forming mental representations
insight
the sudden realization of the relationship between elements in a problem situation, which makes the solution apparent
latent learning
learning that occurs without apparent reinforcement and is not demonstrated until the organism is motivated to do so
cognitive map
a mental representation of a spatial arrangement such as a maze
observational learning
learning by observing the behavior of others and the consequences of that behavior; learning by imitation
modeling
another name for observational learning
Learning
A relatively permanent change in behavior, knowledge, capability, and attitude. Acquired through experience. Not attributable to illness, injury, or maturation
Neutral Stimulus
Has no impact on the audience or subject. A "C" tone to dogs was initially a neutral stimulus.
The word "can" in our experiment was the neutral stimulus. When paired with a squirt in the face often enough, it became the conditioned stimulus evoking a conditioned response.
discrimination
the learned ability to distinguish between similar stimuli so that the conditioned response occurs only to the original conditioned stimulus but not similar stimuli.
Watson and Rayner and Little Albert
trained a small boy to be afraid of a white rabbit by introducing a loud sound when rabbit was present. Proved generalization occurred.
Robert Rescorla
Worked with rats, electricity, and tones. The important factor in classical conditioning is whether the conditioned stimulus provides info that reliably predicts the occurrence of the unconditioned stimulus. When the tone provided no clue of the shock, the pairings did not lead to conditioning
Two factors that greatly influence classical conditioning
1) The number of pairings
2) The temporal effect - Was the unconditioned stimulus immediately paired with the neutral stimulus?
Garcia and Koelling
Proved two things that challenged classical conditioning - 1) Because rats avoided flavored water, it challenged the notion that the conditioned stimulus must be present shortly before the unconditioned stimulus
2) Animals are predisposed to make connections.
Factors Influence Operant Conditioning
1) Motivation - rats had to be around 70% target body weight.
2) Satisfying consequence
3) Immediacy of the reinforcement - takes months to see results from a diet (that's why it's so hard.)
4) Magnitude of the reinforcement - one student gets $50 for an A but another gets $500
Thorndyke and the Law of Effect
Responses closely followed by satisfying consequences are more likely to be repeated.
Cats placed in a puzzle box, food placed outside, cats learned to pull lever to open door.
Continuous Reinforcement
reinforcing that is administered after every desired or correct response, the most effective method of conditioning a new response
Fixed-Ratio schedule
in operant conditioning, a reinforcement schedule that reinforces a response only after a specified number of responses. Ex: FR-30. Pellet given after 30 correct responses. Very effective when you need a constant high response rate - migrant workers in harvesting.
Variable-Ratio Schedule
in operant conditioning, a reinforcement schedule that reinforces a response after an unpredictable number of responses. ex: VR-5. Rat would get a pellet on avg every fifth time, but could be after 1 or after 13. Effective for slot machines
Fixed Interval schedule
in operant conditioning, a reinforcement schedule that reinforces a response only after a specified time has elapsed. ex: FI5 - the first correct response after five minutes have elapsed. Monthly paycheck is an example.
..procrastination can occur right after the payday too.
Variable Interval Schedule
Help eliminate the pause after fixed interval - a reinforcer is given after the first correct response following a varying time of nonreinforced responses (based on avg times.) ex: Drug testing (you'll be tested on average twice during the season.) Keeps people constantly on their toes.
Punishment
Decrease in the frequency of a behavior following some kind of consequence.
Positive punishment
behavior decreases after the addition of an unpleasant consequence. Decreases the probability that the response will be repeated. Student stops staying up late after sleeping through an important exam.
Negative punishment
Behavior decreases after the removal of a pleasant consequence.
Disadvantages of punishment
1) Doesn't eliminate a behavior, just removes it in the presence of a punishing agent.
2) Doesn't help ppl develop right behaviors
3) Person can feel fearful or hostile towards punisher
4) Punsihment can lead to aggression
Keys to punishment
1) Consistency
2) minimum severity used to control the behavior
Learned Helplessness
hopelessness and passive resignation an animal or human learns when unable to avoid repeated aversive events - Martin Seligman. Dog experiment using shocks and harnesses.
Wolfgang Kohler
A Gestalt psychologist who became known for his experiments with chimpanzees and insight in problem solving.
He believed that by perceiving the whole situation, chimps were able to create novel solutions to problems (rather than just by trial and error). Through insight, chimps were able to use props in order to retrieve rewards. Theory of "aha moments." He was at odds with Behavioralists. They think behavior springs from primary reinforcement.
Albert Bandura
pioneer in observational learning (AKA social learning), stated that people profit from the mistakes/successes of others; Studies: Bobo Dolls-adults demonstrated 'appropriate' play with dolls, children mimicked play
Edward Tolman
organisms can also learn in the absence of reinforcement--> unreinforced rats had developed a cognitive map (mental representation of the maze)
Ian Pavlov (1849-1936)
Experimented on the physiology of digestion, which own him a Nobel Prize in 1904 - 1st time Russian received this honor - "salivary response in dogs" " classical conditioning"
Extinction
IN classical conditioning, the weakening and eventual disappearance of the conditioned response as a result of repeated presentation of the conditioned stimulus without the unconditioned stimulus
Inhibitory Effect
Suppressing a behavior because a model is punished for displaying the behavior
Disinhibitory Effect
Displaying a previously suppressed behavior because a model does so without receiving punishment
Elicitation Effect
Exhibiting a behavior similar to that shown by a model in an unfamiliar situation
Modeling Effect
Learning a new behavior form a model through the acquisition of new responses
Model
the individual who demonstrates a behavior or what behavior is imitated
Token Economy
a program that motivates socially desirable behavior by reinforcing it with tokens that can be exchanged for desired items or privileges
Behavior Modification
a method of changing behavior thorugh a systematic program based on the learning principles of classical conditioning aperant conditioning on observational learning
Bio-feedback
the use of sensitive equipment to give people precise feedback about internal physiological processes so that they can learn, with practice to exercise control over them
Avoidance Learning
Learning to avoid events or condition associated with adverse consequences or phobias
Punishment
a decrease in the frequency of a behavior caused by some kind of consequence
Partial Reinforcement Effect
the greater resistance to extinction that occurs when a portion, rather than all, of the correct responses are reinforced
Schedule of reinforcement
a systematic process for administering partial reinforcement that produces a distinct rate and pattern of responses and degree of resistance to extinction
Partial Reinforcement
a pattern of reinforcement in which some but not all correct responses are reinforced
Mary Cover Jones
the researcher that paired a pleasant stimulus (a favorite food) with the feared object (rabbit) to use classical conditioning to rid "little peter" of his fear of rabits
Little Peter
Made child fear a white rabbit and counterconditioned him to be less and less afraid of the rabbit by having it in the vicinity and presenting something he likes at the same time, lessening the fear.
Physiology
the study of how the body and its parts work or function
Escape Learning
a type of learning in which an organism acquires a response that decreases or ends some aversive stimulation
Partial Reinforcement
reinforcing a response only part of the time; results in slower acquisition of a response but much greater resistance to extinction than does continuous reinforcement.
Partial Reinforcement Effect
the tendency for a response that is reinforced after some, but not all, correct responses to be very resistant to extinction
Schedule of Reinforcement
a timetable for when and how often reinforcement for a particular behavior occurs
Avoidance Learning
learning that has occurred when an organism engages in a response that prevents aversive stimulation from occurring
Biofeedback
a system for electronically recording, amplifying, and feeding back information regarding a subtle physiological state, such as blood pressure or muscle tension
Behavior Modification
psychotherapy that seeks to extinguish or inhibit abnormal or maladaptive behavior by reinforcing desired behavior and extinguishing undesired behavior
Token Economy
an operant conditioning procedure in which people earn a token of some sort for exhibiting a desired behavior and can later exchange the tokens for various privileges or treats.
Partial Reinforcement
reinforcing a response only part of the time; results in slower acquisition of a response but much greater resistance to extinction than does continuous reinforcement
Schedules of Reinforcement
the rule for determining when and how often reinforcers will continue; Four types of schedules: fixed ratio, variable ratio, fixed interval, and variable interval; interval means over a time and ratio means an act; partial reinforcement is on a variable schedule whereas continuous reinforcement is on a fixed schedule; variable schedules are more effective in learning
Partial-Reinforcement Effect
a phenomenon in which behaviors learned under a partial reinforcement schedule are more difficult to extinguish than behaviors learned on a continuous reinforcement schedule
Aggressive Behavior
Belligerently or violently confronting another with your preferences, feelings, needs, or rights with little regard for the situation or for the feelings or rights of others
Bobo Doll
(bop bag) experiment held in 1940s; kids placed in room with bobo doll and hammer, nothing happened; second group show movie where adult hits bag with hammer and the kids followed suit when placed with bag and hammer; people's behavior can become more violent as a result of violent media
Inhibitory Effect
suppressing a behavior because a model is punished for displaying the behavior
Socio-Cognitive Learning
Language develops from the interaction of language, cognitive and social knowledge are parts of human development
Elicitation Effect
exhibiting a behavior similar to that shown by a model in an unfamiliar situation
Disinhibitory Effect
displaying a previously suppressed behavior because a model does so without receiving punishment
Modeling Effect
Learning a new behavior from a model through the acquisition of new responses
Model
the act of representing something (usually on a smaller scale)
Albert Bandura
Bobo doll and observational learning
Observation Learning
observer must be physically capable of performing a behavior; observer must be cognitiviely capable of performing a behavior and motivated to perform a behavior
Tolman
called mental picture a cognitive map
Kohler (Wolfgang)
believed such learning took place because of a cognitive concept called insight
Skinner
doesn't belong with Kohler, Tolman or Bandura
Modeling effect
step by step process - first learned to do wash
Primary Reinforcers
Food, water and sleep
Elicitation Effect
whenever you observe how others are dressed as a means for determining how you dress in a particular social setting, the observational learning taking place is known as the ...
Respodet Conditioning
is learning by assocation (as is Pavlovian and classical)
Skinner
shaping; operant via box