Extinction of a problem behavior will be more gradual when the behavior is reinforced on a

What could cause a person or animal to stop engaging in a previously conditioned behavior? Extinction is one explanation. In psychology, extinction refers to the gradual weakening of a conditioned response that results in the behavior decreasing or disappearing. In other words, the conditioned behavior eventually stops.

For example, imagine that you taught your dog to shake hands. Over time, the trick became less interesting. You stop rewarding the behavior and eventually stop asking your dog to shake. Eventually, the response becomes extinct, and your dog no longer displays the behavior.

In classical conditioning, when a conditioned stimulus is presented alone without an unconditioned stimulus, the conditioned response will eventually cease. For example, in Pavlov's classic experiment, a dog was conditioned to salivate to the sound of a bell. When the bell was repeatedly presented without the presentation of food, the salivation response eventually became extinct.

In operant conditioning, extinction occurs when a response is no longer reinforced following a discriminative stimulus. B. F. Skinner described how he first observed this phenomenon:

"My first extinction curve showed up by accident. A rat was pressing the lever in an experiment on satiation when the pellet dispenser jammed. I was not there at the time, and when I returned I found a beautiful curve. The rat had gone on pressing although no pellets were received...

The change was more orderly than the extinction of a salivary reflex in Pavlov's setting, and I was terribly excited. It was a Friday afternoon and there was no one in the laboratory who I could tell. All that weekend I crossed streets with particular care and avoided all unnecessary risks to protect my discovery from loss through my accidental death."

Let's take a closer look at a few more examples of extinction.

Imagine that a researcher has trained a lab rat to press a key to receive a food pellet. What happens when the researcher stops delivering the food? While extinction will not occur immediately, it will after time. If the rat continues to press the key but does not get the pellet, the behavior will eventually dwindle until it disappears entirely.

Conditioned taste aversions can also be affected by extinction. Imagine that you ate some ice cream right before getting sick and throwing it up. As a result, you developed a taste aversion to ice cream and avoided eating it, even though it was formerly one of your favorite foods.

One way to overcome this reluctance would be to expose yourself to ice cream, even if just the thought of eating it made you feel a little queasy. You might start by taking just a few small tastes over and over again. As you continued to eat the food without getting sick, your conditioned aversion would eventually diminish.

If the conditioned response is no longer displayed, does that really mean that it's gone forever? In his research on classical conditioning, Pavlov found that when extinction occurs, it doesn't mean that the subject returns to their unconditioned state.

Allowing several hours or even days to elapse after a response has been extinguished can result in the spontaneous recovery of the response. Spontaneous recovery refers to the sudden reappearance of a previously extinct response.

In his research on operant conditioning, Skinner discovered that how and when a behavior is reinforced could influence how resistant it was to extinction. He found that a partial schedule of reinforcement (reinforcing a behavior only part of the time) helped reduce the chances of extinction.

Rather than reinforcing the behavior each and every time it occurs, the reinforcement is given only after a certain amount of time has elapsed or a certain number of responses have occurred. This sort of partial schedule results in behavior that is stronger and more resistant to extinction. 

A number of factors can influence how resistant a behavior is to extinction. The strength of the original conditioning can play an important role. The longer the conditioning has taken place and the magnitude of the conditioned response may make the response more resistant to extinction.

Behaviors that are very well established may become almost impervious to extinction and may continue to be displayed even after the reinforcement has been removed altogether. Some research has suggested that habituation may play a role in extinction as well. For example, repeated exposure to a conditioned stimulus may eventually lead you to become used to it, or habituated.

Because you have become habituated to the conditioned stimulus, you are more likely to ignore it and it's less likely to elicit a response, eventually leading to the extinction of the conditioned behavior.

Personality factors might also play a role in extinction. One study found that children who were more anxious were slower to habituate to a sound. As a result, their fear response to the sound was slower to become extinct than non-anxious children.

Extinction of a problem behavior will be more gradual when the behavior is reinforced on a

Extinction of a problem behavior will be more gradual when the behavior is reinforced on a

No, not that kind of extinction. :-) Extinction is a behavioral term that basically means to determine the function/cause of a behavior and then to terminate access to that function in order to extinguish the behavior. You determine what the reinforcement for the behavior is and then you withhold it. There are different types of extinction, such as Tangible Extinction (the child does not receive access to a desired item or activity) and Escape Extinction (the child does not get to avoid or escape a non-preferred task or person). Extinction is used to decrease inappropriate behaviors such as tantrums, screaming, or saliva play. Here's some real life examples of extinction:
  1. Screaming: Your client screams in the car when they want you to turn the radio on. You used to plead with him to stop screaming, now you give no response to the screaming.
  2. Crying/Tantrums: Your client tantrums at restaurants when she is ready to go home. You used to pick her up and leave the restaurant when this happened, now you stay at the restaurant and continue eating.
  3. Excessive scratching: Your client scratches at scabs or wounds excessively to the point of causing harm. You used to tell him not to do this, and sometimes place him in time out. Now you place cotton gloves on his hands so he cannot cause harm by scratching.
Notice in each example that extinction does not mean you stop the behavior. When you apply an extinction procedure the behavior may still happen. For this reason extinction isn't always an appropriate choice for a behavioral intervention. Particularly if you are dealing with very aggressive or self harming behaviors.  In my opinion another reason extinction isn't always appropriate is that it is extremely hard for non-professionals to implement. Many parents tell me that doing an extinction procedure feels wrong and counter-intuitive. There is also the ethical question of considering if there are better alternatives to traditional extinction that aren't as difficult on the client/learner to tolerate.

It might sound like an extinction procedure just means to ignore problem behaviors. There is an important distinction between Ignoring and Extinction. Ignoring is to not give your child attention because they are doing something you don't like or are seeking your attention in an inappropriate way. Extinction is a behavioral technique where you withhold reinforcement when the behavior occurs, so by definition you must know what the reinforcement is. Planned ignoring would only extinguish a behavior if the reinforcement was attention. If your client bites her arm because of sensory input and you ignore that, your ignoring will have no effect on the behavior. The child isn't biting for a reaction so you withholding a reaction doesn't matter.

Another way to understand the difference between Extinction and Ignoring is that extinction procedures will have Extinction Effects. If you are properly implementing an extinction procedure this is what it should look like:

Extinction of a problem behavior will be more gradual when the behavior is reinforced on a

This graphical display shows the course of a behavior after an extinction procedure was applied  *the path of the behavior is what is important here. Try to ignore the "bad behavior" label. This is not my graph :-)

Initially the behavior is occurring at a rate of about 20 occurrences per day. Then the intervention begins. The intervention is clearly effective, as the problem behavior almost immediately drops off in frequency. But that "Honeymoon Period" ends, and the behavior skyrockets to a frequency of 40. Then the behavior makes a gradual decline until it is at a frequency of about 5, before dropping to 0. Some parents or professionals may think at this point that the behavior has been successfully terminated and the extinction procedure can be stopped. However, that's incorrect. After some time passes the behavior pops up again a few times, before decreasing to a very low rate.

This graph is explaining that once you introduce an extinction procedure you will see the Extinction Burst, then a gradual decline in the behavior, then Spontaneous Recovery of the behavior until eventually the behavior is extinguished completely, or occurs at a very low rate.

An extinction burst is a dramatic increase in the frequency/duration/intensity of the problem behavior. To explain more simply "Its going to get worse before it gets better". From the client's point of view, he/she is doing MORE of the behavior to try and get that reaction they are used to getting.

Spontaneous recovery occurs after the behavior starts to go away and can happen even without reinforcement. You could be doing everything right and all of a sudden the behavior will pop back up. If everyone on the team is being consistent then when spontaneous recovery happens you have nothing to worry about. There's 1 more extinction effect to explain: Once you determine whats maintaining a behavior and start withholding it, now the child has no way to meet that need. So they may start engaging in new behaviors you haven't seen before. For example you may decide to start an extinction procedure with your 9 year old client for his behavior of teasing his sister. You determine that the function of teasing is attention from his sister. So you teach his sister to stop giving him attention as part of the extinction procedure. The teasing begins to decrease, but now your client has started pushing his sister. What happened? The problem is you removed the maintaining variable, but didn't replace it with anything (translation= teach new skills). Your client has no way to get his "attention fix" because his sister no longer gives him the attention reaction he wants when he teases her. So your client starts being aggressive with his sister to get a reaction out of her. The great news is if you know about this you can plan for it. Such as incorporating contingent reinforcement into your extinction plan. Think of contingent as meaning "based on".  Based on certain behaviors, you provide reinforcement. If your client talks to, hugs, or is appropriate towards his sister in any way she is free to give him attention. The extinction burst can mean the behavior increases by frequency, duration, magnitude, etc. It could also mean certain people get targeted more, such as aggression being mainly directed at the teacher, or that in specific settings the behavior is more intense.

When done correctly and consistently extinction is a powerful behavior reduction tool, but there are also many considerations that must be made before just jumping straight into an extinction procedure.

*Resources:

An Alternative to Escape Extinction

Task as Reinforcer: Alternative to Escape Extinction