Operant Conditioning

Operant conditioning, also known as instrumental conditioning, is a form of associative learning. An organism learns to associate a behavior with its consequence.

When an action is followed by a reward, we’re more likely to repeat it; when it’s followed by a punishment, we tend to avoid it.

• Reinforcement: A consequence that strengthens a behavior, making it more likely to occur in the future.
• Punishment: A consequence that weakens a behavior, making it less likely to occur in the future.

B.F. Skinner’s theory of operant conditioning shows how rewards and consequences shape behavior, from animal tricks to human motivation at school and work.

Consequence	What happens	Effect on behavior	Example
Positive reinforcement	Add a pleasant stimulus	Increases	Praise for good work
Negative reinforcement	Remove an unpleasant stimulus	Increases	Turning off a blaring alarm
Positive punishment	Add an unpleasant stimulus	Decreases	Giving extra chores after misbehavior
Negative punishment	Remove a pleasant stimulus	Decreases	Taking away a games console

1. Positive Punishment:

   • Positive punishment means adding an unpleasant stimulus right after a behavior, to make that behavior less likely to happen again.
   • It aims to weaken the target behavior by associating it with an undesirable consequence.
   • Example: A child receives a scolding (an aversive stimulus) from their parent immediately after hitting their sibling. This is intended to decrease the likelihood of the child hitting their sibling again.

2. Negative Punishment:

   • Negative punishment means removing a desirable stimulus right after a behavior, to make that behavior less likely to happen again.
   • It aims to weaken the target behavior by taking away something the individual values or enjoys.
   • Example: A teenager loses their video game privileges (a desirable stimulus) for not completing their chores. This is intended to decrease the likelihood of the teenager neglecting their chores in the future.

There are many problems with using punishment, such as:

• Behavior Is Suppressed, Not Forgotten: Punishment suppresses a response in the short term without weakening it (Estes, 1970). Once the punishment stops, the undesired behavior often reemerges.
• Risk of Fear and Aggression: Punishment may generate fear, avoidance, or aggression, potentially normalizing aggression as a way to cope with problems (Campbell & Church, 1969).
• Lack of Guidance: Punishment only shows what not to do. It does not teach the desired alternative. Reinforcing that alternative works best (Azrin & Holz, 1966).

Skinner (1953) argued that reinforcement is far more potent than punishment. You cannot teach anything new by punishment alone. He urged teachers and parents to reward desirable behavior, “catching students being good,” rather than suppress undesirable behavior.

Habituation and Continuous Punishment

Habituation helps explain why continuous punishment often loses its effectiveness if applied too frequently or predictably.

If an individual is punished every time a behavior occurs, they may initially suppress that behavior. With repeated exposure, though, the emotional or motivational impact of the punishment can fade.

The person becomes desensitized to the punishment. It is much like how one stops noticing background noise.

In operant conditioning terms:

• Continuous punishment can lead to habituation, reducing the aversive stimulus’s power over time.

• Intermittent punishment (occasional and unpredictable) tends to remain more effective because the individual cannot anticipate it and thus doesn’t fully adapt.

So, while reinforcement often benefits from consistency, punishment is subject to diminishing returns when it becomes predictable, partly due to habituation.

Negative Reinforcement vs. Punishment: The Key Distinction

The key distinction between negative reinforcement and punishment is in their effect on future behavior:

• Negative Reinforcement = Increases the likelihood of a behavior being repeated.

• Punishment = Decreases the likelihood of a behavior being repeated.

The confusion arises because both processes involve an aversive or unpleasant stimulus, but the way that stimulus is used fundamentally changes the outcome.

A simple memory aid: “positive” and “negative” mean a stimulus is added or removed, while “reinforcement” and “punishment” mean behavior is strengthened or weakened.

Examples of Operant Conditioning

1. Positive Reinforcement (Social Media ‘Likes’)

Users on social media platforms often post content in anticipation of receiving “likes,” comments, and shares. 

These notifications act as small rewards, encouraging users to continue posting and staying active on the platform.

2. Positive Reinforcement (Sports Coaching)

Suppose you are a coach and want your team to improve their passing accuracy in soccer. 

When the players execute accurate passes during training, you praise their technique.

This positive feedback encourages them to repeat the correct passing behavior.

3. Positive Reinforcement (Pet Training)

Training a cat to use a litter box can be achieved by giving it a treat each time it uses it correctly. The cat will associate the behavior with the reward and likely repeat it.

Professional trainers add a clicker, a secondary reinforcer that marks the exact instant of the correct response before food follows (Skinner, 1951). Guide-dog, police-dog and marine-mammal training rest on the same principles.

4. Negative Punishment (Teen Curfew)

If teenagers stay out past their curfew, their parents might take away their gaming console for a week.

Losing the console increases the likelihood they will respect curfew in the future to avoid losing something they value.

The scenario fits negative punishment because:

• The parents are removing something pleasant (the gaming console)
• This is done to decrease an undesired behavior (breaking curfew)
• The teen is motivated to follow curfew in the future to avoid losing something they value

5. Negative Reinforcement (Teen Curfew)

If teenagers stay out past their curfew, their parents might nag them. Once the teen starts coming home on time, the parents stop nagging, removing something unpleasant.

The parents remove something unpleasant (nagging) to increase a desired behavior (respecting curfew).

The scenario fits negative reinforcement because:

• Something unpleasant (nagging) is being removed
• This removal occurs when the teen performs the desired behavior (respecting curfew)
• The removal of the unpleasant stimulus increases the likelihood of the desired behavior continuing

6. Positive Punishment (to Discourage Tardiness)

A manager might require chronically late employees to complete extra paperwork or tasks each time they arrive past their start time.

This additional burden (the unpleasant stimulus) is introduced in direct response to lateness, aiming to discourage employees from repeating the behavior.

The scenario fits positive punishment because:

1. Something unpleasant (extra paperwork or tasks) is being added or introduced
2. This addition occurs as a direct consequence of an undesired behavior (arriving late)
3. The purpose is to decrease the frequency of the undesired behavior (tardiness)

In behavioral psychology, positive punishment means adding an unpleasant stimulus after an unwanted behavior. This makes that behavior less likely to happen again.

The key components that make this positive punishment:

• “Positive” in this context means addition (adding something)
• “Punishment” means the goal is to decrease a behavior
• The extra work serves as an aversive stimulus that employees will want to avoid

This differs from the other three consequence types:

• Positive reinforcement: adding something pleasant to increase behavior.
• Negative reinforcement: removing something unpleasant to increase behavior.
• Negative punishment: removing something pleasant to decrease behavior.

7. Ineffective Punishment (Child’s Eating Habits)

Your child refuses to finish their vegetables at dinner. You punish them by withholding dessert, but the child still refuses to eat vegetables next time.

The punishment seems ineffective in shaping the desired behavior.

Here’s why it’s ineffective:

1. Lack of behavior change: Despite implementing a punishment (withholding dessert), the child continues to refuse eating vegetables in future meals.

   The key indicator of effectiveness in behavioral modification is whether the undesired behavior decreases over time.

2. Punishment without learning: The child may be willing to accept the punishment (no dessert) rather than comply with eating vegetables. This suggests the aversiveness of eating vegetables outweighs the reward of dessert.
3. Possible reinforcement: The child might be reinforced by the attention received during the power struggle. Or they may simply be reinforced by successfully avoiding something they dislike.
4. Failure to address underlying issues: The punishment doesn’t address why the child refuses vegetables (taste preferences, texture sensitivities, desire for autonomy, etc.).

For punishment to be effective, it typically needs to be:

• Immediate
• Consistent
• Proportionate
• Paired with positive reinforcement of alternative behaviors
• Accompanied by clear communication about desired behaviors

8. Premack Principle Application:

• You could motivate your child to eat vegetables by offering an activity they love after they finish their meal.
• For instance, for every vegetable eaten, they get an extra five minutes of video game time. They value video game time, which might encourage them to eat vegetables.

This is an example of the Premack Principle because:

1. High-probability behavior as reinforcer: A frequent behavior, like playing video games, reinforces a less frequent one, like eating vegetables. Video game playing, which the child already wants to do, reinforces vegetable eating, which the child resists.

2. Contingency relationship: The principle sets up a clear “first this, then that” rule. The child completes the less preferred activity first, then gains access to the preferred one.

3. Natural reinforcement: The reinforcer, video game time, is something the child already enjoys. That makes it natural and meaningful rather than artificial.

4. Proportional reward: Each vegetable eaten earns five extra minutes of game time, a clear, proportional link between behavior and reward.

5. Positive approach: Unlike punishment-based strategies, this approach encourages the desired behavior through positive means. It tends to work better for long-term change and avoids negative feelings about eating vegetables.

Other Premack Principle Examples:

• A student who dislikes history but loves art might earn extra time in the art studio for each history chapter reviewed.
• For every 10 minutes a person spends on household chores, they can spend 5 minutes on a favorite hobby.
• For each successful day of healthy eating, an individual allows themselves a small piece of dark chocolate at the end of the day.
• A child can choose between taking out the trash or washing the dishes. Giving them the choice makes them more likely to complete the chore willingly.

Skinner’s Pigeon Experiment

B.F. Skinner conducted several experiments with pigeons to demonstrate the principles of operant conditioning.

One of the most famous of these experiments is often colloquially referred to as “Superstition in the Pigeon.”

Skinner used the experiment to explore non-contingent reinforcement. The observations resembled human superstitions.

Non-contingent reinforcement (NCR) refers to a method in which rewards (or reinforcements) are delivered independently of the individual’s behavior. In other words, the reinforcement is given at set times or intervals, regardless of what the individual is doing.

Skinner drew a direct parallel with human superstition: a card player’s lucky ritual, or a bowler who gestures to influence a ball already in motion.

The study shows how blind reinforcement is to whether a response actually caused the reward. It also draws a clear parallel between animal and human behavior.

It elegantly shows that contiguity alone is enough for conditioning. Later researchers argued that some rituals may partly reflect species-typical behaviors during waiting rather than pure operant shaping. That qualifies the demonstration but does not overturn it.

Schedules of Reinforcement

Imagine a rat placed in a “Skinner box.”

In operant conditioning, if pressing a lever is no longer followed by a food pellet, the rat will eventually stop pressing it.

In other words, the behavior is extinguished. Extinction means the learned behavior fades without reinforcement. A person might likewise stop working if unpaid.

Behaviorists found that the pattern of reinforcement, how and when rewards are given, has powerful effects. It shapes both the rate of learning and the resistance to extinction.

In a classic study, Ferster and Skinner (1957) systematically varied the timing and frequency of reinforcement. Different schedules produced distinct, reproducible behavioral patterns.

• The Response Rate: the rate at which the rat pressed the lever, or how hard the rat worked.
• The Extinction Rate: the rate at which lever pressing dies out, or how soon the rat gave up.

The method mattered as much as the schedules. Earlier apparatus, such as Thorndike’s puzzle box, imposed discrete trials that the experimenter defined and timed. That hid the rate of responding.

In a free-operant procedure, the animal can respond at any time. Its rate of responding became the basic measure, not trial-completion time or error count (Skinner, 1963).

Responses were logged as a cumulative record. In it, “rate and changes in rate are visible at a glance over substantial periods of time” (Skinner, 1963).

Skinner found that variable-ratio reinforcement produces the slowest rate of extinction (i.e., people will continue repeating the behavior for the longest time without reinforcement).

The type of reinforcement with the quickest rate of extinction is continuous reinforcement.

This pattern is the partial-reinforcement extinction effect. Behaviors learned on partial (intermittent) schedules take longer to acquire but resist extinction far better than those learned on continuous reinforcement.

Variable schedules produce the steadiest responding because the organism cannot predict when the next reward will come.

The practical lesson is simple. Use continuous reinforcement to teach a new response, then shift gradually to a partial schedule so the behavior lasts.

The table compares the five main schedules.

Schedule	Rule	Response rate	Resistance to extinction	Human example
Continuous	Every response is reinforced	Slow but steady	Very low (quickest to extinguish)	A tip for every customer
Fixed ratio	Reinforced after a fixed number of responses	Fast, with a pause after each reward	Medium	Piece work; sales commission
Variable ratio	Reinforced after an unpredictable number of responses	Very fast and steady	Very high (slowest to extinguish)	Gambling; social media notifications
Fixed interval	Reinforced for the first response after a fixed period	Medium; speeds up as the interval elapses, then pauses (a “scallop”)	Medium	Weekly or monthly pay
Variable interval	Reinforced for the first response after an unpredictable period	Fast and very stable	High (slow to extinguish)	Checking email

(A) Continuous Reinforcement

An animal or human is positively reinforced every time a specific behavior occurs. For example, a pellet is delivered every time a lever is pressed, then food delivery is shut off.

• Response rate is SLOW
• Extinction rate is FAST

(B) Fixed Ratio Reinforcement

Behavior is reinforced only after it occurs a set number of times, for example after every fifth correct response. A child might receive a star for every five words spelled correctly.

• Response rate is FAST
• Extinction rate is MEDIUM

(C) Fixed Interval Reinforcement

One reinforcement is given after a fixed time interval providing at least one correct response has been made.

An example is being paid by the hour. In the Skinner box, a pellet might be delivered every 15 minutes if at least one lever press was made. Food delivery is then shut off.

• Response rate is MEDIUM
• Extinction rate is MEDIUM

(D) Variable Ratio Reinforcement

Behavior is reinforced after an unpredictable number of times, as in gambling or fishing.

• Response rate is FAST
• Extinction rate is SLOW (very hard to extinguish because of unpredictability)

(E) Variable Interval Reinforcement

Once at least one correct response has been made, reinforcement is given after an unpredictable amount of time, for example every 5 minutes on average.

An example is a self-employed person being paid at unpredictable times.

• Response rate is FAST
• Extinction rate is SLOW

Extinction, Spontaneous Recovery, and Stimulus Control

Extinction happens when reinforcement stops and the learned behavior fades. How quickly it fades depends on reinforcement history. Continuously reinforced behaviors extinguish fastest, and variable-ratio behaviors slowest.

Extinguished behavior can return. Spontaneous recovery is the reappearance of an extinguished response after a rest interval, as in classical conditioning (Skinner, 1938).

Operant behavior also comes under stimulus control. Once lever pressing has been reinforced, it becomes more likely in the presence of the stimuli that signaled reinforcement. The response is never certain, only more probable.

A discriminative stimulus is a signal in whose presence a response is reinforced but in whose absence it is not. A rat reinforced only when a light is on comes to press the lever only when the light is on (Skinner, 1953).

Generalization means responding similarly to similar stimuli. Discrimination means responding differently to different stimuli. Both occur in operant as well as classical conditioning.

Applications In Psychology

1. Behavior Modification Therapy

Behavior modification is a set of therapeutic techniques based on the principles of operant conditioning (Skinner, 1938, 1953).

The core idea is that behavior can be changed by altering the environmental events that follow it. Consequences reinforce desired behaviors and reduce undesired ones.

However, this isn’t as simple as it sounds. Always reinforcing desired behavior, for example, can become a form of bribery if not applied carefully.

There are two main types of reinforcement:

• Primary reinforcement: A reward that naturally strengthens behavior (e.g., food, comfort).

• Secondary reinforcement: A stimulus that becomes rewarding because it leads to a primary reinforcer (e.g., money, tokens, praise).

Common behavior modification techniques include token economies and behavior shaping.

Token Economy

A token economy is a system where specific behaviors are reinforced with tokens (secondary reinforcers) that can later be exchanged for rewards (primary reinforcers). Tokens might include stickers, points, or fake money. Rewards range from snacks to privileges or preferred activities.

The token bridges the delay between the target behavior and the primary reinforcer. It also makes it practical to reinforce many people consistently.

For example, teachers may give stickers to young children for good behavior in class. Token economies are also widely used in psychiatric hospitals and prisons to encourage positive behaviors. One landmark study shows this works.

The study also exposed a hidden contingency. Nursing staff had been inadvertently reinforcing withdrawn or bizarre behavior by attending to it.

Later controlled comparisons confirmed that token programs work for chronic patients (Paul & Lentz, 1977). But gains do not always last. Participants can become over-reliant on the tokens, making it harder to adjust to everyday life once the system is removed.

Because of this, staff must apply tokens fairly and consistently, ensuring equal treatment and continuity even during staff rotations.

Behavior Shaping

Behavior shaping, introduced by Skinner (1951), refers to the gradual training of complex behaviors through successive approximation. The individual is rewarded for behaviors that progressively resemble the desired response.

Each time the person or animal moves closer to the target behavior, the criteria for reinforcement become more specific. Over time, small steps accumulate into significant behavioral change.

A classroom example shows how the contingency shifts. A teacher shaping a pupil to work for a whole lesson might:

1. Reward the pupil for working on task for a short period, say ten minutes of the hour.
2. Gradually require longer and longer periods of work to earn the reward.
3. Reward only on-task work for the entire lesson, then introduce new desirable behaviors.

This is how Skinner taught pigeons to play table tennis or turn a full circle (Skinner, 1953). Chaining extends the same logic to sequences, such as dressing or a gymnastics tumble, by reinforcing each link in order.

Skinner proposed that many forms of human and animal behavior, including language, can be explained by this process of gradual reinforcement. Chomsky (1965) later disputed that claim.

In modern therapy, shaping plays a central role in cognitive-behavioral therapy (CBT).

For example, therapists use successive approximation to help clients overcome phobias or severe anxiety. They reward small, manageable steps toward facing the feared situation until the client can confront it fully.

2. Educational Applications

In the conventional learning situation, operant conditioning applies largely to issues of class and student management, rather than to learning content. It is very relevant to shaping skill performance.

A simple way to shape behavior is to provide feedback on learner performance, e.g., compliments, approval, encouragement, and affirmation.

From Continuous to Intermittent Reinforcement

Continuous reinforcement suits students learning a new task. Initial reinforcement, such as praise, follows almost every attempt. As performance improves, reinforcement becomes intermittent, until eventually only exceptional outcomes are reinforced.

For example, a teacher who wants students to answer questions in class should praise every attempt at first, regardless of whether the answer is correct. Correctness comes later.

Gradually the teacher praises only correct answers, and over time only exceptional answers are praised.

Unwanted behaviors, such as tardiness or dominating class discussion, can be extinguished by being ignored rather than reinforced with attention.

This is not an easy task, as the teacher may appear insincere if he/she thinks too much about the way to behave.

Success matters too. It motivates future learning. However, it is important to vary the type of reinforcement given so that the behavior is maintained.

Operant Conditioning vs. Classical Conditioning

The table summarizes the main differences. The sections below explain the learning type, the learning process and the timing.

Feature	Classical conditioning	Operant conditioning
Response	Elicited: triggered automatically, reflexive and involuntary	Emitted: voluntary and active
Learner	Passive; no reward or punishment needed	Active; learns from consequences
What is learned	An association between two stimuli	An association between a behavior and its consequence
Certainty	The stimulus is guaranteed to produce the response	The response is more or less probable, but never certain
What changes	New stimulus-response connections are formed	Existing response tendencies are strengthened or weakened
Timing	The unconditioned stimulus comes before the response, whatever the behavior	The consequence comes after the response, and only if the behavior occurs
Measure of strength	Response magnitude or latency	Response rate

Learning Type

While both types of conditioning involve learning, classical conditioning is passive (automatic response to stimuli), while operant conditioning is active (behavior is influenced by consequences).

• Classical conditioning links an involuntary response with a stimulus. It happens passively on the part of the learner, without rewards or punishments. An example is a dog salivating at the sound of a bell associated with food.
• Operant conditioning connects voluntary behavior with a consequence. Operant conditioning requires the learner to actively participate and perform some type of action to be rewarded or punished. It’s active, with the learner’s behavior influenced by rewards or punishments. An example is a dog sitting on command to get a treat.

Learning Process

Classical conditioning involves learning through associating stimuli resulting in involuntary responses, while operant conditioning focuses on learning through consequences, shaping voluntary behaviors.

1. Learning by Association (Classical Conditioning):

In learning by association, a person (or animal) learns to associate two stimuli, causing a behavior change. A neutral stimulus is paired with an unconditioned stimulus that naturally triggers a response.

Over time, the person responds to the neutral stimulus as if it were the unconditioned stimulus, even when presented alone. The response is involuntary and automatic.

An example is a dog salivating (response) at the sound of a bell (neutral stimulus) after it has been repeatedly paired with food (unconditioned stimulus).

2. Learning by Consequences (Operant Conditioning):

In learning by consequences, behavior is learned based on its outcomes or consequences. The learner is active, and the response is voluntary.

Behavior followed by pleasant consequences (rewards) is more likely to be repeated, while behavior followed by unpleasant consequences (punishments) is less likely to be repeated.

For instance, if a child gets praised (pleasant consequence) for cleaning their room (behavior), they’re more likely to clean their room in the future.

Conversely, if they get scolded (unpleasant consequence) for not doing their homework, they’re more likely to complete it next time to avoid the scolding.

Timing of Stimulus & Response

The timing of the response relative to the stimulus differs between classical and operant conditioning:

1. Classical Conditioning (response after the stimulus):

In this form of conditioning, the response occurs after the stimulus.

The behavior (response) is determined by what precedes it (stimulus). 

For example, in Pavlov’s classic experiment, the dogs started to salivate (response) after they heard the bell (stimulus) because they associated it with food.

2. Operant Conditioning (consequence after the response):

In this form of conditioning, the response comes first and the consequence follows, but only if the behavior occurs.

The anticipated consequence then influences whether the behavior is repeated.

It is a more active form of learning, where behaviors are reinforced or punished, thus influencing their likelihood of repetition.

For example, a child might behave well (behavior) in anticipation of a reward (consequence), or avoid a certain behavior to prevent a potential punishment.

Summary

Looking at Skinner’s classic studies on pigeons’ and rats’ behavior, we can identify some of the major assumptions of the behaviorist approach.

• Psychology should be seen as a science, to be studied in a scientific manner. Skinner’s study of behavior in rats was conducted under carefully controlled laboratory conditions.

• Behaviorism is primarily concerned with observable behavior, as opposed to internal events like thinking and emotion. Note that Skinner did not say that the rats learned to press a lever because they wanted food. He instead concentrated on describing the easily observed behavior that the rats acquired.

• The major influence on human behavior is learning from our environment. In the Skinner study, because food followed a particular behavior the rats learned to repeat that behavior, e.g., operant conditioning.

• There is little difference between the learning that takes place in humans and that in other animals. Therefore research (e.g., operant conditioning) can be carried out on animals (Rats / Pigeons) as well as on humans. Skinner proposed that the way humans learn behavior is much the same as the way the rats learned to press a lever.

Picture a layperson’s idea of psychology: people in white coats, watching rats negotiate mazes to reach their dinner. That image is behavioral psychology.

Behaviorism and its offshoots tend to be among the most scientific of the psychological perspectives. The emphasis of behavioral psychology is on how we learn to behave in certain ways.

We are all constantly learning new behaviors and how to modify our existing behavior.

Behavioral psychology studies how this learning happens.

Critical Evaluation

Operant conditioning explains a broad range of learned behaviors. But it does not fully capture internal thought processes, inherent predispositions, or the social side of learning.

Operant conditioning has three main strengths:

• Rigorous and objective: Defining behavior functionally and recording response rate automatically made learning a replicable experimental science (Skinner, 1938).
• Highly applicable: Token economies, shaping, contingency management and humane animal training all rest on it, and meta-analyses now back the applied claims (Bentzley et al., 2021).
• Well-specified variables: Schedules of reinforcement are a predictive body of law, explaining phenomena from gambling persistence to effort under monthly pay (Ferster & Skinner, 1957).

The key criticisms emphasize cognitive, biological and social considerations:

• Biological preparedness: Some associations, such as taste and illness, are learned far more readily than others (Garcia & Koelling, 1966).
• Insight: Chimpanzees solved problems in sudden bursts of understanding rather than by trial and error (Kohler, 1924).
• Observational learning: People can learn by watching others, without direct reinforcement (Bandura, 1977).
• Language: Chomsky argued that innate linguistic structures, not reinforcement, drive language acquisition (Chomsky, 1965).
• Overjustification: Extrinsic rewards can undermine intrinsic motivation (Lepper, 1983).
• Animal-to-human extrapolation: Findings from rats and pigeons may not capture human language, culture and self-awareness.
• Learned helplessness: The controllability of consequences, not only their occurrence, shapes behavior (Seligman, 1975).
• Latent learning: Rats learned a maze without reward, so reinforcement affects performance more than learning (Tolman & Honzik, 1930).

1. The Biological Challenge (Preparedness)

A key biological critique of behaviorism comes from the concept of biological preparedness (Garcia & Koelling, 1966).

Their research on taste-aversion learning showed that animals are biologically predisposed to form some associations far more readily than others. Taste and illness pair up easily. Sound and illness do not.

In their classic study, rats exposed to sweetened water followed by nausea quickly learned to avoid that flavor, even when the sickness occurred hours later.

However, the same rats did not learn to associate nausea with a light or tone paired with the drink.

These findings suggest that learning is not governed by uniform, universal laws of conditioning, as strict behaviorists proposed. Evolutionary factors instead shape what an organism can easily learn.

Biological preparedness therefore highlights the interaction between learning processes and innate biological constraints, challenging the idea that all behaviors can be explained through conditioning alone.

2. Insight and “Aha!” Moments

Kohler (1924) had chimpanzees solve problems such as retrieving food placed out of reach. They solved them in sudden bursts of insight, not through incremental trial and error.

In one example, a chimp stacked boxes or combined tools to reach a banana hanging overhead. It seemed to grasp the solution spontaneously.

These observations suggest that learning can involve cognitive restructuring and problem-solving, elements that a purely operant framework does not fully address.

3. Observational Learning

Social Learning Theory (Bandura, 1977) proposes that people can acquire new behaviors simply by observing others, without needing to experience reinforcement or punishment firsthand.

In Bandura’s classic Bobo Doll experiment, children who watched adults act aggressively toward an inflatable doll later imitated those same aggressive behaviors.

This demonstrated observational learning: learning that occurs vicariously, through watching rather than direct experience. No reward was needed.

Bandura emphasized the role of cognitive processes such as attention, memory, and motivation.

These internal factors help explain why individuals imitate certain behaviors and not others, extending beyond the limits of traditional operant conditioning.

The expectation of a future consequence, a cognitive factor, is enough to influence behavior.

Operant conditioning focuses on learning through direct consequences. Bandura argued that much of human learning is latent, formed through mental rehearsal, observation, and expectation rather than trial-and-error.

Concepts like cognitive mapping and expectancy reveal that internal mental processes play a vital role that pure behaviorism cannot fully explain.

4. Linguistic and Innate Structures

Noam Chomsky (1965) famously challenged behaviorist explanations of language acquisition. Humans, he argued, possess innate linguistic capacities, often called a “language acquisition device.”

Children around the world master grammar and syntax rapidly. Reinforcement alone cannot explain that.

Instead, the presence of universal grammar rules suggests a built-in framework guiding language development.

Operant conditioning alone cannot account for the speed and complexity of acquiring language. Inherited cognitive structures, these arguments suggest, play a crucial role too.

5. Overjustification Effect

People who are repeatedly rewarded for a task they already find enjoyable can experience the overjustification effect: a decline in intrinsic motivation (Lepper, 1983).

For example, a child who loves drawing may draw less once they start being rewarded for it with candy or praise. Once the reward is removed, motivation can drop sharply.

Extrinsic reinforcers can shape behavior in the short term. But they sometimes undermine the internal satisfaction that originally drove the activity.

6. Animal-to-Human Extrapolation

Because much of operant conditioning research involves animal subjects, rats, pigeons, and other species, critics caution against generalizing these findings directly to humans.

Human cognition is shaped by complex language, self-awareness, culture, and nuanced emotional processes, which might not be captured in animal experiments.

Basic principles of reinforcement and punishment can transfer across species. But the depth and variability of human thought mean our behavior may not always match the patterns seen in lab animals.

7. Practical Applications

Operant conditioning helps explain a wide range of behaviors, including learning, addiction, and language acquisition. It is applied in settings such as classrooms, prisons, and psychiatric hospitals through token economies.

Researchers have also developed innovative ways to use operant conditioning for improving health and changing habits:

• Stroke Rehabilitation (Kumar et al., 2019)
  A virtual-reality system rewarded patients with stars for shifting weight onto their weakened limb. In a single session, 29 patients made significantly more use of the weakened leg, a promising but small proof of concept.

• Smoking Cessation (Dallery et al., 2008)
  Eight smokers were assigned to recoup a $50 deposit or earn vouchers for verified reductions in smoking. Both approaches reduced smoking equally, but the deposit contract cost less.

• Exercise and Healthy Eating (Michie et al., 2009)
  A meta-regression of 122 evaluations (N = 44,747) found self-monitoring most effective, especially when combined with another self-regulation technique (effect size 0.42 vs. 0.26). Operant principles suggest adding rewards, such as TV time for every 10 minutes of exercise.

• Mobile Apps and Habit Tracking (Eckerstorfer et al., 2018)
  Apps such as Habitica award points for real-life tasks. Evidence for rewards is limited. A meta-analysis of 50 trials (N = 5,997) found a small overall effect (g = 0.29), with goal-setting and self-monitoring each raising success.

• OCD Management (Twohig et al., 2010)
  Within exposure-and-response-prevention treatment, reinforcing patients with OCD for resisting compulsions is an established component that can reduce obsessive behaviors.

8. Contemporary Research

Directly rewarding abstinence is now among the best-evidenced behavioral treatments for substance use.

The strongest evidence comes from systematic reviews and meta-analyses, not single studies. They sit near the top of the evidence pyramid.

Bentzley et al. (2021) reviewed treatments for cocaine use disorder. The condition has no approved medication.

They pooled 157 clinical trials (402 treatment groups, 15,842 outpatients) published between 1995 and 2017. Eleven treatment categories were compared, including psychotherapy, placebo and several drug classes.

Only contingency management, earning vouchers or privileges for biochemically verified abstinence, was significantly linked to a cocaine-negative urine test (odds ratio 2.13; 95% CI 1.62–2.80). That more than doubles the odds.

The result held in every sensitivity analysis.

A parallel Cochrane overview pooled 312 randomized smoking-cessation trials with 250,563 participants.

It found high-certainty evidence that guaranteed financial incentives raise quit rates (odds ratio 1.46; 95% credibility interval 1.15–1.85), based on 19 trials (Hartmann-Boyce et al., 2021).

Two apex-level syntheses agreeing on direct reinforcement is stronger evidence than many small single-site trials. Together they confirm the same principle at population scale.

9. Learned Helplessness

Seligman (1974/1975) gave dogs shocks they could not escape. Later, the same dogs faced a shock they could easily escape, but many did not even try.

They had learned that nothing they did changed the outcome, and that lesson carried over even when escape became possible. Seligman called this passive giving-up learned helplessness.

The finding matters because it shows that controllability, not just the shock itself, shapes behavior. It became an influential model of human depression. There, a person’s belief that their actions cannot change a bad situation may keep them stuck.

10. Latent Learning and Cognitive Maps

Latent learning shows that reinforcement is not necessary for learning.

Tolman and Honzik (1930) left one group of rats unrewarded in a maze for ten days. These rats showed no apparent progress.

On day 11 the rats were first rewarded, and their performance immediately matched that of rats rewarded throughout. The learning had been acquired all along. It stayed latent until the rats had a motive to show it.

Tolman (1948) argued that the rats had built cognitive maps, internal representations of the maze, without reinforcement. The finding separates learning from performance. Reinforcement affects what an animal does more than what it has learned.

Ethical Implications

While operant conditioning is widely used in education, therapy, business, and technology, its ethical implications raise important concerns.

Critics argue that certain applications, particularly those involving punishment, animal research, and extrinsic reward, may have unintended negative consequences. 

1. The Use of Punishment: Fear, Aggression, and Emotional Harm

Punishment is often used to reduce undesirable behaviors, but it can lead to unintended emotional and psychological consequences.

Positive punishment (e.g., scolding, fines, physical punishment) can generate fear and anxiety rather than teaching constructive alternatives.

Similarly, negative punishment (e.g., loss of privileges) may create resentment rather than behavioral improvement.

• Example: In a workplace, fining employees for late arrivals may increase stress rather than improve punctuality.
• Potential Consequences: Punished behaviors may only be suppressed rather than eliminated, resurfacing in different contexts. Additionally, punishment can increase aggression, particularly if individuals learn that aggressive responses are a means of exerting control.
• Ethical Debate: Some psychologists argue that punishment should be minimized or replaced with positive reinforcement to encourage desired behaviors instead of merely discouraging negative ones.

2. Ethical Concerns in Animal Research

Much of the foundational research on operant conditioning, particularly by B.F. Skinner, was conducted on animals, such as rats and pigeons in controlled lab environments. This raises two key ethical concerns:

1. Treatment of Animals: Some experiments involved food deprivation, electric shocks, and confinement, raising concerns about the ethical treatment of research animals.
2. Extrapolation to Humans: Critics argue that findings from animal studies cannot always be applied directly to human behavior. Human cognition, emotions, and social influences add complexity animal studies miss.

• Example: Skinner’s use of electric shocks in avoidance learning experiments has been criticized for causing distress to animals.
• Ethical Debate: Should research that involves distressing procedures for animals be justified by potential human benefits? Today, research guidelines enforce stricter ethical standards, but past studies remain controversial.

3. Manipulation and Loss of Autonomy Through Rewards

A major ethical concern with operant conditioning is the potential for behavioral manipulation, particularly when individuals are unaware that they are being conditioned.

• Extrinsic vs. Intrinsic Motivation: Over-reliance on external rewards (money, grades, promotions) can reduce intrinsic motivation, known as the overjustification effect. When rewards are removed, individuals may lose interest in previously enjoyable activities.

• Unethical Use in Business & Technology: Companies use operant conditioning in advertising, workplace incentives, and social media engagement loops to subtly influence behavior.

• Examples:

  • Workplace Manipulation: Employers may use performance-based bonuses to encourage overworking without considering employee well-being.
  • Social Media Addiction: Platforms like Instagram and TikTok use intermittent reinforcement (random “likes” and notifications) to keep users engaged, creating compulsive usage patterns.
  • Consumer Behavior: Loyalty programs (e.g., rewards points, discounts) reinforce purchasing habits, sometimes encouraging unnecessary spending.

• Ethical Debate: When does conditioning cross the line into coercion? Are companies and institutions ethically responsible for ensuring that reinforcement does not lead to addiction, burnout, or financial exploitation?

4. The Ethics of Using Operant Conditioning in Education & Therapy

In settings where operant conditioning is used to shape behavior, such as classrooms, therapy, and mental health treatment, ethical considerations become particularly important.

• Token Economies in Schools & Psychiatric Hospitals: Reward-based behavior systems can be effective. Critics argue, though, that they oversimplify human motivation and may not foster genuine personal growth.
• Discipline Methods: Should children and patients be conditioned to behave in ways that primarily serve institutional convenience rather than their own well-being?
• Long-Term Effects: While reinforcement strategies can improve behavior in the short term, reliance on external rewards may not foster self-discipline or critical thinking skills.

Conclusion: Balancing Effectiveness with Ethics

While operant conditioning is a powerful tool for shaping behavior, it must be applied with caution.

Minimizing harm, promoting autonomy, and ensuring that reinforcement strategies align with ethical principles are essential when implementing operant conditioning in real-world settings.

Encouraging transparency, informed consent, and a balance between extrinsic and intrinsic motivation can help ensure ethical applications of behavior modification techniques.

Key Takeaways

• Behavior modification: Operant conditioning is a learning process that changes behavior through reinforcement and punishment.
• Reinforcement and punishment: Positive and negative reinforcement increase behavior, while positive and negative punishment decrease it.
• Reinforcement schedules: The timing and pattern of rewards affect how quickly behaviors are learned and how long they last.
• Skinner’s experiments: Studies like the Skinner Box and “superstitious pigeons” show how behavior can be shaped, even by accidental rewards.
• Real-world uses: Token economies, reward systems, and consequences are applied in classrooms, workplaces, and therapy.
• Critiques and limits: Some argue operant conditioning ignores thoughts and emotions, raising ethical and cognitive concerns.

Further Reading

• Ivan Pavlov Classical Conditioning Learning and behavior PowerPoint
• Ayllon, T., & Michael, J. (1959). The psychiatric nurse as a behavioral engineer. Journal of the Experimental Analysis of Behavior, 2(4), 323-334.

References

• Ayllon, T., & Azrin, N. H. (1968). The token economy: A motivational system for therapy and rehabilitation. Appleton-Century-Crofts.
• Azrin, N. H., & Holz, W. C. (1966). Punishment. In W. K. Honig (Ed.), Operant behavior: Areas of research and application (pp. 380–447). Appleton-Century-Crofts.
• Bandura, A. (1977). Social learning theory. Englewood Cliffs, NJ: Prentice Hall.
• Bentzley, B. S., Han, S. S., Neuner, S., Humphreys, K., Kampman, K. M., & Halpern, C. H. (2021). Comparison of treatments for cocaine use disorder among adults: A systematic review and meta-analysis. JAMA Network Open, 4(5), e218049.
• Campbell, B. A., & Church, R. M. (Eds.). (1969). Punishment and aversive behavior. Appleton-Century-Crofts.
• Chomsky, N. (1965). Aspects of the Theory of Syntax. MIT Press.
• Dallery, J., Meredith, S., & Glenn, I. M. (2008). A deposit contract method to deliver abstinence reinforcement for cigarette smoking. Journal of Applied Behavior Analysis, 41(4), 609–615.
• Eckerstorfer, L., Tanzer, N. K., Vogrincic-Haselbacher, C., Kedia, G., Brohmer, H., Dinslaken, I., & Corcoran, R. (2018). Key elements of mHealth interventions to successfully increase physical activity: Meta-regression. JMIR mHealth and uHealth, 6(11), e10076.
• Estes, W. K. (1970). Learning theory and mental development. Academic Press.
• Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. New York: Appleton-Century-Crofts.
• Garcia, J., & Koelling, R. A. (1966). Relation of cue to consequence in avoidance learning. Psychonomic science, 4(1), 123-124.
• Gray, J. A. (1975). Elements of a two-process theory of learning. Academic Press.
• Hartmann-Boyce, J., Livingstone-Banks, J., Ordóñez-Mena, J. M., Fanshawe, T. R., Lindson, N., Freeman, S. C., Sutton, A. J., Theodoulou, A., & Aveyard, P. (2021). Behavioural interventions for smoking cessation: An overview and network meta-analysis. Cochrane Database of Systematic Reviews, 2021(1), CD013229.
• Kohler, W. (1924). The mentality of apes. London: Routledge & Kegan Paul.
• Kumar, D., Sinha, N., Dutta, A., & Lahiri, U. (2019). Virtual reality-based balance training system augmented with operant conditioning paradigm. BioMedical Engineering OnLine, 18(1), Article 90. https://doi.org/10.1186/s12938-019-0709-3
• Lepper, M. R. (1983). Extrinsic reward and intrinsic motivation: Implications for the classroom. In J. M. Levine and M. C. Wang (Eds.), Teacher and student perceptions: Implications for learning (pp. 281–317). Hillsdale, NJ: Erlbaum.
• Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009). Effective techniques in healthy eating and physical activity interventions: A meta-regression. Health Psychology, 28(6), 690–701.
• Mowrer, O. H. (1960). Learning theory and behavior. John Wiley.
• Paul, G. L., & Lentz, R. J. (1977). Psychosocial treatment of chronic mental patients: Milieu versus social-learning programs. Harvard University Press.
• Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275(5306), 1593–1599. https://doi.org/10.1126/science.275.5306.1593
• Schunk, D. (2016). Learning theories: An educational perspective. Pearson.
• Seligman, M. E. P. (1974). Depression and learned helplessness. In R. J. Friedman & M. M. Katz (Eds.), The psychology of depression: Contemporary theory and research. Winston-Wiley.
• Seligman, M. E. P. (1975). Helplessness: On depression, development and death. W. H. Freeman.
• Skinner, B. F. (1938). The behavior of organisms: An experimental analysis. New York: Appleton-Century.
• Skinner, B. F. (1948). ‘Superstition’ in the pigeon. Journal of Experimental Psychology, 38(2), 168–172. https://doi.org/10.1037/h0055873
• Skinner, B. F. (1951). How to teach animals. Scientific American, 185(6), 26–29. https://doi.org/10.1038/scientificamerican1251-26
• Skinner, B. F. (1953). Science and human behavior. Macmillan.
• Skinner, B. F. (1963). Operant behavior. American Psychologist, 18(8), 503–515. https://doi.org/10.1037/h0045185
• Thorndike, E. L. (1898). Animal intelligence: An experimental study of the associative processes in animals. The Psychological Review: Monograph Supplements, 2(4), i–109. https://doi.org/10.1037/h0092987
• Tolman, E. C. (1948). Cognitive maps in rats and men. Psychological Review, 55(4), 189–208. https://doi.org/10.1037/h0061626
• Tolman, E. C., & Honzik, C. H. (1930). Introduction and removal of reward, and maze performance in rats. University of California Publications in Psychology, 4, 257–275.
• Twohig, M. P., Whittal, M. L., Cox, J. M., & Gunter, R. (2010). An initial investigation into the processes of change in ACT, CT, and ERP for OCD. International Journal of Behavioral Consultation and Therapy, 6(1), 67–83. https://doi.org/10.1037/h0100898
• Watson, J. B. (1913). Psychology as the behaviorist views it. Psychological Review, 20, 158–177.

Citation

McLeod, S. (2025, March 17). Operant conditioning: What it is, how it works, and examples. Simply Psychology. https://www.simplypsychology.org/operant-conditioning.html