Experimental Design
Saul McLeod published 2007
If you have decided that an experiment is the best approach to testing your hypothesis, then you need to design the experiment.
Experimental design refers to how participants are allocated to the different conditions (or IV levels) in an experiment.
Probably the commonest way to design an experiment in psychology is to divide the participants into two groups, the experimental group and the control group, and then introduce a change to the experimental group and not the control group.
The researcher must decide how he/she will allocate their sample to these IVs. For example, if there are 10 participants, will all 10 participants take part in both conditions (e.g. repeated measures) or will the participants be split in half and take part in only one condition each?
Three types of experimental designs are commonly used:
1. Independent Measures:
This type of design is also known as between groups. Different participants are used in each condition of the independent variable. This means that each condition of the experiment includes a different group of participants. This should be done by random allocation, which ensures that each participant has an equal chance of being assigned to one group or the other.
Independent measures involves using two separate groups of participants; one in each condition. For example:
Pro: Avoids order effects (such as practice or fatigue) as people participate in one condition only. If a person is involved in several conditions they may become bored, tired and fed up by the time they come to the second condition, or becoming wise to the requirements of the experiment!
Con: More people are needed than with the repeated measures design (i.e. more time consuming).
Con: Differences between participants in the groups may affect results, for example; variations in age, gender or social background. These differences are known as participant variables (i.e. a type of extraneous variable).
Control: After the participants have been recruited, they should be randomly assigned to their groups. This should ensure the groups are similar, on average (reducing participant variables).
2. Repeated Measures:
This type of design is also known as within groups. The same participants take part in each condition of the independent variable. This means that each condition of the experiment includes the same group of participants.
Pro: Fewer people are needed as they take part in all conditions (i.e. saves time).
Pro: As the same participants are used in each condition, participant variables (i.e., individual differences) are reduced.
Con: There may be order effects. Order effects refer to the order of the conditions having an effect on the participants’ behavior. Performance in the second condition may be better because the participants know what to do (i.e. practice effect). Or their performance might be worse in the second condition because they are tired (i.e. fatigue effect). This limitation can be controlled using counterbalancing.
Control: To combat order effects the researcher counter balances the order of the conditions for the participants. Alternating the order in which participants perform in different conditions of an experiment.
Counterbalancing
Suppose we used a repeated measures design in which all of the participants first learned words in 'loud noise' and then learned it in 'no noise'. We would expect the participants to show better learning in 'no noise' simply because of order effects, such as practice. However, a researcher can control for order effects using counterbalancing.
The sample would split into two groups experimental (A) and control (B). For example, group 1 does ‘A’ then ‘B’, group 2 does ‘B’ then ‘A’ this is to eliminate order effects. Although order effects occur for each participant, because they occur equally in both groups, they balance each other out in the results.
3. Matched Pairs:
Each condition uses different but similar participants. An effort is made to match the participants in each condition in terms of any important characteristic which might affect performance, e.g. gender, age, intelligence etc.
One member of each matched pair must be randomly assigned to the experimental group and the other to the control group.
Pro: Reduces participant variables because the researcher has tried to pair up the participants so that each condition has people with similar abilities and characteristics.
Pro: Avoids order effects, and so counterbalancing is not necessary.
Con: Very time-consuming trying to find closely matched pairs.
Con: Impossible to match people exactly, unless identical twins!
Con: If one participant drops out you lose 2 PPs’ data.
Control: Members of each pair should be randomly assigned to conditions. However, this does not solve all these problems.
Experimental Design Summary
Experimental design refers to how participants are allocated to the different conditions (or IV levels) in an experiment. There are three types:
1. Independent measures / between groups: Different participants are used in each condition of the independent variable.
2. Repeated measures /within groups: The same participants take part in each condition of the independent variable.
3. Matched pairs: Each condition uses different participants, but they are matched in terms of important characteristics, e.g. gender, age, intelligence etc.
Animation created by Tom H
Learning Check
Read about each of the experiments below. For each experiment, identify (1) which experimental design was used; and (2) why the reseacher might have used that design.
1. In order to compare the effectiveness of two different types of therapy for depression, depressed patients were assigned to receive either cognitive therapy or behavior therapy for a 12-week period. The researchers attempted to ensure that the patients in the two groups had a similar severity of depressed symptoms by administering a standardised test of depression to each participant, then pairing them according to the severity of their symptoms.
2. To assess the difference in reading comprehension between 7 and 9-year-olds, a researcher recruited a group of each from a local primary school. They were given the same passage of text to read, and then asked a series of questions to assess their understanding.
3. To assess the effectiveness of two different ways of teaching reading, a group of 5-year-olds were recruited from a primary school. Their level of reading ability was assessed, and then they were taught using scheme one for 20 weeks. At the end of this period, their reading was reassessed, and a reading improvement score was calculated. They were then taught using scheme two for a further 20 weeks and another reading improvement score for this period was calculated. The reading improvement scores for each child were then compared.
4. In order to assess the effect of organisation on recall, a researcher randomly assigned student volunteers to two conditions. Condition one attempted to recall a list of words that were organised into meaningful categories; condition two attempted to recall the same words, randomly grouped on the page.
How to cite this article:
McLeod, S. A. (2007). Experimental design. Retrieved from www.simplypsychology.org/experimental-designs.html
