Experimental Design

Site: Young Education
Cursus: Experimental Physics and Scientific Measurement
Boek: Experimental Design
Afgedrukt door: Guest user
Datum: maandag, 9 november 2026, 16:42

1. Variables

Learning outcomes
  • I can distinguish between independent, dependent, and controlled variables.
  • I can identify variables in scientific investigations.
  • I can design experiments that manipulate only one independent variable.
  • I can explain why controlled variables are important.
  • I can write clear hypotheses based on variables.

What Is a Variable?

A variable is something that can change or be measured during a scientific investigation.

Imagine investigating whether the amount of sunlight affects the growth of a plant.

Several things could change:

  • Amount of sunlight
  • Plant height
  • Amount of water
  • Type of plant
  • Type of soil
  • Temperature

These are all variables.

However, they do not all have the same role in the experiment.

Scientists usually identify three main types:

  • Independent variable
  • Dependent variable
  • Controlled variables

Understanding these variables is essential for designing a fair test.

https://images.openai.com/static-rsc-4/6lJ79-14NxoIxXCviUvvX5Xzw3QnVYr6X1iX2NRnPxFXL7F7Epw1B-E7EltAZogvBm-8gh8LO_i4zWx9hbWG52_RuRFzrSrVZ9eflmcN13o419Ps2A5_TPkmvIPNUEpCB79ub8EzDozJXB_ihZ01FNLe8nNaqkC47EmJVqAV_4Cg4jjFvZGC8e6dpcuPAkbR?purpose=fullsize
 
https://images.openai.com/static-rsc-4/nEo6g9GDQG7tACRWbzO8A5KiGZzZXPuG1KkNt2AwNj7KCV6Je6ekrbIomjzHt1RTOkOyIwApDjg44gcasbxapxjIWDZuiRHVu7edbC9ULUDt0SyykS6ewXecMXN9L0ndHTqBasoquqKxtCxQaR_rdhT6oRpFWcZp-XIdusZXb9wzOjuokSgbxKCVQANBzbhY?purpose=fullsize
 
https://images.openai.com/static-rsc-4/TzQ5QsaiJQPffXsYFKrYloBkCSPZnxtj1_7mtXazmmvJtuF6KXKwtJ505vg20NCm26wPmjz5rdFUefQ1CBAHBR3JvwgGfWqpuIX4WdO81Rdd1z8dvWDt536hC5EIpJV3y_J86GR3v3ZQOhOqDpfkkaFc0kt0HlbA_D-yscU5B2mv_DTENGu4YJYEtbVsbbCJ?purpose=fullsize
5

The Independent Variable

The independent variable is the variable that the scientist deliberately changes.

A good question to ask is:

What am I changing?​

Suppose we investigate:

How does the amount of sunlight affect plant growth?

The scientist deliberately changes the amount of sunlight.

Therefore:

Independent variable = amount of sunlight​

Only one independent variable should normally be deliberately changed in a fair test.


The Dependent Variable

The dependent variable is the variable that is measured or observed.

It changes in response to the independent variable.

Ask:

What am I measuring?​

In our plant experiment, we measure the growth of the plants.

Therefore:

Dependent variable = plant growth​

We might measure plant growth as:

height in centimetres

This makes the dependent variable quantitative and easier to compare.


Controlled Variables

Controlled variables are variables that are kept the same during an experiment.

Ask:

What must I keep the same?​

In the plant experiment, controlled variables could include:

  • Type of plant
  • Starting size of the plants
  • Amount of water
  • Type of soil
  • Size of the pot
  • Temperature
  • Length of the experiment

These variables should remain as constant as possible.


The Three Types of Variables

A useful way to remember the variables is:

Variable Question to Ask Example
Independent   What do I change? Amount of sunlight
Dependent What do I measure? Plant height
Controlled What do I keep the same?   Water, soil, plant type

Another useful pattern is:

Change → Measure → Control​

An Example Investigation

Suppose a student wants to investigate:

How does water temperature affect the time taken for sugar to dissolve?

First identify the variables.

Independent Variable

What does the student deliberately change?

Water temperature​

Dependent Variable

What does the student measure?

Time taken for the sugar to dissolve​

Controlled Variables

What should remain the same?

Possible controlled variables include:

  • Mass of sugar
  • Volume of water
  • Type of sugar
  • Size of sugar particles
  • Container
  • Stirring method

If these variables are controlled, the student can investigate the effect of temperature alone.

https://images.openai.com/static-rsc-4/JzFMt-e-b0uMML1E5SM1IDEF6W8537pRz8dmx1nTkh1GpjUUNOPZqJ9TpNunVu4YY242a3pp6AzDD3nlLI8BHWIFYBb1COVG8qzyVsflSTvRYc2Jr9rpS825-zJsGHZ1E4d27tfOD1ZhLvG5OGVNEvagORFF6jnse6wY9FKu5rELFHREeJ5nEIlpEn53_tv1?purpose=fullsize
 
https://images.openai.com/static-rsc-4/JZIQzRqul3mk-2-di6Vbx71hwusl1nE2-jFP0sJl4_aRBQqZurvmVIGQf8Ilfc2WmhcJDQ3rOI3U7hn2RBuAEWlDSwt9hZrxUVoupFSfU7Dv9sH2p56EJPmkxIYABGShZh_wImhil_vI2tlDy1otSPHVvwooi0vsHbEavH6F8HuQybicG2lHkQTtDW2RbYJx?purpose=fullsize
 
https://images.openai.com/static-rsc-4/pCOC_-KMPfXI1keDUA3NqBOt0aYckqTqyiTiAfSA1vVU4mnenC18pTdVD8sJIXqpmWe10vvrSrIDxxVtyl3t-wehaOzF1ha2YuI-VvVOkoGVgjdpN3VGSo2aY9IomH-hRJmzmG5GBxcDVpV1diU2n0-2vTiphAi31OfosF-vCNrjqQ1h9tZLEeKStzFn6q_Y?purpose=fullsize
5

Why Should We Change Only One Independent Variable?

Suppose a student wants to investigate how temperature affects dissolving.

In one experiment, the student uses:

  • 20oC water
  • 5 g sugar

In another experiment, the student uses:

  • 60oC water
  • 20 g sugar

There is a problem.

Two variables have changed:

  • Temperature
  • Mass of sugar

If the dissolving time changes, we cannot tell which variable caused the difference.

A better investigation would use:

Test Temperature Sugar
1 20°C 5 g
2 40°C 5 g
3 60°C 5 g
4 80°C 5 g

Now only the temperature changes.

This allows us to investigate its effect more clearly.


What Is a Fair Test?

A fair test is an investigation in which only the independent variable is deliberately changed while other relevant variables are controlled.

The basic idea is:

Change one thing and measure what happens.​

This helps scientists determine whether the independent variable is responsible for changes in the dependent variable.


Why Are Controlled Variables Important?

Controlled variables make an experiment more valid.

Imagine investigating whether different amounts of fertiliser affect plant growth.

Plant A receives fertiliser and also receives much more water.

Plant B receives no fertiliser and receives less water.

If Plant A grows more, what caused the difference?

Was it:

  • The fertiliser?
  • The extra water?
  • Both?

We cannot tell.

Water has become a confounding variable.

If the amount of water is kept constant, we can more confidently investigate the effect of fertiliser.


Control Does Not Always Mean Zero

A controlled variable is not necessarily something that is removed from an experiment.

It is something that is kept consistent.

For example, if the amount of water is controlled at:

50 mL

every plant should receive approximately:

50 mL

The water is still present. Its amount simply does not change between experimental conditions.


Identifying Variables from a Question

Scientific investigation questions often have the form:

How does X affect Y?

Usually:

and:

For example:

How does temperature affect reaction rate?

Therefore:

IV = temperature​
 
DV = reaction rate​

More Examples

How does light intensity affect the rate of photosynthesis?

Independent variable:

Light intensity​

Dependent variable:

Rate of photosynthesis​

Possible controlled variables:

  • Type of plant
  • Temperature
  • Carbon dioxide concentration
  • Amount of water

How does the length of a pendulum affect its period?

Independent variable:

Length of pendulum​

Dependent variable:

Period​

Possible controlled variables:

  • Mass of pendulum bob
  • Release angle
  • Method of timing
https://images.openai.com/static-rsc-4/kuf1fQdE9dWuQjNOGYtvTCqy9iFHZK6nCyeIEm_T14Br5QwxGq6cF_CiSKvABv6iJsNqK0vlMq2NIY9ErLzWDZZv_7dQOyW1l5e8KkSFawrbwPlgpWJHbLWFHgIpScoZ4G42eZBdBR_6CcP3UyJcSgYtKukT8p7nSYtRlFzESmNiW7CIqtK7ZzljILKPqPJx?purpose=fullsize
 
https://images.openai.com/static-rsc-4/jTJJbGhn7e5C8BmNohLf29Jvo3Z-DlBA49s6_-lUITWtpiRQS17NdC52Tm6ain9vcXzo_sgla-CPw1FVexfbOTBriw8XWz_NqGJxqp9Sane66hV5OhHLYq0ticptXYEF8-2e6kpqbO4wEW7KqJoNvZoQnc03Ee4V2J_Qu0UoTSfE3vF58AgQLxh3r48kFXBa?purpose=fullsize
 
https://images.openai.com/static-rsc-4/kjtwj6gxxx7N3yhiqyJOmjw9X-Vk9_RnFKY9nvYiPYRJFgYqyo3PehE7VwfHBtB3cJ_Xp2c_zoko1eYbm5DiX_CNKGUNBVx5wQ9h6Xumln2mn-jwSqAZyV391Q6mYVCWypRP2DzxstoNHFJiN6qNpuyibjxSl4OXvNnqEfA1XmWy_Ev4ShQyy4jxDi4DOMrL?purpose=fullsize
5

How does concentration affect reaction time?

Independent variable:

Concentration​

Dependent variable:

Reaction time​

Possible controlled variables:

  • Temperature
  • Volume of reactants
  • Type of reactants
  • Equipment used

Variables and Graphs

Variables also determine how experimental graphs are constructed.

The independent variable is normally plotted on the:

x-axis​

The dependent variable is normally plotted on the:

y-axis​

For example, if investigating how temperature affects reaction rate:

 

This allows us to see how the dependent variable changes in response to the independent variable.


What Is a Hypothesis?

A hypothesis is a testable prediction about the relationship between variables.

A good hypothesis should clearly identify:

  • The independent variable
  • The dependent variable
  • The expected relationship

A common structure is:

If [independent variable changes], then [dependent variable will change], because [scientific reason].


Writing a Clear Hypothesis

Suppose the investigation asks:

How does water temperature affect the rate at which sugar dissolves?

A weak hypothesis might be:

The sugar will dissolve.

This does not describe the expected relationship between the variables.

A better hypothesis is:

If the temperature of the water increases, then the sugar will dissolve more quickly.

An even stronger hypothesis includes scientific reasoning:

If the temperature of the water increases, then the sugar will dissolve more quickly because the water particles have greater kinetic energy and move more rapidly.


Another Hypothesis Example

Investigation:

How does the amount of light affect plant growth?

Independent variable:

Amount of light

Dependent variable:

Plant growth

Possible hypothesis:

If the amount of light a plant receives increases, then its growth will increase because light provides the energy required for photosynthesis.

The prediction directly connects the two variables.


Hypotheses Must Be Testable

Consider:

Plants like sunlight.

This is not a strong scientific hypothesis because "like" is difficult to measure scientifically.

A better statement would be:

If the number of hours of light per day increases, then the average increase in plant height over 14 days will increase.

Now both variables can be measured:

Light exposure in hours

and:

Plant growth in centimetres

This makes the hypothesis testable.


Operational Variables

Scientists often need to describe exactly how a variable will be changed or measured.

Instead of saying:

Plant growth

we could specify:

Change in plant height in centimetres after 14 days.

Instead of saying:

Amount of light

we could specify:

Number of hours of light received each day.

Clear definitions make experiments easier to repeat and results easier to compare.


Designing an Investigation

Suppose you want to investigate:

How does the concentration of salt in water affect the time required for an ice cube to melt?

A good experimental design might be:

Independent Variable

Concentration of salt solution.

For example:

0%, 5%, 10%, 15%

 

Dependent Variable

Time required for the ice cube to melt.

Measured in:

seconds

Controlled Variables

Keep constant:

  • Size of ice cube
  • Starting temperature
  • Volume of solution
  • Container
  • Room conditions

The experiment changes one main variable while controlling the others.


Repeated Measurements

Even when variables are carefully controlled, measurements may vary.

Scientists therefore often repeat measurements.

For example, instead of measuring each condition once:

32 s

we might repeat it three times:

32 s, 30 s, 31 s

and calculate a mean:

Repeating measurements can improve the reliability of experimental results.


Variables, Validity, and Reliability

These ideas are closely connected but have different meanings.

Variables

Identify what is changed, measured, and controlled.

Validity

A valid experiment actually tests the intended relationship.

Controlling relevant variables helps improve validity.

Reliability

Reliable results are reasonably consistent when measurements are repeated.

Repeating measurements helps scientists assess and improve reliability.

Good experimental design requires attention to all three.


Common Mistakes When Identifying Variables

Mistake 1: Confusing Independent and Dependent Variables

Remember:

Independent = change​ Dependent = measure​

 

Mistake 2: Calling Everything a Controlled Variable

Only variables that could affect the results and should remain constant need to be controlled.

Mistake 3: Changing Several Variables at Once

This makes it difficult to determine which variable caused the observed effect.

Mistake 4: Using Variables That Cannot Be Measured Clearly

Instead of "plant health," use something measurable such as:

plant height (cm)

or:

number of leaves

A Variables Checklist

Before beginning an investigation, ask:

Independent variable

  • What will I deliberately change?
  • What values or conditions will I test?

Dependent variable

  • What will I measure?
  • What units will I use?
  • How will I measure it?

Controlled variables

  • What other factors could affect my results?
  • How will I keep them constant?

Hypothesis

  • What relationship do I predict?
  • Does my hypothesis clearly connect the independent and dependent variables?
  • Can my prediction actually be tested?

Did You Know?

Scientists cannot always control every variable.

In laboratory experiments, scientists can often control temperature, quantities, equipment, and other conditions carefully.

However, scientists studying ecosystems, weather, populations, or space may have much less control over the conditions.

They must instead collect large amounts of data and use statistical methods to determine whether observed relationships are meaningful.

This is one reason experimental design is such an important part of science.


Key Vocabulary

Variable – A factor that can change or be measured during an investigation.

Independent variable – The variable deliberately changed by the investigator.

Dependent variable – The variable measured or observed in response to the independent variable.

Controlled variable – A relevant variable kept constant during an investigation.

Fair test – An investigation in which one independent variable is deliberately changed while relevant variables are controlled.

Hypothesis – A testable prediction about the relationship between variables.

Validity – The extent to which an investigation tests what it is intended to test.

Reliability – The consistency of results when measurements are repeated.

Confounding variable – An uncontrolled factor that may affect the dependent variable and make the results difficult to interpret.


Key Takeaways

  • A variable is something that can change or be measured in an investigation.
  • The independent variable is deliberately changed.
  • The dependent variable is measured or observed.
  • Controlled variables are kept constant so they do not unfairly influence the results.
  • A useful memory aid is: change, measure, control.
  • Only one independent variable should normally be deliberately changed in a fair test.
  • Controlling relevant variables helps make an experiment more valid.
  • The independent variable is normally plotted on the x-axis and the dependent variable on the y-axis.
  • A good hypothesis predicts how the dependent variable will respond to changes in the independent variable.
  • Strong hypotheses are specific, measurable, and testable.
  • Clearly defining how variables will be changed and measured improves experimental design.
  • Repeated measurements help scientists determine whether results are reliable.
 
 
 

2. Controls

Learning outcomes
  • I can explain the purpose of a control in an experiment.
  • I can identify appropriate control groups or control conditions.
  • I can distinguish between controlled variables and control groups.
  • I can evaluate whether an experiment includes suitable controls.
  • I can design experiments with effective controls.

Why Experiments Need Controls

A scientific experiment is designed to determine whether changing one factor causes a measurable change in another factor.

However, many things can affect the outcome of an experiment. Scientists therefore use controls to make comparisons more reliable.

A control provides a reference or comparison that helps scientists determine whether the independent variable actually caused the observed result.

A useful idea is:

experimental result + appropriate control → stronger evidence about cause and effect


What Is a Control?

A control is a standard or comparison used in an experiment.

Depending on the investigation, the control may be:

  • A control group.
  • A control condition.
  • An untreated sample.
  • A sample receiving a known treatment.
  • A normal or baseline condition.

The control should be as similar as possible to the experimental treatment except for the factor being investigated.

https://images.openai.com/static-rsc-4/C9I4qh2rV8AvpJW1fM-Tkyw46LUcihljSHo9LiZ1J76n9YauO6lLznKUeGlIxuM4ntqBJCPafV9PrxJy2AUQ9PsXExFvd4MuQnzkzVje_MOZ0tOzge6-GTeacw9AG_7jbr369kmSMXePNPqnp3SKfqLRmYu18hRx55U56bHalzISKGSiX1AvRvNYsIvG3a-S?purpose=fullsize
 
https://images.openai.com/static-rsc-4/TZG3nrpDg19Xe62DX-p4ZaYEPQSp-cISfFr9B2KiCpUzFw2R3NyiSLbsKfw-cnZFXxGIzJtyGbUFi36sj-E6NtaBYGnDFDTeV2rG-c-YyANYdeuiR6rKH1-nRSMEhXalbFrRYPNPm3P9fhGHnZ3lGMQ8XuQKpeViJABl2QeMdrfl8IGxCfKC5btsGE7EV79k?purpose=fullsize
 
https://images.openai.com/static-rsc-4/2ulR0l75MpWnpC6QzQhDF_RBM9zfZFyn4LLpjZETMmD5pMfNGiQH_YAsJ0MLf7Qp9uxiUB6QInyFWmKet6d5QRt48_13ordlMmx3sa1_pW9lncyLPiTvVMGUlAAWP4bUVsE1WkOhcnJhAZZvFjJYtxZ75z1c4-7rKCkrAKHMOVucNII8oee1cAsdxLq57Fh7?purpose=fullsize
 
6

Experimental Group and Control Group

Many experiments contain at least two groups.

Experimental Group

The group that receives the treatment or condition being investigated.

Control Group

The comparison group that does not receive the experimental treatment, or receives a standard treatment.

The results of the two groups can then be compared.


Simple Example: Fertilizer

Suppose a student asks:

Does fertilizer increase the growth of bean plants?

The student grows two groups of identical bean plants.

Experimental Group

Plants receive fertilizer.

Control Group

Plants do not receive fertilizer.

Both groups receive:

  • The same amount of water.
  • The same amount of light.
  • The same type of soil.
  • The same temperature.
  • The same growing time.

If the fertilized plants grow more, the control group provides a baseline for comparison.

Without the control group, it would be much harder to determine whether the fertilizer caused the difference.

https://images.openai.com/static-rsc-4/nhkorK_6F-Gyc2jtZLwtHTCqOFqtK2ByqKUzbFKMX211Kz_QZtChIhBabga3VMkVQFCicptl2C63UrL21f_0gVb8p7SwCjMQ5KnxFnhjye0MNo3QU3BlGHc5xM983LLfhseB8YJqolLkK99TstfJVbQzg_TE6O9BLQM0aCHTDEuAL54eVjyvEwoRSeG8sOqK?purpose=fullsize
 
https://images.openai.com/static-rsc-4/I4mrFRzTfpr9QuB_GKqZOwKU7MnQdyEmoKNV3jxdyDfYjVHR-Kd6KeHBqVnX2x0VtD49Nwqr5LGVZyM2FPBg25a3OGT3M7ySOwUxpt85tGYvfWTdpyk-tSms2dXSFmsrhqDrfJSNpYQfqs-gImfStDk-2grPpDaxjgv7RgO8pz9hyyRNYTM98XaNmtlil7pb?purpose=fullsize
 
https://images.openai.com/static-rsc-4/nEo6g9GDQG7tACRWbzO8A5KiGZzZXPuG1KkNt2AwNj7KCV6Je6ekrbIomjzHt1RTOkOyIwApDjg44gcasbxapxjIWDZuiRHVu7edbC9ULUDt0SyykS6ewXecMXN9L0ndHTqBasoquqKxtCxQaR_rdhT6oRpFWcZp-XIdusZXb9wzOjuokSgbxKCVQANBzbhY?purpose=fullsize
 
5

Control Groups Are Not the Same as Controlled Variables

This distinction is extremely important.

Control Group

A group or condition used for comparison.

Controlled Variable

A factor kept the same throughout the experiment.

These terms sound similar, but they describe different things.


Example: Fertilizer Investigation

Question:

How does fertilizer concentration affect plant growth?

Independent Variable

Fertilizer concentration.

Dependent Variable

Plant growth.

Controlled Variables

  • Plant species.
  • Starting plant size.
  • Amount of water.
  • Soil type.
  • Light exposure.
  • Pot size.
  • Temperature.
  • Length of experiment.

Control Group

Plants receiving no fertilizer.

The controlled variables help make the experiment fair.

The control group provides a baseline for comparison.


Why Controlled Variables Matter

Suppose one group receives fertilizer and another does not.

However, the fertilized plants also receive twice as much water.

If the fertilized plants grow faster, what caused the difference?

Was it:

fertilizer?

or:

extra water?

We cannot tell.

Water has become a confounding variable.

Keeping water constant helps isolate the effect of fertilizer.


Control Conditions

Not every investigation has separate groups of organisms.

Sometimes scientists use a control condition.

Suppose students investigate:

How does temperature affect the rate at which a tablet dissolves?

They might test:

  • 10°C.
  • 20°C.
  • 30°C.
  • 40°C.
  • 50°C.

A standard temperature, such as 20°C, might serve as a reference condition.

The other results can be compared with this baseline.


Baseline Conditions

A baseline represents a normal or starting condition.

For example, scientists investigating the effect of exercise on heart rate might measure a person's:

resting heart rate

before exercise.

They then compare the heart rate:

  • Before exercise.
  • Immediately after exercise.
  • After several minutes of recovery.

The resting measurement acts as a baseline.


Negative Controls

A negative control is designed to produce no experimental effect if everything is working correctly.

Suppose scientists test whether a disinfectant kills bacteria.

Experimental Treatment

Bacteria + disinfectant.

Negative Control

Bacteria + no disinfectant.

The negative control shows how the bacteria behave without the treatment.

If bacteria decrease even in the negative control, something else may be affecting the experiment.


Positive Controls

A positive control is a condition expected to produce a known result.

Suppose a scientist is testing a new antibacterial substance.

The experiment might contain:

Experimental Group

Bacteria + new substance.

Negative Control

Bacteria + no antibacterial treatment.

Positive Control

Bacteria + an established antibacterial treatment known to work under the test conditions.

The positive control can help show whether the experimental method is capable of detecting an antibacterial effect.


Why Positive Controls Are Useful

Imagine the new substance produces no effect.

There are at least two possibilities:

Possibility 1: The new substance does not work.

Possibility 2: Something was wrong with the experimental method.

If the positive control also fails to produce its expected effect, this suggests there may be a problem with the procedure.

Controls therefore help scientists interpret results.


Placebos as Controls

In some clinical research, a placebo may be used as part of a control condition.

A placebo resembles the treatment but does not contain the active treatment being tested.

Researchers can compare:

treatment group

with:

placebo control group

This helps distinguish effects associated with the active treatment from effects related to expectations, study participation, or other factors.

Human research requires appropriate ethical safeguards, so not every study can or should use a placebo.


Worked Example: Light and Plant Growth

Research question:

How does light intensity affect plant growth?

A student places plants at different distances from a lamp.

Independent Variable

Light intensity.

Dependent Variable

Plant growth.

Controlled Variables

  • Plant species.
  • Starting size.
  • Soil.
  • Water.
  • Pot size.
  • Temperature.
  • Length of experiment.

A suitable baseline could be plants grown under the normal lighting condition used for comparison.

The student should change the light condition while keeping other important factors as consistent as possible.


Worked Example: Exercise and Heart Rate

Question:

How does exercise affect heart rate?

Independent Variable

Exercise condition or intensity.

Dependent Variable

Heart rate.

Baseline Control Condition

Resting heart rate before exercise.

Controlled Variables Could Include

  • Exercise duration.
  • Measurement method.
  • Recovery time before each trial.
  • Environmental conditions where practical.

Comparing exercise measurements with the resting baseline helps show the change associated with exercise.


Worked Example: Enzyme Activity

Question:

How does pH affect enzyme activity?

A student tests enzyme activity at:

pH 3, 5, 7, 9 and 11

The student must also control other factors such as:

  • Temperature.
  • Enzyme concentration.
  • Substrate concentration.
  • Reaction time.
  • Total reaction volume.

If pH 7 represents the normal reference condition for the investigation, it can serve as a useful comparison.

The controlled variables are not control groups.


Worked Example: Cleaning Products

Suppose students investigate:

Which cleaning product removes an oil stain most effectively?

They test:

  • Product A.
  • Product B.
  • Product C.
  • Water only.

The water-only treatment provides a useful control.

Why?

It shows how much stain removal occurs from the washing procedure without the cleaning products being tested.


Worked Example: Seed Germination

Question:

Does a particular treatment affect seed germination?

Students use 40 similar seeds.

Group A

20 seeds receive the treatment.

Group B

20 seeds do not receive the treatment.

Group B is the:

control group

Other factors should remain similar:

  • Seed type.
  • Water.
  • Temperature.
  • Light.
  • Growing medium.
  • Observation time.

If 18 treated seeds germinate but only 10 control seeds germinate, the difference provides evidence that the treatment may have influenced germination.

Replication and further testing would strengthen the conclusion.


Identifying a Missing Control

Consider this experiment:

A student gives fertilizer to five plants.

After three weeks, all five plants have grown.

The student concludes:

"The fertilizer caused the plants to grow."

There is a major problem.

Plants normally grow even without fertilizer.

The experiment needs:

similar plants grown without the fertilizer

Without this control group, the student cannot determine how much growth would have occurred anyway.


Identifying a Poor Control

Suppose students investigate whether fertilizer increases tomato plant growth.

Experimental Group

Tomato plants + fertilizer, grown outdoors.

Control Group

Tomato plants without fertilizer, grown indoors.

This is a poor design.

Why?

Two factors have changed:

  • Fertilizer.
  • Growing environment.

If the groups grow differently, the students cannot determine which factor caused the difference.

A better control group would experience the same conditions except for the fertilizer treatment.


Effective Controls

A good control should usually:

  • Provide a meaningful comparison.
  • Be treated similarly to the experimental group.
  • Differ mainly in the independent variable or treatment being tested.
  • Be measured using the same methods.
  • Be observed over the same time period.

This allows the effect of the independent variable to be isolated more effectively.


Designing an Experiment with a Control

Suppose you want to investigate:

Does salt concentration affect seed germination?

Step 1: Identify the Independent Variable

Salt concentration.

Possible concentrations:

0%, 0.5%, 1.0%, 1.5%, 2.0%

Step 2: Identify the Dependent Variable

Percentage of seeds that germinate.

Step 3: Establish a Control

Seeds receiving:

0% salt solution

This provides the normal condition without added salt.

Step 4: Identify Controlled Variables

Keep constant:

  • Seed species.
  • Number of seeds.
  • Volume of solution.
  • Temperature.
  • Light conditions.
  • Container.
  • Growing medium.
  • Time allowed for germination.

Step 5: Compare Results

Compare each salt treatment with the 0% salt control.


Controls and Fair Testing

Controls are part of a broader idea called a fair test.

In a fair test:

one independent variable is deliberately changed

while:

other relevant variables are kept as constant as reasonably possible

and:

the dependent variable is measured consistently

An appropriate control provides a comparison that helps interpret the results.


Controls Do Not Eliminate All Uncertainty

Even a well-controlled experiment can contain variation.

For example, individual plants may naturally grow at different rates.

Scientists therefore often use:

  • Multiple samples.
  • Repeated trials.
  • Larger sample sizes.
  • Random assignment where appropriate.
  • Consistent measurement methods.

Controls improve experimental design, but they work together with these other techniques.


Control vs Repetition

A control and a repeated trial serve different purposes.

Control

Provides a comparison.

Repetition

Helps determine whether results are consistent and reduces the influence of random variation.

A strong investigation often uses both.


Control vs Constant

Consider:

Does water temperature affect how quickly sugar dissolves?

Independent Variable

Water temperature.

Dependent Variable

Time required for sugar to dissolve.

Controlled Variables

  • Amount of sugar.
  • Volume of water.
  • Type of sugar.
  • Stirring method.
  • Container.

Reference Condition

A standard temperature may be selected for comparison.

Notice again:

controlled variables ≠ control condition


Does Every Experiment Need a Control Group?

Not every scientific investigation requires a separate control group.

For example, an investigation measuring how pendulum period changes with length may simply test many different lengths while keeping other variables constant.

A separate "untreated pendulum" would not necessarily be meaningful.

Instead, scientists compare the measurements across the different values of the independent variable.

Therefore, an important question is not simply:

"Where is the control group?"

but:

"What comparison is needed to answer the research question?"


Observational Studies

Some scientific investigations are observational rather than experimental.

Scientists might study:

  • Animal populations.
  • Climate patterns.
  • Ecosystems.
  • Geological formations.
  • Astronomical objects.

Researchers may not directly manipulate an independent variable.

Instead, they compare naturally occurring conditions or groups.

The idea of comparison remains important even when a traditional experimental control is not possible.


Evaluating an Experimental Control

When examining an experiment, ask:

What is the independent variable?

What is the dependent variable?

What is being used as the comparison?

Does the control differ from the experimental group mainly in the treatment being investigated?

Are other important variables controlled?

Is the control measured in the same way?

Does the control actually help answer the research question?

These questions help determine whether the control is appropriate.


Example: Evaluate the Experiment

A student wants to determine whether caffeine affects the growth of bean plants.

Group A

10 bean plants receive water containing caffeine.

Group B

10 bean plants receive plain water.

Both groups have:

  • Identical soil.
  • Similar starting sizes.
  • Equal water volumes.
  • Equal light.
  • Equal temperatures.
  • Identical pots.

Plant height is measured every two days.

Evaluation

Group B is an appropriate control group because it receives the same basic treatment except for caffeine.

The design therefore allows the effect of caffeine to be investigated more effectively.


Example: Find the Problem

A student investigates whether detergent affects seed germination.

Group A

Seeds receive detergent solution and are kept at 25°C.

Group B

Seeds receive water and are kept at 10°C.

The control is poorly designed.

Two variables differ:

detergent exposure

and:

temperature

Therefore, differences in germination could be caused by either variable.

A better design would keep both groups at the same temperature.


Designing Stronger Controls

Suppose you want to test a new plant-growth treatment.

A stronger design might include:

Negative Control

Plants receive no active treatment.

Experimental Group

Plants receive the new treatment.

Positive Control

Plants receive an established treatment known to influence plant growth, if such a comparison is relevant.

This design can provide more information than simply observing the experimental group alone.


Common Mistakes

Confusing a Control Group with a Controlled Variable

A control group is a comparison group.

A controlled variable is a factor kept constant.

Saying "The Control Is Everything Kept the Same"

Those are controlled variables, not the control group.

Changing Several Variables at Once

This makes it difficult to determine which variable caused the result.

Using an Unfair Control Group

The control should experience comparable conditions except for the treatment being investigated.

Assuming the Control Must Receive Nothing

A control may receive water, a placebo, a standard treatment, or another appropriate baseline condition.

Assuming Every Experiment Needs a Separate Control Group

Some experiments compare different values of an independent variable without a separate untreated group.

Forgetting Repeated Trials

A control provides comparison, but repeated trials help assess consistency.

Assuming a Control Proves Cause and Effect by Itself

Controls strengthen evidence, but experimental design, sample size, measurement quality, replication, and other factors also matter.


Check Your Understanding

1. What is the purpose of a control in an experiment?

2. What is a control group?

3. What is a controlled variable?

4. Explain the difference between a control group and a controlled variable.

5. Why does a fertilizer experiment need plants that receive no fertilizer?

6. Why should control and experimental groups be treated similarly?

7. What is a baseline?

8. What is a negative control?

9. What is a positive control?

10. Why might a positive control be useful?

11. What is the purpose of a placebo in some experiments?

12. A student tests whether fertilizer affects plant growth. Identify an appropriate control group.

13. Give four variables that should be controlled in the fertilizer experiment.

14. A student tests detergent on seeds but changes both detergent concentration and temperature. What is wrong with the design?

15. Why is plain water a useful control when testing cleaning products?

16. How does a control help scientists determine cause and effect?

17. What is the difference between a control and a repeated trial?

18. Why does natural variation make repeated trials useful?

19. Does every experiment require a separate control group? Explain.

20. Design an appropriate control for an experiment investigating how salt affects seed germination.


Key Terms

  • Control – reference or comparison used to help interpret experimental results.
  • Control group – group used as a comparison with the experimental group.
  • Control condition – reference condition used for comparison.
  • Controlled variable – factor kept constant during an experiment.
  • Independent variable – factor deliberately changed by the investigator.
  • Dependent variable – factor measured in response to the independent variable.
  • Experimental group – group receiving the treatment or condition being investigated.
  • Baseline – normal or starting condition used for comparison.
  • Negative control – control expected to show no experimental effect.
  • Positive control – control expected to produce a known response.
  • Placebo – inactive treatment used as a comparison in some studies.
  • Confounding variable – uncontrolled factor that could influence the dependent variable.
  • Fair test – investigation in which the independent variable is deliberately changed while other relevant factors are controlled.
  • Replication – repeating an investigation or using multiple experimental units to test the reliability of results.

Key Takeaways

  • Controls provide a reference against which experimental results can be compared.
  • A control group is not the same thing as a controlled variable.
  • Controlled variables are factors kept constant.
  • Control groups provide comparison conditions.
  • Experimental and control groups should usually differ mainly in the treatment being investigated.
  • Negative controls show what happens without the experimental treatment.
  • Positive controls provide a known expected response.
  • Baseline measurements can act as useful comparison conditions.
  • Appropriate controls make it easier to determine whether the independent variable caused an observed change.
  • Poor controls can introduce confounding variables.
  • Controls should be measured using the same methods as experimental treatments.
  • A control does not replace repeated trials or adequate sample sizes.
  • Not every investigation requires a separate control group.
  • The most important question is:

What comparison is needed to answer the research question fairly?

 
 
 

3. Fair tests

Learning outcomes
  • I can explain what makes an experiment a fair test.
  • I can identify sources of bias in investigations.
  • I can design experiments that produce reliable comparisons.
  • I can control variables to improve fairness.
  • I can evaluate whether an investigation is scientifically valid.

What Makes an Experiment a Fair Test?

A fair test is an investigation designed so that the effect of one factor can be studied without other factors interfering with the comparison.

In a simple controlled experiment:

one independent variable is deliberately changed

while:

other relevant variables are kept as constant as reasonably possible

and:

the dependent variable is measured consistently

A fair test allows scientists to make a meaningful comparison between different experimental conditions.

A useful idea is:

change one factor → control other relevant factors → measure the outcome → compare results

https://images.openai.com/static-rsc-4/sGqs22lRyUvtnojFkTpNoQC82l4PZJopZ4h9Ns-lifMgOPsPyQV00bbPvUmwpSUQGyn9Vh1e5Hew9zM4Ibj3rpmbzXflwdk4Lpl2i7d0NJ5oMCryjTEHL6nD1FE5WBlL1whhA9BA1K74HwVdGYTxXYlMKIG9WLEtiJhlHW7T3Ha9o1xGoY9jtvCjWtbVPyTh?purpose=fullsize
 
https://images.openai.com/static-rsc-4/LPigIMvFE6BNZj27rCxUNxkpMEPOueF9Txxx1PBudNKovvE4fSngIHouhTTjWyOYzPbIz_02vESWNg47-H2aQo4JQMrgxuDNzu-fsnYzs5NBrKPqm27PfgM-C7o2wTkPiCwL89s8Cv45IDcOCzCiEwqgDFiFZXy2FnQPKqrgT16tyrjjtd_gLGpA5hVxZd9w?purpose=fullsize
 
https://images.openai.com/static-rsc-4/qc-R36hcn3yw-hfMXIW0_cUvbmkT-CexFM-S8sqTwyRRyy4fsA6dwhb4uDp5YUNsoVvsD0eUz2hHXyjsvexFqUBkI45S8N3jJ5ZA9sOcQPqlHdd8Kq2zcwwWQamcU-Yae7azYWDjGL8t-COQ-SM3qp3UgIZzLp967CSLHcDtabwb-I_Ew_Hq5S81OBYAriF8?purpose=fullsize
 
6

The Three Main Types of Variables

Understanding variables is essential for designing fair tests.

Independent Variable

The independent variable (IV) is the factor deliberately changed by the investigator.

For example:

Does water temperature affect how quickly sugar dissolves?

Independent variable:

water temperature


Dependent Variable

The dependent variable (DV) is the factor measured or observed.

In the sugar investigation:

Dependent variable:

time required for the sugar to dissolve

The dependent variable may change because the independent variable was changed.


Controlled Variables

Controlled variables are factors kept as constant as reasonably possible.

For the sugar investigation, these could include:

  • Mass of sugar.
  • Volume of water.
  • Type of sugar.
  • Container.
  • Stirring method.
  • Method used to determine when the sugar has dissolved.

These controls make the comparison more meaningful.


A Fair-Test Example

Suppose a student asks:

How does ramp height affect the speed of a toy car?

The student changes the ramp height and measures the car's speed.

Independent Variable

Ramp height.

Dependent Variable

Speed of the car.

Controlled Variables

  • Same toy car.
  • Same ramp.
  • Same surface.
  • Same travel distance.
  • Same release point or release procedure.
  • Same timing method.
https://images.openai.com/static-rsc-4/cdBXcnzCAAFkpIzylpDY8JCma-mmFwHwI5kdRsZZuD8XOmYqw2NI1Bp-D0JA9XkCboS7T4uQYstSwpfsFDdgMqMOrv4l60bYvWDMe-E_bYMY4QUXadHPURWN_6ulfmSE90Mw0AnVTkerHkXwUefv3zq9g45ZksG2TXjIS_yNu1iZ-utdzJLjdBdVCMzkHskc?purpose=fullsize
 
https://images.openai.com/static-rsc-4/VPFys-jPWxPxWsneae2Q9jcnQf3Hl9dZ-erc2t6mKwuWrNhM8q0r66J3f7ludq9YV8IG-th33miRRn8USQ4mi8ncWwqdzpAcEsMtyAz-DDa3WynrFcOh_6mr23cRieuSlpbqTSJbZT8NkDtJdpcID2YRPtQ0nj5fv8JQmxjznTCX6Uj1_7GPU26ipQzW7LRR?purpose=fullsize
 
https://images.openai.com/static-rsc-4/EZp_uht1R7QVTUXc1B9BcD7cCX7rDpyItpEmnxf4bePEDuqvq2sDXv6tdquxHohloBHDCeD8Zt8pVY41XgSELTlLoEAWbsqvt_s7hmi51IRnKtcYRG6K4MEDuiJookRuizUI1Ax7Gpsp_0e9Se9gxZoGDtoiDc7FCit0qz-xYdfpgkcl_7f7uO02JjfuHCkj?purpose=fullsize
 
5

If the student changes both the ramp height and the car, the comparison becomes less fair because either change could influence the result.


Why Controlled Variables Matter

Imagine testing whether temperature affects how quickly a tablet dissolves.

Trial A

Cold water + one tablet + 100 mL water.

Trial B

Hot water + two crushed tablets + 300 mL water.

This is not a fair comparison.

Several variables changed:

  • Temperature.
  • Number of tablets.
  • Tablet particle size.
  • Water volume.

If Trial B behaves differently, we cannot confidently determine which change was responsible.


Improving the Investigation

A better design would use:

Trial A

10°C water + one whole tablet + 100 mL water.

Trial B

30°C water + one whole tablet + 100 mL water.

Trial C

50°C water + one whole tablet + 100 mL water.

Now:

temperature changes

while the other important variables remain constant.

This provides a much fairer comparison.


Fair Does Not Mean Identical

A common misunderstanding is that everything must be kept the same.

If everything were identical, there would be no experiment.

One factor must deliberately change:

the independent variable

Therefore:

IV → changes

DV → measured

controlled variables → kept constant where relevant


Choosing an Appropriate Range

A good fair test usually investigates several useful values of the independent variable.

For example, instead of testing plant growth at only:

10°C and 30°C

a student might test:

10°C, 15°C, 20°C, 25°C and 30°C

This provides more information about the relationship between temperature and growth.

A suitable range should also be:

  • Safe.
  • Practical.
  • Relevant to the research question.

Choosing Suitable Intervals

The values of the independent variable should allow useful comparisons.

Suppose a student investigates how ramp height affects travel time.

They could use:

5 cm, 10 cm, 15 cm, 20 cm, 25 cm

These regular intervals make it easier to identify patterns.

If the student used:

5 cm, 6 cm, 7 cm, 50 cm and 100 cm

the values might provide a less useful picture of the relationship, depending on the investigation.


Measuring the Dependent Variable

A fair test also requires the dependent variable to be measured consistently.

For example, if measuring plant growth, students should decide whether they will measure:

  • Plant height.
  • Change in height.
  • Leaf number.
  • Biomass.

They should then use the same method throughout the investigation.

Changing measurement methods halfway through an experiment reduces comparability.


Reliable Comparisons

A reliable comparison is one in which differences between groups are less likely to be caused by inconsistent procedures or random variation.

Ways to improve reliability include:

  • Repeating measurements.
  • Using multiple samples.
  • Using consistent procedures.
  • Using appropriate measuring equipment.
  • Calculating averages where appropriate.

Fairness and reliability are related, but they are not exactly the same idea.


Repeated Trials

Suppose a student measures the time for a toy car to travel down a ramp.

First result:

1.42 s

Should the student immediately accept this as the correct value?

Probably not.

The student could repeat the measurement:

Trial 1: 1.42 s

Trial 2: 1.38 s

Trial 3: 1.40 s

Average:

(1.42 + 1.38 + 1.40) / 3 = 1.40 s

Repeated trials reduce the influence of random variation.


Identifying Anomalies

An anomaly is a result that differs noticeably from the general pattern.

Suppose the measurements are:

1.42 s, 1.38 s, 2.91 s, 1.40 s, 1.41 s

The value:

2.91 s

appears unusual compared with the others.

The student should investigate possible reasons.

Perhaps:

  • The timer was started late.
  • The car hit something.
  • The car was released incorrectly.
  • The measurement was recorded incorrectly.

An anomalous result should not simply be deleted because it is inconvenient.

There should be a scientific reason for excluding or repeating it.


Accuracy

Accuracy describes how close a measurement is to the accepted or true value.

For example, suppose a balance should read:

100.0 g

but consistently reads:

104.0 g

The measurements may be consistent but inaccurate.

Checking and calibrating equipment can improve accuracy.


Precision

Precision refers to how closely repeated measurements agree with one another and, in measurement contexts, the resolution with which measurements are reported.

For example:

20.1 cm, 20.2 cm, 20.1 cm

are closely grouped.

Measurements such as:

18.4 cm, 22.7 cm, 20.0 cm

show much greater spread.

https://images.openai.com/static-rsc-4/tO5fk65A29zOVJ4eJoKHel7gevHMuxq0a6stTB6vZjwOPH-BZQzgvGT4pGx9YCb8TN4bdVAH5h04Yk3jzzdtguPDuFCFjlTdZ6le_ET_j-56LTrumnb9sJInAb_4gMaMD6zs654aFZVv0Zrf0C09CtPJReJhoQHia6EkNEylADJLJ5XNteSKsKE_3nRy3ECT?purpose=fullsize
 
https://images.openai.com/static-rsc-4/1BZ0QijMgkxKKbUMFG3TKz-MaJ-Q--o0So82bvJE6_ngTv3OQj_QBVJRqUQczWgfypndgVxPXDMlqdCLmPP4lvZJ0Jryn2CtfMEYLBcwqvh5p8DmHWh6v7ud0tXq_xdrLw2ErvGnbxR9vKuTvzMzvxhQE0W1ajd1AR6sY_Ps33XZ7cUbJlMhMS650p59qLsE?purpose=fullsize
 
https://images.openai.com/static-rsc-4/ACfa3tBBQAFBYvI-hB6odfqa4Jb63hyK_kYgj-VD5R7ImEdJcJ6Kwcj8jw4Jv8j8z2ieJt7KJgjSUy1DseSc5SZyWuwX_0gAgMDF5sxQy4YIEaZp8ZvBxfLIZbLza4iXgk4g9qmgOVa-Ms7zQRU3wXhpCICngaDp3Qg2vdmD0C9pEJyqew-hJcHkWbtMxxdc?purpose=fullsize
 
4

A good investigation aims for measurements that are both accurate and appropriately precise.


Validity

An investigation is valid when its design and measurements allow it to answer the intended research question appropriately.

Suppose the question is:

How does light intensity affect photosynthesis?

If the experiment actually changes both light intensity and temperature, it becomes difficult to determine whether light intensity caused the observed change.

This weakens the validity of the investigation.


Reliability and Validity Are Different

A procedure can produce very consistent results without answering the intended question properly.

For example, students might repeat a poorly designed experiment ten times.

The results could be highly consistent.

But if two important variables were changed simultaneously, the investigation would still have weak validity for isolating the effect of either one.

Therefore:

repetition improves reliability

but:

repetition cannot automatically fix a poor experimental design


What Is Bias?

Bias is a systematic influence that pushes results or interpretations in a particular direction.

Bias can enter an investigation through:

  • Sample selection.
  • Measurement methods.
  • Expectations.
  • Experimental procedures.
  • Data collection.
  • Data interpretation.

Scientists try to identify and reduce sources of bias.


Selection Bias

Selection bias occurs when the sample being studied is not selected in a way that fairly represents the population relevant to the question.

Suppose a student asks:

What is the average height of students at our school?

They measure only members of the senior basketball team.

The sample is unlikely to represent the entire school.

A better approach would involve selecting students from the relevant school population using an appropriate sampling method.


Measurement Bias

Measurement bias can occur when a measuring method consistently favors particular results.

For example, suppose a ruler has a damaged end and every measurement begins at the damaged edge.

All measurements might be systematically too large or too small.

This produces a systematic error.


Observer Bias

Expectations can sometimes influence observations.

Suppose a researcher knows which plants received a new treatment and expects those plants to look healthier.

If "healthier" is judged subjectively, expectations might influence the assessment.

A more objective measurement could be:

  • Plant height.
  • Dry mass.
  • Number of leaves.

In some investigations, researchers can also use blinding so the person making measurements does not know which treatment each sample received.


Confirmation Bias

Confirmation bias is the tendency to focus more strongly on evidence that supports an existing expectation while overlooking contradictory evidence.

For example, a student predicts that fertilizer will increase plant growth.

If one fertilized plant grows poorly, the student should not simply ignore it.

Scientists should examine all relevant data, including results that do not support the original hypothesis.


Random Error

Not every difference is caused by bias.

Random errors produce unpredictable variation in measurements.

Examples include:

  • Human reaction time.
  • Small differences between biological organisms.
  • Slight fluctuations in temperature.
  • Small variations in equipment readings.

Repeating measurements can help reduce the influence of random error on the final result.


Systematic Error

A systematic error shifts measurements consistently in the same direction.

For example:

A balance reads:

+2.0 g

even when empty.

Every measurement may therefore be approximately 2.0 g too high unless the balance is correctly zeroed.

Repeating the measurement does not remove this systematic error.

The equipment or method must be corrected.


Random vs Systematic Error

Random Error Systematic Error
Causes unpredictable variation Shifts measurements consistently
Often reduced by repetition Usually not removed by repetition
Can affect precision Often affects accuracy
Example: reaction-time variation Example: incorrectly calibrated balance

Understanding this difference helps students improve experimental design.


Using a Control Group

Some fair tests require a control group.

Suppose the question is:

Does fertilizer increase plant growth?

Experimental Group

Plants receive fertilizer.

Control Group

Plants receive no fertilizer.

All other important conditions should be similar.

https://images.openai.com/static-rsc-4/_-0UJkKO_cGFoMC_ldgjVBoiDnCxEwX3C27BJQC2wnqmSygY7BAp7ud-KdN3aruc1fIWJciflVeMOax0hWGg6fXat1d0iPzf8mKjryMPaRBj72zSD3x_FoSL0kz82tMgoI48k4PSRBYeRIFdTuJekBWF0MrT2TjsCrb00lekFCTIuGlP9Gw1R9t23AqE08su?purpose=fullsize
 
https://images.openai.com/static-rsc-4/nEo6g9GDQG7tACRWbzO8A5KiGZzZXPuG1KkNt2AwNj7KCV6Je6ekrbIomjzHt1RTOkOyIwApDjg44gcasbxapxjIWDZuiRHVu7edbC9ULUDt0SyykS6ewXecMXN9L0ndHTqBasoquqKxtCxQaR_rdhT6oRpFWcZp-XIdusZXb9wzOjuokSgbxKCVQANBzbhY?purpose=fullsize
 
https://images.openai.com/static-rsc-4/nhkorK_6F-Gyc2jtZLwtHTCqOFqtK2ByqKUzbFKMX211Kz_QZtChIhBabga3VMkVQFCicptl2C63UrL21f_0gVb8p7SwCjMQ5KnxFnhjye0MNo3QU3BlGHc5xM983LLfhseB8YJqolLkK99TstfJVbQzg_TE6O9BLQM0aCHTDEuAL54eVjyvEwoRSeG8sOqK?purpose=fullsize
 
6

The control provides a baseline for comparison.


Control Group vs Controlled Variable

These are different concepts.

Control Group

A comparison group or condition.

Controlled Variable

A factor kept constant.

For the fertilizer investigation:

control group → plants receiving no fertilizer

while:

controlled variables → water, light, soil, temperature, plant species, pot size

Do not confuse the two.


Worked Example: Fertilizer and Plant Growth

Question:

How does fertilizer concentration affect bean plant growth?

Independent Variable

Fertilizer concentration.

Possible values:

0%, 1%, 2%, 3%, 4%

Dependent Variable

Change in plant height over 21 days.

Controlled Variables

  • Bean variety.
  • Starting size.
  • Soil type and amount.
  • Pot size.
  • Water volume.
  • Light exposure.
  • Temperature.
  • Growing time.

Control Condition

0% fertilizer

Reliability

Use several plants at each concentration.

Measurement

Measure plant height using the same method at regular intervals.

This is much stronger than using one plant for each concentration.


Worked Example: Ramp Investigation

Question:

How does ramp height affect the time a toy car takes to travel 2.0 m?

Independent Variable

Ramp height.

Dependent Variable

Travel time.

Controlled Variables

  • Same car.
  • Same ramp.
  • Same surface.
  • Same travel distance.
  • Same release procedure.
  • Same timing method.

Reliability

Repeat each height at least three times.

Processing Data

Calculate the mean time for each ramp height.

The results can then be graphed.


Worked Example: Temperature and Dissolving

Question:

How does water temperature affect the time required for sugar to dissolve?

Independent Variable

Water temperature.

Dependent Variable

Dissolving time.

Controlled Variables

  • Mass of sugar.
  • Volume of water.
  • Sugar particle size.
  • Container.
  • Stirring method.

Useful Temperatures

For example:

10°C, 20°C, 30°C, 40°C, 50°C

Reliability

Repeat each temperature several times.


Worked Example: Exercise and Heart Rate

Question:

How does exercise duration affect heart rate immediately after exercise?

Independent Variable

Exercise duration.

Dependent Variable

Heart rate immediately after exercise.

Variables Requiring Control

Depending on the design:

  • Type of exercise.
  • Exercise intensity.
  • Measurement method.
  • Timing of heart-rate measurement.
  • Recovery conditions.

Biological investigations can be difficult because people naturally differ.

Using repeated measurements or appropriate groups can help account for variation.


Evaluating an Investigation

Consider this investigation:

A student wants to determine whether light affects plant growth.

Plant A

  • 8 hours of light per day.
  • 100 mL water per day.
  • 25°C.

Plant B

  • 2 hours of light per day.
  • 30 mL water per day.
  • 15°C.

Is this a fair test?

No.

Three important variables changed:

  • Light.
  • Water.
  • Temperature.

If Plant A grows more, the student cannot determine which variable caused the difference.


Improving the Investigation

A better design could use:

Plant A

8 hours of light.

Plant B

2 hours of light.

Both receive:

  • 100 mL water per day.
  • Same temperature.
  • Same soil.
  • Same plant species.
  • Same pot size.
  • Same experimental duration.

Now the major deliberate difference is:

light exposure

The comparison is much fairer.


Sample Size

Using only one experimental subject can produce misleading results.

Suppose:

one fertilized plant grows 12 cm

and:

one control plant grows 8 cm

Can we confidently conclude that fertilizer caused the difference?

Not necessarily.

The individual plants may naturally grow at different rates.

Using multiple plants in each condition provides stronger evidence.


Random Assignment

When experimental subjects naturally vary, random assignment can help reduce bias.

Suppose 40 similar plants are divided into:

  • Fertilizer group.
  • Control group.

If the researcher deliberately places the healthiest-looking plants in the fertilizer group, the experiment becomes biased.

Randomly assigning plants to groups helps reduce this problem.


Standardized Procedures

A standardized procedure means performing measurements and treatments consistently.

For example:

  • Measure plants at the same time of day.
  • Use the same measuring instrument.
  • Use the same starting point.
  • Use the same person or clearly defined method when appropriate.
  • Follow the same procedure for every trial.

Standardization makes comparisons more reliable.


Designing a Fair Test

A useful procedure is:

Ask a Testable Question

For example:

How does temperature affect enzyme activity?

Identify the Independent Variable

Temperature.

Identify the Dependent Variable

Rate of enzyme activity.

Identify Controlled Variables

Keep relevant factors constant.

Select an Appropriate Range

Choose several suitable temperatures.

Decide How Measurements Will Be Made

Use a consistent and appropriate method.

Include a Control if Appropriate

Choose a meaningful baseline or comparison.

Repeat Trials

Collect enough data to assess variation.

Record All Results

Do not remove inconvenient results without justification.

Analyze the Data

Calculate averages where appropriate and look for patterns.

Evaluate the Method

Identify limitations and suggest realistic improvements.


Evaluating Scientific Validity

When evaluating an investigation, ask:

Does the experiment actually test the stated question?

Is only the intended independent variable deliberately changed?

Are important variables controlled?

Is the dependent variable measured appropriately?

Are measurements collected consistently?

Is the sample size adequate for the question?

Are trials repeated?

Are appropriate controls included where needed?

Could bias have influenced the results?

Are the conclusions supported by the data?

A scientifically strong investigation should survive this type of questioning.


Correlation Is Not Automatically Causation

Sometimes two variables change together.

This is called a correlation.

However, observing a correlation does not automatically prove that one variable caused the other.

For example, suppose researchers observe that two variables increase at the same time.

Possible explanations include:

  • Variable A causes B.
  • Variable B causes A.
  • A third variable influences both.
  • The relationship occurred by chance.

Well-controlled experiments can provide stronger evidence for causal relationships.


Fair Tests in Biology

Biological experiments can be challenging because organisms naturally vary.

Scientists may improve comparisons by:

  • Increasing sample size.
  • Randomly assigning organisms.
  • Using organisms of similar age or size where appropriate.
  • Maintaining consistent environmental conditions.
  • Repeating experiments.

Natural variation cannot always be eliminated, but it can be managed.


Fair Tests in Chemistry

Chemistry experiments may require control of:

  • Temperature.
  • Concentration.
  • Volume.
  • Mass.
  • Pressure.
  • Surface area.
  • Reaction time.

For example, when investigating concentration and reaction rate, temperature should normally remain constant unless temperature is the variable being investigated.


Fair Tests in Physics

Physics investigations may require control of:

  • Mass.
  • Distance.
  • Angle.
  • Surface.
  • Starting position.
  • Applied force.
  • Equipment.
  • Measurement method.

For example, when investigating ramp height and car speed, using a different car for every height could introduce another variable.


Fair Does Not Mean Perfect

Real experiments are rarely perfect.

Scientists may not be able to control every possible factor.

Instead, they try to:

  • Control the most important variables.
  • Measure carefully.
  • Reduce bias.
  • Repeat measurements.
  • Quantify uncertainty where appropriate.
  • Identify limitations.
  • Improve future investigations.

Scientific validity comes from thoughtful experimental design and transparent evaluation, not from pretending uncertainty does not exist.


Common Mistakes

Changing More Than One Independent Variable

This makes cause and effect difficult to determine.

Confusing the Independent and Dependent Variables

Remember:

IV → deliberately changed

DV → measured

Confusing Control Groups and Controlled Variables

A control group provides a comparison.

A controlled variable is kept constant.

Using Only One Trial

One result may be affected by random variation.

Using an Extremely Small Sample

Individual differences can strongly influence results.

Ignoring Anomalies

Unexpected results should be investigated rather than automatically deleted.

Thinking Repetition Fixes Systematic Error

Repeating a biased measurement usually reproduces the same bias.

Choosing Samples That Support the Hypothesis

Samples should be selected using an appropriate method rather than chosen to produce a desired outcome.

Changing the Measurement Method

The dependent variable should be measured consistently.

Claiming More Than the Evidence Shows

A conclusion should match the strength and limitations of the data.


Check Your Understanding

1. What is a fair test?

2. What is the independent variable?

3. What is the dependent variable?

4. What is a controlled variable?

5. Why should relevant variables be controlled?

6. Why does a fair test deliberately change one variable?

7. Identify the IV, DV, and three controlled variables in an investigation of ramp height and toy-car travel time.

8. Why are repeated trials useful?

9. What is an anomaly?

10. Should an anomalous result automatically be deleted? Explain.

11. What is the difference between accuracy and precision?

12. What is the difference between random and systematic error?

13. Why doesn't repeating an experiment necessarily remove systematic error?

14. What is experimental bias?

15. Give an example of selection bias.

16. How can observer bias influence results?

17. What is confirmation bias?

18. What is the difference between reliability and validity?

19. Why might a larger sample improve a biological investigation?

20. How can random assignment reduce bias?

21. Why are standardized procedures important?

22. A student changes both temperature and concentration while measuring reaction rate. Why is this not a fair test of temperature alone?

23. How could the investigation in Question 22 be improved?

24. Why does correlation not necessarily demonstrate causation?

25. Describe how you would design a fair test investigating how light exposure affects plant growth.


Key Terms

  • Fair test – investigation designed to make meaningful comparisons by deliberately changing an independent variable while controlling other relevant factors.
  • Independent variable – factor deliberately changed by the investigator.
  • Dependent variable – factor measured or observed.
  • Controlled variable – factor kept constant during an investigation.
  • Control group – comparison group used to help interpret experimental results.
  • Validity – extent to which an investigation appropriately answers the question it was designed to test.
  • Reliability – extent to which measurements or findings are consistent when repeated under comparable conditions.
  • Accuracy – closeness of a measurement to the accepted or true value.
  • Precision – closeness of repeated measurements to one another and the resolution with which measurements are expressed.
  • Bias – systematic influence that can push results or interpretations in a particular direction.
  • Random error – unpredictable variation between measurements.
  • Systematic error – consistent error that shifts measurements in a particular direction.
  • Anomaly – result noticeably different from the general pattern.
  • Sample size – number of experimental units or observations included.
  • Random assignment – assigning experimental units to groups using chance.
  • Standardized procedure – method performed consistently across trials or groups.
  • Confounding variable – uncontrolled factor that could provide an alternative explanation for an observed result.
  • Correlation – relationship in which variables change together.
  • Causation – relationship in which a change in one factor produces a change in another.

Key Takeaways

  • A fair test allows meaningful comparisons between experimental conditions.
  • The independent variable is deliberately changed.
  • The dependent variable is measured.
  • Other relevant variables should be controlled.
  • Fair testing does not mean keeping everything identical—the independent variable must change.
  • Appropriate controls can provide useful baselines.
  • Repeated trials help assess random variation and improve reliability.
  • Larger sample sizes can reduce the influence of individual variation.
  • Random assignment can reduce selection bias.
  • Standardized procedures make comparisons more consistent.
  • Random and systematic errors are different and require different solutions.
  • Repetition does not automatically correct systematic error.
  • Bias can enter an investigation through sampling, measurement, procedures, or interpretation.
  • Scientists should examine evidence that both supports and contradicts their hypotheses.
  • Reliability and validity are related but different.
  • A reliable investigation is not necessarily valid if it does not properly test the intended question.
  • A strong scientific conclusion should be supported by the data and acknowledge important limitations.
  • A useful summary of fair testing is:

change one relevant factor → control other important factors → measure consistently → repeat → compare → evaluate

4. Reliability and validity

Learning outcomes
  • I can distinguish between reliability and validity.
  • I can explain how repeated trials improve reliability.
  • I can evaluate whether experimental methods are valid.
  • I can identify factors that reduce reliability or validity.
  • I can suggest improvements to increase experimental quality.

Why Experimental Quality Matters

Collecting data does not automatically make an investigation scientifically useful. Scientists must also consider the quality of the evidence.

Two important ideas used to evaluate investigations are:

  • Reliability – are the results consistent?
  • Validity – does the investigation actually test what it is supposed to test?

A useful distinction is:

Reliability asks: "Can I get consistent results?"

Validity asks: "Am I actually testing the intended question?"

An investigation should ideally be both reliable and valid.


What Is Reliability?

Reliability describes the consistency of measurements or results when an investigation is repeated under comparable conditions.

Suppose a student measures the time for a toy car to travel down a ramp three times:

  • Trial 1: 2.42 s
  • Trial 2: 2.39 s
  • Trial 3: 2.41 s

The results are very similar.

This suggests that the measurement is reasonably reliable.

If the results were:

  • Trial 1: 1.84 s
  • Trial 2: 3.21 s
  • Trial 3: 2.46 s

there is much greater variation, so the results are less reliable.


Repeated Trials

One of the most important ways to improve reliability is to perform repeated trials.

Instead of collecting one measurement for each condition, scientists collect several.

For example:

Ramp Height Trial 1 Trial 2 Trial 3
10 cm 2.51 s 2.47 s 2.50 s
20 cm 2.13 s 2.10 s 2.12 s
30 cm 1.87 s 1.84 s 1.86 s

The repeated measurements allow the investigator to determine whether the results are consistent.


Why Repetition Improves Reliability

Repeated trials help scientists:

  • Identify unusual results.
  • Estimate how much measurements naturally vary.
  • Reduce the influence of random error when calculating a mean.
  • Determine whether a pattern appears consistently.
  • Detect problems with the experimental method.

One result could occur by chance.

A repeated pattern provides stronger evidence.


Calculating a Mean

Repeated measurements can often be summarized by calculating a mean.

Mean = sum of measurements / number of measurements

Suppose three measurements are:

12.4 cm, 12.7 cm and 12.5 cm

Mean = (12.4 + 12.7 + 12.5) / 3

Mean = 37.6 / 3

Mean = 12.53 cm

Depending on the measurement precision, this might reasonably be reported as:

12.5 cm


Identifying Anomalies

Repeated trials can also reveal an anomaly.

Consider:

4.21 s, 4.18 s, 7.96 s, 4.20 s

The measurement:

7.96 s

is very different from the others.

Possible explanations include:

  • Incorrect timing.
  • Equipment malfunction.
  • Recording error.
  • An inconsistent starting procedure.
  • An unexpected event during the trial.

An anomalous result should be investigated rather than automatically removed.


Range and Reliability

The spread of repeated measurements can provide information about consistency.

Consider two sets of measurements.

Experiment A

10.2 cm, 10.3 cm, 10.2 cm, 10.4 cm

Range:

10.4 − 10.2 = 0.2 cm

Experiment B

8.7 cm, 10.9 cm, 9.4 cm, 11.2 cm

Range:

11.2 − 8.7 = 2.5 cm

Experiment A shows much less variation between repeated measurements.

This suggests greater repeatability under those conditions.


Repeating vs Replicating

There are two useful ways to check scientific findings.

Repetition

The same investigator repeats measurements using the same or very similar equipment and method.

Replication

Other investigators independently perform the investigation.

If different scientists using appropriate methods obtain similar findings, confidence in the result increases.

Replication is particularly important in scientific research.


Reliability in Biological Experiments

Living organisms naturally vary.

Two plants of the same species may:

  • Grow at different rates.
  • Have slightly different masses.
  • Produce different numbers of leaves.
  • Respond differently to environmental conditions.

Using only one organism can therefore produce misleading results.

https://images.openai.com/static-rsc-4/_-0UJkKO_cGFoMC_ldgjVBoiDnCxEwX3C27BJQC2wnqmSygY7BAp7ud-KdN3aruc1fIWJciflVeMOax0hWGg6fXat1d0iPzf8mKjryMPaRBj72zSD3x_FoSL0kz82tMgoI48k4PSRBYeRIFdTuJekBWF0MrT2TjsCrb00lekFCTIuGlP9Gw1R9t23AqE08su?purpose=fullsize
 
https://images.openai.com/static-rsc-4/FAGQxEJwOqLIuxYOdzNXJLvqAWZYU9-Caw2BkOQE4Ejin4SRMhEX2ItY6CVo0LixFPg0fW5VB-LRLnRceOqITePDTbz6RzA-ncwy_FJ99XScar07MRFzTkInbFACIgxSTQKDQawH0-vrtMhAaD4QY_yiUWD3Jr920mybD5IXt13GsJylvXTlh8kyk39huSdj?purpose=fullsize
 
https://images.openai.com/static-rsc-4/rwgxgTL7LxjP_LnWb_uTFxoHw4OsZ1vY7kZpT7p6A62bylHUzqjKdafY0Jra2FGv1N2U12HyOAz9oaj_bF1DUDD8xK2j_f_WXz8cx6EbqIEWIbf6tJwD17b42kUwx9I4JBef0VsyEHLp4sULdnMu0D0MpGDmTAiZYi8Flq-oY8Tx_U-VgOSU9ylRvLUfKMnB?purpose=fullsize
 
5

Scientists often use larger sample sizes to reduce the influence of individual variation.


Sample Size

Imagine testing fertilizer using:

1 fertilized plant + 1 control plant

If the fertilized plant grows faster, this might simply reflect natural differences between the two plants.

A stronger investigation could use:

20 fertilized plants + 20 control plants

The larger sample provides more information about variation within each group.

Increasing sample size does not automatically make an investigation valid, but it can improve the reliability and precision of estimates.


Consistent Procedures

Reliability also depends on performing measurements consistently.

For example, when measuring plant height, students should:

  • Measure from the same starting point.
  • Use the same type of measuring instrument.
  • Measure using the same definition of plant height.
  • Record measurements consistently.

Changing the measurement method introduces additional variation.


What Is Validity?

Validity concerns whether an investigation and its measurements appropriately address the question being investigated.

Suppose the research question is:

How does fertilizer concentration affect plant growth?

A valid investigation should deliberately change fertilizer concentration while controlling other important factors that could affect growth.

If fertilizer concentration changes and water volume changes, the experiment cannot clearly isolate the effect of fertilizer.

This weakens the validity of the investigation.


Validity and Variables

A simple controlled experiment usually involves:

Independent Variable

The factor deliberately changed.

Dependent Variable

The factor measured.

Controlled Variables

Other relevant factors kept as constant as reasonably possible.

For a valid investigation:

the independent variable should be manipulated appropriately

and:

the dependent variable should actually measure the outcome relevant to the question

while:

important confounding variables should be controlled where possible.


Worked Example: Fertilizer

Question:

How does fertilizer concentration affect plant growth?

Independent Variable

Fertilizer concentration.

Dependent Variable

Change in plant height.

Controlled Variables

  • Plant species.
  • Starting plant size.
  • Soil type.
  • Pot size.
  • Water volume.
  • Light exposure.
  • Temperature.
  • Growing time.

If these variables are appropriately controlled, differences in growth can more reasonably be associated with fertilizer concentration.


An Invalid Comparison

Suppose:

Group A

Receives fertilizer, 200 mL water each day, and 10 hours of light.

Group B

Receives no fertilizer, 50 mL water each day, and 3 hours of light.

If Group A grows more, what caused the difference?

Possibilities include:

  • Fertilizer.
  • Water.
  • Light.
  • A combination of factors.

The investigation cannot clearly answer the original question.

Its validity is therefore weak.


Confounding Variables

A confounding variable is a factor that changes along with the independent variable and provides another possible explanation for the result.

For example:

Research question:

Does exercise increase heart rate?

Suppose:

  • Group A exercises in a cool room.
  • Group B exercises outdoors in extreme heat.

Temperature could also influence heart rate.

Temperature is therefore a potential confounding variable.

Confounding variables reduce the ability to determine cause and effect.


Measuring the Right Thing

Validity also depends on choosing an appropriate dependent variable.

Suppose the question is:

How does fertilizer affect plant growth?

The student measures:

soil temperature

Soil temperature might be interesting, but it does not directly measure plant growth.

More appropriate measurements might include:

  • Change in plant height.
  • Change in biomass.
  • Leaf area.

The measurement must match the research question.


Operational Definitions

Sometimes scientists need to define exactly how something will be measured.

Suppose the investigation asks:

Does fertilizer improve plant growth?

What exactly does growth mean?

It could mean:

  • Increase in height.
  • Increase in mass.
  • Increase in leaf area.
  • Increase in root length.

An operational definition states exactly how a variable will be measured.

For example:

Plant growth will be measured as the increase in stem height in centimetres over 21 days.

This makes the method clearer and easier to reproduce.


Reliable but Not Valid

An investigation can be reliable without being valid.

Suppose a broken balance always adds 5 g.

A true mass of 50 g might repeatedly be measured as:

  • 55.0 g
  • 55.0 g
  • 55.0 g

The results are extremely consistent.

They are therefore repeatable.

But the measurement is systematically wrong.

This demonstrates an important principle:

consistent results are not automatically correct or valid measurements.


Valid Idea but Unreliable Data

An investigation can also be appropriately designed but produce highly variable measurements.

Suppose students correctly investigate:

How does ramp height affect travel time?

They control all relevant variables but use inconsistent hand timing.

Results at one height are:

  • 1.4 s
  • 2.1 s
  • 1.6 s
  • 2.5 s
  • 1.3 s

The design may address the intended question, but the measurements have poor reliability.

A better timing system could improve the investigation.


Accuracy, Reliability, and Validity

These ideas are related but should not be confused.

Accuracy

How close is a measurement to the accepted or true value?

Reliability

How consistent are measurements or findings?

Validity

Does the investigation appropriately measure or test what it claims to?

https://images.openai.com/static-rsc-4/SRaOnDpD5DKaRXD9V72riVi_lC-hHxV1S17sRkgiMScWHFBhO0BhKmqNI8jlMmIsEQ3alljrxgFR9aTEigtQ-LTGwmcanSDfmE_KnE-jAz7MHdSkgwcut5oMi1956qn6qoFj_BnNsdBsNCYp9uGO_vfWJNRkLIXeogo036szFDj591eTBR0UtBnsUcv4f00U?purpose=fullsize
 
https://images.openai.com/static-rsc-4/lB6ERDs3af8v6LS5tM8uf6jZ6Sv_DLiayeKMAmuypXGseCYR2c7YZSyJOE1NR_fHLymJSEHUanWRifxIzQROq4lHfdZ3IKxdrYJ5aLDdFS3m3v481Jf1d1utSmtJagaI9KAMZXdgGRsqQ-moKOngVl5fR-7VYxXjue5dc4XSujJ3mGIwVs4j3hPc25qdKtSZ?purpose=fullsize
 
https://images.openai.com/static-rsc-4/6fdVXZHSLFrA4jleO92PPN1Cq_yIuqpaq_PlL4JlE-SO_RWp9UqtMz-xSDT-rnNf0hkhUqBgPntArsDRYpVCLr6bODxK3TklAGgPw2w02hNgN2zrO3vvOcb1y0AB7nSIWeaX3f1JsvoIWX2T2lff4675l-6QUyoH0Oko7PpDuDJ7m_uG0dgDdl1peZwak8i7?purpose=fullsize
 
4

A high-quality investigation aims for all three where they are applicable.


Random Error

Random error causes unpredictable variation between measurements.

Examples include:

  • Human reaction time.
  • Slight temperature fluctuations.
  • Small changes in equipment readings.
  • Natural biological variation.

Random errors often reduce reliability.

Repeated measurements can help reveal and reduce their influence on calculated averages.


Systematic Error

Systematic error consistently shifts measurements in a particular direction.

Examples include:

  • A balance that is incorrectly zeroed.
  • A thermometer that consistently reads 2°C too high.
  • Measuring length from the damaged end of a ruler.
  • A sensor that has been incorrectly calibrated.

Repeating measurements does not usually solve systematic error.

If the same faulty instrument is used repeatedly, it may repeatedly produce the same incorrect result.


Worked Example: Reaction Time

A student investigates:

How does temperature affect reaction rate?

The student measures the time required for a reaction to reach a particular endpoint.

At 30°C:

  • Trial 1: 42.1 s
  • Trial 2: 41.8 s
  • Trial 3: 42.3 s

These measurements are closely grouped.

This suggests good repeatability.

However, suppose the student also used twice the reactant concentration at 30°C compared with the other temperatures.

The comparison would not validly isolate the effect of temperature.

This demonstrates:

reliable measurements do not guarantee a valid experiment.


Worked Example: Toy-Car Ramp

Question:

How does ramp height affect the time required for a toy car to travel 2.0 m?

Improving Validity

Keep constant:

  • Car.
  • Ramp.
  • Surface.
  • Travel distance.
  • Release procedure.

Only ramp height should deliberately change.

Improving Reliability

  • Repeat each height several times.
  • Use a consistent release mechanism.
  • Use electronic timing if available.
  • Calculate a mean.

The same experiment requires different strategies to improve reliability and validity.


Worked Example: Enzyme Investigation

Question:

How does temperature affect enzyme activity?

Students test:

10°C, 20°C, 30°C, 40°C and 50°C

To improve validity, they should control:

  • pH.
  • Enzyme concentration.
  • Substrate concentration.
  • Reaction volume.
  • Measurement method.

To improve reliability, they should:

  • Repeat each temperature.
  • Use consistent equipment.
  • Calculate appropriate averages.
  • Investigate anomalous results.

Factors That Reduce Reliability

Reliability can be reduced by:

  • Too few repeated trials.
  • Very small sample sizes.
  • Inconsistent procedures.
  • Poorly controlled measurement conditions.
  • Human reaction-time differences.
  • Low-resolution equipment.
  • Natural variation between organisms.
  • Inconsistent equipment use.

These factors increase variation in results.


Factors That Reduce Validity

Validity can be reduced by:

  • Changing several variables simultaneously.
  • Failing to control important confounding variables.
  • Measuring the wrong dependent variable.
  • Using an inappropriate control.
  • Using a method that does not address the research question.
  • Systematic measurement problems.
  • Bias in experimental design.
  • Comparing groups under substantially different conditions.

Improving Reliability

Possible improvements include:

  • Repeat each measurement.
  • Increase sample size where appropriate.
  • Use a standardized procedure.
  • Use more precise or automated equipment.
  • Keep measurement methods consistent.
  • Train investigators to use equipment correctly.
  • Calculate means where appropriate.
  • Investigate anomalies.
  • Replicate the experiment independently.

Improving Validity

Possible improvements include:

  • Change only the intended independent variable in a simple fair test.
  • Control relevant confounding variables.
  • Include appropriate control conditions.
  • Measure a dependent variable that directly addresses the question.
  • Use an appropriate range of independent-variable values.
  • Calibrate measuring equipment.
  • Reduce sources of systematic bias.
  • Define variables clearly.
  • Ensure experimental and control groups are treated consistently apart from the intended difference.

Improving Both

Some changes can improve several aspects of experimental quality.

For example, using an electronic light gate instead of a handheld stopwatch in a motion experiment may:

  • Reduce human reaction-time variation.
  • Improve timing precision.
  • Standardize measurement.
  • Improve repeatability.

However, better equipment cannot fix every problem.

A highly precise sensor used in a badly designed experiment still produces evidence that may not answer the intended question.


Evaluating an Investigation

When evaluating reliability, ask:

Were trials repeated?

How similar were repeated measurements?

Was the sample size appropriate?

Were procedures performed consistently?

Are there unexplained anomalies?

When evaluating validity, ask:

Does the method actually test the research question?

Was the correct independent variable changed?

Was an appropriate dependent variable measured?

Were important confounding variables controlled?

Was an appropriate control used where necessary?


Example Evaluation

A student wants to determine whether salt concentration affects seed germination.

They use:

  • 10 seeds with pure water.
  • 10 seeds with 1% salt solution.
  • 10 seeds with 2% salt solution.
  • 10 seeds with 3% salt solution.

All seeds have:

  • The same species.
  • Similar environmental conditions.
  • Equal solution volumes.
  • The same temperature.
  • The same growing medium.
  • The same observation period.

The student records the percentage that germinate.

Validity

The design is reasonably valid for the stated question because salt concentration is deliberately changed while other important factors are controlled.

Reliability

Reliability could be improved by:

  • Using more seeds.
  • Repeating the entire investigation.
  • Repeating the experiment with additional batches.

This separates two different questions about experimental quality.


Evaluating Conclusions

Scientists must also consider whether conclusions are supported by the evidence.

Suppose the results show:

Salt Concentration Germination
0% 90%
1% 80%
2% 55%
3% 20%

A reasonable conclusion is:

Within the tested range and conditions, germination decreased as salt concentration increased.

A poor conclusion would be:

Salt always prevents all plants from germinating.

The data do not support such a broad claim.

Validity also involves making conclusions appropriate to the evidence collected.


Experimental Quality Is More Than Repetition

Repeating an experiment ten times does not automatically make it a good experiment.

Consider:

poor method × 10 repetitions

The same design problem may simply be repeated ten times.

A strong investigation needs:

appropriate design + suitable controls + reliable measurement + repetition + appropriate analysis


Reliability and Scientific Confidence

Science becomes stronger when findings can be reproduced by other investigators.

If many independent researchers obtain similar results using appropriate methods, confidence in the finding increases.

This is why scientists:

  • Publish methods.
  • Describe equipment.
  • Report experimental conditions.
  • Share data.
  • Replicate studies.
  • Compare results.

Science depends on evidence that can be checked.


Common Mistakes

"Reliable Means Correct"

Not necessarily.

A measurement can be consistently wrong.

"Valid Means the Results Are Similar"

Similarity between repeated results relates more directly to reliability.

Validity concerns whether the investigation appropriately addresses what it claims to test.

"Repeating an Experiment Makes It Valid"

Repetition improves information about reliability.

It does not automatically fix poor experimental design.

"One Measurement Is Enough"

One measurement provides little information about random variation.

"More Trials Fix Every Error"

Repeated trials can reduce the influence of random error but usually do not remove systematic error.

"A Large Sample Automatically Makes an Experiment Valid"

Large samples can be useful, but they cannot compensate for a fundamentally inappropriate method.

"Anomalies Should Always Be Deleted"

Anomalies should be investigated and handled with scientific justification.

"Controlling More Variables Always Improves the Experiment"

Only variables relevant to the question need to be controlled. Some variables cannot or should not be held constant depending on the investigation.


Check Your Understanding

1. Define reliability.

2. Define validity.

3. Explain the difference between reliability and validity.

4. Why are repeated trials important?

5. How can calculating a mean improve the usefulness of repeated measurements?

6. What is an anomaly?

7. Why should anomalies be investigated?

8. How can increasing sample size improve an investigation?

9. What is the difference between repetition and replication?

10. What is a confounding variable?

11. How can a confounding variable reduce validity?

12. Why must the dependent variable match the research question?

13. What is an operational definition?

14. Give an example of an investigation that is reliable but not valid.

15. Can an appropriately designed investigation still produce unreliable measurements? Explain.

16. What is the difference between random and systematic error?

17. Why can repeated trials reduce the influence of random error?

18. Why don't repeated trials usually remove systematic error?

19. Give three ways to improve reliability.

20. Give three ways to improve validity.

21. A student investigates temperature and reaction rate but changes concentration at each temperature. What problem does this create?

22. How could the investigation in Question 21 be improved?

23. A student obtains almost identical measurements using a balance that consistently reads 4 g too high. Are the measurements reliable? Explain.

24. Why doesn't highly precise equipment guarantee a valid experiment?

25. Explain why a scientifically strong investigation should consider both reliability and validity.


Key Terms

  • Reliability – consistency of measurements or findings when an investigation is repeated under comparable conditions.
  • Validity – extent to which an investigation and its measurements appropriately address the intended question.
  • Repeated trial – repeating a measurement or procedure under comparable conditions.
  • Replication – independent repetition of an investigation, often by other researchers.
  • Mean – sum of values divided by the number of values.
  • Range – difference between the highest and lowest values.
  • Anomaly – result that differs noticeably from the general pattern.
  • Sample size – number of experimental units or observations included in an investigation.
  • Confounding variable – uncontrolled factor that provides an alternative explanation for a result.
  • Operational definition – precise description of how a variable will be measured or identified.
  • Random error – unpredictable variation between measurements.
  • Systematic error – consistent error that shifts measurements in a particular direction.
  • Accuracy – closeness of a measurement to an accepted or true value.
  • Precision – closeness of repeated measurements to one another and the resolution of measurement.
  • Control – reference condition used to help interpret results.

Key Takeaways

  • Reliability and validity describe different aspects of experimental quality.
  • Reliability concerns consistency.
  • Validity concerns whether the investigation appropriately tests what it claims to test.
  • Repeated trials help assess reliability.
  • Means can reduce the influence of random variation.
  • Larger samples can reduce the influence of individual variation.
  • Anomalies should be investigated rather than automatically discarded.
  • Consistent procedures improve reliability.
  • Controlling important confounding variables improves validity.
  • The dependent variable must appropriately represent what the investigation is trying to measure.
  • Random errors mainly increase variation between measurements.
  • Systematic errors can consistently shift results.
  • Repetition does not normally eliminate systematic error.
  • An experiment can be reliable but not valid.
  • An appropriately designed experiment can still produce unreliable measurements.
  • Better equipment can improve measurement quality but cannot rescue a fundamentally poor experimental design.
  • Scientists improve experimental quality by evaluating both their methods and their data.

The central distinction is:

Reliability = Can I obtain consistent results?

Validity = Am I actually testing what I intend to test?

5. Improving procedures

Learning outcomes
  • I can identify weaknesses in an experimental method.
  • I can suggest realistic improvements to procedures.
  • I can reduce sources of experimental error.
  • I can improve data quality through better measurement techniques.
  • I can justify recommended improvements using scientific reasoning.

Why Scientists Improve Experimental Procedures

An experimental procedure is a set of instructions describing how an investigation will be carried out.

A good procedure should allow scientists to collect evidence that is:

  • Relevant to the research question.
  • Reliable.
  • As accurate and precise as reasonably possible.
  • Consistent.
  • Reproducible.
  • Safe.

Scientists rarely assume that their first procedure is perfect. After completing an investigation, they examine the method and ask:

What could have affected the results, and how could the investigation be improved?

This process is called evaluation.

https://images.openai.com/static-rsc-4/RzTuE8dTPfeXbEnUeUcCbTGnaIjEKuoNnhR3mmccWqiTB2abcJe5GZe6ECWOFCPCHhKXzI64RyZQpxG3rxBAwKINKXe1pj-PY0O9yoHfjeOGGjhf1aErMQjZnZ4nyPhRcAKmdB53tvuDtfUtXn7jlPMjvW9mL1il-jI4NVmNiz_sRRDRzaqLnOZ33YyDiPhN?purpose=fullsize
 
https://images.openai.com/static-rsc-4/nQpGY2lCWck0az9DyRvNcxNy4-A2R6kLD2nzd94riRvaazZdUbRh6dkPzzJuxoJ44UZp_9BCGCjlQX81s838_zmWOBxz1j2pEtVTP9GK_bgxcWuNS_fON8FTk1v-u7ar2PHp0D28ZkTDcIcSwvVdlt9NW1y6RXI2NzVIE_YQi0MZW2kiPYwJPFn0flC24muu?purpose=fullsize
 
https://images.openai.com/static-rsc-4/yizZXYRJsE_c4MlmHJKMMMYB-ko2PS9UNhLE1pBshvnbScZpBvyxF80dtp-9624lNhoMKgsQQdUzz-53S8IASG0zJAKpfkYk-7ikQhjEv2GRUbiXzxCrQxlPjNgUIQkkuw4QS6UQWfi5eMnnUfTiDpfGZz38Bs2_aNJOYpsJvspb5TuvdosvpVf-UZYAs7O_?purpose=fullsize
 
6

Identifying Weaknesses

A weakness is a feature of an experimental method that may reduce the quality of the evidence.

Common weaknesses include:

  • Too few trials.
  • Small sample size.
  • Poor control of variables.
  • Inappropriate measuring equipment.
  • Inconsistent procedures.
  • Human reaction time.
  • Subjective measurements.
  • Poorly defined endpoints.
  • Large measurement uncertainty.
  • Equipment that has not been calibrated.
  • An inappropriate range of values.
  • Missing control conditions.
  • Unclear instructions.

Identifying a weakness is only the first step.

A strong evaluation also explains:

how the weakness affects the results

and:

how the procedure could realistically be improved.


The Weakness–Effect–Improvement Approach

A useful way to evaluate a procedure is:

Weakness → Effect on data → Specific improvement → Why it helps

For example:

Weakness: A student uses a handheld stopwatch to measure a very short travel time.

Effect: Human reaction time introduces variation into the measurements.

Improvement: Use electronic light gates.

Why: Light gates automatically detect when the object passes and reduce timing variation caused by human reaction time.

This is much stronger than simply writing:

"Use better equipment."


Avoid Vague Improvements

Weak scientific evaluations often contain statements such as:

  • Be more careful.
  • Do it better.
  • Use better equipment.
  • Take better measurements.
  • Avoid mistakes.
  • Repeat it more.
  • Control everything.

These statements do not explain exactly what should change.

Instead, recommendations should be:

specific + realistic + scientifically justified


Example: Timing a Toy Car

Suppose students investigate:

How does ramp height affect the time taken for a toy car to travel 2.0 m?

They release the car by hand and use a handheld stopwatch.

Possible weaknesses include:

  • Human reaction time.
  • Inconsistent release of the car.
  • Too few trials.
  • Inaccurate measurement of ramp height.
  • Changes in the surface.
  • The car not travelling in a straight line.
https://images.openai.com/static-rsc-4/M91kbNGeOAmWovWVT_PR437P97RS7DS0UMdWH_jgbxOKWuKqSSA8ndGPOoX7GWG0ZE_KzoUqj0DtT0SWO_ouuzLv91gGr98EsP8BZkGaI52A7Y51ydPCizNo5kfUVBO_fCgOp_1lNp4dOVJKepxMSzG2gBnsTAIJsHLp5AGQEo9SDTYPEmd6YExLJnvyEX4u?purpose=fullsize
 
https://images.openai.com/static-rsc-4/vNseGmNWqO2VVuxx-0Grzf5JI915z5zlwSGyQjouCIVpLDaS-Usr2uZAcnuwaG68nFGzkCJbmLBPgl5msdniBKiSr3IbM5QgFOw-8Flo_0dGD6UE6TQ7Pe2g7Q4XaXSkGlKvte_UK5zhdEoRmr3EWkIpG-96t7-HX3tFaX-BEeMgVFx1AoSOcs0mfUDZtHPW?purpose=fullsize
 
https://images.openai.com/static-rsc-4/ys6tyzej_kZjUPVTqkHLNOK9yf-S2H9tDcatBXivTkETYgSwnOpyDUWkI4NrSkL1MIH4yXZoUWpIiv1uSaET8I1JveIVAErMpwRRR5TrpAPSGVsTPhh1bTgGXJ8qDLnPqQgFMXKHg3u22c1QewXefi4fyPFFVtNavZ_cWGHiRD2X3wjYbxyVuKMdTXrcAndO?purpose=fullsize
 
6

Improving the Toy-Car Investigation

Weakness: Hand Timing

Human reaction time affects the start and stop of the stopwatch.

Improvement: Use electronic light gates or motion sensors.

Reason: Automatic timing reduces human reaction-time error.


Weakness: Hand Release

A student might accidentally push the car.

Improvement: Use a fixed release mechanism such as a gate or barrier that can be removed without pushing the car.

Reason: Each trial begins under more consistent conditions.


Weakness: One Trial

A single measurement may be affected by random variation.

Improvement: Repeat each ramp height at least three times and calculate a mean.

Reason: Repetition helps identify unusual results and reduces the influence of random variation on the final value.


Measurement Quality

Better procedures often begin with better measurements.

Scientists should consider:

  • What quantity is being measured?
  • What instrument is being used?
  • What is the instrument's resolution?
  • Is the instrument appropriate for the expected measurement?
  • Has it been correctly zeroed or calibrated?
  • Is the same technique used every time?

Choosing an appropriate instrument can significantly improve data quality.


Instrument Resolution

Resolution is the smallest change an instrument can display or distinguish.

Suppose two rulers are available.

Ruler A

Smallest division:

1 cm

Ruler B

Smallest division:

1 mm

For measuring the length of a small object, Ruler B allows finer measurements.

However, greater resolution does not automatically make a measurement accurate. The instrument must also be used correctly.


Choosing Suitable Equipment

Different measurements require different instruments.

Quantity Possible Instrument
Mass Balance
Temperature Thermometer or temperature probe
Time Stopwatch, light gate or electronic timer
Length Ruler, metre stick or calipers
Volume Measuring cylinder, pipette or burette
Force Force sensor or Newton meter
pH pH paper or pH meter

The most suitable instrument depends on the required range and precision.


Measuring Volume

Suppose students need exactly 25.0 mL of solution.

Using a large beaker marked every 50 mL would provide poor measurement quality.

A more appropriate instrument might be:

  • Measuring cylinder.
  • Pipette.
  • Burette.

The choice depends on the investigation and required precision.

https://images.openai.com/static-rsc-4/H0zW_MUc8rBWbK6q6Pl0kIMWPyde9Ia26_vN44eUH-kIrky2P99CgCSQFBVhUJ-2exq6nJQuMTUo7TGMqXdLDMLM-4pEWfFIWsIeW2H3cdVWRaQcdoXblvMe9Lkw7-V9TM6uipgUSE8OdUUCEpjOL__jONx7RaqIG3i4Q-0PYQgwKPU6Hun3uNCAH2LF_4d6?purpose=fullsize
 
https://images.openai.com/static-rsc-4/rkzc_yxeKCKFDJk2AnmMg3AMo1yLjlmZ2xduX4OdboKIDcyXP6UsHoqhcy0LK7gEgs2cnFp_59Qx9EZ0Ray-4eaqAB8giER_8jXb83gU2htD0sTWE0bo4kb3xFkNnOrDhgRTyjnkoaJUh3bMrAUfa30JZ8_9VMQFsplPioj8WLEiDXeZ-KsnT9P0fL78zd3z?purpose=fullsize
 
https://images.openai.com/static-rsc-4/xcEtuhwhpxHLSHP8O7ETk3osCIn2WH-wAFEJidTFl2aNVebhTun8GM9xD3Qw03xZsi9IW3pRS7I45lO0uvfH61cWLlrHAttxMe2wuztDF0XUDF7QzWwdY6gNaZUoZq3FEODcXnPHdXRLAPbWhG9XI4Lsdp4_77bZQRJrahbMAsN4tInj3aWmbiCQSNw5gjdi?purpose=fullsize
 
6

Reading a Meniscus

When measuring the volume of many liquids in laboratory glassware, the surface curves.

This curved surface is called the:

meniscus

For water and many aqueous solutions, the measurement is generally read from the bottom of the meniscus, with the eye level with the liquid surface.

Viewing from above or below can introduce:

parallax error


Parallax Error

Parallax error occurs when a scale is viewed from an incorrect angle.

This can affect measurements from:

  • Rulers.
  • Measuring cylinders.
  • Analogue meters.
  • Thermometers with scales.

A simple improvement is:

view the scale directly at eye level and perpendicular to the scale where appropriate.


Zeroing Equipment

Some instruments should be checked or zeroed before measurements begin.

For example, a balance should normally read:

0.00 g

before an object is measured.

If it reads:

2.00 g

when empty, every measurement could be systematically too high.

Repeated trials will not solve this problem.

The procedure should instead include:

check and zero the balance before collecting data.


Calibration

Calibration involves checking an instrument against known standards or reference values and adjusting or accounting for its response where appropriate.

Examples include:

  • Checking temperature probes.
  • Calibrating pH meters.
  • Checking electronic balances.
  • Calibrating sensors.

Calibration can help reduce systematic measurement problems.


Random Error

Random error produces unpredictable variation between measurements.

Possible causes include:

  • Human reaction time.
  • Small environmental fluctuations.
  • Natural biological variation.
  • Slight differences in release technique.
  • Small fluctuations in instrument readings.

Random error cannot usually be eliminated completely.

However, its influence can often be reduced.


Reducing Random Error

Possible improvements include:

  • Repeat measurements.
  • Increase sample size.
  • Calculate a mean.
  • Use automated measurement equipment.
  • Standardize procedures.
  • Maintain stable environmental conditions.

The correct improvement depends on the source of variation.


Systematic Error

Systematic error causes measurements to be consistently shifted in a particular direction.

Examples include:

  • A balance incorrectly reading +3 g.
  • A thermometer consistently reading 2°C too high.
  • A ruler with a damaged zero point.
  • An incorrectly calibrated sensor.

Repeating the measurement does not normally eliminate systematic error.

The method itself must be corrected.


Improving Systematic Error

Possible improvements include:

  • Zero equipment before use.
  • Calibrate instruments.
  • Replace damaged equipment.
  • Check instruments against known standards.
  • Correct the measurement technique.

Therefore:

random error → repetition may help

but:

systematic error → fix the method or equipment


Controlling Variables

Poor control of variables is a major weakness in experimental procedures.

Suppose students investigate:

How does temperature affect reaction rate?

They should normally control factors such as:

  • Reactant concentration.
  • Reactant volume.
  • Surface area of solid reactants.
  • Mixing method.

If concentration also changes, the investigation cannot clearly isolate the effect of temperature.


Improving Variable Control

Instead of saying:

"Control the variables better."

identify the specific variable.

For example:

Keep the hydrochloric acid concentration at 1.0 mol/L for every trial so that changes in reaction rate can be attributed more confidently to temperature rather than concentration.

This is a scientifically justified improvement.


Standardizing Procedures

A standardized procedure is performed in the same way during every trial.

Suppose students measure plant height.

Different students might measure:

  • From the soil.
  • From the bottom of the pot.
  • To the highest leaf.
  • To the top of the stem.

Their results would not be directly comparable.

The procedure should clearly define:

Measure vertically from the soil surface to the highest point of the main stem.

This improves consistency.


Defining an Endpoint

Some experiments require students to decide when a process is "finished."

Examples include:

  • When a tablet has completely dissolved.
  • When a color has disappeared.
  • When a reaction stops producing gas.
  • When a precipitate makes a mark impossible to see.

If the endpoint is subjective, different people may make different decisions.

This reduces reliability.


Improving Endpoints

Where possible, replace subjective judgments with objective measurements.

Instead of:

"Stop timing when the solution looks clear."

a procedure might use:

  • A colorimeter.
  • A light sensor.
  • A gas sensor.
  • A fixed threshold reading.

Automated or quantitative measurements can reduce observer variation.


Sample Size

Using too few samples can make an investigation strongly affected by natural variation.

Suppose students investigate fertilizer using:

one fertilized plant

and:

one control plant

The plants may naturally grow at different rates.

A better method would use several plants in each condition.

For example:

10 plants per condition

may provide stronger evidence than one plant per condition.


Why Larger Samples Help

Larger samples can:

  • Better represent natural variation.
  • Reduce the influence of unusual individuals.
  • Allow averages to be calculated.
  • Provide more reliable comparisons.

However, sample size should remain realistic given:

  • Time.
  • Equipment.
  • Cost.
  • Space.
  • Ethical considerations.

"Use 10,000 plants" is not a realistic improvement for most school investigations.


Repeated Measurements

Suppose a student records:

Temperature = 23.4°C

once.

There is no information about measurement variation.

Instead, several readings or repeated trials may provide:

23.4°C, 23.6°C, 23.5°C

The student can examine the spread and calculate an appropriate mean.

Repeated measurements provide information about reliability that one measurement cannot.


Selecting an Appropriate Range

An experiment may have a poor range of independent-variable values.

Suppose students investigate temperature and reaction rate using:

20°C and 21°C

The difference may be too small to reveal a useful pattern.

A more suitable range might be:

10°C, 20°C, 30°C, 40°C and 50°C

provided those temperatures are scientifically appropriate and safe.

A useful range should:

  • Cover enough values to reveal a pattern.
  • Include sensible intervals.
  • Remain safe.
  • Remain relevant to the research question.

More Data Points

Two values can show a difference, but several values can reveal a relationship.

For example:

10°C → 85 s

50°C → 21 s

shows a difference.

But:

10°C → 85 s

20°C → 63 s

30°C → 46 s

40°C → 32 s

50°C → 21 s

provides much more information about the pattern.

More appropriately spaced data points can improve the quality of the conclusion.


Worked Example: Pendulum

Suppose students investigate:

How does pendulum length affect period?

Weak method:

  • Measure one swing.
  • Use a handheld stopwatch.
  • Test only two lengths.

Possible improvements:

Time Multiple Oscillations

Measure the time for 10 oscillations instead of one.

Then calculate:

Period = total time / 10

Why?

The total measured time is longer, so human reaction time represents a smaller percentage of the measurement.

Repeat Measurements

Repeat the measurement several times.

Test More Lengths

Use several appropriately spaced pendulum lengths.

Control Other Variables

Keep the release angle reasonably consistent.

https://images.openai.com/static-rsc-4/EeVdOyVfUpNHH2YlurQbr8eHhoPB9DJu-n7SKhKzab4GJqxxTwZY_nwQDmr3yIy7KZ-C8t3mzQuOcilJvxndzhvtnWUlQhknQb6aXv11tdGGSOF07CxbK1ykU_evfzreIuV-6vIPvezvc-OBTTis3Zsxp2zKVuufuZ01kxy7SuvFKzmK58XACrL1a4ngE6sk?purpose=fullsize
 
https://images.openai.com/static-rsc-4/IJH2EjXuI1ARSe8XkVLuOtokU2RvcXP0mS1TPR6c4t_Zci7TtkWFHEH9zNcVm82GIRJWYCDcdmss7sni46TfQMAWxS5mO9T2KNz9s-4JV4sLcV7a_HsC6fs7_tKPrd-YlYadCIyb0NR2O2vS7EGE30FBnV98k7HHTKuzZYxNcS5VpPo2jknAMPOt0m05X2wX?purpose=fullsize
 
https://images.openai.com/static-rsc-4/Odkci6K5wSmzx_aBOVgKKsUnYWQTL4GtxYdVHxdIH--0i-XR2g8srEHuJ2MPjrXHhVBXcXqQ711PgiaKs4HYh-p-N3iZn31FBLp5LF0aMUCHRXumN0KdOLjSzBt4qgtVj3lHxeQt8uTLlvc8RBMKSuH4ittgHYkydZeUSp3WWlVpAEBTFyK6_4aHk9UBcQdg?purpose=fullsize
 
6

Worked Example: Reaction Rate

Students investigate how temperature affects reaction rate.

They measure gas production using a balloon.

Weakness

Balloon size is difficult to measure accurately and may vary between balloons.

Improvement

Collect the gas using a gas syringe.

Why?

A gas syringe provides a direct quantitative measurement of gas volume.

This can improve precision and make comparisons easier.


Worked Example: Plant Growth

Students investigate the effect of fertilizer on plants.

They use:

  • One plant with fertilizer.
  • One plant without fertilizer.

Weakness

The sample size is too small to account well for natural variation.

Improvement

Use multiple plants in each condition.

Why?

A larger sample reduces the influence of unusual individual plants and provides a better estimate of typical growth.


Worked Example: Dissolving

Students investigate how temperature affects dissolving time.

Different students stir at different speeds.

Weakness

Stirring rate is not controlled.

Effect

Differences in dissolving time could be caused partly by stirring rather than temperature.

Improvement

Use the same stirring procedure for every trial, or use a mechanical stirrer set to the same speed.

Why?

This controls stirring and improves the validity of the comparison.


Worked Example: Measuring Temperature

A student removes a thermometer from a liquid before reading it.

Weakness

The thermometer may begin changing temperature after removal.

Improvement

Read the thermometer while it remains correctly positioned in the liquid, if appropriate for the instrument.

Why?

This reduces changes between the actual experimental temperature and the recorded measurement.


Worked Example: Free Fall

Students drop a ball and use a handheld stopwatch to measure a fall lasting approximately:

0.5 s

Human reaction time is a substantial fraction of such a short interval.

Improvement

Use:

  • Light gates.
  • Motion sensors.
  • Video analysis with known frame rate.

These methods can provide more appropriate timing measurements.


Digital Measurement Techniques

Modern experiments can often use electronic sensors.

Examples include:

  • Temperature probes.
  • Light sensors.
  • Force sensors.
  • Motion sensors.
  • pH probes.
  • Pressure sensors.
  • Gas sensors.
https://images.openai.com/static-rsc-4/vdhiLeSyuJxGprTRz3nOROQIAViSHc8Gyv2vfL_hLIvRqluwwhyO_WRAW4wPi2NPzm03XXf0saZbHP7g7sFqBi6O3rvg75EnvTAVB8BC9EQwin1KKPGm88R94_nh8qKK320FETTh4GGjZBKiD2yQyoQHBoYQlyXCkMmxCsdc7kzjmfL98SH8ofHiPjqk-TP_?purpose=fullsize
 
https://images.openai.com/static-rsc-4/R8eeWxTjdZcF2YT-NaGr80UpP8CzTEZWiU25RSDpxw9f-tnTA9mmCWG6VoOcRf7DMO4dIdC8Nn_S4uO48w6vKcPHM8ODDp1Q8DyZIHW8uon1hezx9lHFR3Vd09sxq7pFINbmxzvQz768MDpw1qCezaN4h75Hl35_1gIFKc4YqmSqrmp8v-QIkPkf4fN20GlI?purpose=fullsize
 
https://images.openai.com/static-rsc-4/W9JYOuBkpUKEWYsR0e1Tyv1K5aVb0bjOv0TcE9jq2DzwB6ub-qqoIyW_im5DS6e6ObElpY7WZjKFLir2Z5PyVjq95zRbzyjHg6OYdEhpMozoZBEwujqmM41OwnbORixQf2r7jQyDRoJOLcb481iLUULEor7KSaM2zQnfm4U_2IGf6p8eYWii2zQrsZv-kN5v?purpose=fullsize
 
6

Sensors can:

  • Take frequent measurements.
  • Reduce some human reading errors.
  • Record changes automatically.
  • Produce large datasets.
  • Measure rapidly changing quantities.

However, sensors still need appropriate calibration and correct use.


Video Analysis

Video can improve some motion experiments.

Students can record an object moving and analyze its position frame by frame.

If the frame rate is known, time intervals can be determined.

Video analysis can be useful for:

  • Projectile motion.
  • Falling objects.
  • Collisions.
  • Toy-car investigations.
  • Sports movements.

It also creates a record that can be reanalyzed.


Avoiding Bias

Bias can also arise from the procedure.

Suppose a student expects fertilized plants to grow taller and unconsciously measures those plants differently.

Possible improvements include:

  • Use objective measurement criteria.
  • Label samples using codes.
  • Use automated measurements where practical.
  • Have measurements checked independently.

These strategies can reduce the influence of expectations.


Recording Data Immediately

Measurements should normally be recorded as they are collected.

Waiting until later can introduce:

  • Memory errors.
  • Missing data.
  • Transcription mistakes.

A prepared data table can make data collection more consistent.

For example:

Temperature (°C) Trial 1 (s) Trial 2 (s) Trial 3 (s) Mean (s)
10        
20        
30        
40        
50        

Recording Units

Every measured quantity should include appropriate units.

Poor:

Time = 14.2

Better:

Time = 14.2 s

Without units, the measurement is incomplete.


Recording Appropriate Precision

Measurements should reflect the resolution of the instrument.

If a ruler measures to the nearest millimetre, reporting:

12.638472 cm

would suggest a level of precision that the instrument did not provide.

Data should not imply greater measurement precision than was actually available.


Safety and Procedure Improvements

A procedure is not improved if it becomes unnecessarily dangerous.

Possible safety improvements include:

  • Use lower concentrations where appropriate.
  • Use smaller quantities.
  • Wear appropriate eye protection.
  • Use heatproof equipment.
  • Secure unstable apparatus.
  • Keep electrical equipment away from water.
  • Use appropriate handling procedures.

Scientific quality and safety must be considered together.


Realistic Improvements

A recommendation should be practical.

For example:

Weak recommendation:

"Use a perfect timer with no error."

Such equipment does not exist.

Better recommendation:

"Use electronic light gates instead of hand timing to reduce variation caused by human reaction time."

Science aims to reduce and understand uncertainty, not pretend that uncertainty can be completely eliminated.


Matching Improvements to Problems

Problem Possible Improvement
Human reaction time Automated timing
Too few trials Repeat measurements
Small biological sample Increase sample size
Poor volume measurement Use more appropriate volumetric equipment
Parallax Read scale at eye level
Balance not zeroed Zero balance before use
Sensor systematic offset Calibrate sensor
Inconsistent release Use fixed release mechanism
Subjective endpoint Use quantitative sensor or defined threshold
Uncontrolled temperature Use controlled-temperature equipment
Narrow IV range Test a wider appropriate range
Too few IV values Add appropriately spaced values
Inconsistent procedure Standardize the method

Improving Reliability

To improve reliability, scientists might:

  • Repeat trials.
  • Increase sample size.
  • Standardize procedures.
  • Use automated measurements.
  • Reduce random variation.
  • Calculate means where appropriate.
  • Investigate anomalies.

Improving Validity

To improve validity, scientists might:

  • Control important confounding variables.
  • Change only the intended independent variable in a simple controlled experiment.
  • Use appropriate control conditions.
  • Measure the correct dependent variable.
  • Use an appropriate experimental range.
  • Reduce systematic errors.
  • Ensure the procedure actually answers the research question.

Improving Accuracy

To improve accuracy, scientists might:

  • Calibrate equipment.
  • Zero instruments correctly.
  • Use appropriate measuring instruments.
  • Avoid parallax.
  • Follow correct measurement procedures.
  • Check instruments against known standards.

Improving Precision

To improve measurement precision where needed:

  • Use instruments with suitable resolution.
  • Use electronic sensors where appropriate.
  • Measure longer intervals where this reduces percentage uncertainty.
  • Standardize measurement techniques.

The most precise instrument is not always necessary. Equipment should be appropriate for the investigation.


Percentage Uncertainty

The importance of measurement uncertainty depends partly on the size of the measurement.

A useful approximation is:

percentage uncertainty = absolute uncertainty / measured value × 100%

Suppose timing uncertainty is approximately:

±0.2 s

For a measurement of:

1.0 s

percentage uncertainty is approximately:

0.2 / 1.0 × 100% = 20%

For a measurement of:

10.0 s

it is:

0.2 / 10.0 × 100% = 2%

This explains why measuring longer time intervals can sometimes improve measurement quality.


Justifying an Improvement

A strong scientific recommendation contains three parts.

Identify the Problem

The car is released by hand.

Recommend a Specific Improvement

Use a mechanical release mechanism.

Explain Why

This reduces variation in the initial push and gives each trial more consistent starting conditions.

Therefore:

problem → improvement → scientific reason


Example Evaluation Paragraph

A weak evaluation might say:

The experiment could be improved by being more careful and repeating it.

A stronger evaluation would say:

The travel time was measured using a handheld stopwatch, so human reaction time may have increased variation between trials. Electronic light gates could be placed at the start and finish points to measure the travel time automatically. This would reduce timing variation and improve the reliability and precision of the measurements.

The second response identifies:

  • The weakness.
  • Its effect.
  • A realistic improvement.
  • Why the improvement works.

Prioritizing Improvements

Not every weakness has the same importance.

Suppose an experiment contains:

  • Slight uncertainty in measuring 100 mL of water.
  • Only one trial.
  • Two variables changed simultaneously.

The most serious issue is probably:

changing two variables simultaneously

because this directly affects whether the investigation can answer its research question.

Scientists should prioritize improvements that have the greatest effect on the quality and interpretation of the evidence.


Evaluating the Whole Procedure

When reviewing an experimental method, ask:

Variables

  • Is the independent variable clearly changed?
  • Is the dependent variable measured appropriately?
  • Are important variables controlled?

Measurements

  • Is the equipment suitable?
  • Is its resolution appropriate?
  • Is it correctly calibrated or zeroed?
  • Are measurements taken consistently?

Reliability

  • Are there repeated trials?
  • Is the sample size sufficient?
  • Are anomalies investigated?

Validity

  • Does the method actually answer the research question?
  • Are there important confounding variables?

Data Quality

  • Are units recorded?
  • Is precision appropriate?
  • Is the range useful?

Safety

  • Are hazards controlled appropriately?

Common Mistakes

"Be More Careful"

This is too vague.

Explain exactly what should change.

"Repeat the Experiment to Make It Accurate"

Repetition primarily helps evaluate and reduce the influence of random variation. It does not automatically correct systematic error.

"Use Better Equipment"

Name the equipment and explain why it is better for the measurement.

"Control All Variables"

The independent variable must change. Relevant controlled variables should remain constant where appropriate.

"Remove the Anomaly"

Investigate the anomaly first. Do not delete data simply because it does not fit the expected pattern.

"Use More Decimal Places"

More decimal places do not automatically produce better data.

"Use a Bigger Sample" Without Explanation

Explain that a larger sample can reduce the influence of individual variation and provide a better estimate of typical behavior.

"Eliminate All Error"

No real experiment is completely free of uncertainty.

A better goal is to:

identify, reduce, measure, and account for uncertainty.


Check Your Understanding

1. What is meant by a weakness in an experimental procedure?

2. Why is "be more careful" a poor experimental improvement?

3. Explain the weakness–effect–improvement approach.

4. How can human reaction time affect stopwatch measurements?

5. How could light gates improve a toy-car investigation?

6. Why should a car be released using a consistent mechanism?

7. What is instrument resolution?

8. Why should equipment be zeroed before use?

9. What is calibration?

10. What is parallax error, and how can it be reduced?

11. Why might a measuring cylinder be more appropriate than a beaker for measuring liquid volume?

12. How can repeated trials improve data quality?

13. Why doesn't repetition normally eliminate systematic error?

14. How can increasing sample size improve a biological investigation?

15. Why should experimental procedures be standardized?

16. What is a subjective endpoint?

17. How could a subjective endpoint be made more objective?

18. Why should an experiment use an appropriate range of independent-variable values?

19. Why are several data points usually more informative than only two?

20. A pendulum period is very short. Explain why timing 10 oscillations may be better than timing one.

21. Students measure gas production using balloon size. Suggest and justify a better method.

22. Students investigate temperature and reaction rate but use different reactant concentrations. Identify the weakness and suggest an improvement.

23. A balance reads 2.0 g when empty. Explain how this should be addressed.

24. Explain the difference between reducing random error and correcting systematic error.

25. Write a complete justified improvement for an experiment in which students use a handheld stopwatch to measure a 0.4 s event.


Key Terms

  • Experimental procedure – instructions describing how an investigation is performed.
  • Evaluation – examination of the strengths, weaknesses, limitations, and quality of an investigation.
  • Improvement – specific change intended to strengthen an experimental method.
  • Random error – unpredictable variation between measurements.
  • Systematic error – consistent error that shifts measurements in a particular direction.
  • Resolution – smallest change an instrument can display or distinguish.
  • Calibration – checking an instrument against known standards or reference values.
  • Parallax error – measurement error caused by viewing a scale from an incorrect angle.
  • Reliability – consistency of measurements or findings.
  • Validity – extent to which an investigation appropriately addresses the intended question.
  • Accuracy – closeness of a measurement to an accepted or true value.
  • Precision – closeness of repeated measurements and the resolution with which measurements are expressed.
  • Sample size – number of experimental units or observations included.
  • Anomaly – result noticeably different from the general pattern.
  • Endpoint – defined point at which a measurement or reaction is considered complete.
  • Confounding variable – uncontrolled factor that provides an alternative explanation for a result.
  • Percentage uncertainty – uncertainty expressed as a percentage of the measured value.

Key Takeaways

  • Scientists evaluate procedures to identify weaknesses and improve the quality of evidence.
  • A strong improvement is specific, realistic, and scientifically justified.
  • A useful evaluation follows:

weakness → effect → improvement → reason

  • Repeated trials help reduce the influence of random variation and assess reliability.
  • Increasing sample size can reduce the influence of individual biological variation.
  • Systematic errors usually require changes to equipment or technique rather than additional repetitions.
  • Instruments should have an appropriate range and resolution.
  • Equipment should be correctly zeroed and calibrated.
  • Automated timing can reduce human reaction-time variation.
  • Standardized procedures improve consistency.
  • Objective measurements are generally preferable to subjective judgments.
  • Important confounding variables should be controlled.
  • Appropriate ranges and multiple data points make patterns easier to identify.
  • Better measurement techniques can improve accuracy, precision, and reliability.
  • Improvements should target the actual source of the problem.
  • More expensive equipment is not automatically better; it must be appropriate for the measurement.
  • Experimental improvements must remain safe and practical.
  • Scientists cannot eliminate all uncertainty, but they can reduce and evaluate it.
  • The strongest recommendations explain not only what should change, but also why that change improves the investigation.