Experiments are conducted to test how introducing an intervention, also known as a variable, affects what happens. Hypothesis testing is used to test variable relationships. It is necessary to control all other factors to ensure that you are measuring the impact of the intervention you have introduced.
Experiments are used in explanatory research based on causal logic, which identifies causal relationships between variables. For instance, A causes B or A causes B under C circumstances. Certain necessary conditions must be present to support the presence of a causal relationship. The cause must precede the effect (temporal order), the reason must be related to the effect, and there must be no alternative explanation.
Explained in terms of variables (Leavy, 2022):
- The independent variable must precede the dependent variable, and a relationship must exist between the two.
- No extraneous variable can provide an alternative explanation for the dependent variable.
- Experimental groups receive the experimental intervention (the experimental stimulus), while control groups do not.
- In some cases, the control group may receive a placebo.
- All experiments have at least one experimental group, but not all experiments have control groups.
- Using control groups is necessary to accurately compare the results of the experimental group whose members received the intervention with those of a similar group whose members did not.
- Depending on the type of experiment, there may be one, two, or four groups in total.
- Some experiments involve pretests and/or post-tests in addition to the experimental intervention.
- A pretest determines a subject's baseline before introducing the experimental intervention.
- A post-test is given after the experimental intervention to assess the impact of the intervention.
When forming a hypothesis, it is essential to identify independent and dependent variables. The hypothesis should be a plausible statement of how the independent variable interacts with the dependent variable. Additionally, potential control variables must be identified.
The next step involves determining how to measure the independent, dependent, and control variables. During the operationalisation process, it is crucial to ensure high content validity between the numerical representation and the conceptual definition of any given concept.
Once the variables are defined and operationalised, the researcher must consider sampling. Which empirical referents will be used to test the hypothesis?
Stockermer (2019) point out that measurement and sampling are typically done simultaneously because the empirical referents that the researcher studies may affect the choice of operationalisation of an indicator over another.
After collecting the data, the researcher can conduct statistical tests to evaluate the research question and hypothesis. Ideally, the study's results will influence theory.
After constructing a set of hypotheses to test the initial theory, the researcher must also pinpoint other variables potentially impacting the phenomenon under investigation. These variables, such as socio-demographic, psychographic, and behavioural factors, should be controlled for in the study. With hypotheses and control variables in place, the researcher can then identify the best methods for measuring both the main variables of interest and the control variables before selecting an appropriate sample for the study.