Jump to a key chapter
- We will start by exploring probability and significance: psychology and how probability and significance can be explained in terms of psychological research.
- Then we will take a look at the types of significance tests.
- Finally, we will take a look at some levels of significance examples.
Probability and Significance Psychology
Psychologists aim to establish if their findings support or negate their hypothesis. Assuming that the hypothesis should be accepted if a pattern/ trend is found would be too simple.
Significance tests give researchers a statistical value to measure how likely/ the probability the research results are due to chance. Another word for this is the alpha level. In psychology, this is written as.
Significance tests are commonly used in psychological research to determine the extent the intended variables affect the phenomenon and that the results are not due to chance.
Significance and Probability Explained
The main research method used in psychology involves manipulating the independent variable to observe its effect on the dependent variable. However, researchers can't control everything, even when the experiment is conducted in a lab setting. Researchers cannot determine 100% that their results are due to the variables they are studying because extraneous and confounding variables are likely to influence observed effects.
Researchers have a consensus about what alpha level is acceptable, which is 0.05. If a significance level above this is found, the hypothesis that states an observed difference (alternative hypothesis) should be rejected.
But what does a significant level of 0.05 exactly mean, and how can it be interpreted? A significance value of 0.05 indicates a 95% probability that the results are not due to chance.
Level of Significance Psychology
The significance level in psychology ranges from 0 to 1 and is expressed as a p-value. The closer the value is to 0, the more likely the results are not due to chance. The smaller the number, the less likely the researcher will reject the alternative hypothesis and be more likely to reject the null hypothesis.
In psychology, the accepted level of significance is .05.
When writing the p-value, the researcher does not report the 0 before the decimal point.
Types of Significance Tests
The significance value is a quantitative value that tells the researcher and readers how likely the results are due to chance.
The significance values commonly used in psychological research are:
- 0.05 - there is a 5% chance results are due to chance.
- 0.01 - there is a 1% chance: results are due to chance.
- 0.001 - there is a 0.01% chance results are due to chance.
Anything above the 5% threshold means that the hypothesis should be rejected. It is because there is a too high probability that the results are due to external factors rather than the independent variable.
To calculate the probability, you simply need to convert the value into a percentage, i.e. x 100.
Two-Tailed Probability and Significance
The hypothesis proposed at the start of the study also influences the probability and significance level.
There are many types of hypotheses in psychology research:
- The null hypothesis proposes the IV (independent variable) will not affect the DV (dependent variable).
- A non-directional - the researcher does not state how the IV will change.
- A directional - the researcher proposes the IV will affect the DV; this can be further subdivided into one-tailed to two-tailed.
A one-tailed hypothesis is when a researcher proposes the specific (one) direction of the results, i.e. how the IV will change. And a two-tailed hypothesis is when the researcher proposes the research can go either way, i.e. an increase or decrease may be observed.
As we learned earlier, the type of hypothesis accepted depends on the level of significance found.
Acceptance of:
- The alternative hypothesis is accepted if a value is found at or below the significance level.
- The null hypothesis is accepted if a value above the significance level is found.
Rejection of:
- The alternative hypothesis is rejected if a value above the significance level is found.
- The null hypothesis is rejected if a value at or below the significance level is found.
Significance Tests and Methodology
Occasionally, non-significant results are due to problems with the methodology used. Once these have been corrected and the experiment retested, significant results can be found.
Suppose a research design does not use a standardised protocol. In that case, the results may reflect the conditions under which the participants were experimented and are likely due to chance. The researcher must repeat the experiment but use a standardised procedure to counteract this.
These errors can lead to type 1 and type 2 errors.
A Type 1 error is when we incorrectly reject the null hypothesis when it is, in fact, true. If the significance level is at 0.05, there is a 5% chance of a Type 1 error.
A Type 2 error is when we incorrectly reject the alternative hypothesis when it is true.
Level of Significance Example
Let's quickly take a look at the symbols you may come across during your studies:
p = significance value.
< = the significance value is less than the number reported (e.g. < 0.05 = significance is less than 0.05).
> = the significance value is greater than the number reported (e.g. > 0.05 = significance is greater than 0.05).
Now let's apply significance to psychology and some examples.
If a significant value is found, the inferential statistic can be used to make inferences about the target population supported by evidence. However, if this is not the case, the study should not make inferences about the target population.
The inferential statistic is a quantitative statistical value that measures the data collected. It can be used to make generalisations about the target population.
If a non-significant value is not found, it does not mean there is no relationship/interaction between the independent and dependent variables.
Instead, it means that other variables are also influencing the dependent variable. Therefore the study cannot provide an accurate (reliable or valid) measure of the interaction between the independent and dependent variables.
An example of a significance level for a correlation analysis that would be accepted is:
r (56) = .63, p = <.05
This example shows:
A correlational analysis was performed (r).
A positive correlation was found (.63).
There were 56 participants (56).
The significance value was accepted because the significance value is below the accepted alpha value of 0.05.
The alternative hypothesis should be accepted.
On the other hand, a correlational analysis that suggests the researcher should reject the alternative hypothesis and accept the null hypothesis is...
r (56) = .63, p = < .08
This example shows:
The significance value is non-significant as it is above .05.
The null hypothesis should be accepted.
Probability and Significance - Key takeaways
- Significance tests are commonly used in psychological research to determine whether the results are due to chance or the variables investigated. The results of the tests (inferential statistical data) determine whether to reject the null hypothesis.
- Significance tests give researchers a statistical value to measure how likely the research results are due to chance.
- There is a consensus among researchers as to what level of significance is acceptable, 0.05. The significance value can be converted into a percentage. In this case, there is a 5% chance that the results are due to chance.
- If a significant figure is found, the alternative hypothesis should be accepted; however, if an insignificant figure is found, the null hypothesis should be accepted.
- If a significant inferential statistic is found, the researcher can use their data to make inferences about the target population.
Learn with 10 Probability and Significance flashcards in the free StudySmarter app
We have 14,000 flashcards about Dynamic Landscapes.
Already have an account? Log in
Frequently Asked Questions about Probability and Significance
How do you know if the probability is significant?
If a probability of less than 0.05 is found, then the analysis is considered significant in psychology.
Is probability the same as significance?
No, the significance value is a number used in psychology to measure probability.
What is the level of significance psychology?
The level of significance is also known as the alpha value. It is a statistical measure of the strength of the data extracted from the sample's likelihood of rejecting the null hypothesis. It is used to identify if the findings are statistically significant.
How is significance related to probability?
The significance level is a statistical term that measures one form of probability.
What is meant by psychology significance level?
The significance level in psychology ranges from 0 to 1 and is expressed as a p-value. The closer the value is to 0, the more likely the results are not due to chance. The smaller the number, the less likely the researcher will reject the alternative hypothesis and be more likely to reject the null hypothesis.
About StudySmarter
StudySmarter is a globally recognized educational technology company, offering a holistic learning platform designed for students of all ages and educational levels. Our platform provides learning support for a wide range of subjects, including STEM, Social Sciences, and Languages and also helps students to successfully master various tests and exams worldwide, such as GCSE, A Level, SAT, ACT, Abitur, and more. We offer an extensive library of learning materials, including interactive flashcards, comprehensive textbook solutions, and detailed explanations. The cutting-edge technology and tools we provide help students create their own learning materials. StudySmarter’s content is not only expert-verified but also regularly updated to ensure accuracy and relevance.
Learn more