Accedi

Reliability in Psychology Experiments

Panoramica

Source: Laboratories of Gary Lewandowski, Dave Strohmetz, and Natalie Ciarocco—Monmouth University

In order to study something scientifically, a researcher needs to determine a way to quantify it. However, psychological constructs can be challenging to measure and quantify. This video examines reliability in the context of content analysis. 

A recent study in the journal Pediatrics reported that 4-year-olds who watched a fast-paced cartoon had worse performance on cognitive tasks, such as following rules in a game, listening to direction from an adult, and delaying gratification, compared to other children who watched a slower paced cartoon.1 In addition to the pace of the cartoon, the content of the cartoon may also have deleterious effects on its young viewers.

This video uses a simple two-group design, to exemplify the issue of reliability, in examining the question of whether the cartoon SpongeBob SquarePants has more inappropriate content than does the cartoon Caillou.

Procedura

1. Define key variables.

  1. Create an operational definition (i.e., a clear description of exactly what a researcher means by a concept) of inappropriate content.
  2. Consult definitions created by the organization TV Parental Guidelines and approved by the Federal Communications Commission.
  3. Inappropriate content is any crude or rude behavior (e.g., toilet humor), depictions of verbal or physical aggression (e.g., name calling, hitting, etc.), bad language (

    Log in or to access full content. Learn more about your institution’s access to JoVE content here

Risultati

The results indicate that the raters had a high level of agreement or consistency in their ratings within each cartoon episode, which indicates high inter-rater reliability (Figure 1). There is also reliability or consistency in SpongeBob SquarePants episodes having more inappropriate content than Caillou. The results also revealed individual biases amongst raters. For example, Rater 3 reported more inappropriate content in SpongeBob than the other 2 raters, and Rater 1 reported less in Caillou than othe

Log in or to access full content. Learn more about your institution’s access to JoVE content here

Riferimenti
  1. Lillard, A. S., & Peterson, J. The Immediate Impact of Different Types of Television on Young Children's Executive Function. Pediatrics. 128(4):644-9. doi: 10.1542/peds.2010-1919 (2011).
Tags
ReliabilityPsychology ExperimentsMeasurementsVariabilityInter rater ReliabilityInappropriate BehaviorsCartoonsWithin subjects DesignDependent VariableCrude And Rude BehaviorsBad LanguageVerbal AggressionPhysical AggressionReferences To DrugsSexual Content

Vai a...

0:00

Overview

0:57

Experimental Design

2:09

Running the Experiment

2:58

Representative Results

3:47

Applications

4:44

Summary

Video da questa raccolta:

article

Now Playing

Reliability in Psychology Experiments

Experimental Psychology

8.4K Visualizzazioni

article

From Theory to Design: The Role of Creativity in Designing Experiments

Experimental Psychology

18.2K Visualizzazioni

article

Ethics in Psychology Research

Experimental Psychology

29.1K Visualizzazioni

article

Realism in Experimentation

Experimental Psychology

8.2K Visualizzazioni

article

Perspectives on Experimental Psychology

Experimental Psychology

5.6K Visualizzazioni

article

Pilot Testing

Experimental Psychology

10.3K Visualizzazioni

article

Observational Research

Experimental Psychology

13.0K Visualizzazioni

article

The Simple Experiment: Two-group Design

Experimental Psychology

72.3K Visualizzazioni

article

The Multi-group Experiment

Experimental Psychology

22.7K Visualizzazioni

article

Within-subjects Repeated-measures Design

Experimental Psychology

22.9K Visualizzazioni

article

The Factorial Experiment

Experimental Psychology

73.1K Visualizzazioni

article

Self-report vs. Behavioral Measures of Recycling

Experimental Psychology

11.8K Visualizzazioni

article

Placebos in Research

Experimental Psychology

11.6K Visualizzazioni

article

Manipulating an Independent Variable through Embodiment

Experimental Psychology

8.5K Visualizzazioni

article

Experimentation using a Confederate

Experimental Psychology

17.8K Visualizzazioni

JoVE Logo

Riservatezza

Condizioni di utilizzo

Politiche

Ricerca

Didattica

CHI SIAMO

Copyright © 2025 MyJoVE Corporation. Tutti i diritti riservati