サインイン

Reliability in Psychology Experiments

概要

Source: Laboratories of Gary Lewandowski, Dave Strohmetz, and Natalie Ciarocco—Monmouth University

In order to study something scientifically, a researcher needs to determine a way to quantify it. However, psychological constructs can be challenging to measure and quantify. This video examines reliability in the context of content analysis. 

A recent study in the journal Pediatrics reported that 4-year-olds who watched a fast-paced cartoon had worse performance on cognitive tasks, such as following rules in a game, listening to direction from an adult, and delaying gratification, compared to other children who watched a slower paced cartoon.1 In addition to the pace of the cartoon, the content of the cartoon may also have deleterious effects on its young viewers.

This video uses a simple two-group design, to exemplify the issue of reliability, in examining the question of whether the cartoon SpongeBob SquarePants has more inappropriate content than does the cartoon Caillou.

手順

1. Define key variables.

  1. Create an operational definition (i.e., a clear description of exactly what a researcher means by a concept) of inappropriate content.
  2. Consult definitions created by the organization TV Parental Guidelines and approved by the Federal Communications Commission.
  3. Inappropriate content is any crude or rude behavior (e.g., toilet humor), depictions of verbal or physical aggression (e.g., name calling, hitting, etc.), bad language (

    Log in or to access full content. Learn more about your institution’s access to JoVE content here

結果

The results indicate that the raters had a high level of agreement or consistency in their ratings within each cartoon episode, which indicates high inter-rater reliability (Figure 1). There is also reliability or consistency in SpongeBob SquarePants episodes having more inappropriate content than Caillou. The results also revealed individual biases amongst raters. For example, Rater 3 reported more inappropriate content in SpongeBob than the other 2 raters, and Rater 1 reported less in Caillou than othe

Log in or to access full content. Learn more about your institution’s access to JoVE content here

申請書と概要

Researchers have increasingly turned their attention toward analyzing television’s content, especially as it relates to children. As discussed prior to this current experiment, a recent study in the journal Pediatrics correlated the fast pace of the SpongeBob SquarePants cartoon to relatively poor cognitive abilities in the children who watch it.

Since the results of our experiment appear reliable, future research could examine whether the relative amount of inappropriate conten

Log in or to access full content. Learn more about your institution’s access to JoVE content here

参考文献
  1. Lillard, A. S., & Peterson, J. The Immediate Impact of Different Types of Television on Young Children's Executive Function. Pediatrics. 128(4):644-9. doi: 10.1542/peds.2010-1919 (2011).
タグ
ReliabilityPsychology ExperimentsMeasurementsVariabilityInter rater ReliabilityInappropriate BehaviorsCartoonsWithin subjects DesignDependent VariableCrude And Rude BehaviorsBad LanguageVerbal AggressionPhysical AggressionReferences To DrugsSexual Content

スキップ先...

0:00

Overview

0:57

Experimental Design

2:09

Running the Experiment

2:58

Representative Results

3:47

Applications

4:44

Summary

このコレクションのビデオ:

article

Now Playing

Reliability in Psychology Experiments

Experimental Psychology

8.4K 閲覧数

article

From Theory to Design: The Role of Creativity in Designing Experiments

Experimental Psychology

18.2K 閲覧数

article

Ethics in Psychology Research

Experimental Psychology

29.1K 閲覧数

article

Realism in Experimentation

Experimental Psychology

8.2K 閲覧数

article

Perspectives on Experimental Psychology

Experimental Psychology

5.6K 閲覧数

article

Pilot Testing

Experimental Psychology

10.3K 閲覧数

article

Observational Research

Experimental Psychology

13.0K 閲覧数

article

The Simple Experiment: Two-group Design

Experimental Psychology

72.3K 閲覧数

article

The Multi-group Experiment

Experimental Psychology

22.7K 閲覧数

article

Within-subjects Repeated-measures Design

Experimental Psychology

22.9K 閲覧数

article

The Factorial Experiment

Experimental Psychology

73.1K 閲覧数

article

Self-report vs. Behavioral Measures of Recycling

Experimental Psychology

11.8K 閲覧数

article

Placebos in Research

Experimental Psychology

11.6K 閲覧数

article

Manipulating an Independent Variable through Embodiment

Experimental Psychology

8.5K 閲覧数

article

Experimentation using a Confederate

Experimental Psychology

17.8K 閲覧数

JoVE Logo

個人情報保護方針

利用規約

一般データ保護規則

研究

教育

JoVEについて

Copyright © 2023 MyJoVE Corporation. All rights reserved