Back to search

North Texas State University

Comparison of Methods for Computation and Cumulation of Effect Sizes in Meta-Analysis

Abstract

dc:description

This study examined the statistical consequences of employing various methods of computing and cumulating effect sizes in meta-analysis. Six methods of computing effect size, and three techniques for combining study outcomes, were compared. Effect size metrics were calculated with one-group and pooled standardizing denominators, corrected for bias and for unreliability of measurement, and weighted by sample size and by sample variance. Cumulating techniques employed as units of analysis the effect size, the study, and an average study effect. In order to determine whether outcomes might vary with the size of the meta-analysis, mean effect sizes were also compared for two smaller subsets of studies. An existing meta-analysis of 60 studies examining the effectiveness of computer-based instruction was used as a data base for this investigation. Recomputation of the original study data under the six different effect size formulas showed no significant difference among the metrics. Maintaining the independence of the data by using only one effect size per study, whether a single or averaged effect, produced a higher mean effect size than averaging all effect sizes together, although the difference did not reach statistical significance. The sampling distribution of effect size means approached that of the population of 60 studies for subsets consisting of 40 studies, but not for subsets of 20 studies. Results of this study indicated that the researcher may choose any of the methods for effect size calculation or cumulation without fear of biasing the outcome of the metaanalysis. If weighted effect sizes are to be used, care must be taken to avoid giving undue influence to studies which may have large sample sizes, but not necessarily be the most meaningful, theoretically representative, or elegantly designed. It is important for the researcher to locate all relevant studies on the topic under investigation, since selective or even random sampling may bias the results of small meta-analyses.

Degree

thesis:*
Grantor dc:publisher
North Texas State University
Year dc:date
1987

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Ronco, Sharron L. (Sharron Lee)
Contributors dc:contributor
  • Brookshire, William K.
  • Poirot, James L., 1939-
  • Moore, Alan D.
  • McCallon, Earl L.
  • Pavur, Robert J.

Subjects

dc:subject × 3

Rights

dc:rights
Statement dc:rights
  • Public
  • Ronco, Sharron L. (Sharron Lee)
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: 1002715260-Ronco
oclc: 1052948823
lccn: 379 N81d no.2797
untcat: b1418299
ark: ark:/67531/metadc331655

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Ronco, Sharron L. (Sharron Lee). Comparison of Methods for Computation and Cumulation of Effect Sizes in Meta-Analysis. North Texas State University, 1987. https://digital.library.unt.edu/ark:/67531/metadc331655/