Cautionary note on calculating standardized effect size (SES) in randomization test

Z. Botta-Dukát

doi:10.1556/168.2018.19.1.8

Jump to Content

Community Ecology

Volume/Issue:: Volume 19: Issue 1

Cautionary note on calculating standardized effect size (SES) in randomization test

Author:

Z. Botta-Dukát

Z. Botta-Dukát Institute of Ecology and Botany, Alkotmány u. 2-4, Vácrátót, Hungary

Search for other papers by Z. Botta-Dukát in
Current site
Google Scholar
PubMed

botta-dukat.zoltan@okologia.mta.hu

View More View Less

Pages:: 77–83

Online Publication Date:: Jun 2018

Publication Date:: 01 Jun 2018

Article Category:: Research Article

DOI:: https://doi.org/10.1556/168.2018.19.1.8

Keywords:: Functional diversity; Randomization test; Standardized effect size; Statistics

Open access

Download PDF

In community ecology, randomization tests with problem specific test statistics (e.g., nestedness, functional diversity, etc.) are often applied. Researchers in such studies may want not only to detect the significant departure from randomness, but also to measure the effect size (i.e., the magnitude of this departure). Measuring the effect size is necessary, for instance, when the roles of different assembly forces (e.g., environmental filtering, competition) are compared among sites. The standard method is to calculate standardized effect size (SES), i.e., to compute the departure from the mean of random communities divided by their standard deviations. Standardized effect size is a useful measure if the test statistic (e.g., nestedness index, phylogenetic or functional diversity) in the random communities follows a symmetric distribution. In this paper, I would like to call attention to the fact that SES may give us misleading information if the distribution is asymmetric (skewed). For symmetric distribution median and mean values are equal (i.e., SES = 0 indicates p = 0.5). However, this condition does not hold for skewed distributions. For symmetric distributions departure from the mean shows the extremity of the value, regardless of the sign of departure, while in asymmetric distributions the same deviation can be highly probable and extremely improbable, depending on its sign. To avoid these problems, I recommend checking symmetry of null-distribution before calculating the SES value. If the distribution is skewed, I recommend either log-transformation of the test statistic, or using probit-transformed p-value as effect size measure.

Supplementary Materials

Save
Cite
Email this content

Share Link

Copy this link, or click below to email it to a friend
Email this content
or copy the link directly:

https://akjournals.com/view/journals/168/19/1/article-p77.xml
The link was not copied. Your current browser may not support copying via this button.

Link copied successfully

Collapse
Expand

Community Ecology An Interdisciplinary Journal Reporting Progress in Community and Population Studies

Print ISSN:: 1585-8553

Online ISSN:: 1588-2756

To see the editorial board, please visit the website of Springer Nature.

Manuscript Submission: HERE

For subscription options, please visit the website of Springer Nature.

Community Ecology
Language	English
Size	A4
Year of Foundation	2000
Volumes per Year	1
Issues per Year	3
Founder	Akadémiai Kiadó
Founder's Address	H-1117 Budapest, Hungary 1516 Budapest, PO Box 245
Publisher	Akadémiai Kiadó Springer Nature Switzerland AG
Publisher's Address	H-1117 Budapest, Hungary 1516 Budapest, PO Box 245. CH-6330 Cham, Switzerland Gewerbestrasse 11.
Responsible Publisher	Chief Executive Officer, Akadémiai Kiadó
ISSN	1585-8553 (Print)
ISSN	1588-2756 (Online)