Author Information
Eugen Zaretsky, Marburg University Hospital, GermanyAbstract
Results of statistical calculations can vary depending on the sample size, comparability of subsamples, choice of statistical methods, coding of variables, use of imputation, and many other factors. It is up to the researcher whether the Bonferroni adjustment of p-values, or Bonferroni-Holm adjustment, or no adjustment at all is used, whether he or she utilizes parametrical or more conservative non-parametrical statistical methods, whether metrical data are z-transformed etc. This presentation shows some examples of statistical pitfalls in large-scale language assessment programs. First, data from German language screening programs are utilized to show why children with frequent otitis media seem to acquire German more quickly than children without frequent otitis media (N = 1,628). Another example shows why children born in January-July speak better German than those born in August-December (N = 4,316) and how one can reverse these results on the basis of another sample (the same age, the same region, the same language test; N = 6,144). One more example demonstrates how a link between stuttering and children’s German language competence can be described as very close or non-existent depending on chosen statistical methods (N = 748). A high variability of results, in spite of very large samples, validated and standardized language tests, high quality of data in terms of the inter-rater and intra-rater reliability, can be traced back either to errors in the study design or to unexpected confounding variables. For instance, children with frequent otitis media acquired German under comparatively favourable sociodemographic conditions.
Paper Information
Conference: ACEID2026Stream: Assessment Theories & Methodologies
This paper is part of the ACEID2026 Conference Proceedings (View)
Full Paper
View / Download the full paper in a new tab/window
To cite this article:
Zaretsky E. (2026) Why Otitis Media is Good for the Language Acquisition: Some Examples of Statistical Pitfalls in Language Assessment Programs ISSN: 2189-101X – The Asian Conference on Education & International Development 2026 Official Conference Proceedings (pp. 197-209) https://doi.org/10.22492/issn.2189-101X.2026.17
To link to this article: https://doi.org/10.22492/issn.2189-101X.2026.17
Comments
Powered by WP LinkPress