A study on content validity of TEM4 listening comprehension (2016-2023)

Authors

DOI:

https://doi.org/10.54475/jlt.2023.031

Keywords:

multimodal input, virtual reality, reading comprehension, cognitive load

Abstract

Test for English Majors-Band 4 (TEM4) is a large-scale nationwide criterion-referenced test for English majors in Chinese colleges and universities. Since its implementation in 1990, there have been continuous studies on its validity. However, most focused on its reading comprehension section and were based on the traditional classification validity view. Moreover, TEM4 was officially reformed in 2016, especially its listening comprehension section, but relevant validity study is still limited. Therefore, this study aims to assess the content validity of TEM4 listening comprehension after the reform, attempting to enrich the relevant validity study, helping test developers improve question types and promoting the pedagogical teaching to strengthen college students’ listening comprehension ability. Based on Bachman and Palmer’s framework of task characteristics and reference to the interlocutor characteristics proposed by Weir, this study established its framework and analyzed quantitative statistics on the linguistic characteristics of TEM4 listening comprehension. Three dimensions are included in the verification framework: language input characteristics, expected response characteristics, and the relationship between input and response. The study found that the selected TEM4 listening comprehension tests meet the requirements of the teaching and testing syllabuses in terms of length, vocabulary, topic, speech speed, and accent; the question types and expected skills are varied with prominent emphasis; the range and scope of relationship between input and response align with the test proposition principle. All the research results demonstrated a high content validity of TEM4 listening comprehension since its reform in 2016.

Author Biographies

  • Lixia Ma, Southeast University, Nanjing, Jiangsu Province, China

    Ma Lixia, School of Foreign Languages, Southeast University, China. Her research interests include second language acquisition, teaching foreign language, and testing.
    Email: lixiama0225@163.com

  • Jing Jin, School of Foreign Languages, Southeast University, China

    Jing Jin (corresponding author), School of Foreign Languages, Southeast University, China.
    Email: crystal2229@126.com

Ma (2023)

Downloads

Published

2023-12-05

Issue

Section

Original Research

How to Cite

Ma, L., & Jin, J. (2023). A study on content validity of TEM4 listening comprehension (2016-2023). Journal of Language Teaching, 3(10), 69-79. https://doi.org/10.54475/jlt.2023.031

Similar Articles

1-10 of 24

You may also start an advanced similarity search for this article.