Qatar University launched an initiative at the beginning of 2024 to address weaknesses in Arabic language proficiency. The initiative aimed to establish a comprehensive vision for improving the Arabic language skills of all students. The committee formed under this initiative recommended the development of a standardized Arabic language proficiency test to be administered to all university students, while also exploring the possibility of using it as a diagnostic tool during the early academic years to identify and address language weaknesses effectively and at an early stage. Accordingly, the Testing Center was assigned the task of developing the Arabic Language Proficiency Test for native speakers, due to the absence of an available standardized test.
Work on the test began in January 2025. Committees were formed from within the University (College of Arts and Sciences – College of Education – CORE Program) and from outside the university (Ministry of Education and Higher Education). The Testing Center completed the development and international validation of the test framework, as well as the writing and scientific and linguistic review of test items in collaboration with experts in Arabic language and educational measurement from Qatar University, the Ministry of Education and Higher Education, and international schools. This process followed the training of item writers on the test framework and the skills it measures.
Test Description
The test framework and the subskills it measures were developed in terms of international standards and Qatari curriculum standards, incorporating the essential skills students are expected to possess for university studies. Each skill can be described as follows:
A. Reading Skill
This skill focuses on measuring reading comprehension abilities acquired during secondary education, which relate to the Arabic language in general and reading skills in particular. Through selected texts, the test measures four levels of reading comprehension: literal, inferential, critical, and appreciative comprehension. Items related to each text are distributed according to Webb's Depth of Knowledge classification.
B. Listening Skill
The listening skill measures abilities practiced by university students in lectures, seminars, discussions, or any auditory medium. It involves a complex cognitive and linguistic process that includes attention, comprehension, interpretation, and evaluation of spoken content through auditory memory that distinguishes sounds and meanings. Students interact with listening texts in an effective, critical, or interactive manner, demonstrating their ability to understand the speaker's content, identify main and supporting ideas, determine relationships among ideas, recognize evidence, distinguish logical arguments from others, verify information, ask items about what they have understood, and enhance critical thinking as well as analytical and inferential skills. This supports university learning through the use of various audio materials such as recorded lectures and virtual seminars. Items related to each text are distributed according to Webb's Depth of Knowledge classification (recall and reproduction, basic reasoning, and strategic thinking).
C. Writing Skill
Writing is considered one of the fundamental skills in language education. Therefore, the writing test measures the extent of university students' proficiency in writing skills required to prepare them before entering professional service and to achieve competency standards in teaching and learning. This is done through measuring three main aspects of writing skills.
The first aspect addresses free linguistic production in persuasive writing, in addition to summarizing a persuasive text. The second aspect concerns language skills, including grammar, structures, and the correctness of linguistic and syntactic construction. Finally, the third aspect relates to research and inquiry skills and how to employ information effectively. Items related to each text are distributed according to Webb's Depth of Knowledge classification (recall and reproduction, basic reasoning, and strategic thinking).
Importance of QU Arabic Language Proficiency Test
QU Arabic Language Proficiency Test is considered highly important for the following reasons:
- It is the only available standardized test for native Arabic speakers within the Qatari context that measures reading, writing, and listening skills.
- The Arabic Language Proficiency Test represents a strategic project within Qatar University's efforts to enhance the quality of educational outcomes and ensure that students possess the essential language skills required for academic and professional success.
Methodology for Developing the Arabic Language Proficiency Test
The Testing Center followed the Standards for Educational and Psychological Testing (2014) in the test development process, with a focus on standards of validity, reliability (score accuracy), measurement error, and fairness. The test development process at the center followed these steps:
- Defining the assessment framework and test specifications.
- Writing and reviewing test items.
- Constructing pilot test forms.
- Administering pilot test forms.
- Developing scoring rubrics for writing and summarization items.
- Scoring each student's response by 2 certified raters.
- Reviewing and eliminating unfit items while retaining only high-quality items in the item bank.
- Conducting statistical analyses and calibrating test items using Item Response Theory (IRT).
- Constructing equivalent and equated test forms to ensure accurate estimation of students' abilities across the three components.
The Testing Center continues to develop and enrich the Arabic Language Proficiency Test item bank on an ongoing basis through pilot administration to different samples of university students. This process aims to gather scientific evidence to verify item quality and measurement accuracy. The phase also includes statistical analyses, calibration of the item bank, and linking of test forms according to modern models of measurement and evaluation to ensure the development of equivalent and fair test forms. The test is expected to be ready for operational administration in the near future, with the official launch targeted by the end of 2026.