Document Type : Research Paper
Authors
1
Shiraz university
2
M. A student of Arabic Language and Literature at shiraz university
3
Phd of Arabic Language and Literature at university of Isfahan
Abstract
Abstract
The present study aims to analyze the extent to which different levels of cognitive learning objectives are represented in the first four volumes of the "Miftah Al-Arabiyyah" textbook series (first edition), based on the revised Bloom’s taxonomy framework in science education. The research sample included the four volumes of the Al-Istima‘ wa Al-Muhadathah books, selected through purposive sampling. The findings revealed that the series predominantly emphasizes lower-order thinking skills, particularly understanding, applying, and remembering, while higher-order cognitive skills such as analyzing, evaluating, and creating received relatively less attention. Among the most frequent codes were "understanding conceptual knowledge," "applying conceptual knowledge," "applying procedural knowledge," and "analyzing conceptual knowledge," which, despite belonging to lower cognitive levels, showed a declining trend in their relative frequency across the four volumes. Conversely, although higher-order cognitive skills such as "analyzing conceptual knowledge," "creating procedural knowledge," and "evaluating factual knowledge" were observed to some extent, their occurrence was not substantial enough to categorize them as dominant patterns in the content. Additionally, the results of the chi-square test indicated a statistically significant difference in the distribution of learning objectives across the four volumes of the Al-Istima‘ wa Al-Muhadathah series. This suggests a lack of balance in the representation of cognitive skill levels, which may affect the development of learners' higher-order thinking abilities. The findings highlight the need for a more deliberate and balanced integration of cognitive domains in the design of Arabic language instructional materials.
Introduction
Textbooks constitute one of the most influential components of foreign language education, particularly in contexts where they function not merely as supplementary materials but as the principal framework guiding curriculum implementation, instructional practices, and assessment procedures. In the field of teaching Arabic as a foreign language, educational textbooks play a crucial role in shaping learners’ linguistic competence, communicative performance, and cognitive engagement. Consequently, the evaluation of instructional materials has become an essential area of research within applied linguistics and language pedagogy. Contemporary educational theories increasingly emphasize that language learning should not be confined to memorization and mechanical repetition; rather, instructional materials should cultivate higher-order thinking skills, critical analysis, creativity, and learner autonomy.
One of the most widely used frameworks for evaluating educational objectives and cognitive engagement is Bloom’s revised taxonomy, proposed by Anderson and Krathwohl (2001). This framework categorizes cognitive processes into six hierarchical levels: remembering, understanding, applying, analyzing, evaluating, and creating. In addition, the taxonomy distinguishes among different dimensions of knowledge, including factual, conceptual, procedural, and metacognitive knowledge. The revised taxonomy has been extensively employed in curriculum studies, textbook evaluation, and educational assessment because it provides a systematic model for examining the cognitive depth of instructional activities.
In recent years, several studies have examined foreign language textbooks based on Bloom’s taxonomy and have frequently reported an imbalance between lower-order and higher-order cognitive skills. Many instructional materials tend to emphasize memorization, comprehension, and limited application while neglecting analytical, evaluative, and creative thinking. Such imbalances may reduce learners’ opportunities for meaningful engagement with language and may hinder the development of communicative and critical thinking abilities. These concerns are particularly important in the context of teaching Arabic to non-native speakers, where communicative competence requires both linguistic proficiency and active cognitive participation.
The present study investigates the “Miftah al-‘Arabiyyah” series, a contemporary instructional collection designed for teaching Arabic to non-Arabic speakers, particularly Turkish learners. The series consists of nine volumes covering different proficiency levels, with separate books devoted to reading-writing and speaking-listening skills. The present research specifically focuses on the four volumes of “al-Muhadathah wa al-Istima‘” (Conversation and Listening), which are intended to strengthen learners’ oral and auditory abilities through structured communicative activities.
The study seeks to analyze the cognitive levels embedded in the exercises and activities of these four volumes using Bloom’s revised taxonomy. More specifically, it aims to determine the relative distribution of lower-order and higher-order cognitive skills across different proficiency levels and to evaluate whether the textbooks gradually encourage more advanced forms of thinking as learners progress through the series. By doing so, the study contributes to the growing body of research on Arabic language pedagogy and provides insights into the extent to which contemporary Arabic instructional materials support cognitive development alongside linguistic competence.
Research Methodology
The present study employed a descriptive-analytical approach based on content analysis. The research materials consisted of the four volumes of “al-Muhadathah wa al-Istima‘” from the “Miftah al-‘Arabiyyah” series, published in 2020 by Ahmad al-Rabban, Ruqayyah al-Muhanna, and Mu‘tasim Hamad. These volumes are specifically designed to improve speaking and listening skills among learners of Arabic as a foreign language.
For data collection, four chapters were randomly selected from each volume, resulting in a total of sixteen analyzed chapters. The selected chapters included various exercises and instructional activities representing different communicative tasks. Altogether, 622 exercises and activities were extracted and systematically categorized for analysis. The unit of analysis in this study was each independent instructional activity or command within an exercise. Thus, if a single exercise contained multiple instructions such as “listen,” “fill in,” or “answer,” each instruction was treated as a separate coding unit.
The coding procedure was based on the revised Bloom’s taxonomy, which integrates cognitive processes with knowledge dimensions. Activities were classified according to six cognitive categories—remembering, understanding, applying, analyzing, evaluating, and creating—and four knowledge dimensions: factual, conceptual, procedural, and metacognitive knowledge. Reliability was ensured through recoding procedures and inter-coder agreement. Two weeks after the initial coding, a sample of the data was recoded, producing an agreement rate of 98%. Furthermore, 20% of the data were independently analyzed by a second trained coder, and Cohen’s Kappa coefficient was calculated at 0.68, indicating a “very good” level of reliability according to Lincoln and Guba’s criteria.
To analyze the distribution of cognitive levels across the four volumes, descriptive statistics and chi-square tests were employed. Additionally, Cramer’s V was calculated to determine the strength of the observed relationships among variables.
Discussion
1. Distribution of Cognitive Skills in the Textbooks
The findings revealed that the “Miftah al-‘Arabiyyah” series predominantly emphasizes lower-order cognitive skills. Across the four analyzed volumes, the most frequent category was “understanding conceptual knowledge” (B2), which accounted for the largest proportion of instructional activities. The second most common category was “applying conceptual knowledge” (C2), followed by “applying procedural knowledge” (C3) and “analyzing conceptual knowledge” (D2).
These findings indicate that the textbook series prioritizes learners’ comprehension and practical use of language rather than encouraging higher-order thinking skills such as evaluation and creativity. Exercises frequently require learners to understand vocabulary and structures, respond to questions, complete dialogues, or use previously learned concepts in communicative situations. Although these activities are pedagogically valuable for beginner and intermediate learners, they remain largely within the lower cognitive domains of Bloom’s taxonomy.
The analysis also demonstrated that metacognitive knowledge was entirely absent from all four volumes. None of the activities addressed metacognitive awareness, self-monitoring, or reflective learning strategies. Similarly, several categories related to evaluation and creation appeared either rarely or not at all. This absence suggests that the textbooks provide limited opportunities for learners to develop self-regulated learning skills or reflective language awareness.
2. Cognitive Progression across Proficiency Levels
Although lower-order cognitive skills dominated the series overall, the findings revealed a gradual increase in higher-order cognitive activities as learners advanced through the volumes. In the beginner levels, activities focused heavily on understanding and applying conceptual knowledge. Learners were primarily expected to comprehend basic vocabulary, recognize structures, and use memorized language patterns in simple communicative contexts.
At the intermediate and upper-intermediate levels, however, there was a moderate increase in analytical activities. The fourth volume demonstrated the highest proportion of higher-order cognitive skills among the analyzed books. Activities involving conceptual analysis became more frequent, requiring learners to distinguish appropriate responses, analyze meanings, and interpret communicative situations. Nevertheless, even at these advanced levels, evaluative and creative activities remained relatively limited.
This gradual progression suggests that the authors intentionally designed the textbooks to align cognitive demands with learners’ linguistic development. Such sequencing corresponds with educational theories arguing that learners must first establish foundational knowledge before engaging in more sophisticated cognitive operations. Bloom himself emphasized that lower cognitive skills form the basis for achieving advanced abilities such as analysis, evaluation, and creation.
However, the study also indicates that the increase in higher-order cognitive tasks is not sufficiently substantial. Even in advanced levels, analytical, evaluative, and creative activities occupy only a minor proportion of the instructional content. As a result, opportunities for critical thinking and independent language production remain constrained.
3. The Role of Conceptual Understanding and Application
One of the most significant findings concerns the dominance of conceptual understanding and application in the textbook series. Activities categorized under B2 (“understanding conceptual knowledge”) and C2 (“applying conceptual knowledge”) constituted the majority of the exercises. These tasks commonly included listening comprehension, completing missing words, answering comprehension questions, role-playing dialogues, and selecting appropriate responses.
From a pedagogical perspective, this emphasis reflects a communicative orientation in which learners are encouraged not merely to memorize isolated vocabulary but also to understand and apply linguistic concepts in meaningful contexts. For example, fill-in-the-blank exercises require learners first to comprehend contextual meanings and then apply appropriate linguistic structures. Similarly, true-or-false tasks and guided dialogues involve cognitive processing beyond simple memorization because learners must interpret and respond to contextual information.
The prominence of conceptual understanding is particularly understandable in the context of teaching Arabic to beginners and non-native speakers. Learners at early stages often require extensive exposure to comprehensible input and structured communicative practice before they can effectively perform analytical or creative tasks. Studies in second language acquisition similarly emphasize that lower-order cognitive engagement may serve as a necessary foundation for later linguistic and cognitive development.
4. Analytical and Interactive Activities
Another important finding concerns the use of procedural and analytical activities. The category C3 (“applying procedural knowledge”) appeared relatively frequently throughout the series and often involved pair work, collaborative dialogue, and communicative interaction. These activities encouraged learners to exchange information, ask questions, and negotiate meaning with classmates.
Although classified within lower cognitive domains, such activities possess considerable pedagogical value because they foster active participation and communicative competence. Through interaction-based exercises, learners engage in meaningful language use and develop speaking and listening skills in socially situated contexts. In some cases, these collaborative tasks may also create opportunities for spontaneous language production and limited creativity.
The analytical category D2 (“analyzing conceptual knowledge”) represented the highest among the higher-order cognitive skills. Activities within this category required learners to examine structures, identify suitable responses, compare meanings, and interpret communicative situations. Such tasks demand greater cognitive engagement because learners must process linguistic information critically rather than simply recall or reproduce it.
Nevertheless, the relatively modest frequency of analytical tasks suggests that the textbooks still prioritize functional language use over critical and reflective engagement. While this orientation may support communicative fluency, it may simultaneously limit learners’ opportunities for independent reasoning and advanced discourse production.
5. Statistical Findings and Educational Implications
The chi-square analysis demonstrated statistically significant differences among the four textbook volumes regarding the distribution of cognitive levels (p = 0.000). Furthermore, Cramer’s V coefficient (0.41) indicated a moderate to strong relationship between textbook level and cognitive distribution. These findings confirm that cognitive complexity gradually increases across proficiency levels.
Despite this progression, the overall dominance of lower-order cognitive skills raises important educational concerns. Modern approaches to language teaching increasingly advocate the integration of critical thinking, problem-solving, creativity, and learner autonomy into instructional materials. The limited presence of evaluative and creative tasks in the analyzed textbooks suggests that learners may not receive sufficient opportunities to develop these advanced competencies.
The study therefore highlights the need for textbook developers to incorporate more activities targeting evaluation, interpretation, reflection, and creative production. Such activities could include debates, problem-solving discussions, project-based tasks, critical listening exercises, and open-ended communicative assignments. Incorporating metacognitive elements may also help learners become more reflective and autonomous in their language learning processes.
Conclusion
The present study evaluated the cognitive dimensions of the “Miftah al-‘Arabiyyah” speaking and listening textbooks using Bloom’s revised taxonomy. The findings demonstrated that the instructional activities overwhelmingly emphasize lower-order cognitive skills, particularly conceptual understanding and application. Although higher-order cognitive skills such as analysis, evaluation, and creation appear gradually in advanced levels, their overall presence remains limited.
The absence of metacognitive knowledge across all four analyzed volumes constitutes one of the most important findings of the study. While the textbooks successfully promote communicative practice and conceptual understanding, they provide insufficient opportunities for reflective learning, self-regulation, and critical thinking. Nevertheless, the gradual increase in analytical activities across proficiency levels suggests that the authors attempted to align cognitive demands with learners’ linguistic development.
The statistical analyses confirmed significant differences among the textbook levels regarding cognitive distribution, indicating a developmental progression in instructional design. However, the predominance of lower-order skills suggests that the series remains primarily oriented toward comprehension and functional language use rather than toward fostering higher-order intellectual engagement.
The study contributes to research on Arabic language pedagogy by providing a systematic cognitive evaluation of contemporary Arabic instructional materials. The findings imply that future textbook development should incorporate more evaluative, analytical, and creative tasks alongside metacognitive strategies in order to balance linguistic competence with critical and independent thinking. Such improvements may enhance learners’ communicative performance while simultaneously supporting broader educational goals related to creativity, autonomy, and cognitive growth.
Keywords
Subjects
