Educational Assessment, Evaluation, and Research Commons^™

Ai In The Classroom, Dr. Adrian E. Hinkle, Dr. Amanda Wilson, Dr. Jan H. R. Wörner

Faculty Presentations on AI

This presentation examines how educators can thoughtfully integrate artificial intelligence into the classroom while upholding academic integrity, ethical engagement, and the core mission of education. It draws on historical parallels—from ancient concerns about writing to later fears surrounding typing—to frame AI as a double-edged sword that can offload routine cognitive tasks yet risks eroding the mental discipline and critical thinking essential for deep learning. Centered on the guiding question of what students truly need to learn and how technology can help them achieve it, the session offers practical assignment frameworks, such as designing an AI-supported ministry plan and developing a …

Ai In Scholarship, Dr. Tim Hart

Faculty Presentations on AI

This presentation explores the appropriate role of artificial intelligence in scholarly work, distinguishing between uses that support academic rigor and those that undermine intellectual responsibility. While cautioning against reliance on AI for original argumentation, unverified literature reviews, data interpretation, and normative judgments, it highlights practical applications across the research lifecycle, including ideation, literature exploration, argument refinement, structural analysis, reviewer simulation, and manuscript preparation.

Faculty Readiness And Ethical Perceptions Of Artificial Intelligence Integration In Higher Education Teaching And Assessment, Ayesha Afzal, Shahid Rafiq, Aisha Sami

Higher Learning Research Communications

The rapid advancement of artificial intelligence (AI) technologies presents both transformative opportunities and complex challenges for higher education, particularly in teaching and assessment. This study examines the readiness of faculty members in Pakistani universities to integrate AI tools into pedagogical and evaluative practices, alongside their ethical perceptions of AI use in academic contexts. Using a qualitative research design, semi-structured interviews were conducted with 20 faculty members across diverse disciplines and institutions. Thematic analysis, guided by the Technology Acceptance Model (TAM), the Technological Pedagogical Content Knowledge (TPACK) framework, and Rest’s Four-Component Model of ethical decision making, revealed four interrelated themes: (1) …

Enhancing Learning With Ai: The ‘Icing On The Cake’ Approach, Ejike Okonkwo

Essays in Education

Drawing on a narrative review based on inductive thematic analysis, this paper examines the expanding role of artificial intelligence (AI) in education. The analysis shows that while AI offers useful educational benefits, they often come into conflict with concerns about how AI affects learning, including risks of overreliance and potential constraints on learners’ critical thinking and creative capacities. Consequently, the paper develops the “icing on the cake” conceptual framework, which conceptualizes AI adoption as non-linear and positions AI as a complementary tool rather than a substitute for human learning. The framework is grounded in reflection, metacognition, and skill development, and …

Development And Initial Validation Of The Comprehensive Ai Integration Readiness Survey (Caiirs), Richard D. Amoako, Jennifer A. Morrow

International Journal of Teaching and Learning in Higher Education

Artificial intelligence (AI) has emerged as a transformative force in higher education, improving learning and optimizing administrative operations. However, the adoption and integration of AI in learning environments have received limited research attention until recently. Consequently, this research aimed to develop and validate a scale to assess readiness and preparedness among higher education faculty members for the integrative adoption of AI in learning and teaching practices. A nationwide survey was used to collect data from faculty at universities and colleges in the United States. The CAIIRS scale was developed after an extensive review of scholarly literature. Exploratory factor analysis was …

Informing Change: A Final Research Report On The Findings From The Longitudinal R&D Partnership For Math Equity Project, H. Colleen Sinclair, Samuel Robison, Youn Kyoung Kim, Stacey R. Terrio, Judith Lee Falgout Rhodes

Reports

This report covers a three-year partnership between the LSU Social Research and Evaluation Center, East Baton Rouge Parish Schools (EBR Schools), and DreamBox Learning, in which we conducted a longitudinal, multi-method examination of the effectiveness of DreamBox’s tech-based math intervention on EBRPS student performance. The three key research questions – developed with guidance from our Gates Foundation funding partners – are outlined below with abbreviated conclusions. The body of the report provides further detail on the methods, results, and interpretations of our quantitative study. We complement these conclusions with qualitative insights drawn from focus groups with teachers and students.

Correlation Analysis Of Factors Associated With Students’ Numeracy Skills Using Decision Tree Algorithms, Yenita Roza, Arisman Adnan, Zul Indra, Tuti Alawiyah

Numeracy

Numeracy is a critical competency for academic and everyday functioning. This study investigates the key factors associated with students’ numeracy skills by employing decision tree algorithms as a data mining technique. The dataset used in this study is educational assessment data from Indonesia. Utilizing a dataset comprising 6,953 entries and 60 variables from Education Report, the research adopts an exploratory approach involving data preprocessing, exploratory data analysis, and decision tree model construction. The findings reveal that students’ literacy skills serve as the most dominant predictor of numeracy proficiency, emerging as the root node in the decision tree structure. Additional associated …

Teacher-Guided Video Instruction For Dance Appreciation: A Design-Based Research Study, Cuiqing Meng, Tiantian Zhou

Journal of Educational Technology Development and Exchange (JETDE)

Video is widely used in dance appreciation courses; however, unguided viewing often leads to passive observation rather than analytical understanding. Grounded in multimedia learning theory and instructional scaffolding, this study employed a Design-Based Research (DBR) approach to develop and evaluate a teacher-guided video instructional model in a dance appreciation course in a Chinese university. The DBR process involved iterative phases of design, implementation, analysis, and refinement within an authentic classroom context. A convenience sample of 23 undergraduate dance majors participated in the study. Data were collected through a structured questionnaire consisting of Likert-scale items and open-ended responses. Quantitative data were …

Digital Transformation And Artificial Intelligence In Education In Vietnam: A Bibliometric And Systematic Review, Minh-Anh Thi Nguyen, Van-Quynh Ha

Journal of Educational Technology Development and Exchange (JETDE)

Globally, digital transformation (DT) is reshaping education through data-driven innovation, artificial intelligence (AI), and emerging learning technologies. These transformative forces are influencing not only instructional methods but also governance, equity, and sustainability in education. Within this context, the study provides a comprehensive review of DT and AI in Vietnam’s education sector. Combining bibliometric mapping with a systematic content analysis, it synthesizes recent scholarly developments to reveal key research trends, methodological orientations, and conceptual structures. Five thematic clusters are identified, including digital competence, institutional transformation strategies, AI literacy, and learner engagement, potentially reflecting a shift from institutional readiness toward learner-centered innovation. …

Enhancing Academic Literacy Through Ai-Supported Writing Analytics In Multilingual Higher Education, Riki Nasrullah, Septia Rizqi Nur Abni

Journal of Educational Technology Development and Exchange (JETDE)

This study examines the longitudinal impact of AI-supported writing analytics on academic literacy in multilingual higher education. Using a quasi-experimental design over two semesters with 124 undergraduates, the treatment group employed a GPT-based analytics tool, while the control group relied on conventional feedback. Using a longitudinal quasi-experimental design and repeated-measures analyses, the study found significant group effects and significant Group × Time interactions, indicating that the treatment group achieved larger and more sustained gains in academic literacy. Process-oriented indicators and learning analytics further showed a shift from surface editing to global revision, accompanied by deeper metacognitive engagement.

Artificial Intelligence In Higher Education: How Educators’ Perception, Readiness, And Well-Being Shape Performance, Fatimah Pohan, Dicky Aprillo Siregar, Muhammad Bangun Siregar

Journal of Educational Technology Development and Exchange (JETDE)

Artificial Intelligence (AI) is transforming higher education, but its effectiveness depends on how educators perceive, adopt, and psychologically respond to the technology. This study examines the effects of educators’ perception of AI and AI adoption on self-reported educators’ performance through AI readiness and psychological well-being. Grounded in the Technology Acceptance Model, Readiness for Change Theory, and the Job Demands–Resources framework, the study employed a quantitative cross-sectional survey design. Data were collected from 121 educators at private higher education institutions in North Sumatra, Indonesia, using purposive sampling of active educators. The data were analyzed using Partial Least Squares Structural Equation Modeling. …

Investigation Of Dean’S Transformational Leadership Profiles And Digital Transformation Maturity In Guangxi Public Higher Vocational Colleges, Lili Ding, Jamilah Binti Ahmad, Yuqiang Luo

Journal of Educational Technology Development and Exchange (JETDE)

Background: As China builds an innovation-driven economy, vocational education provides essential skilled workers for key industries, helping to elevate vocational colleges into crucial centers for talent development and social mobility. In this context, the dean’s transformational leadership may play an important role in supporting institutional digital transformation.

Research Question: How do deans’ transformational leadership domains predict institutional digital transformation maturity across leadership and pedagogy in vocational education?

Methods: A sequential explanatory mixed-methods design combined a faculty survey with semi-structured interviews. Valid survey responses from 30 faculty members were analyzed using descriptive statistics, correlations, and regression, followed by thematic analysis of …

Ai-Generated Content In Education: Moving Beyond Theory Toward Data-Driven And Actionable Insights, Huong Thi Pham, Nhung Thi Phuong Nguyen

Journal of Educational Technology Development and Exchange (JETDE)

The emergence of AI-powered content such as text, images, and videos generated by large language models (LLMs) has rapidly transitioned from an experimental novelty to a structural force in higher education. Yet, previous reviews have remained largely conceptual or focused on the early stages of the AI wave. This study offers an updated, multi-faceted overview of AI-generated content in education based on data from 2022 to 2025. Following the PRISMA protocol, we systematically identified and reviewed 64 peer-reviewed studies to examine usage, transformation of teaching practices, impacts on learning outcomes, and challenges related to academic integrity, bias, trustworthiness, and teacher …

Development Of The Digital Literacy Scale Based On A Socioformative Approach In University Students, Pedro Luis Arroyo-Pizarro, Renzo Esteban Martinez Laya, Elizabeth Deisy Herrera Bustillos, Esperanza Carmen Quiñones Aldazabal, Ernesto Elias Mamani Tipula, Alex Giovanny Arestigue Navarro, Christian Daniel Palomino Huananchin

Journal of Educational Technology Development and Exchange (JETDE)

Abstract: The objective of this study was to develop and validate a digital literacy scale grounded in the socioformative approach for university students. An instrumental, cross-sectional design was used with a sample of 174 students from Metropolitan Lima. Content validity was established through expert judgment, and construct validity was examined using exploratory factor analysis. The results supported a four-factor structure—Metacognitive-Adaptive ICT domain, Critical digital information management, Multimedia communicative production, and Digital socio-ethical practice—that explained 61% of the variance. Reliability indices were acceptable across dimensions (α=.716–.810; ω=.728–.817). The findings indicate that the scale (EADigit) is a valid and reliable tool for …

Development And Psychometric Validation Of A Short-Form Critical Thinking Scale In Generative Ai Contexts (Genai–Crt): Evidence From Vietnamese Efl Learners, Ngo Cong-Lem, Thang T. Nguyen, Khanh N. H. Nguyen, Quyen N. H. Nguyen

Journal of Educational Technology Development and Exchange (JETDE)

The rapid spread of generative artificial intelligence (GenAI) in education has intensified concerns about its impact on learners’ critical thinking, underscoring the need for reliable instruments to assess how students engage critically with AI-generated content. This study adapted, developed, and initially validated the Generative AI–Critical Thinking (GenAI–CrT) scale, an eight-item short-form instrument designed to capture EFL learners’ critical thinking in AI-enhanced learning contexts. Data from 233 Vietnamese undergraduates and graduates underwent exploratory and confirmatory factor analyses, supporting a theoretically grounded four-factor structure comprising analytical skills, logical reasoning, evidence evaluation, and open-mindedness. The scale demonstrated excellent model fit (χ²(14) = 23.49, …

Trends And Innovations In The Development Of Immersive Technology In Science Education (2019-2024): A Literature Review, Aziz Kurniawan, Hartono Hartono, Bambang Subali

Journal of Educational Technology Development and Exchange (JETDE)

The COVID-19 pandemic has had a significant impact, including the change in learning methods from face-to-face to non-face-to-face learning. This change in method accelerates innovation in the use of technology to support non-face-to-face learning. Immersive technologies, such as Augmented Reality (AR), Virtual Reality (VR), and Virtual laboratories, have offered authentic and interactive non-face-to-face learning experiences in science education. This study employed a systematic literature review (SLR) method to map trends and innovations in the development of immersive technology in science education from 2019 to 2024. The literature data were obtained from the Scopus database and then selected using the PRISMA …

Speaking Up Online And Offline: The Effects Of Social Media-Based E-Portfolios In Empowering Efl Students' Speaking Performance, I Putu Indra Kusuma, Luh Indrayani

Journal of Educational Technology Development and Exchange (JETDE)

Although e-portfolios are widely acknowledged for enhancing EFL students’ speaking skills, most studies assessed performances offline, leaving limited evidence of their impact across both modes. This study examined the effects of social media-based e-portfolios combined with classroom instruction on students’ speaking performance in online and offline contexts. A mixed-methods experimental design was employed, involving 46 Indonesian university students divided into an experimental and a control group. Data were collected through online and offline pre- and post-speaking tests, a speaking performance rubric, and semi-structured interviews. Quantitative analysis using One-Way MANOVA, Univariate ANOVA, paired sample t-test, and effect size revealed significant improvements …

Case-Based Learning In Biology Education: A Systematic Literature Review, Elsje Theodora Maasawet, Jullya Christin Kolow

Journal of Educational Technology Development and Exchange (JETDE)

Biology education often relies on content-intensive instructional materials that may encourage rote memorisation rather than conceptual understanding, potentially contributing to misconceptions. Case-Based Learning (CBL) offers an alternative by engaging students in applying biological concepts to authentic, real-life cases and promoting meaningful learning. Despite growing empirical interest in CBL, no systematic literature review has specifically synthesised its application in biology education. This study therefore examined publication trends, learning skills addressed, and conceptualisations of CBL in biology education. Relevant literature was retrieved from Scopus and Web of Science using “Case-Based Learning” as the search term. Following PRISMA-guided screening, 42 articles were included …

Integrating Digital Tools To Foster Soft Skills In Vocational Education: A Flipped Classroom Approach In China, Shanshan Wu, Renee Shiun Yee Chew, Yanhua Bi, Hui Jin

Journal of Educational Technology Development and Exchange (JETDE)

Changes in the global demand for labor have highlighted the need for vocational education and training (VET) systems to develop not only technical skills but also soft skills like critical thinking, communication, and adaptability. This research investigates the use of digital technologies in a flipped classroom (FC) model and their impact on the development of soft skills in vocational students with particular attention to the growing VET ecosystem in China. With data gathered from a cross-sectional quantitative survey of 270 students from a Chinese vocational college, the research seeks to assess the impact of specific digital tools, such as video …

Evaluating Artificial Intelligence Language Tools In English Language Learning For Flight Attendant Learners, Qianying Pu, Amelia Binti Alias, Khairul Azhar Bin Jamaludin

Journal of Educational Technology Development and Exchange (JETDE)

This study analyzes AI language tools aiding English learning for aspiring flight attendants, focusing on fluency, pronunciation, and communication skills. Considering the aviation industry’s very high language requirements, this research examines how AI language tools help flight attendants master English and improve their speech and pronunciation.  A qualitative descriptive design using semi-structured interviews was adopted for the present study with flight attendants and aviation English educators. The study highlights major themes such as Increased Confidence through Repetition and Feedback, Pronunciation Improvement Enabled by an AI-specific feature, Pedagogical Gaps and Instructor Apathy, and Limitations in Contextual Appropriateness. This study concludes that …

Vol 19 Issue 1 Table Of Contents

Journal of Educational Technology Development and Exchange (JETDE)

Table of Contents

Ethical Dilemmas Of Generative Ai In Education And Their Implications For Sdg 4: A Systematic Review From A Global And Inclusive Perspective, Eva García-Beltrán

Journal of Educational Technology Development and Exchange (JETDE)

This systematic review, conducted in accordance with PRISMA 2020 guidelines, examines the ethical dilemmas associated with the use of Generative Artificial Intelligence (GAI) in education and analyses their implications for the achievement of Sustainable Development Goal 4 (SDG 4), with a focus on inclusive and equitable quality education. The review draws on 24 peer-reviewed studies published between December 2022 and December 2024, covering diverse educational levels and geographical contexts, with a predominance of Global North perspectives and limited representation from the Global South. The analysis reveals four primary themes: academic integrity, algorithmic equity, data privacy, and the potential contribution of …

Exploring Teachers’ Perceptions Towards Using Ict With Dialogic Teaching In The Primary Science Classroom In Saudi Arabia, Yousef Alharbi, Sue Johnston-Wilder

Journal of Educational Technology Development and Exchange (JETDE)

This study examines the implications of teachers’ perceptions of using ICT to support dialogic teaching in primary science classrooms in Saudi Arabia. It employed questionnaires distributed electronically to science teachers working in state primary schools in Riyadh, and 305 completed responses were analyzed using SPSS. The majority were found to implement a variety of activities to support dialogue and to use several ICT tools in their science lessons. In addition, most teachers reported positive attitudes toward ICT, dialogic teaching, and ICT-supported dialogic teaching in science lessons. However, the results indicated that some teachers currently adopt a dominant role in dialogue …

Application Of Artificial Intelligence In Case-Based Teaching: A Qualitative Study In Mba Education, Tianjiao Xu, Mohd Nazir Bin Zabit

Journal of Educational Technology Development and Exchange (JETDE)

This study examines the incorporation of artificial intelligence (AI) into case-based teaching (CBT) within Master of Business Administration (MBA) programs in China, amidst the rapid digital transition in higher education. Guided by the Context–Input–Process–Product (CIPP) evaluation framework, the study adopted a qualitative design and conducted semi-structured interviews with five instructors from three core MBA courses. The findings indicate that AI enhanced classroom interaction and reduced teachers’ workload by supporting real-time feedback and dynamic discussion processes. Institutional support, including teacher training, digital infrastructure, and technical assistance, was recognized as a vital facilitator of effective implementation. Despite its various benefits, the study …

Enhancing International School Implementation Capacity: Supporting Contextualized Learning At An International Baccalaureate School In China, Christopher J. Hayden Iv

Theses and Dissertations--Educational Leadership Studies

International schools allocate substantial resources to implement progressive curricular innovations; however, the advantages offered by these developments are contingent on their effective execution within classroom settings. This mixed methods action research (MMAR) study examined the implementation of the International Baccalaureate (IB) Global Context (GC) Strategy in the Middle Years Programme (MYP) at an international school in China and asked how the school might strengthen its capacity to enact this and similar innovations. Following a sequential MMAR design, a reconnaissance phase combined a whole-staff survey (n=87) with qualitative interviews to diagnose the individual, organizational, and contextual factors shaping implementation. Analyses identified …

Redefining Educational Technology: A Critical Collaborative Inquiry, Aras Bozkurt, Helen Crompton, Robert Farrow, Agnes Kukulska-Hulme, Jon Dron, Richard West, Agnieszka (Aga) Palalas, Matth Bower, Junhong Xiao, Ahmed Tlili, Danah Henriksen, Angelica Pazurek, Henk Huijser, Thomas K. F. Chiu, Petar Jandrić, Katy Jordan, John Curry, Royce Kimmons, Mutlu Cukurova, Thomas Reeves, Gwo-Jen Hwang, Peter Shea, Jason Lodge, Martin Weller, Davy Ng, Tutaleni Iita Asino

STEMPS Faculty Publications

Educational technologists have not settled on a fixed definition of the field and likely never will. However, attempting to define the field helps to understand the epistemological meanings that shape what the field sees, values, and considers worth pursuing. Through a critical historical review spanning over a century, alongside theoretical engagement with the concepts of entanglement and distributed agency, this paper identifies three key insufficiencies in current educational technology frameworks. These are the persistence of an instrumental-facilitative paradigm that treats technology as a resource deployed by human agents; the theoretical dissolution of the pedagogy-technology dichotomy that existing definitions have not …

Ai Policy In Virginia Public Schools: A Comparative Analysis, Jesse Senechal, Jamelle Simmons, Jonathan D. Becker, Melissa Ware, Michael Broda, Kindy Anderson, Eric Byers, Kiana Bradford, Thea Racelis, Meleah Ellison

MERC Publications

This MERC research and policy review explores policy implications of artificial intelligence (AI) in Virginia public schools. It is part of a two part series with a companion report focused on AI implications for PK-12 teaching and learning. The report has two parts:

1. A review of the AI policy landscape around PK-12 education
2. Virginia AI policy analysis

It concludes with a series of key takeaways and recommendations for PK-12 policy and practice.

Ai In Pk-12 Education: Implications For Teaching And Learning, David Naff, Meleah Ellison, Casey Bailey, Tzu-Wei Wang, Kiana Bradford

MERC Publications

This research and policy review from the Metropolitan Educational Research Consortium (MERC) explores the implications of artificial intelligence (AI) for teaching and learning in public PK-12 education. It is part of a two part series with a companion report focused on AI implications for PK-12 policy. The report explores two questions:

1. How is AI shaping teaching and instructional practice?
2. How is AI shaping student learning and development?

It concludes with a series of key takeaways and recommendations for PK-12 policy and practice.

Perspectives Of Rural Educators On The Dependencies And Drawbacks Of Chat Gpt In Nigerian Higher Education Practices, Adedayo Olayinka Theodorio Dr, Francisca Jumoke Theodorio, Olumide Gbenga Olugbodi, Peter Adebowale Samson, Olusegun Olawale Olakotan

Journal of Educational Technology Development and Exchange (JETDE)

ChatGPT remains a valuable tool for transforming teaching strategies and supporting students’ comprehension of subject matter. However, its adoption and research remain uneven within the context of higher education in Nigeria. Specifically, there is limited empirical research that exemplifies real-world experiences regarding the dependencies and drawbacks in rural educational settings. This qualitative single-case study explored this phenomenon at a southwestern institution in Nigeria, involving a purposively selected group of educators. Data were gathered through participatory observation and focus group interviews, which were thematically analysed. The results indicated that the effective use of ChatGPT in rural higher education heavily depends on …

Guidelines For Automatic Grading Of Student Essays Using Large Language Models, Diwakar Yalpi, Sruta Keerti Kasula, Ravi Mukkamala

Computer Science Faculty Publications

Automated essay evaluation using large language models (LLMs) has emerged as a promising approach to support scalable and consistent educational assessment. However, the effectiveness of LLM-based grading varies significantly across evaluation dimensions and is highly influenced by prompt design and model selection. In this study, we evaluate five state-of-the-art LLMs across five rubric-based categories: Relevance to Question, Reasoning and Critical Thinking, Evidence and Examples, Organization, and Clarity and Writing Quality. We systematically investigate the impact of three prompting strategies, including rubric-only prompting, exemplar-based prompting (with and without rubric guidance)(Original and Refined prompt designs) incorporating structured instructions. Additionally, a prompt ablation …