Educational Assessment, Evaluation, and Research Commons^™

An International Framework And A Local Standardised Test: A Former Item Writer’S Autoethnography, Xuan Minh Ngo

The Qualitative Report

A recent trend dominating education worldwide is the enactment of external accountability frameworks and standards-based assessment. Likewise, in language education, international standards like the Common European Framework of Reference (CEFR) have been increasingly used for local standardised test development and alignment. However, there has been little research into the application of the CEFR in item writing, the activity of creating new items and associated materials, in local standardised testing contexts. To bridge this gap, this autoethnography shares my firsthand experience of writing items for a locally-developed, CEFR-aligned standardised English test in Vietnam. By combining evocative and analytic autoethnography, I aim …

Code Of Good Practice In Research, Munster Technological University, Ireland

Policies & Procedures

The University is committed to ensuring that the research it supports is carried out to the highest possible standards of integrity and in conformity with current legislation.

The University expects that all research is performed to the highest standards of integrity at all times, irrespective of whether the researchers are students, contract researchers or staff members of the University, or their collaborators. Research integrity takes precedence over any consideration related to the source of the funding, either internal or external.

This code sets out a series of guiding principles and standards for good research practice and applies to all disciplines. …

Construct Validity, Test-Retest Reliability, And Inter-Rater Objectivity Of The Swimming Competence Assessment Scale (Scas), Jon Sundan, Håvard Lorås, Monika Haga

International Journal of Aquatic Research and Education

This study aimed to investigate the construct validity, test-retest reliability, and inter-rater reliability of a newly developed and comprehensive instrument for assessment of children’s swimming competence. The Swimming Competence Assessment Scale (SCAS) consists of six consecutive test items (entry, swim on front, surface dive, float, swim on back and exit) that aligns with the Norwegian curricular standard of swimming competence. The exploratory factor analysis retained a unidimensional model, supporting one underlaying statistical dimension with acceptable internal consistency (α = 0.79). Intraclass correlation coefficients (ICCs) between test and retest ranged from .84 to .98, and .97 for the total score. Strong …

"Feel For The Water": What Is It, Really?, Robert Keig Stallman, Kristine De Martelaer

International Journal of Aquatic Research and Education

The phrase, 'feel for the water,' is commonly used. But what does it really mean? The traditional idea of this 'feel' focuses on the sensation of touch and use of the hands to produce propulsion. But what about water resistance? Mastering a feel for how to reduce resistance is equally important as the unique relationship between aquatic propulsion and resistance is of great importance. While being in the water, the effects of gravity and buoyancy also need to be perceived by the learner and taught by the instructor. Reflection on the effects on propulsion-resistance and gravity-buoyancy requires relevant exercises to …

Water Orientation Skills And Basic Safety And Swimming Skills Of Children With Autism Spectrum Disorder, Kelle L. Murphy, Min Liu

International Journal of Aquatic Research and Education

Drowning is the leading cause of death among individuals with autism spectrum disorder (ASD). The current study examined water orientation (i.e., comfort level), water safety, and beginning swimming skills of individuals with ASD of ages ranging from 3 to 13 years using the Aquatic Orientation Checklist (AOC) (Kilian et al., 1984). Data were collected during consecutive Fall and Spring semesters. A total of 23 children (n = 15 boys; n = 8 girls) volunteered for the study. Lessons were conducted twice a week for 10 weeks continuously and each lesson was 45 minutes in length. Overall, the swimming program had …

Fighting Instinct: The Brain, Emotions And Decision-Making In The Water, Jill Nash, Sam Hills

International Journal of Aquatic Research and Education

This conceptual paper explores the complex interplay among the human brain, emotions, and decision-making processes, particularly in aquatic environments. Integrating insights from neuroscience, psychology, and behavioural economics, we investigate how instinctual responses and emotional states influence our decisions during water-related activities. By analysing both biological and psychological factors, the paper aims to illuminate the intricacies of human behaviour in various aquatic settings and highlights significant gaps in the research on emotional decision-making that warrant further investigation. Additionally, the paper suggests interventions, including plausible communication strategies, to mitigate the impact of instinctual responses and improve safety and decision-making efficiency.

Goggles And Water Competence: An Addendum, Marek Rejman, Robert Keig Stallman Ph.D.

International Journal of Aquatic Research and Education

We offer this short addendum to the 2017 article that appeared in IJARE, ‘’From swimming skill to water competence: Towards a more inclusive drowning prevention future’’ (Stallman et al., 2017), as an editorial to argue that the essential water competencies ought to be mastered “without goggles.” The focus is on the potential negative effect of goggle use during beginning swimming instruction along with their likely absence during unintended and unexpected immersions in natural bodies of water that often lead to drowning. Rejman and Stallman (2024) demonstrated the development of dependence on goggles among young adults and described its negative effect …

In This Issue 14:4, Stephen J. Langendorfer Ph.D.

International Journal of Aquatic Research and Education

In This Issue 14:4

The Perceived Benefits Of And Barriers To Open-Water Swimming: A Mixed-Methods Examination, David Elliott Ph.D, Mark A. Christie Ph.D

International Journal of Aquatic Research and Education

This study set out to determine the perceived benefits of, and barriers to, open-water swimming (OWS). Adopting a mixed-methods approach, six hundred and sixty-five open-water swimmers responded to an online survey consisting of the Exercise Benefits and Barriers Scale (EBBS) and a series of open-ended questions. Data from the EBBS revealed the strongest perceived benefits to be ‘Psychological Outlook’ and ‘Life Enhancement.’ In terms of barriers, those presented in the EBBS received low ratings with only ‘Physical Exertion’ considered as being somewhat problematic. Content analysis performed on the open-ended responses showed social aspects, mental well-being, and connection to nature as …

Evaluation Of Online Information On The Cold Shock Response To Accidental Immersion In Cold Water, Adam Wilson, Heather Massey, Clare M. Eglin

International Journal of Aquatic Research and Education

Many of the UK open water accidental deaths have been attributed to the initial responses to cold water immersion (CWI) collectively known as the cold shock response (CSR). The aim of this study was to analyse the publicly available internet information on CWI and CSR for accuracy and quality compared to the ‘gold standard’ published, peer-reviewed research. Seventy-eight webpages which provided information in English on unexpected CWI and CSR were evaluated. Webpages were accessible, widely available, and had appropriate readability scores. Webpage accuracy was suboptimal including only presenting on average 10 (range 3-16) CSR components out of 19. Quality of …

A Preventionist Framework For Reducing Drowning: A Case For Parenting Interventions, Miriam G. Clark, Linda Quan, Patricia Chamberlain

International Journal of Aquatic Research and Education

Drowning is preventable but still claims the lives of over 300,000 people worldwide every year. The purpose of this theoretical review paper is threefold: 1) discuss the theoretical framework for a multi-faceted system of prevention; 2) discuss the importance of parenting, a crucial area where current drowning prevention research is falling short in this multi-faceted approach; and 3) discuss how evidence-based practices from psychosocial parenting research could be used to create drowning prevention interventions that support parents to implement water safety practices in their families. Practical ideas for integrating psychosocial parent interventions with drowning prevention knowledge are discussed. Such interventions …

Examining The Influence Of Digital Transformation On Organizational Culture And Employee Adaptability In Higher Education Institutions Across The Gulf Cooperation Council (Gcc), Hussein Elsayed Mohamed Ismail

Journal of the Association of Arab Universities for Research in Higher Education مجلة اتحاد الجامعات العربية للبحوث في التعليم العالي

The study aimed to explore the impact of digital transformation on organisational culture and employee readiness within Higher Education Institutions (HEIs) in the Gulf Cooperation Council (GCC) region. Conducted in 2024, it involved research that used a sample of employees and administrators from various universities across the region. Structured questionnaires served as data collection tools, allowing for an in-depth evaluation of the different dimensions of digital transformation. This study primarily utilises secondary data analysis, which involves examining data from existing studies, reports, and scholarly articles. This approach is selected for its efficiency and cost-effectiveness, as it allows access to extensive …

Accessibility Disclosure Statements: Best Practices For Documenting Inclusive And Accessible Web-Based Research Design, Alicia Mason, Elizabeth Spencer, Pan Liu, Kristen Livingston, Sakshi Bhati, Angela Ashmore, Tristan A. Spencer, Lauren Shepard

Faculty Submissions

Accessibility disclosure is a core principle of the Project IRIS Best Practice Framework. This instructional resource-- Accessibility Disclosure Statements: Best Practices for Documenting Inclusive Web-Based Research Design-introduces options for reporting accessible web-based research design efforts in scholarly and professional publications. The three forms of accessibility disclosure statements are introduced: summary statements, reports of analysis--both general and specific-, and detailed process descriptions. Each of these strategies including terms, conceptual definitions, and examples are provided. The instructional resource may be of interest to undergraduate and graduate course instructors teaching research methods courses in a variety of social science disciplines.

A Quantitative Study: The Association Between College Selection Methodology And Sense Of Belongingness Among First-Year, Full-Time Residential College Students, Tamara Reese

Doctoral Dissertations and Projects

College selection methodology can be traced back to the 1920s when colleges had to rely on their to travel through word of mouth, catalogs, pictures, and brochures. Although virtual tours can be dated back to 1994, COVID-19 catapulted the popularity of traveling through virtual reality. While many studies have sought to measure the impact of visitation on student enrollment propensities, none have made a noteworthy effort to account for a potential endogenous link between the student's college choice methodology and a student's sense of belongingness at their college or university campus. The purpose of this quantitative quasi-experimental study is to …

Use Of Simulation In Dietetic Internships: A Qualitative Exploration Of Program Director Attitudes And Motivations, Theresa B. O'Reilly, Amy J. Nwora, Megan Whelan, Mary-Pat Maciolek

Journal of Dietetic Education

The use of simulation holds promise for the future of dietetics education for its use as an alternative for up to 30% of the 1,000 supervised practice hours for the training of Registered Dietitian Nutritionists. Even more so, simulation is a teaching tool. When done well, simulation can challenge students in a safe environment where they can receive constructive feedback from expert guides and meaningfully reflect on their learning. The purpose of this study was to interview dietetic internship (DI) program directors on their attitudes and motivations on the use of simulation in their programs, targeting the heavily program-congested states …

National Assessment Program Civics And Citizenship 2024. Public Report, Tim Friedman, Kate O'Malley, Wolfram Schulz, Judy Nixon, Dominique Hall, Frances Eveleigh

Civics and Citizenship Assessment

This report presents the findings of the 7th National Assessment Program – Civics and Citizenship, which was administered in May 2024, and which tests students’ civics and citizenship knowledge and understanding in a sample of Australian schools. The 2024 report reveals that Year 6 and 10 students have a high degree of trust in civic institutions, but considerably less trust in the media or social media. In addition, students have also expressed concerns about a range of issues affecting Australia, including pollution, climate change, crime, and racism. It also shows that, at the national level, results have fallen since the …

Evolving Design Critique For A Changing Industry, Sejin Hwang, Amy Ai, Leo Bang, Yuchen Chen, Kathryn Chen, Tiffany Chang, Stephen Jiang, Chloe Jo, Eileen Lee, Nicole Lu, Ray Liu, Kevin Wei, Elaine Zhang, Ellano Zhou

Student Work

This class serves as an exploratory practice in response to existing studies evaluating critique environments in the design industry. Previous studies identified three key limitations in the critique process: (1) a lack of experience for novice designers working with non-designers when reviewing their work, (2) an ineffective final review structure, and (3) a need for a more constructive and engaging feedback-sharing environment.1 To address these challenges, the course was designed to “critique” critique activities and develop strategic solutions to transform the way design work is reviewed, analyzed, and critiqued. The course was part of a pilot fall semester program called …

Secondary Stage Students' Perceptions Regarding (Myschool) Learning Management System's Role In Learning English, Huda Ali Sallam

Journal of Human Services: Training, Research, and Practice

This study set out to explore students' opinions and self-efficacy level in relation to the use of MySchool learning management system. The study has added focus on its usefulness in facilitating English language learning. The study sample involved 420 female secondary stage students within one educational district in Riyadh. The study instrument is a 24-item closed-ended questionnaire which was distributed using a Microsoft Forms link. The items of the questionnaire were divided into four main elements: perceived practicality, perceived usefulness, general satisfaction, and sense of self-efficacy. The obtained data was subsequently analyzed using Statistical Packages for Social Sciences (SPSS) 24 …

The Economic Imperatives Of Ensuring Accessible University Education In Nigeria, Adekunle Alexander Balogun

Bullion

This study exmined economic imperatives of enhancing access to university education for Nigerians. It submits that university education is the most important factor for technological and innovative breakthroughs, as it equips graduates with receptive minds for complex reasoning that innovation requires. The study employed critical discourse analysis, focusing on the association between the attainment of a university education and the higher incomes of its recipients. The study recommends that the government increase funding for university education to complement private-sector initiatives. It also recommends that university authorities in Nigeria should tap into the vast endowment and embrace grant opportunities for funding.

Chatgpt Didn’T Write This: Evaluating The Impact Of Llms With A Case Study In Grading Cuny Language Immersion Program Student Essays, Benjamin Inbar

Dissertations, Theses, and Capstone Projects

This study evaluates the capabilities and limitations of large language models (LLMs), specifically OpenAI’s ChatGPT-4o, in grading essays from students in the City University of New York’s Language Immersion Program. The program serves English language learners with diverse linguistic and demographic backgrounds, offering intensive language instruction to prepare students for academic success in college. Using a dataset of 30 pre- and post-program essays scored by program instructors and ChatGPT-4o under three paradigms, this research explores the alignment between human and AI-generated scores across five rubric-based competency areas. Findings reveal that ChatGPT-4o aligns moderately with human grading, with the strongest agreement …

Quantifying Educational Impacts Under The Nypd's Stop-And-Frisk Era, Matthew T. Stanton

Dissertations, Theses, and Capstone Projects

This project examines the educational and economic impacts of the New York Police Department's "Stop, Question, and Frisk" (SQF) program, implemented predominantly under "Operation Impact" from 2003 to 2022. Using data from the NYPD and the American Community Survey, the study explores correlations between high rates of stop-and-frisk encounters and reduced educational attainment among targeted demographics, primarily Black and Hispanic young men. It contextualizes the socioeconomic consequences of SQF policies, including their effect on lifetime earnings and community trust. The project highlights the limitations of data correlation, advocates for further longitudinal and qualitative studies, and suggests frameworks for mitigating inequities …

A Prototype Online Platform For Exploring Post-Covid Academic Recovery In U.S. Public Schools: An Example From California Public Schools, Nicole Baz

Dissertations, Theses, and Capstone Projects

This project introduces a prototype online platform designed to analyze the effects of the COVID-19 pandemic on academic achievement in public schools and districts across the United States. Leveraging data from the Stanford Education Data Archive (SEDA) and the National Center for Education Statistics (NCES), the platform enables users to examine recovery rates as measured by standardized test scores. California serves as a proof-of-concept case study, demonstrating the platform's ability to explore recovery patterns in Reading Language Arts and Mathematics between 2019 and 2023. The platform provides interactive data visualizations and dashboards that facilitate analyses based on district size, resources, …

Intrusion Detection For Wireless Sensor Network Using Particle Swarm Optimization Based Explainable Ensemble Machine Learning Approach, Shaikh Afnan Birahim, Avijit Paul, Fahmida Rahman, Yamina Islam, Tonmoy Roy, Mohammad Asif Hasan, Fariha Haque, Muhammad E. H. Chowdhury

Instructional Technology and Learning Sciences Faculty Publications

Wireless Sensor Networks (WSN) play a pivotal role in various domains, including monitoring, security, and data transmission. However, their susceptibility to intrusions poses a significant challenge. This paper proposes a novel Intrusion Detection System (IDS) leveraging Particle Swarm Optimization (PSO) and an ensemble machine learning approach combining Random Forest (RF), Decision Tree (DT), and K-Nearest Neighbors (KNN) models to enhance the accuracy and reliability of intrusion detection in WSNs. The system addresses key challenges such as the imbalanced nature of datasets and the evolving complexity of network attacks. By incorporating Synthetic Minority Oversampling Technique Tomek (SMOTE-Tomek) techniques to balance the …

Autoethnographic Action Research As A Contemplative Practice: Awareness And Transformation Of Inner And Outer Selves, Jiju Varghese, Bal Chandra Luitel, Niroj Dahal

The Qualitative Report

Contemplation as a spiritual practice has taken various forms across different religious traditions and regions worldwide. Over the years, various contemplative practices have evolved and become popular even outside religious traditions to promote the well-being of all for inner and outer selves’ transformation. In education, many scholars worldwide have expounded on the benefits of contemplative practices in the classroom for students and teachers. Contemplative practices have penetrated research practices in the form of contemplative inquiry considering performative, philosophical, and artistic transformations, where researchers enter into a deep, thoughtful, and reflective introspective journey to see the connection between what is seen …

Education For Citizenship In Times Of Global Challenge: Iea International Civic And Citizenship Education Study 2022 International Report, Wolfram Schulz, John Ainley, Julian Fraillon, Bruno Losito, Gabriella Agrusti, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

This open access book investigates the ways in which young people around the world are prepared to undertake their roles as citizens. It presents the international results from the third cycle of the study IEA’s International Civic and Citizenship Education Study (ICCS 2022). Based on data from 24 countries or benchmarking participants from Europe, Latin America, and Asia, ICCS 2022 studies contexts for and learning outcomes of civic and citizenship education in a wide range of national contexts at the beginning of the third decade of the 21st Century. It responds to both enduring and emerging challenges of educating young …

National Assessment Program Civics And Citizenship 2024 : Technical Report., Kate O'Malley, Renee Kwong, Dulce Lay, Jorge Fallas

Civics and Citizenship Assessment

This report describes the procedures and processes involved in the conduct of the National Assessment Program – Civics and Citizenship (NAP – CC) 2024. The report is divided into chapters covering: the assessment framework and instrument design, item development, test design, scoring student responses, the student questionnaire, student background information, sampling and weighting, data collection procedures and data management, and scaling procedures. The report include an extensive collection of tables and figures.

A Review Of The Validity Of The Autism Diagnostic Observation Schedule 2, Keegan Cundiff

Masters Theses & Specialist Projects

Autism spectrum disorder (ASD) is a multifaceted condition that affects individuals in unique ways. According to the Centers for Disease Control (CDC, 2020), people with ASD have a neurological disorder that impacts communication, social interaction, and behavior. One common ASD evaluation tool is the Autism Diagnostic Observation Schedule 2 (ADOS-2), which helps a clinician decide if the student exhibits social and communication skills expected of someone with or without ASD. Since ASD is a disorder for which symptoms need to be present within the early developmental period, it is common for schools and pediatricians to be initial sources of referral …

Computing In The Commonwealth: Specialized Education In Computer Science And Information Technology For High School Students In Virginia – An Environmental Scan, Amy Corning, Jonathan D. Becker, Jon Graham, James Carrigan, Keisha Tennessee

ICRE Publications

Over the past two decades, Virginia has invested substantially in STEM education, in part through specialized programs focused on computer science and information technology (CS/IT). This study represents the first effort to identify Virginia’s specialized secondary CS/IT programs and examine them collectively. Findings from the statewide environmental scan indicate that the programs are delivered through a wide variety of institutional structures, including Governor’s STEM Academies, Governor’s Schools, specialty centers, and academies, but most often through Career and Technical Education (CTE) centers. Programs tend to be concentrated in metropolitan areas, and some rural divisions may not be served. The programs provide …

Six Years Of Proposed Ai Legislation Across The Us States: What’S On Policymakers’ Minds?, Luisa Nazareno Phd, Nakeina E. Douglas-Glenn Phd, Research Institute For Social Equity Rise

Research Institute for Social Equity

As artificial intelligence (AI) technologies expand rapidly, public debate has focused on their societal impacts and the need for regulatory oversight. This report offers the first overview of the “what, where, and when” of AI-related legislation introduced in U.S. state legislatures between 2019 and 2024, analyzing key policy trends, priorities, and equity considerations. Although relatively few bills have been enacted, legislative activity has accelerated, reflecting growing political attention to the promises and risks of AI. Most approved bills focus on regulating public or private sector uses of AI, establishing commissions or study groups, and updating education and workforce development programs. …

La Declaración De Munster Sobre Los Principios De Ética De La Investigación E Integridad En La Investigación (Spanish), Ingenium

Dissemination

INGENIUM es una alianza de diez instituciones de educación superior de diez países europeos. Esta Universidad Europea busca permitir que cada miembro de la red ofrezca programas de estudio y cualificación de alta calidad con componentes digitales que se comparten dentro de la Alianza INGENIUM.

En las instituciones de educación superior está cobrando una importancia creciente la promoción de buenas prácticas de investigación en todos los aspectos de la investigación12, incluyendo desde la investigación fundamental hasta la investigación aplicada y la transferencia. La ética de la investigación (EI) y la integridad de la investigación (II) sustentan la actividad y la …