Educational Assessment, Evaluation, and Research Commons^™

The Security Of Deep Neural Networks, Jalaya Allen

Cybersecurity Undergraduate Research Showcase

Our society has transitioned from our primitive lifestyle to soon, an increasingly automatic one. That idea is further exemplified as we shift into an AI era, better known as Artificial intelligence. Artificial Intelligence is classified as computer systems that can perform tasks that typically require human intelligence. However, a common thought or question that most might have is, how is this done? How does AI process information the way we want it to and have access to so much information? AI is trained by systems called AI models. These modeling programs are trained on data to recognize patterns or make …

Unpacking Automated Test Assembly: New Findings And Directions For The Future, Ling Tan, Charlotte Waters, Fuchan Huang, Dan Cloney

OECD Programme for International Student Assessment (PISA)

In large-scale assessments, the manual assembly of tests to meet many competing criteria may become an intractable task. Automated test assembly (ATA) can use optimisation algorithms to achieve optimal assembly outcomes. Since 2018, PISA has been transitioning from fixed test forms to adaptive testing. This transition is driven by the aim of improved test targeting, which increases reliability. Multi-stage adaptive testing (MSAT) has been preferred to item level computer adaptive testing (CAT) as it can better address the sometimes-competing requirements of an assessment like PISA where item exposure, position effects, construct coverage, and cross-sectional trend all must be met in …

Assessing Higher Order Thinking In The New Jersey Social Studies Standards For Grades K-8 By Using Artificial Intelligence (Ai), Connie Sanchez

Seton Hall University Dissertations and Theses (ETDs)

New Jersey consistently ranks as one of the top-performing states in the country when it comes to education. Most recently, it was ranked third in the nation. A look at the state standards in any subject shows the state works diligently to vertically align standards while also challenging students in order to better prepare them for the future and to be able to live in a global society. It is evident in looking at the New Jersey Department of Education’s standards that the planning they do is performed with an eye toward the future. The social studies standards are no …

Who Cares?! Fostering Inclusive And Empowering Environments For Black Students In Predominantly White Institutions: Strategies For Retention And Cultural Engagement, Joel Mandell Stancer, Danielle Allen, Angela Haywood-Gaskin, Kelly Atkins, Rhonda Lingard, Kuriston White-Dunlap

Dissertations

This research focuses on the critical components of caring relationships and how they relate to first-generation Black students’ achievement in higher education. It will reveal how staff-led collegiate programming could benefit first-generation Black college students by allowing them to establish caring relationships and mentorships that allow them to construct a solid support system that is easily accessible to them from the moment they begin college until graduation.

Using data collected from interviews with current college students enrolled in a retention program at a PWI (Predominately White Institution) and in connection with a conceptual framework informed by theorists Nel Noddings, Vincent …

Tools For Capturing Outcomes In Virtual Educational Programs, Leyla Marandi, Eleanor Haworth, Vikram Koundinya, Katherine Webb-Martinez, Kit Alviz

Journal of Extension

During the COVID-19 pandemic, organizations increased virtual programming and adoption of online technologies. This article outlines the [University redacted] assessment of tools for gathering data on participant learning outcomes from virtual educational programs. After assessing colleagues’ experiences and searching for new web applications, a central repository was created. [University redacted] team will use this information to assist extension professionals in collecting program planning and evaluation data. We believe that these tools can help other extension programs nationally and globally with similar efforts, as more virtual programming is likely to increase in the future.

Examining The Factor Structure Of A Subjective Well-Being Measure In A Medical Student Sample, Hoan Do, Mary Wurm-Schaar, Gordon Brooks

Mid-Western Educational Researcher

Accreditation standards for U.S. medical education programming require that training programs promote trainee wellness and well-being, although constructs such as psychological distress and depression commonly serve as proxies for well-being. A direct measure of subjective well-being would be invaluable to inform programming efforts to promote medical trainees’ well-being and advance the study of the well-being construct itself. This study investigated the structural validity of subjective well-being as measured by the Well-Being Scale in a sample of 548 osteopathic medical students. Results of the confirmatory factor analysis indicated that subjective well-being is best represented by a bifactor model with a general …

My Story Is In The Structure: An Autoethnographic Study By An Instructional Designer Working In A Centralized Academic Reporting Line, Pamela Williams

Dissertations

Although not officially named in the shared governance of an institution, instructional designers play an important role as they collaborate with administrators and faculty to create high quality, regulatory-compliant courses for enrolled students. Instructional designers working in centralized, academic reporting units may be well-positioned to advance the work of institutions to maintain good standing with the industry and regulatory bodies. To illustrate the challenges, opportunities, and strategies employed by an instructional designer working in such a position, an autoethnographic study was conducted to elucidate how shared governance influences, empowers, and disempowers an instructional designer’s ability to lead and collaborate on …

Construct Validation Of A Learning Resources Rubric [Lrr]: A Modified Delphi Study, Lei Wang, Andrew Feldstein, Tiffany Koszalka

SACAD: Scholarly Activities

This study delivers a comprehensive exploration of the construct validation of the LRR, employing a Modified Delphi study coupled with Confirmatory Factor Analysis and Structural Equation Modeling to analyze data. Through rigorous analysis involving 576 expert instructional designers, the study achieves consensus on the LRR’s multifaceted indicators, evidenced by high I-CVI values, confirming their relevance, appropriateness, and robustness. The combination of quantitative and qualitative data, including surveys, focus groups, and online document analysis, establishes the rubric’s validity and points to areas for refinement. Grounded in alignment with three well-established deeper learning theories (Generative Learning Theory, Cognitive Flexibility Theory, and Reflection …

Perception, Practice, And Reality: Implementing Effective Professional Development Structures In K-12 School Systems, Rebecca M. Howell, Taylor C. Lauck, Leslie T. Watts

Morehead State Theses and Dissertations

A capstone submitted in partial fulfillment of the requirements for the degree of Doctor of Education in the Ernst and Sara Lane Volgenau College of Education at Morehead State University by Rebecca M. Howell, Taylor C. Lauck, and Leslie T. Watts on April 9, 2024

Ungrading’S Affect On Student Agency In The Education Classroom, Linda E. Feldstein, Robyn Hartman, Janet Stramel

SACAD: Scholarly Activities

This study investigates the impact of ungraded classroom evaluation structures on students' development of agency for learning. Through survey research comparing traditionally graded classes with those employing ungrading practices, student responses are analyzed. Results suggest potential increases in student agency among those in ungraded classes. This challenges prevailing education practices, highlighting the shift towards student-centered, formative learning experiences when agency is actively encouraged.

Effects Of A Mentorship Program On High Need College Students: Reflections From Mentors And Mentees, Stephen Miske, Olusegun Sogunro

Journal of Educational Research and Practice

On average, the college graduation rates for minority and/or high-need students are generally low. To address this situation, a Mid-Atlantic Consortium recently secured a grant to improve 4-year graduation rates of high-need students (i.e., new first-time students and transfer students who qualify as low-income students, first-generation college students, adult students, and/or students of color) by 20% over each selected college’s baseline. The purpose of this qualitative case study was to explore the experiences of students and faculty mentors toward accomplishing this goal. Data were transcribed, coded, and analyzed thematically. Some of the effects identified in this study included enhanced academic …

Comparing Cognitive Theories Of Learning Transfer To Advance Cybersecurity Instruction, Assessment, And Testing, Daniel T. Hickey Ph.D., Ronald J. Kantor

Journal of Cybersecurity Education, Research and Practice

The cybersecurity threat landscape evolves quickly, continually, and consequentially. This means that the transfer of cybersecurity learning is crucial. We compared how different recognized “cognitive” transfer theories might help explain and synergize three aspects of cybersecurity education. These include teaching and training in diverse settings, assessing learning formatively & summatively, and testing & measuring achievement, proficiency, & readiness. We excluded newer sociocultural theories and their implications for inclusion as we explore those theories elsewhere. We first summarized the history of cybersecurity education and proficiency standards considering transfer theories. We then explored each theory and reviewed the most relevant cybersecurity education …

Healing A Generation; Implementation Of Higher Education Curricula For Venezuelan Journalism Students Living Under Structural Violence To Promote A Transition Into Democracy, José Luis Jiménez-Figarotti Prof.

The SUNY Journal of the Scholarship of Engagement: JoSE

Venezuela's sociopolitical landscape has deteriorated significantly over the past decade, culminating in a profound humanitarian crisis. This ethnography, conducted from 2015 to the present, explores the experiences of a study group comprising 2000 Venezuelan communication college students, aged 17 to 25, who navigate structural violence while striving for quality higher education. The research employed a multifaceted approach, encompassing interviews, focus groups, and observations. Additionally, this qualitative study examines the outcomes of implementing an interdisciplinary journalism curriculum grounded in human rights and media activism, complemented by online sessions and an environmental education component. This educational project aims to foster critical thinking …

Impact Of Secondary-Level Cte Credentials On Carpentry Students And Field Employment, Joshua A. Parmely

Morehead State Theses and Dissertations

A capstone submitted in partial fulfillment of the requirements for the degree of Doctor of Education in the Ernst and Sara Lane Volgenau College of Education at Morehead State University by Joshua A. Parmley on April 5, 2024.

基于二分算法构建的非参数 Cd-Cat 选题策略及终止规则, 李 俊杰, 郑 慧婧

Chinese/English Journal of Educational Measurement and Evaluation | 教育测量与评估双语期刊

CD-CAT 能对学生进行诊断和评估，对提升教学效果具有重大意义。但在课堂教学情景中，无法像大规模测评可以使用大量样本对项目参数进行准确估计，此时非参数 CD-CAT 成为唯一可行的选择。相比于参数 CD-CAT，非参数 CD-CAT 起步较晚，且非参数CD-CAT的研究主要集中在选题策略方面，但已有的非参数选题策略存在效率不高的缺点，且非参数终止规则则是鲜有研究。因此本研究提出了两种更高效的选题策略:非参数动态二分选题策略（NDBS）和一般非参数动态二分选题策略（GNDBS），以及一种非参数二分终止规则(NDBI)。模拟研究结果表明：（1）所有条件下，NDBS的模式判准率均高于NPS，因此，在完全没有样本时，可选用NDBS作为选题策略。（2）在大多数情况下，GNDBS的性能优于其他选题策略，因此，在具有少量样本时，可选用GNDBS作为选题策略。（3）在变长测验中，当研究目的是获得更准确的分类结果时，可以降低NDBI规则的临界值；相反，可以适当提高NDBI和GNDBI规则的临界值。

Evaluating The Effectiveness Of A Palestinian Teacher Training Program Through The Stalling Classroom Observation Method, Abdalkarim M. Ayyoub, Belal Abu Eidah

An-Najah University Journal for Research - B (Humanities)

Objective: This study aimed at evaluating the impact of training Palestinian teachers who teach in the early basic stage (Grades from 1 to 4) through Teacher Education Improvement - After Funding (TEIP-AF) project. Methodology: he studies followed a descriptive and experimental methodology. It utilized the Stalling Observation system to study various types of classroom interactions and the Palestinian Teacher Professional Development Index (PTPDI) to assess the competences teachers gained after training on the TEIP-AF project. The study population consisted of all teachers who were qualified in accordance with the teacher education strategy in Palestine and. The study sample was randomly …

A Survey Study Of The Opinion Of Students And Coordinators Of Humanities Graduate Programs At An-Najah National University Regarding Scientific Research Courses And Their Need For Development, Naser Adeen M. Al-Shaer, Tasnim Naser Adeen Alsher, Mohammad Subhi Odeh

An-Najah University Journal for Research - B (Humanities)

Aim: This survey study aims at identifying the level of scientific research in the academic programs and study plans of the department of Graduate Studies for Humanities at An-Najah National University and the need for developing them based on opinions of program coordinators and students to evaluate the effectiveness of research and its validity for future enhancement for the university status. The study hypothesized weak levels of interest in research in study plans, which negatively affects student research skills and the quality of their research production. Methodology: The study adopted the analytical approach using two questionnaires distributed to program coordinators …

What Effect Does Standards-Based Grading Versus Traditional Grading Have On Standardized Tests For Fifth-Grade Students In Mathematics In Arkansas?, Ruby Dean

ATU Theses and Dissertations 2021 - Present

WHAT EFFECT DOES STANDARDS-BASED GRADING VERSUS TRADITIONAL

GRADING HAVE ON STANDARDIZED TESTS FOR FIFTH GRADE STUDENTS IN MATHEMATICS IN ARKANSAS?

Ruby Earlene Dean

This study examined the effects of standards-based grading and traditional grading on standardized tests for fifth grade students in mathematics in Arkansas. The purpose of the study was to determine whether the type of grading system (traditional or standards-based) used to assess student progress makes a difference on the ACT Aspire results in fifth grade in mathematics. The information gleaned from this study will provide school leaders and teachers with information to make more informed decisions to …

Evidence Based Practice Change To Incorporate A Standardized Process Checklist For Fecal Microbiota Therapy (Fmt) To Increase Staff Adherence, Alicia Gomez

Student Scholarly Projects

Practice Problem: Staff adherence to new procedures is crucial for ensuring patient safety, maintaining quality care, reducing risks and liabilities, and fostering a positive organizational culture that supports continuous improvement. Having a procedure done safely for patients infected with C.diff provides an overall benefit to the healthcare system.

PICOT: In an endoscopy lab staffed with nurses and surgical technicians (P), does the implementation of a new standardized process of administering FDA approved Fecal Microbiota Transplant Therapy (I) compared to the current process (C), increase staff adherence to the process (O) over 12 weeks(T)?

Evidence: Leadership, supervision, and organizational culture are …

Get Skilled, Get A Job, Give Us More: An Early Review Of G3, Melissa R. Colangelo, Melanie Graham, Bhavika Sicka

Inquiry: The Journal of the Virginia Community Colleges

If community colleges are to remain relevant, they must be future-oriented, and responsive to demographic and labor force shifts. The Get Skilled, Get a Job, Give Back initiative (G3) was implemented during the 2021-22 academic year to retain economically disadvantaged students, improve community college completion, and help students graduate into productive jobs with the ultimate goal of boosting Virginia’s economy. G3 is an attempt to make postsecondary education and workforce development systems in Virginia more capable and successful in preparing Virginians for available jobs. The aim of this policy review is to examine the current details of the …

Gathering Student Voices: A Qualitative Assessment Of Learning And Experiences At Merze Tate College, Bonnie Pfingst

Assessment Grants

This mini-grant proposal seeks funding to gather qualitative data through interviews and focus groups, exploring student learning and experiences at Merze Tate College. Analyzing this data will provide valuable insights for both marketing and quality improvement initiatives. The project aligns with Merze Tate College's commitment to DEI work and excellence in student engagement. A student employee will be hired to assist with data collection and analysis, ensuring student perspectives are directly integrated into the project. The findings will inform strategic decision-making, leading to enhanced marketing materials that resonate with prospective students and improved programs and services that better meet the …

Formative Assessment Of Writing To Improve Exit Portfolios, Anderson Hagler

Assessment Grants

In one semester students will attend six hybrid workshops hosted by the Department of World Religions and Cultures. Each workshop will address the mechanics and components of persuasive writing to assist the department’s graduate students with assigned coursework. Students will read one assigned textbook and assess their peers’ writing samples using rubrics provided by the instructor. Doing so will help to develop a cohort and improve the quality of writing for assigned coursework as well as the final exit portfolio.

Lee Honors College - Assessing College-Wide Student Learning Outcomes, Anthony Helms, Ajani Wilson

Assessment Grants

The goal of this project is to review the LHC SLOS and accompanying assessment plan and to launch the first data collection from LHC alumni. The Lee Honors College (LHC) created college-wide student learning outcomes (SLO) for the first time in 2019. Due to unforeseen changes in college staffing, the assessment plan for the SLOS has never been implemented. Funding for this proposal would allow the LHC to provide compensation for a WMU graduate student to make the implementation of our assessment plan their sole focus to ensure a smooth transition from design to data collection, storage system and analysis. …

Bcm Assessment Update Application, Marie Moreno

Assessment Grants

This grant application seeks support for the BCM Department to address challenges in teaching professional writing in today’s educational landscape. The plan involves collaborating with the Haworth Communication Center, attending a webinar on teaching underprepared students, creating a workshop for students, and updating assessments in the BCM 1420 curriculum based on the results and experiences. Aligned with university goals, this proposal will empower faculty and students, foster community building, and promote equity and inclusion. It supports students’ retention, academic success, and intellectual and occupational well-being. Emphasizing continuous improvement and data-informed decision-making, the budget covers webinar expenses and workshop coordination.

The Value Of 360-Degree Assessment In Higher Education, Daniela Schroeter, Heather Jach Turner

Assessment Grants

This assessment project aims to examine the value of 360-degree assessment for higher education with the goals of (a) enhancing undergraduate and graduate students' learning experiences and outcomes, (b) developing an assessment toolbox for broad dissemination, (c) fostering curriculum alignment, and (d) contributing to program and unit level learning outcomes assessment while keeping a strong alignment with WMU’s strategic priorities. Funding will be applied toward strategic examination of data derived from exploratory implementation of 360-degree assessment within four School of Public Affairs and Administration courses. Dissemination products include a 360-degree assessment toolbox, presentations and reports, and possible journal manuscripts.

Identification Of Interventions To Elevate The Sense Of Belonging Of Lgbtqia+ Students Of Haworth College Of Business: A Qualitative Study, Ann Veeck, Robert Harrison

Assessment Grants

Sense of belonging has been found to be positively associated with multiple important traits related to student success. Conducted in spring 2023, a survey conducted of Haworth College of Business (HCOB) undergraduate students (n=1,140) found that students who identify as LGBTQAI+ (n=) have a significantly lower sense of belonging at HCOB. The proposed grant will provide funding for a set of focus groups to probe as to why LGBTQAI+ students report a lower sense of belonging and to help identify interventions to elevate the sense of belonging of these students.

Developing A Graduate Program Assessment Plan For The Department Of History, Bill Warren

Assessment Grants

The WMU Department of History's assessment and graduate studies committees propose to develop a graduate program assessment plan. The department has not had an assessment plan for its graduate programs. The department's assessment and graduate studies committees will work together to develop a comprehensive plan to assess a sample of students' written work on an annual basis; conduct annual surveys with students to gauge their satisfaction with the program; and also examine the Graduate Student Annual Activity Reports (GSAARs). The papers, surveys, and GSAARs would then be used to determine the effectiveness of the MA and PhD programs and decide …

Refining The Fashion Merchandising And Design Program Assessment Components, Mary Simpson, Chitra Singh, Zee-Sun Yun

Assessment Grants

To establish a strong and consistent assessment foundation, a program level assessment plan needs to be reevaluated periodically. The overarching goal of this project is to refine the current assessment plan of the Fashion Merchandising and Design program, which includes three components: curriculum evaluation, student learning outcomes, and student exit survey. Particularly, this proposal addresses two main assessment focus areas: i) alignment of the capstone course outcomes and assessments to the program-level outcomes and ii) refining the student exit survey as a tool for program-level assessment. In addition, this project aligns with assessment goals of the program accreditation Textile and …

Spring 2024 - Enrollment Profile Report, Systems Intelligence And Data Analytics, University Of Nebraska At Omaha

Enrollment Reports

This Enrollment Statistical Summary provides delivery and administrative-site information on enrollment headcount and student credit hours. Delivery site reporting counts all students, including those in UNL programs delivered at UNO, but excludes UNO programs only (including the CPACS program delivered in Lincoln).

The purpose of this summary is to provide the undergraduate and graduate enrollments and student credit hour information by college of equivalent academic unit, class, gender and ethnicity. A glossary at the end of the report provides a list of definitions for headings and categories found in the report.

The Effectiveness Of The Student Support Service Trio Program Retention And Graduation Rates At Two-Year Community Colleges In Kentucky, Sheree N. Bryant

Morehead State Theses and Dissertations

An applied project submitted in partial fulfillment of the requirements for the degree of Education Specialist at Morehead State University by Sheree N. Bryant in 2024.