Educational Assessment, Evaluation, and Research Commons^™

Seeking A Feminist Approach To Scholarly Innovations In Music Teacher Education, Andrea Maas

Visions of Research in Music Education

The marketization (Marchand & Orsorno Velázquez, 2016) of higher education impacts faculty through hiring practices, workload structures, and reappointment and promotion policies. Women faculty in fields such as music education need to negotiate masculine discourses and gendered constructions of innovation (Alsos et al., 2013) in a STEM focused economy. Values held by feminist pedagogues could serve as a framework through which to consider a more feminist approach to research and scholarship. Qualities such as equalization of power, collaboration, affective learning, inclusiveness of diversity, and social responsibility may surface through a researcher’s approach to inquiry or in the content itself. This …

Inter-Institutional Analysis Of Skin Of Color Representation In Dermatological Lecture Content At Md And Do Medical Schools, Oluwafunke Ogunremi

Sanford School of Medicine Posters and Presentations

The purpose of this study was to analyze the lecture materials provided in medical schools through a diversity lens. Skin pathologies manifest distinctively on various shades of skin and physicians must be equipped with the proper knowledge to identify and diagnose these conditions accurately and promptly. For most medical students, images in prominent textbooks and lecture slides are their first encounter with disease presentations. Therefore, it is important to analyze the diversity of skin tones in the content that is being delivered. Specifically, the use of images featuring darker skin tones compared to those depicting lighter skin tones. This study …

Improving Cohesion Between General Education And Special Education Departments, Jacob Haugmo

Graduate Teacher Education

Cohesion between general education and special education departments is the idea of blending and aligning instructional methods and approaches regardless of educational discipline. This paper was written to examine how this cohesion can be improved. Educational leaders must improve cohesion between general education and special education departments to support the academic achievement and success of all students in schools. Through qualitative, quantitative, and mixed methods studies, methods to improve this cohesion were researched. The research provided insight on how general education and special education teachers feel about collaboration and how collaborative efforts can be utilized to improve cohesion. These collaborative …

Evaluation Practices In National Science Foundation Research Experiences For Undergraduates Programs, Aly Busse

USF Tampa Graduate Theses and Dissertations

The purpose of this study was to assess and describe the status of program evaluation within the National Science Foundation’s (NSF) Research Experiences for Undergraduates (REU) sites. The National Science Foundation's REU program supports thousands of undergraduates annually in hands-on, immersive research experiences under the mentorship of science professionals. To date, there is a lack of published or accessible evaluation results from these REU programs and it is unknown what evaluation approaches are being used in the REU programs, how they are designed and implemented, how evaluation findings are utilized, and what barriers to evaluation activities exist. A self-administered electronic …

Assessing The Impact Of An Rpp On A Large Urban School District: The Case Of Cafécs, Erin Henrick, Danny Schmidt, Steven Mcgee, Andrew M. Rasmussen, Lucia Dettori, Ronald I. Greenberg, Dale Reed, Don Yanek

Computer Science: Faculty Publications and Other Works

This study analyzes the impact of the Chicago Alliance for Equity in Computer Science (CAFÉCS) Research Practice Partnership (RPP) on the Chicago Public School (CPS) Office of Computer Science (OCS). Using a qualitative analysis drawing on data from leadership team meetings, published articles and presentations, and evaluation reports from 11 years of the partnership, we utilized a framework developed by the CAFÉCS leadership team to document the impact on district (1) Programs, (2) Research, (3) Organizational Structures, and (4) Policies leading to (5) Equitable Results for students, condensed as PROSPER. In particular, we explore the role of the RPP in …

Targeting Persistence: Improving Success Of Stem Students, Teresa J. Bixby, Alec Werner

Chemistry Department Faculty Conferences

Half of STEM majors leave their program without earning a degree. Many of those who leave do so within their first two years of study. A series of exploratory investigations of the mindset, identity, and sense of community of undergraduate students were completed. Differences in mindset were found between underclassmen and upperclassmen, where upperclassmen tended towards growth mindset traits and often described undergoing a shift from fixed to growth mindset during their undergraduate career. Participation in undergraduate research was found to be a driving factor of persistence with numerous benefits, most significantly STEM identity development and sense of community.

Incorporating Design Based Implementation Research With A Randomized Controlled Trial To Develop And Evaluate The Efficacy Of Playful Rational Number Learning, Kreshnik N. Begolli, Vanessa N. Bermudez, Luettamae Lawrence, Lourdes M. Acevedo-Farag, Sabrina V. Valdez, Evelyn Santana, Daniela Alvarez-Vargas, June Ahn, Drew Bailey, Katherine Rhodes, Lindsey E. Richland, Andres S. Bustamante

Instructional Technology and Learning Sciences Faculty Publications

We combine design-based implementation research with a pre-registered RCT to address a long-standing challenge in psychological science: How to use psychological principles to address real-world problems while designing and implementing interventions in the field. We posit this as a design methodology for optimizing the translation between psychological science and real-world applications. We tested the efficacy of an extensively co-designed version of a game-based rational number intervention, Fraction Ball, versus "business-as-usual" math instruction and physical education in a sample of 4th/5th grade Latine students (N=360). Insights from nine co-design sessions with 20 teachers informed revisions and additions to a …

Exploring The Experiences Of African American Female Students In Engineering: A Narrative Literature Review, Anissa Guerin, Phd

Tapestry: Journal of Research in Education

Abstract

This narrative literature review delves into the experiences of African American female students in engineering, addressing their persistent underrepresentation in the field despite advancements in postsecondary education. By examining a broad range of research, the study explores the unique challenges faced by these students and investigates tools for their persistence and degree completion. The theoretical framework draws from intersectionality theory, emphasizing the intersecting identities of race and gender in shaping these experiences. Methodologically, a narrative literature review approach was employed, facilitating a comprehensive analysis of existing scholarship. Data collection involved rigorous criteria focusing specifically on empirical research or original …

Meta-Theoretic Competence For Computational Agent-Based Modeling, Hillary Swanson, Uri Wilensky

Instructional Technology and Learning Sciences Faculty Publications

In the U.S. context, science standards encourage educators to engage students in modeling practices, including computational modeling. While much work has investigated the productivity of computational modeling with respect to students' development of scientific content knowledge, less work has focused on students' development of knowledge and skills for participation in computational modeling practices. A first step in understanding how these practices develop is examining students' activity in the context of computational modeling environments with attention to the productive moves they make. These moves can provide insight into the knowledge they bring to their learning, which may be foundational to the …

Design Forms And Games, Hillary Swanson, Ha Nguyen, Caroline Lavoie, Trilby Nelson

Instructional Technology and Learning Sciences Faculty Publications

This paper introduces a theoretical framework for characterizing design processes as design games. Based on Collins and Ferguson's epistemic forms and games, the framework characterizes design processes as games played by designers to fill out design forms, which are general templates underlying specific design artifacts. We introduce our framework through games involved in human-centered design, describing for each the entry conditions, target form, constraints, and moves. We demonstrate how the framework can be used to characterize design games played by experts in museum exhibit design and urban design. Through similar analyses, the framework …

The Year-By-Year Primary And Secondary Education Histories Of Homeschooled Individuals And The Implications For Empirical Homeschooling Research, Albert Cheng

Education Reform Faculty and Graduate Students Publications

Many scholars have correctly noted the difficulty of obtaining representative samples of the homeschooling population. Empirical research about homeschooling, therefore, has predominantly relied on convenience samples which lack the external validity that enables one to generalize the findings to other segments of the homeschooling population. Unbiased inferences about the whole of the homeschool population have consequently been difficult to acquire (Kunzman & Gaither, 2022). For instance, empirical findings of college-educated homeschoolers or those from higher socioeconomic backgrounds might not generalize to other populations of homeschoolers (Cheng, 2014; Ray, 2009). Nor might findings about homeschooling families who rely on a structured …

What Happened To The Geometry? Examining Spatial And Mathematical Concepts In Computational Toys And Kits For Young Children, Jody Clarke-Midura, Jessica F. Shumway, Anahita Ashineh, Alireza Zandi, Whitney Clawson

Instructional Technology and Learning Sciences Faculty Publications

This paper explores the design of computational toys and kits for young children (ages 4-7) as tools for learning integrated mathematical, spatial, and computational thinking concepts. Specifically, we examine how the design features of the toys and kits represent the concepts of rotation on a point and spatial orientation of the agent. We examine toys and kits sold commercially, developed through research, and used in early childhood classrooms. Our findings indicate that the mathematical and spatial concepts are overlooked in some designs. Prior research examined toys for their affordances related to computational thinking, the present study contributes to understanding of …

The Role Of Generative Ai In Qualitative Research: Gpt-4'S Contributions To A Grounded Theory Analysis, Ravi Sinha, Idris Solola, Ha Nguyen, Hillary Swanson, Luettamae Lawrence

Instructional Technology and Learning Sciences Faculty Publications

We present reflections on our experience using a generative AI model in qualitative research, to illuminate the AI's contributions to our analytic process. Our analytic focus was a segment of classroom transcript, which captured a teacher introducing scientific theory-building practices to middle school students. We used a grounded theory approach to produce a fine-grained characterization of the teacher's talk moves during the lesson implementation. Our eventual goal is to build a more nuanced conceptualization of responsive teaching in the context of theory-building activities. We involved GPT-4 during the initial exploratory and later focused coding stages. For our analysis of GPT-4's …

Redefining Science Education Paradigm—By Course Habitable Earth, Nianzhi Jiao, Sanzhong Li, Chen Hu, Zhonghe Zhou, Degan Shu, Shucheng Xie, Jianping Huang, Fahu Chen, Lin Ding, Tong Zhu, Yigang Xu, Yonglong Lyu, Zhimin Jian, Pinxian Wang

Bulletin of Chinese Academy of Sciences (Chinese Version)

In a rapidly evolving world defined by unprecedented challenges, the integration of education, technology, and talent development has emerged as a national strategic imperative. Cultivating interdisciplinary and innovative scientific talents is not only a demand of the era but also a cornerstone for transforming “population dividends” into “talent dividends”. Against this backdrop, the rapid advancement of artificial intelligence (AI) offers both challenges and opportunities for redefining traditional education models. This study explores the pedagogical practices of the Habitable Earth general science education course, positioning it as a case study to demonstrate how science education can synergize technological empowerment with talent …

What Do Extension And Public Health Educators Need To Address Substance Misuse?, Lisa Washburn, Karen Franck

Journal of Extension

Limited organizational capacity has hindered Extension’s ability to address substance misuse in communities. To inform capacity-building efforts, we obtained Extension educator and health educator feedback on opportunities, challenges and resource needs using the Delphi technique. Opportunities included collaboration and partnerships with local entities. Stigma, inadequate resources, and limited knowledge and skills of educators were challenges. Top resource needs were updated youth curricula, funding, and clear guidance on what educators can do and what should be referred externally. Findings provide insights to educator perceptions and suggest additional training and resources needed to implement evidence-based approaches to address substance misuse.

A Writing Retreat For Extension Professional Development Capacity Building: A Case Study Of Arizona Cooperative Extension’S 4-H Youth Development Program, Jeremy Elliott-Engel

Journal of Extension

Extension Professionals have varying expectations of academic publication depending on tenure and promotion. And, the field of Extension needs the contributions of professionals across the system to support the translation and dissemination of the impacts of and findings from their Extension programming for academic and practitioner audiences. A writing retreat was held to support 4-H Youth Development professionals in academic writing. Because of this writing retreat five teams started working on an academic writing project which resulted in three journal articles being published. Teams also published conference presentations and Extension publications as a result of the initial academic writing project. …

Assessing Extension Educators' Motivation For Program Evaluation Using Self Determination Theory, Adeola C. Ogunade, Megan Kruger, Oluwafunke Abeleje

Journal of Extension

Studies have shown the importance of program evaluation in Extension and its value in communicating Extension program successes. This current study was conducted to assess Extension educators’ motivation toward program evaluation using the self-determination theory. Respondents perceived that they were not competent enough to engage in program evaluation but greatly valued program evaluation. Further analysis of our theory-informed survey data revealed that perceived competence and value positively predicted interest in program evaluation. Our findings contribute to Extension professional development discourse.

The Key To Coding Qualitative Data: Examples From The 4-H Youth Retention Study, Sarah Hensley, Janet Fox, Missy Cummins, Meggan Franks, Marianne Bird, Cindy Wells, Jolynn Miller

Journal of Extension

Cooperative Extension professionals utilize proven qualitative techniques to collect and analyze information to make data-driven decisions that guide program direction and determine impact. While the process may not always look the same, it is indeed essential to ensure findings are credible and reflective of the data. A codebook is a valuable tool that promotes interrater reliability among teams and enhances the reliability of findings. This article provides an overview of the process used to analyze qualitative data and the steps followed to create a codebook. Examples of the analysis process and codebook development are provided from the 4-H multi-state Youth …

Predicting Performance On A Social Studies Assessment: A Correlational Study, David G. Hamilton

Doctoral Dissertations and Projects

This study seeks to determine the predictive relationship between the performance on a middle school Civics practice assessment and performance on the State of Florida Civics assessment. In the current public-school environment across the United States, using high-stakes assessments to measure student performance is the norm. This quantitative correlation study strives to determine if locally developed benchmark assessments accurately predict student achievement on school high-stakes social studies state-mandated assessments. Using post hoc data from 355 middle school students ranging from 12 to 14 years old from a suburban Central Florida charter school who were administered a computer-based Civics practice end-of-course …

Student Perceptions: How Stem Students Value Belonging Interventions, Elizabeth Runkel Baez

University Honors Theses

With the prioritization of increasing Science, Technology, Engineering, and Mathematics (STEM) graduates in the United States, researchers have become increasingly interested in how to promote STEM students' sense of belonging. Sense of belonging is considered a marker of persistence in STEM. Facilitated 'belonging interventions' are one way to strengthen a sense of belonging amongst STEM students. How students respond to, value, and understand these belonging interventions is relatively understudied. In this study, focus groups were conducted with STEM students from a single university to investigate how they value an in-class belonging activity. Qualitative thematic coding of focus group responses revealed …

Capturing Latent Abilities And Latent Capacities Of Professional Golfers Using Nonlinear Mixed Effects Growth Modeling, Mac Wetherbee

Electronic Theses and Dissertations

This study demonstrates an effective and innovative approach to measuring the latent athletic abilities and capacities of professional golfers. I used nonlinear mixed effects growth modeling (e.g., Dynamic Measurement Modeling) to measure professional golfers’ ability levels and capacities for improvement. I accomplished this using a two-stage modeling approach. First, a crossed linear mixed effects model estimated each player’s ability level in each year. In the second stage, I used the results from the first stage to estimate several candidate nonlinear growth trajectories for players’ abilities over time. The quadratic growth trajectory was the best-fitting of these trajectories and was used …

Extending The Utility Of Ant Colony Optimization Through The Incorporation Of An Intraclass Correlation Coefficient To Assess For Rater Consistency, Mark Leveling

Electronic Theses and Dissertations

Ant Colony Optimization (ACO) is a flexible algorithm designed to solve complex combinatorial problems. While the method was derived from the behavior of ants by researchers in the field of computer science, its application to solving complex combinatorial problems is widespread in a growing number of fields in behavioral science, including psychometrics. Over the last two decades, psychometricians have adapted ACO to measurement model specification problems with the intention of generating measurement models that express measurement model fit and reliability within the standards of what is considered acceptable. Additionally, psychometricians have used ACO to generate shortened versions of existing measures …

Northwest Arkansas Education Report Card 2023, Sarah Mckenzie, Josh Mcgee, Charlene Reid, Christine L. Magness

Education Report Card

The goal of this report is to help parents, school personnel, community members, and policy makers understand how effectively the students in their community are being served by public schools. The past two years have been difficult for families, teachers, and students, but despite the challenging context, Northwest Arkansas students are demonstrating greater growth in achievement and earning higher scores on the ACT Aspire than are the students in the state overall. Schools in NWA also received higher School Quality and Student Success scores and graduate a greater percentage of high school students.

Pulaski County Education Report Card 2023, Sarah Mckenzie, Josh Mcgee, Charlene Reid, Christine L. Magness

Education Report Card

The goal of this report is to help parents, school personnel, community members, and policy makers understand how effectively the students in their community are being served by public schools. The past few years have been difficult for families, teachers, and students, and throughout the challenging context, Pulaski County students demonstrated growth in achievement on the Act Aspire that was similar to students across the state, but are performing below the state average in achievement, graduation rates, and School Quality and Student Success scores.

Analyzing Common Mistakes In First-Year Medicine Faculty Students’ Paragraph Writing, Pervaiz Yaseeni, Fahim Rahimi, Fareed Sahil

Journal of Research Initiatives

Academic writing is a salient skill for medical students all over the world. Academic writing starts with composing effective paragraphs, laying the foundation for students' advancement in writing during college. This study investigated common mistakes in English paragraph writing committed by the first-year medical students of the Medicine Faculty at Kabul University of Medical Sciences. Additionally, it measured the challenges that Medicine Faculty students tackled in paragraph writing. This quantitative study was conducted through an action research design. The data were collected from 52 medical students, and their work was analyzed using the developed rubrics. The data were analyzed in …

Facing Publishing Paralysis In Teacher Education: Book Critique Of Writing Your Journal Article In Twelve Weeks (2nd Ed.), Donna Zerr, Carissa Gober, David Wolff

Essays in Education

Our lived experiences as Teacher Education faculty in the realm of scholarly writing was filled with anxiety and trepidation. In the attempt to develop as writers, we participated in a professional learning community book discussion on Wendy Laura Belcher’s workbook, Writing Your Journal Article in Twelve Weeks: A Guide to Academic Publishing Success (2nd ed.). The text’s exercises helped motivate our steps through the writing process and developed productive writing habits for publication. This article is a critique of the book which helped us face and overcome our fears of writing with the intention to publish academic scholarship. The workbook …

The Impacts Of The Higher Education Expansion On Education Quality In China : Evidence From Shenzhen University, Yousong Lun

Lingnan Theses (Doctoral degree)

Within the expansion of higher education in China, education quality should be considered into the process of reform and establishment, which is highly related to the resources of faculty and performances of management. It is crucial that universities sustainably conduct diverse academic research and meet the needs of community. Faced with the policy reform and opening up, China has more opportunities on cooperating with oversea education institutions and taking in overseas management system. This research explores the general quality assessment on higher education and the solution to balance the needs of domestic society and the growth of international education competitiveness, …

Theory-Based Science Communication At Comic Cons, Lisa Lundgren, Emily Slater, Man Zhang, Kadie Kunz, Gabriel-Philip Santos

Instructional Technology and Learning Sciences Faculty Publications

The majority of research concerning science communication happens in spaces where people already have a vested interest in or knowledge of science, such as museums and science cafes. Thus, there is a gap in understanding what theory-based science communication looks like in non-science-centered spaces. This qualitative research study, which featured cosplaying science communicators at comic conventions, offers insights into what science communication practices occur within everyday spaces. We conducted observations of and semi-structured interviews with 15 cosplaying scientists, examining how they utilized effective framing and narrative structuring when communicating science at comic cons in cosplay. Across 700 coded utterances, cosplaying …

واقع الممارسة المَبْنية على الأدلة في مقررات مناهج البحث العلمي لبرامج الدراسات العليا في الكليات الإنسانية بجامعة السلطان قابوس: دراسة استكشافية, Naifa Eid Bait Saleem

Journal of the Association of Arab Universities for Research in Higher Education مجلة اتحاد الجامعات العربية للبحوث في التعليم العالي

هدف المقال استكشاف واقع ظهور "الممارسة المبنية على الأدلة " Evidence Based Practice " في مقررات مناهج البحث العلمي ببرامج الدراسات العليا بكليات العلوم الإنسانية في جامعة السلطان قابوس: الآداب والعلوم الاجتماعية، الاقتصاد والعلوم السياسية، التربية، والحقوق. ولتحقيق هدفت الدراسة فتم استخدام المنهج الاستكشافي وطبَّقتْ أداة تحليل المحتوى لجمع البيانات من المقررات الدراسية التي شكلت مجتمع الدراسة. وتكون مجتمع الدراسة من 27=28% برنامجًا للماجستير بكليات العلوم الإنسانية الأربعة، و10= 27% برنامجًا على مستوى درجة الدكتوراة. توصلت الدراسة إلى أن الممارسة المبنية على الأدلة موجودة واقعيًا في مقررات الدراسات العليا للكليات الإنسانية بجامعة السلطان قابوس، لكن ظهورها كان في برنامجين فقط …

تقييم مطابقة مقياس متعدد الأبعاد لرضا الطلبة عن الحياة الجامعية باستخدام نظرية الاستجابة للفقرة, Jomanah Mete'b Baniissa, Nermeen Nedal Al Shraifin

Journal of the Association of Arab Universities for Research in Higher Education مجلة اتحاد الجامعات العربية للبحوث في التعليم العالي

هدفت المقال الكشف عن مدى مطابقة مقياس متعدد الأبعاد لرضا الطلبة عن الحياة الجامعية باستخدام نموذج الاستجابة المتدرجة لنظرية الاستجابة للفقرة. ولتحقيق هدف الدراسة تم استخدام المنهج الوصفي، ووزع المقياس على عينة مكونة من (781) طالبًا وطالبةً من مجتمع الدراسة، اختيروا بالطريقة المتيسرة من مختلف الكليات العلمية والإنسانية في الجامعات الحكومية الأردنية في شمال المملكة، استبعد منهم 81 طالباً وطالبة إما لعدم اكتمال استجاباتهم على فقرات الاستبانة أو لنمطية الاستجابة، أظهرت نتائج التحليل العاملي الاستكشافي لأبعاد المقياس تحقق افتراض أحادية البعد لكل بعد من أبعاد المقياس الأربعة، كما تم التحقق من افتراض الاستقلال الموضعي، وتم التحقق من افتراض مطابقة الأفراد …