Social and Behavioral Sciences Commons^™

Evaluating An Integrated Science, Technology, Engineering, And Math/Computational Thinking Professional Development Program For Elementary Level Paraprofessional Educators, Aubrey A. Rogowski

All Graduate Theses and Dissertations, Fall 2023 to Present

For my dissertation, I looked at a training program one Utah school district used to teach paraprofessional educators science, technology, engineering, math, and computational thinking. Specifically, the program taught them about what computational thinking is and how they could use it when teaching science, technology, engineering, and math to students from kindergarten to sixth grade. While reviewing this program, I evaluated 1) The experiences the paraprofessionals had with the program, 2) Whether the paraprofessionals understood computational thinking, and 3) Whether the program prepared them to teach computational thinking to K-6 students.

I worked with eight paraprofessionals who participated in this …

Evaluating The Organizational Advancement Of Diversity, Equity, And Inclusion In Extension Education, John M. Diaz, Lendel K. Narine, Cody Gusto

Journal of International Agricultural and Extension Education

In response to global trends and calls for greater inclusivity, the field of extension education has made significant strides towards embracing Diversity, Equity, and Inclusion (DEI) principles. This study explores the progress of DEI initiatives in the Cooperative Extension System (CES), which has aligned with industry groups, non-profit organizations, academia, and scientific societies worldwide. Through a multifaceted approach, CES has pursued strategies such as intercultural competence (ICC) training for professionals, diversity action plans, and culturally responsive teaching techniques. This study assessed the advancement of DEI in extension education using a survey of DEI specialists across extension organizations in the U.S. …

Can School-Based Physical Activity Interventions Be Effective Without A Facilitator? A Step-Back Approach To School-Based Intervention Delivery, Yvonne Larrissa O’Byrne, Joan Dineen, Tara Coppinger

Publications

Irish children’s physical activity (PA) levels are below national guidelines. Schools are an ideal setting to promote PA but it remains challenging. This study evaluates the effectiveness of a step-back approach to Project Spraoi (PS); a facilitator (Energizer) led school-based PA intervention. Each Energizer in year one had 2 contact days per week with all classes (n = 11). A ‘step-back’ progression, with 50% less Energizer contact time, in year two and no Energizer contact in year three, was adopted. Objectively measured PA and cardiorespiratory fitness (CRF) were measured annually with the same children (n = 85). Stakeholders …

Evaluating The “What’S Up Down South” Economic Summit: A Platform For Business Leaders To Share Ideas, Paul A. Hill, Amanda D. Ali

Outcomes and Impact Quarterly

The What’s Up Down South economic summit is southern Utah’s largest business gathering. The event provides the business community with economic insights to assist them in making informed decisions. USU Extension evaluated the 27^th annual What's Up Down South economic summit. Results showed the event was an effective platform for disseminating information and advancing knowledge on economic and business topics. Participants felt the summit provided a valuable experience to the business community. These findings support the continuation of the summit's information dissemination activities in the future.

Construction Of Evaluation System Of Effectiveness Of Supply Based On Spatial Perspective, Tienan Song, Haikuo Yu

International Journal of Physical Activity and Health

The requirement of "building a higher-level National Fitness Public Service system centering on meeting the needs of the people" by the Chinese State Council is to guarantee and satisfy the demand of public through effective supply. However, despite of the clear purpose of the task, there is still a gap between the actual and the expected status of National Fitness Public Service supply. Based on the characteristics of the perspective of space, the purpose of this study is to examine how to measure and achieve the effectiveness of National Fitness Public Service’s supply. By reviewing the literature, relevant results of …

The Proof Is In The Pudding – Using Perceived Stress To Measure Short-Term Impact In Initiatives To Enhance Gender Balance In Computing Education, Alina Berry, Sarah Jane Delany

Academic Posters Collection

The problem of gender imbalance in computing higher education has forced academics and professionals to implement a wide range of initiatives. Many initiatives use recruitment or retention numbers as their most obvious evidence of impact. This type of evidence of impact is, however, more resource heavy to obtain, as well as often requires a longitudinal approach. There are many shorter term initiatives that use other ways to measure their success.

First, this poster presents with a review of existing evaluation measures in interventions to recruit and retain women in computing education across the board. Three main groups of evaluation come …

Iea International Civic And Citizenship Education Study 2022: Assessment Framework, Wolfram Schulz, Julian Fraillon, Bruno Losito, Gabriella Agrusti, John Ainley, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Education Study (ICCS) investigates the preparation of young people to undertake their roles as citizens. It gathers and analyzes data from representative national samples on students’ conceptual knowledge and understanding of civics and citizenship, as well as their attitudes to, and engagement with, aspects of civics and citizenship. ICCS builds on a succession of IEA studies in this field dating back to 1971, and especially since 2009. The 2022 study has been developed to build on previous perspectives on, and monitor changes in, such enduring issues as: levels of civic knowledge and understanding; patterns of …

Utilization-Focused Evaluation On The Impact Of A Sports-Based Youth Development On Unaccompanied Youth Students, Eric Cortez

University of the Pacific Theses and Dissertations

Unaccompanied immigrant youth (UIY) face obstacles that can hinder their education in their host countries. Given that educational attainment can help interrupt intergenerational cycles of poverty, the examination of support systems for UIY is critical. This study examined the role of sports-based youth development (SBYD) programs in supporting UIY students using a utilization-focused evaluation. To do this, two groups’ high school graduation rates were compared: (a) UIY participating in an SBYD program and (b) UIY not participating in a SYBD program. In addition to this quantitative analysis, UIY were surveyed and interviewed to contextualize the results of the graduation rate …

Evaluating Utah's Rural Online Initiative: Empowering Organizational Leaders Through Remote Work, Paul A. Hill, Amanda D. Ali, Lendel K. Narine, Andrea T. Schmutz, Tyson M. Riskas, Debra M. Spielmaker

The Journal of Extension

Compared to urban counties, Utah's rural counties experienced high levels of unemployment. Informed by a statewide needs assessment, Utah State University Extension developed a remote work leadership course to equip business leaders with knowledge and skills to create remote jobs as a solution to rural unemployment. This descriptive evaluation study collected data from course participants (N = 62). Findings showed short-term outcomes were achieved; participants experienced increases in knowledge and skills and had more positive intentions toward creating remote jobs and hiring employees from rural counties. Extension professionals can design and evaluate their programs using the framework in this study.

Hci Education And Ux Practice: Highlights From Singapore, Tamas Makany, Dharani Perera-Schulz

Research Collection Lee Kong Chian School Of Business

This position paper highlights trends in education, practice, and support of HCI/UX in Singapore, a small city-state island in Southeast Asia. The paper was prepared for the 2022 Southeast Asia Computer-Human Interaction (SEACHI'22) virtual workshop on Apr 14, 2022, as part of the ACM CHI Conference on Human Factors in Computing Systems (CHI'22) international conference.

Exploring The Impact Of An Online Leadership Course On Japanese Undergraduates' Conceptions Of Leadership, Ryosuke Watanabe

Dissertations

Today’s complex problems transcend borders and require a collective and adaptive learning response. Literature suggests that, because the traditional hierarchical or positional style of leadership cannot effectively address problems we face today, leadership should take a more collaborative and systemic form. Rost (1991) characterized this new approach as the postindustrial paradigm of leadership. Unfortunately, changing the existing conception of leadership is not easy. Furthermore, assessing people’s leadership perceptions is challenging because leadership is often a tacit and latent construct. Because formal leadership education is still in its infancy in Japan, little is known about the impact of leadership education in …

The Method Of Goalkeeper’S Evaluation In Futsal, Andrzej Szwarc, Mateusz Oszmaniec, Patrycja Lipinska

Baltic Journal of Health and Physical Activity

Background: The aim of this study was to develop a research tool used to assess the efficiency a goalkeeper’s actions in a game of futsal. Material/Methods: Author’s own proposal of an observation sheet was created and subject to a validation procedure. To assess intra-rater reliability and inter-rater reliability, the ICC test was used. Results: There was a strong compatibility of ratings of the intra-rater reliability – 1.00 (95% Cl 1.00-1.00) and the inter-rater reliability – 0.99 (95% CI 0.99-1.00), which proves the reliability of the proposed research tool. Conclusions: The developed sheet allows the registration and evaluation of individual performance …

Optimizing The Assessment Of Motor Skills In 6th Grade Pupils Through Multimedia Means, Paul Szabo-Alexi, István Pocsai, Mariana Szabo-Alexi

Baltic Journal of Health and Physical Activity

Background: In this paper we propose to analyze ways to introduce multimedia methods in the evaluation process in the discipline of physical education and sports, by increasing the objectivity of evaluation and self-evaluation. Material and Methods: During the research, 20 students aged 12–13 were filmed and evaluated. Movement analysis software, Kinovea application, version 0.8.15, was used to analyze the recorded image. Results: Through the centralized data represented in graphs and tables, at the first evaluation, the control group obtained results closer to the execution model by an average of 0.62% in 5 of the 6 samples. Following the application of …

Development Of Instrument To Assess Influence Of Extension Conference On Intended Outcomes, Marina D. Denny, Martha A. Ellard

The Journal of Extension

The Annual Conference for Mississippi State University Extension is the sole event at which the majority of Extension personnel gather for networking, organizational updates, recognition of efforts, and professional development. Extension leaders plan this conference with intended outcomes but without ever evaluating those outcomes beyond attendee satisfaction. We developed an evaluation instrument to determine how certain conference events influence participants’ critical psychological states and ultimately, their perceived motivation, professional enrichment, opportunities for networking, professional accountability, and organizational awareness. Rather than simply assessing attendee satisfaction, this instrument may help inform planning for successive Extension conferences and other professional development events.

Iea International Civic And Citizenship Education Study 2022: Assessment Framework [Early Online Version], Wolfram Schulz, Julian Fraillon, John Ainley, Bruno Losito, Valeria Damiani, Tim Friedman

Civics and Citizenship Assessment

The International Civic and Citizenship Study (ICCS) 2022 continues IEA’s investigation into the ways in which young people understand and are prepared to be citizens in a world where contexts of democracy and civic participation continue to change. This assessment framework provides insight into the study’s conceptual background, cognitive, affective-behavioral and contextual content, and assessment design. It also describes content relevant for the measurement of the United Nations’ Sustainable Development Goals (SDGs) that is related to Global Citizenship Education (GCED) and Education for Sustainable Development (ESD). Countries that participated in ICCS 2009, ICCS 2016, and ICCS 2022 will be able …

A Discipline In Search Of A Voice: A Corpus Linguistic Study Of Evaluation Scholarly Literature, Aaron Wilson Kates

Dissertations

Linguists use the concept of discourse community (DC) to describe the speech of groups of people associated by some extrinsic purpose or interest (Swales, 1990). One defining feature of a DC is a shared lexicon. Scriven (1994), in his discussion of evaluation as a discipline, addresses the need for evaluation to have a “core subject” which would then allow, among other things, the development of “concepts and language to deal with core problems,” while noting that there exists a definite lack of clarity of language among evaluators (p. 147). Christie and Rose (2003) suggest that the lack of clarification around …

Stem For Success Evaluation And Assessment Resources For Researchers, Cristo Leon

STEM for Success Resources

The article presents a collection of federal and nonfederal resources intending to assist the researcher in the understanding of evaluation of broader impacts and participation in STEM.

STEM for Success is an integrated program to broaden participation in STEM.

Using Extension As A Vehicle To Reduce Elementary Student Food Waste, Rebecca Koetz, Rod N. Williams

The Journal of Extension

Extension can play a key role in providing food waste education nation-wide. This study is the first to evaluate the effects of environmentally focused lesson plans on elementary student knowledge and perceptions regarding food waste. Herein we provide suggestions on concepts to teach students for the greatest impact on food waste reduction. We also provide avenues to incorporate food waste education into existing Extension programming. We hope the study can inspire and inform further food waste program development, assessment, and implementation through Extension.

Using Generalizability And Rasch Measurement Theory To Ensure Rigorous Measurement In An International Development Education Evaluation, Louise Bahry

Doctoral Dissertations

Between the United States and Great Britain, over 30 billion USD was spent in 2018 on international aid, over a billion of which is dedicated to education programs alone. Recently, there has been increased attention on the rigorous evaluation of aid-funded programs, moving beyond counting outputs to the measurement of educational impact. The current study uses two methodological approaches (Generalizability (Brennan, 1992, 2001) and Rasch Measurement Theory (Andrich, 1978; Rasch, 1980; Wright & Masters, 1982) to analyze data from math and literacy assessments, and self-report surveys used in an international evaluation of an educational initiative in the Democratic Republic of …

Librarians, Outreach And Evaluation: Edia In A Large Urban Public Library, Mariella Colon

New Librarianship Symposia Series: Fall 2021

Although we seek to be more universal in our offerings, libraries DEIA work still centers on simply event programming and collection development.

To talk about meaningful DEIA work today however is acknowledging that true advancement goes beyond events and artifacts. We must evolve this approach to where DEIA values drive our professional development through (1) critical librarianship (2) outreach and (3) responsive evaluation.

The framework for DEIA at a large urban library has three pillars of focus. The first is our librarians. It is important that we acknowledge the work that already exists because to start to review DEIA as …

Principals’ Perception On Teacher Evaluations During The 2020-2021 School Year, Luke Mosiman

Leadership Education Capstones

The reason for this qualitative study was to understand principal’s perspective of their teacher evaluation tool effectiveness during the 2020-2021 school year. Schools in this study were all from the same upper Midwestern state. The districts these schools were in had learning models range from full in person to full distance learning for most of the 2020-2021 school year. The participants were asked through surveys and an interview how they felt their evaluation tool was able to measure teacher performance in the areas of class atmosphere, classroom management, content delivery, and student engagement. Results indicate the evaluation tool was able …

Opening Act: The Academic Library's Role In Orientation Planning And Evaluation, Zachary Lewis, Katy Kelly

Roesch Library Faculty Publications

This article describes a private, mid-sized university library’s experience of hosting a music festival-themed event in the library building as part of new student orientation, with program evaluation and student learning assessment at the forefront of planning. The authors and co-planners will discuss four years of data to explore the connection between library outreach and students’ use of the library, their perceptions of the institution, and the role the event plays in shaping student success. It offers recommendations for collaborating with academic libraries and approaches in future cross-campus collaborations, including using a scaffolding approach to outline the goals and assessment …

The Tasting Party Assessment: Can Educators Reliably Evaluate Preschoolers’ Willingness To Try New Foods In Group Settings?, Laura L. Bellows, Savannah Hobbs, Susan L. Johnson

Journal of Human Sciences and Extension

Food neophobia, defined as an unwillingness to consume novel and unfamiliar foods is common in young children. Assessment of neophobia or willingness to try new foods can be a challenge with this audience. With the increase in nutrition interventions focused on the young child, valid and reliable measures to assess willingness to try new foods that can be administered in groups by classroom teachers and Extension educators are needed. The Food Friends: Fun with New Foods (FWNF) program aims to increase children’s willingness to try new foods in childcare settings. The Tasting Party assessment was developed as the primary tool …

Success And Sustainability Of Sponsored International Development Programs In Education: A Narrative Inquiry, Sara Beth Leikin

USF Tampa Graduate Theses and Dissertations

In a 2008 working paper published by the U.S. Agency for International Development, the authors lamented that, despite billions of dollars in investment in global education initiatives, access to education had been improved in targeted areas, but the return on investment with regards to learning outcomes was “much less impressive” (Gillies & Jester Quijada, 2008). From 2012-2017, USAID engaged in the Egypt STEM Schools Project (ESSP) along with four partner organizations with the goal of building model science and mathematics public schools that would challenge the educational status quo by providing students with hands-on, constructivist learning and providing an alternative …

Pre-Reading Activities And Students’ Achievement In French Oracy: Implication For Evaluation In Library And Information Science, Kenneth O. Eze Phd, Grace C. Offorma Phd, Christian S. Ugwuanyi Phd, Chinedu I.O. Okeke Phd

Library Philosophy and Practice (e-journal)

Library and Information Science is a profession that is full of people who are passionate about making a positive change in the world. In this profession, the workers are known as Librarians whose duty is to bridge the gaps that exist between people, information and technology. Librarians work to create reader’s advisory resources to encourage young students to develop a lifelong love of reading and learning through pre-reading activities. This paper thus, investigated the effect of pre-reading activities on students’ achievement in French oracy. Using quasi-experimental research design, 154 senior secondary one students participated in the study. French Oracy Achievement …

Understanding The Influence Of Interdisciplinary Research: An Examination Of Carol Hirschon Weiss’S Scholarship, Gregory Dee Greenman Ii

Dissertations

Research evaluation is the subfield of evaluation that examines the processes and products of scientific and technological research. This dissertation explores the case of interdisciplinary research evaluation by reviewing the publications of one of the most influential and highly cited scholars in evaluation, public administration, and knowledge utilization: Carol Hirschon Weiss. As one of the foundational theorists of evaluation, the evaluation perspective of Weiss's work typically pervades discussions. That approach ignores her influence in other fields, particularly her centrality to the knowledge utilization field. Prior research indicates that the influence of interdisciplinary research is challenging to ascertain because research evaluation …

Feasting On Words: What University Students Learn When They Study Food Writing And Food Media, Janet K. Keeler

USF Tampa Graduate Theses and Dissertations

The use of food in college curriculum is unique in its ability to create lasting impact because of the keen interest millennial and Generation Z students have in what they eat and drink. Studying media with food at its core is an underutilized mechanism to show how food intersects with the lives of all people thus encouraging students to look beyond their own experiences to consider the wider society. A program evaluation of 10 semesters of food writing and food media courses at a Florida public university reveals the ways in which students make deeper connections to culture and current …

Theatre Of The Beat’S Restorative Justice Theatre Program: Highlights From The Baseline Evaluation, Karen Nelson, Keely Kavcic, Courtney Primeau, Kimberlee Walker

Pedagogy and Theatre of the Oppressed Journal

This report highlights the findings from the evaluation of Theatre of the Beat’s (TOTB) Restorative Justice Theatre Program, which works with incarcerated persons at the Grand Valley Institution for Women (GVIW), a federal prison in Kitchener, Ontario. The project was conducted by the Research Shop, part of the Community Engaged Scholarship Institute (CESI) at the University of Guelph, in partnership with Theatre of the Beat (TOTB), a not-for-profit theatre company with a process rooted in restorative justice principles and a passion for promoting conversations around social justice.

An Evaluation Of Agricultural Communications Faculty Members’ Mentoring Experiences, Taylor K. Ruth, Ricky W. Telg, Lisa K. Lundy

Journal of Applied Communications

Agricultural communications programs are expected to grow and emerge over the next decade. For these programs to find success, faculty leading them will need to be properly supported through effective mentoring. The purpose of this study was to evaluate the current mentoring of agricultural communications faculty across the country. In November 2019, an online survey instrument was distributed to a census of members of the Society of Agricultural Communications Scholars listserv. Survey respondents reported mentoring was not formally required, and most of the respondents received informal mentoring. Mentors were most frequently non-agricultural communications faculty in the respondents’ respective department or …

Doing Discipline Different: Evaluating The Implementation Of Restorative Justice As An Alternative To Punitive Discipline In New York City Public Schools, Virginia Diaz-Mendoza

Dissertations, Theses, and Capstone Projects

Given that punitive discipline practices have disproportionately impacted its poor students of color, New York City is committed to transforming school discipline and improving school climate by implementing restorative justice as an alternative. This study is an evaluation of the restorative justice pilot program funded by the New York City Council and managed by the New York City Department of Education where key stakeholders including officials at the Department of Education, school administrators, educators, school staff, and community organizations are involved in the implementation of restorative justice in schools with high suspension rates. Data was collected through interviews, observations of …