Educational Assessment, Evaluation, and Research Commons^™

Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva

Journal of Media Literacy Education

From 2015-2016, IREX implemented a media literacy training program called Learn to Discern (L2D) that trained Ukrainian citizens to critically analyze news media messages and identify misinformation. In 2017, IREX conducted a quasi-experimental impact evaluation of news literacy skills, knowledge, and behavior using a stratified random sample of L2D participants and non-participants (n=412). The groups were matched for gender, age, region and education levels. A news literacy assessment was administered to both groups via an online survey. The assessment required participants to analyze an objective news article and a disinformation-based news article; demonstrate knowledge of the news media environment; and …

Using Rich Pictures To Verify, Contradict, Or Enhance Verbal Data, Carol M. Booton

The Qualitative Report

The problem addressed in this case study stemmed from recognition of qualitative researchers’ desire to triangulate findings with two or more data sources. In this study, I describe the process of using visual data to verify, contradict, or enhance verbal data using a soft systems methodology tool called rich pictures. To date, the process of comparing verbal data and visual data has not been well explored. I use secondary data from a Ph.D. study about faculty members’ perceptions of academic quality to compare two data sources: participants’ verbal definitions of academic quality and participants’ verbal descriptions of rich pictures representing …

Persistent Social-Emotional Symptoms Following A Concussion: Recommendations For School Psychology Practice, Susan C. Davies, Elana R. Bernstein

Counselor Education and Human Services Faculty Publications

Concussions can result in a constellation of physical, cognitive, and social– emotional symptoms, most of which resolve within 1 to 2 weeks following the injury. In some instances, social–emotional difficulties following concussion persist, causing ongoing distress and psychosocial impairments. It is important that school psychologists understand the nature of these symptoms, as well as ways in which they can support students who are recovering from concussions. As part of a collaborative concussion team, school psychologists can provide valuable insight into the complex interaction of symptoms that may present following a concussion. This article summarizes the existing literature on persistent social–emotional …

Citizen Science In 4-H: Youth Volunteer Motivations, Participation, Retention And Scientific Literacy, Veronica Del Bianco

LSU Doctoral Dissertations

The primary purpose of this study was to examine the influence of volunteer motivation, participation, and citizen science project type on the retention and scientific literacy of 4-H youth volunteers ages 8-19 years participating in science projects. The conceptual model of participation in organized activities (OA) proposed by Bohnert, Fredericks and Randall (2010) was used as a framework for the variables included in the study categorizing them as predictors of participation, participation, program characteristics, or outcomes. A systematic review of volunteer motivations, retention, and scientific literacy in citizen science projects exposed that the literature contains silos of information published in …

The Relationship Between The High-Impact Practice Of Communication-Intensive Courses And Undergraduate Degree Completion At A Research University (Ru/Vh), Rebecca Acosta Burdette

LSU Doctoral Dissertations

With a critical public lens on quality student learning inclusive of 21^st century communication skills, and organizational effectiveness à la retention and graduation rates, all amidst budget constraints and increasing enrollments, postsecondary institutions must adopt practices that are both efficient and effective. This study examined the educational practice of Communication‑Intensive (C-I) courses and its influence on the institutional outcome of undergraduate degree completion at a large, public research university.

In this longitudinal study, the researcher applied a quantitative ex post facto research design to analyze six years of official university data on undergraduates who entered the selected university as …

Evaluation Of Innovative Medical School Facilities And Consultant Recommendations, Tripp Umbach

Lincy Institute Reports and Briefs

In August 2018, The Lincy Institute1 retained Tripp Umbach2 to provide consultation to evaluate and identify best practices for medical school facilities and development models as the University of Nevada Las Vegas (UNLV) and the community embarks on the development of a home for the UNLV School of Medicine. To complete this assignment, Tripp Umbach completed a comprehensive process involving secondary data analysis and actively sought and received input from stakeholders including leadership at The Lincy Institute, UNLV School of Medicine, previous Tripp Umbach clients, leading design professionals with experience developing medical schools, and potential donors to the proposed project. …

2018 Annual Report, Hedi Benaicha

Library Reports

Lesley University Library's 2018 Annual Report, A Culture of Engagement: Our Students, Faculty and Staff within the Larger Community, provides an overview of the Library's focus on strengthening its central role within the university. The report outlines what was done during the 2017-2018 academic year to achieve the Library's vision of building community, providing easy access to knowledge and information, preserving the institutional memory, and becoming an innovation center.

The 2018 Annual Report begins with an executive summary by the Dean of Libraries and documents the Library's achievements and goals for the 2018-2019 academic year. This is followed by …

Inclusion For A Student With Vision Impairment: “They Accept Me, Like, As In I Am There, But They Just Won’T Talk To Me.”, Jill L. Opie, Jane Southcott

The Qualitative Report

We explore the experiences of Nick, a secondary school student with vision impairment in an Australian mainstream school in this study, and we particularly focus on whether he perceived his education as inclusive. We have used Interpretative Phenomenological Analysis in this single individual case as this approach explores our participant’s understandings which may be revealed by close examination of mindful experiences. The “gem” spoken by Nick (pseudonym), our 16-year old participant, was “They accept me, like as in I am there, but they just won’t talk to me.” This statement summarises his sense of not belonging, of being other, and …

How Mother And Father Support Affect Youths’ Interest In Computer Science, Jody Clarke-Midura, Frederick J. Poole, Katarina Pantic, Chongning Sun, Vicki Allan

Instructional Technology and Learning Sciences Faculty Publications

Parental support is a predictor of children’s career interest and aspirations. However, mother and father support affects youth career choices differently. To understand how perceived mothers’ and fathers’ support affect career interest in computer science (CS), we developed two path models using both mother and father support gains to predict youths’ interest in CS. We hypothesized that perceived father’s and mother’s support would relate to youths’ interest in CS via youths’ perception of CS utility value as a mediator. We found that both mother and father support leads to interest in CS. However, father support was found to affect CS …

The Lost & Found Game Series: Teaching Medieval Religious Law In Context, Owen Gottlieb, Ian Schreiber

Presentations and other scholarship

Lost & Found is a strategy card-to-mobile game series that teaches medieval religious legal systems with attention to period accuracy and cultural and historical context. The Lost & Found project seeks to expand the discourse around religious legal systems, to enrich public conversations in a variety of communities, and to promote greater understanding of the religious traditions that build the fabric of the United States. Comparative religious literacy can build bridges between and within communities and prepare learners to be responsible citizens in our pluralist democracy. The first game in the series is a strategy game called Lost & Found …

Designing For Online Computer-Based Clinical Simulations: Evaluation Of Instructional Approaches, Ilana Dubovi

Instructional Technology and Learning Sciences Faculty Publications

Background: Online computer-based simulations are becoming more widespread in nursing education. Therefore, an understanding of when and how to implement the variety of instructional strategies related to these simulations is fundamental.

Objectives: This study compares the effectiveness of online computer-based simulations designed using two alternative instructional approaches—Productive Failure and Simple-to-Complex sequencing—on learning of clinical reasoning skills.

Participants: Participants in this study were undergraduate nursing students (n = 103, mean age = 23.4 ± 2.1) enrolled at a university in Israel.

Methods: Participants completed two online simulations designed using Productive Failure approach (emergency medicine, mental health) and two online simulations using …

Evidence, Standards, And School Librarianship: Prevailing Policies, Promising Methods, And Progress On A Research Agenda, Barbara Schultz-Jones, Sue C. Kimmel, Marcia A. Mardis, Faye R. Jones, Shana Pribesh, Laura Pasquini

STEMPS Faculty Publications

Guided by the question, "What are the implications of national educational evidence standards for school librarianship research?," prevailing U.S. evidence-driven educational policies are examined to identify implications for school librarianship research; promising methods to contribute to building this evidence base are explored; and finally, progress on a long-term research agenda designed to enable school librarianship researchers to contribute evidence to educational policy is reviewed. As promising methods are explored, an actionable agenda is proposed that school library researchers can undertake to participate in a causal research environment.

Does Audience Matter? Comparing Teachers' And Non-Teachers' Application And Perception Of Quality Rubrics For Evaluating Open Educational Resources, Min Yuan, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

While many rubrics have been developed to guide people in evaluating the quality of Open Educational Resources (OER), few studies have empirically investigated how different people apply and perceive such rubrics. This study examines how participants (22 teachers and 22 non-teachers) applied three quality rubrics (comprised of a total of 17 quality indicators) to evaluate 20 OER, and how they perceived the utility of these rubrics. Results showed that both teachers and non-teachers found some indicators more difficult to apply, and displayed different response styles on different indicators. In addition, teachers gave higher overall ratings to OER, but non-teachers' ratings …

Exploring The Relationship Between Students' Sense Of Community, Student Satisfaction, And Doctoral Program Retention, Adam Roberson

Doctoral Dissertations and Projects

This is a study examining the interaction between certain doctoral student engagement indicators (peer, institution, curriculum, faculty, spirituality) and student satisfaction. The scope is to understand if student sense of community is a significant moderator to this interaction in order to address the issue of student attrition. It is important to understand these interactions and the influence of sense of community so that institutions of higher education better analyze student commitment. The outcomes of this study may be used as a means to design and implement engagement strategies that are effective in student retention and completion. Doctoral students were invited …

Putting Making Into High School Computer Science Classrooms: Promoting Equity In Teaching And Learning With Electronic Textiles In Exploring Computer Science, Deborah A. Fields, Yasmin B. Kafai, Tomoko Nakajima, Joanna Goode, Jane Margolis

Instructional Technology and Learning Sciences Faculty Publications

Recent discussions of making have focused on developing out-of-school makerspaces and activities to provide more equitable and enriching learning opportunities for youth. Yet school classrooms present a unique opportunity to help broaden access, diversify representation, and deepen participation in making. In turning to classrooms, we want to understand the crucial practices that teachers employ in broadening and deepening access to making. In this paper, we investigate two high school teachers’ approaches in implementing a novel eight-week, electronic textiles unit within the Exploring Computer Science curriculum, where students designed wearable electronic textile projects with microcontrollers, sensors, and LEDs. We share teachers’ …

The Narration Of Conflicting Accountabilities In The Era Of High-Stakes Teacher Evaluation, James Christopher Head

Dissertations, Theses, and Capstone Projects

The U.S. Government’s Race to the Top program inspired a wave of education reforms across the nation aimed at holding teachers individually accountable for their students’ “growth” on test scores. These individualized programs implemented new forms of audit technologies aimed at orienting teachers’ priorities toward the calculations produced by students, rather than towards students’ holistic growth and well-being. In so doing, these programs signify an ideological rupture for teachers in that their long-shared sense of interpersonal accountability is institutionally re-directed – and reinforced with consequences – toward calculative accountability. In this dissertation, I investigated teachers’ experiential navigation of the introduction …

Challenges In Stem Learning In Australian Schools, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Policy Insights

Australian STEM education seems caught in a whirlpool of problems that are contributing to one another. Student engagement and performance in STEM are declining, but we do not have the supply of qualified teachers we need to improve learning. The STEM curriculum is unbalanced and fragmented, leading to less interest among students. It is not possible to break out of the downward cycle from within the current system and it requires policy changes that address the issues raised in this report. This means developing well-considered, systemic and joined-up policies that address the following challenges: Improving student outcomes, building the STEM …

Challenges In Stem Learning In Australian Schools: Literature And Policy Review, Michael J. Timms, Kathryn Moyle, Paul R. Weldon, Pru Mitchell

Program monitoring and evaluation

This literature and policy review outlines the complex context related to STEM learning in Australian schools and focuses on student outcomes, the teacher workforce and the curriculum. This paper also sheds light on possible policy directions by examining lessons from other countries. STEM education is a broad enterprise that starts in early childhood education, continues through the years of schooling and extends into tertiary education supported by contributions from extracurricular and enrichment activities, science centres and museums. However, the focus in this document is on primary and secondary schooling. Australian STEM education seems caught in a whirlpool of problems that …

Principal Professional Development And Principal Self-Efficacy In An Urban School District., Brian Thomas Garrett

Electronic Theses and Dissertations

Educator professional development (PD) is a heavily relied upon method for school improvement, and administrator professional development (APD) is a key element to nearly all school reform efforts. District-wide APD in large school districts can carry a heavy cost in financial and human resources. Moreover, PD is frequently too inadequately planned and/or implemented to bring about lasting positive change in educator practice, school reform, and student achievement. The purpose of this study was to determine the relationship between principal PD focused on culture/climate or instruction and principal self-efficacy in an urban school district. Through hierarchical linear multiple regression (HLMR), this …

Self-Efficacy Change Associated With A Cognitive Load-Based Intervention In An Undergraduate Biology Course, David F. Feldon, Joana Franco, Jie Chao, James Peugh, Cathy Maahs-Fladung

Instructional Technology and Learning Sciences Faculty Publications

Cognitive load theory (CLT) holds that discovery learning and other instructional strategies imposing high levels of extraneous load on novice learners hinder learning. Such learning conditions are also associated with significant drops in persistence, a key measure of motivation. However, research within the CLT framework typically engages motivation as a necessary precursor to learning, rather than as an outcome of instruction. In this study, we examine changes in motivational beliefs as outcomes of learners' cognitive processes through a CLT lens as they engage with instruction. Using a double-blind quasi-experimental design, we manipulate the level of cognitive load imposed on participants …

The Predictors Of Juvenile Recidivism: Testimonies Of Adult Students 18 Years And Older Exiting From Alternative Education, La Toshia Palmer

Dissertations

Purpose: The purpose of this descriptive, qualitative study was to identify and describe the importance of the predictors of juvenile recidivism and the effectiveness of efforts to prevent/avoid juvenile recidivism as perceived by previously detained, arrested, convicted, and/or incarcerated adult students 18 years of age and older exiting from alternative education in Northern California. A second purpose was to explore the types of support provided by alternative schools and the perceived importance of the support to avoid recidivism according to adult students 18 years of age and older exiting from alternative education.

Methodology: This qualitative, descriptive research design identified …

The Preparation And Education Of First-Year Teachers: A Case Study, Jennifer A. Tygret

The Qualitative Report

The purpose of this case study was to provide a policy analysis of the Council for the Accreditation of Educator Preparation (CAEP) standard that requires teacher preparation programs to follow their recent graduates during their first years of teaching to demonstrate their positive impact on student growth, satisfaction with their preparation, and effective teaching practices. Using the Colorado Teacher Quality Standards as a conceptual framework, this qualitative study used interviews and observations at the beginning, middle, and end of the school year to discover five first-year teachers’ perceptions of their preparation, needs, level of confidence in all areas of teaching, …

Adolescents’ Perceptions Of “Cheating” In Gaming And Educational Settings, Brandon Nease, Michelle Samura

Education Faculty Articles and Research

Background. Given the widespread popularity of video gameplay among adolescents, it is important to understand the relationship between video gameplay and adolescent behaviors in various contexts.

Aim. This exploratory study aimed to explore adolescent gamers use of player guides and cheat codes during video gameplay in order to understand how they reason about the relationship between cheating in video games and cheating in academic settings.

Method. Semi-structured interviews were conducted with adolescents in order to gain in-depth insight into participants’ perspectives on video gameplay and their perceptions of cheating in video games and academic settings. Interview data was coded and …

Using Wikipedia In Israel Studies Courses, Shira Klein

History Faculty Articles and Research

Instructors of Israeli history or literature, like professors in other areas, complain about students’ use of Wikipedia—and with good reason. Unlike peer-reviewed scholarship, many Wikipedia articles contain information that is both incomplete and wrong. Most instructors will warn their students that relying on Wikipedia is a sure recipe for failing assignments. Yet there is a way to mobilize this giant encyclopedia for pedagogical purposes. When students in Israel Studies classes are assigned to edit Wikipedia articles, they achieve multiple goals: they gain critical reading skills, shape public knowledge about Israel, and engage in active learning. This article explains how to …

Imls Sparks Ignite Il Framework Cooperative Project Final Performance Report, Appendix D: Focus Group Report, Joel M. Wright, Jessame Ferguson

IMLS SPARKS Ignite IL Framework Cooperative Project for At-Risk Student Success in Smaller Colleges

This appendix to the Final Performance Report for the IMLS Sparks IL Cooperative Project grant is the report on the focus groups. The focus group research summarized herein represents a segment of the overall IMLS grant proposal process, and should be viewed not as a separate endeavor, but rather as an integrated approach to the overall research questions in the grant proposal. In conjunction with the pre-test/post-test survey driven component, the findings from the focus group research help to strengthen the case for the value of librarian-driven pedagogy in positively impacting the academic and intellectual growth of all students, and …

Does The Test Work? Evaluating A Web-Based Language Placement Test, Avizia Long, Sun-Young Shin, Kimberly Geeslin, Erik Willis

Faculty Publications

In response to the need for examples of test validation from which everyday language programs can benefit, this paper reports on a study that used Bachman’s (2005) assessment use argument (AUA) framework to examine evidence to support claims made about the intended interpretations and uses of scores based on a new web-based Spanish language placement test. The test, which consisted of 100 items distributed across five item types (sound discrimination, grammar, listening comprehension, reading comprehension, and vocabulary), was tested with 2,201 incoming first-year and transfer students at a large, Midwestern public university. Analyses of internal consistency and validity revealed the …

Imls Sparks Ignite Il Framework Cooperative Project Teaching Materials: Slide Presentation Template, Jessica Barbera, Jim Huff, Christine Iannicelli, Marianne Sade, Samantha Martin

IMLS SPARKS Ignite IL Framework Cooperative Project for At-Risk Student Success in Smaller Colleges

This slide presentation, adapted from Google Slides to PowerPoint, was used as a template by our cohort for the instructional sessions that were part of the information literacy grant project.

Imls Sparks Ignite Il Framework Cooperative Project Pre-Test, Jessame Ferguson, Diane Skorina, Ronalee Ciocco, April Cunningham

IMLS SPARKS Ignite IL Framework Cooperative Project for At-Risk Student Success in Smaller Colleges

This is a pdf file of the pre-test that was administered to students before they received any information literacy instruction. The pre-test contains all the questions that were in the post-test, plus several extra that were only asked on the pre-test.

Conjecture Mapping The Library: Iterative Refinements Toward Supporting Maker Learning Activities In Small Community Spaces, Victor R. Lee, Mimi Recker, Abigail L. Phillips

Instructional Technology and Learning Sciences Faculty Publications

A recent and important innovation in design-based research (DBR) is the use of conjecture maps, where researchers explicitly articulate the conjectured mediational relations between their designed goals and the learning designs and contexts. In this paper, we present a design case as an iterative sequence of evolving conjecture maps. As each conjecture map was tested, we revised it to highlight and refine our articulation of the tools and processes that embodied our design approach. Out design case involves small-town and rural community and school libraries in the United States as partners and DBR sites, with the goal of supporting librarians …

Delving Into The Specificity Of Instructional Guidance In Social Media-Supported Learning Environments, Tian Luo

STEMPS Faculty Publications

Aim/Purpose: This study investigates the variations in student participation patterns across different types of instructional activities, learning modes, and with different instructional guidance approaches. In the current study, different variables, modes of learning (guided versus unguided), and types of guidance (social versus cognitive) were manipulated in a series of microblogging-supported collaborative learning tasks to examine to what extent and in which aspects instructional guidance affects the effectiveness and student perception of microblogging-supported learning.

Background: Despite the overwhelming agreement on the importance of instructional guidance in microblogging-supported learning environments, very few studies have been done to examine the specificity of guidance, …