Educational Assessment, Evaluation, and Research Commons^™

Tell Me Your Business: Assessing The Teaching Needs Of Undergraduate Business Faculty, Nora Allred, Lauren Movlai, Jennifer Sams

Michigan Tech Publications, Part 1

Academic libraries often fill a variety of roles in response to the needs of teaching and research faculty while simultaneously navigating a rapidly changing information landscape. As higher education embraces students’ desire for active learning, experiential learning, and service learning, the support needs of teaching faculty also change. In the spirit of providing high-quality, relevant support, librarians at Michigan Technological University partnered with Ithaka S+R to explore the evolving teaching needs of Business Faculty. Nine faculty members from Michigan Tech's School of Business and Economics were interviewed, and interviews were coded and analyzed. Major themes identified included: students' information and …

Effects Of A Cooperative Learning Intervention Program On Cyberbullying In Secondary Education: A Case Study, David Hortigüela Alcalá, Javier Fernández Río, Gustavo González Calvo, Ángel Pérez Pueyo

The Qualitative Report

The goal was to assess the effects of an intervention program, based on cooperative learning and involving the whole school community, on the emotional and social evolution of a student who had suffered cyberbullying. The student, her parents, the school administration, a teacher and the student's classmates agreed to participate in the study. A qualitative research design was used, which included interviews, discussion groups and diaries. The information obtained was structured in three categories: cyberbullying detection and response, psychoeducational intervention program, and emotional and social evolution. Results showed that the program produced significant improvements in the cyberbullied adolescent's emotional and …

Let’S Talk: An Examination Of Parental Involvement As A Predictor Of Stem Achievement In Math For High School Girls, Nicol R. Howard, Keith E. Howard, Randy T. Busse, Christine Hunt

Education Faculty Articles and Research

This research was conducted to examine the influence of parental involvement, in the form of parent conversations, on mathematics achievement for high school girls. Data from the High School Longitudinal Study of 2009 (HSLS:09) public-use file provided a sample of 13,694 students, including 6,592 girls for our analyses. A scale for measuring parent conversations was developed and regression analyses were conducted to examine whether this scale variable predicted mathematics achievement. Results indicated that conversational parental involvement was a significant predictor of mathematics achievement for Black and White girls, but not Hispanic and Asian. Implications for research and policy initiatives are …

Learning From Incidents To Reduce The Risk Of Drowning In Swimming Pools: Implementation Of Experience-Based Feedback Regarding Near-Misses In Four Public Facilities In France, Élie Vignac, Pascal Lebihain, Bastien Soulé

International Journal of Aquatic Research and Education

The prevention of sports accidents must rely on a detailed knowledge of accident circumstances and risk factors. Today, very few studies have investigated in depth non-fatal drowning incidents that have occurred in public swimming pools (PSP). Learning from incidents seems likely to advance the knowledge of accident scenarios. This research study aimed to capture minor incidents that might identify safety lessons and preventive measures. Incidents of minor and major aquatic events were collected from four PSPs that had hosted 700,000 bathers per year. About 800 incidents and 300 aquatic rescues performed by lifeguards were recorded within a time frame of …

Measuring The Value Of Professional Indexing, Philip Hider, Pru Mitchell, Robert Parkes

Information Management

This study provides both a quantitative estimate and qualitative analysis of the additional ‘retrieval power’ that professionally assigned subject indexing affords users of a typical database in the field of education. A full version of Informit’s A+ Education database and one stripped of its subject indexing were searched by four research assistants tasked with compiling exhaustive bibliographies on forty-eight topics. The searchers were then surveyed about their use of the two databases, while their bibliographies and search logs were also examined. A two-way ANOVA model was constructed to estimate the percentage of additional resources found by the searchers on the …

Class Matters: School Affluence And Other Predictors Of Attainment For Wealthy And Poor Students, Alison Brockhouse

Dissertations, Theses, and Capstone Projects

Public schools in the United States are becoming increasingly segregated by socioeconomic status. Though the educational consequences of socioeconomic segregation are well researched, segregation is often ignored or exacerbated by education reform. To learn more about the wider implications of socioeconomic segregation, this study utilizes theoretical frameworks derived from Max Weber’s theory of social stratification to analyze over 10,000 students’ experiences from the National Center for Education Statistics (NCES) Education Longitudinal Study (ELS) 2002, 2004, and 2012 waves of data collection. More specifically, this research explores the impact of attending an affluent high school on long-term educational attainment. It finds …

Co-Design Of An Orchestration Tool: Supporting Engineering Teaching Assistants As They Facilitate Collaborative Learning., Luettamae Lawrence, Emma Mercier

Instructional Technology and Learning Sciences Faculty Publications

This paper describes a design-based implementation research (DBIR) project, focused on the co-design and implementation of an orchestration tool for teaching assistants (TAs) in required engineering classes. Building on our collaboration with the engineering department, we identified a need for a tool that provides insight into groups to help TAs intervene in realtime. This paper presents two phases of our iterative co-design process. The first phase includes the initial design of the tool from design workshops with TAs. The second phase focuses on a 16-week implementation of the orchestration tool and reports on interviews with TAs to understand how they …

Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond

Journal of Media Literacy Education

The ability to critically access, analyze, evaluate, and create media messages is crucial in the process of becoming an informed and engaged citizen throughout life. Asking critical questions is not only a valuable dimension of media literacy, but also an indispensable aspect of participating in a democracy. Yet, measuring the effectiveness of media literacy is still a major challenge for the field. It is unclear to what extent people of all ages may engage in critical questioning habits with regards to media. To address this gap, we studied the changes in critical questioning habits for college-aged students enrolled in media …

Creating Global Citizens Through Returnee Programming, Kristen Foos

Capstone Collection

The purpose of study abroad is to facilitate students’ journey to global citizenship and a large part in doing this is having effective returnee programming. This research focused on what type of program models best facilitate this goal and are of interest to students at Washington State University (WSU). To answer this question, 12 WSU peer advisors, 4 global learning advisors at WSU, and 5 global learning advisors at other institutions were all interviewed. Along with that, a survey was sent out to all WSU student who had studied abroad within the past year. The results demonstrated that when WSU …

What Can Early Childhood Education And Care Settings Teach Us About Skills For The 21st Century?, Dan Cloney, Kellie Picker

2009 - 2019 ACER Research Conferences

Early childhood education and care (ECEC) settings are naturally oriented towards promoting 21st century skills. This can be seen in Australia, where learning is defined as the development of identity, social and emotional skills, problem-solving, and communication skills. A 21st century orientation is also seen in the playbased pedagogies implemented in ECEC settings. A gap, however, exists in the ability of the ECEC sector to communicate its successes. This gap relates to the lack of measurement tools to quantify the quality of the adult–child interactions in ECEC settings, and children’s growth in these 21 century skills and abilities. This paper …

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

2009 - 2019 ACER Research Conferences

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to …

Assessing And Understanding Social And Emotional Skills: The Oecd Study On Social And Emotional Skills, Sue Thomson

2009 - 2019 ACER Research Conferences

In an increasingly fast-changing and diverse world, the importance of developing social and emotional skills is becoming more evident. The large body of accumulated evidence shows that these skills have strong relationships with life outcomes and they have been referred to as a key component of 21st century skills. The Organisation for Economic Co-operation and Development (OECD) Study on Social and Emotional Skills is a new international assessment of these skills in students at primary and secondary schools. This study also gathers information on students’ families, schools and community learning contexts, aiming to provide information about the conditions or practices …

The Impact Of Bumpers College Of Agricultural, Food And Life Sciences International Programs On Student Motivation For Continuing College And Student Engagement In The Classroom, Olivia Caroline Caillouet

Graduate Theses and Dissertations

Colleges aim to increase student achievement, which has been linked to motivation and engagement, as well as increase global partnerships. There is also an increasing demand from students for international programs (IPs) that prepare them to be global citizens. This study aimed to compare student motivation for continuing college and student engagement in the classroom before and after an IP. Students who participated in a Bumpers College of Agricultural, Food, and Life Sciences IP between January 2018 and August 2018 were surveyed prior to, and two weeks and three months post-program participation (n = 24). The instrument had 51 Likert-scale …

Technical Standards Literacy In Management Education, Heather A. Howard, Margaret Phillips

Midwest Business Librarian Summit (MBLS)

Industry standards have a significant impact on business as a means to eliminate waste, reduce costs, market products (e.g., for quality, safety, interoperability) and lessen liability (Thompson, 2011). Consequently, an understanding of and ability to use standards, agreed upon practices among interested or vested parties, is a critical workplace competency for those engaged in business and industry. To have a workforce competent in the use of standards, higher education curricula must be developed to integrate standards education at appropriate points within the curriculum. Despite the importance of standards, they are not universally integrated into the college and university curricula. Given …

The Effects Of Grading Practices On Motivations For Learning At The Middle School Level, Justin D. Stebbins Ms

Muskie School Dissertations

The objective of this quantitative survey study was to measure the effect grading traditionally (using averaging) versus non-traditionally (best, most recent evidence) on four types of student motivation. These types of motivation were mastery orientation (learning for learning sake), performance orientation (going for the grade or external recognition), performance avoidance (not wanting to appear incompetent), and mastery avoidance (not wanting to lose what you have). This set of orientations is derived from the goal orientation theory.

In this study, 1,652 students and 93 educators between four schools took an anonymous 20-minute online survey. Due to lack of teacher participation, two …

Examining Student Perspectives On Information Literacy, Kathleen Conklin Brenner

All Theses And Dissertations

The American Library Association released its Framework for Information Literacy in Higher Education in response to the changing needs and demographics of today’s digital native students. This study was designed to ascertain first-year undergraduate students’ definitions and perspectives of information literacy to determine how they are aligned to the Association of College and Research Libraries (ACRL) six frames of information literacy. The overarching research question was: How is the Association of College and Research Libraries Framework for Information Literacy aligned to first-year undergraduate student expectations of information literacy instruction? The following supplemental research questions supported the study:
1. How do …

21st Century Teenagers And Young Adults Who Are Deaf Or Hard Of Hearing: Outcomes And Possibilities, Jean S. Moog, Amanda M. Rudge 3730756

Journal of Early Hearing Detection and Intervention

The purpose of this study was to document demographics, characteristics, and long-term outcomes of teenagers and young adults who are deaf or hard of hearing (DHH) and who all attended the Moog Center for Deaf Education for preschool and/or a portion of elementary school. Data were obtained via an online survey that was designed to assess educational, personal, and professional outcomes of individuals who were currently in high school and beyond. Survey questions were about the lives of these individuals after leaving the Moog Center. Participants included 108 individuals who were DHH, ranging from 15 to 32 years of age. …

A Qualitative Examination Of College Disability Services For Students With Traumatic Brain Injuries, Susan C. Davies, Michael R. Crenshaw, Elana R. Bernstein

Counselor Education and Human Services Faculty Publications

Adolescents and young adults are at relatively high risk for sustaining traumatic brain injuries (TBIs). These injuries can result in persistent disabilities, including a range of cognitive, physical, and social-emotional deficits that can be particularly challenging for college age students. This qualitative study explored disability services for college students with TBIs through interviews with directors of 18 college Offices of Disability Services (ODS). Respondents provided general information regarding their service model, the most common disabilities served, as well as the number of students with TBI served, and more specific information pertaining to services for students with TBI. Results indicated ODS …

Opportunities For Self-Evaluation Increase Student Calibration In An Introductory Biology Course, Jennifer L. Osterhage, Ellen Usher, Trisha A. Douin, William M. Bailey

Biology Faculty Publications

Accurate self-evaluation is critical for learning. Calibration describes the relationship between learners’ perception of their performance and their actual performance on a task. Here, we describe two studies aimed at assessing and improving student calibration in a first-semester introductory biology course at a 4-year public institution. Study 1 investigated students’ (n = 310) calibration (the difference between estimated and actual exam performance) across one semester. Students were significantly miscalibrated for the first exam: their predicted scores were, on average, significantly higher than their actual scores. The lowest-performing students had the most inaccurate estimates. Calibration improved with each exam. By …

Australian Higher Education Equity Ranking Project: Final Report, Tim Pitman, Paul Koshy, Daniel Edwards, Liang-Cheng Zhang, Julie Mcmillan

Higher education research

This report details the findings of a feasibility study for the Department of Education and Training (DET) into the development of a higher education student equity ranking index. The purpose of study was to determine whether it was possible to measure higher education equity performance at the institutional level and convey each institution’s relative performance through an ‘equity rank’. The ranking was to be based on institutional performance in regard to equity-group students, including students from low socio-economic backgrounds; students from regional/remote areas of Australia; Indigenous students; students with disability; and students from non-English speaking backgrounds.

Scientometric Mapping Of Research Output Of Nirf First Ranked Institute Of India: Iisc, Bangalore, Satish Kumar, Senthilkumar R.

Library Philosophy and Practice (e-journal)

The study is aimed to investigate the scientific research productivity of India’s NIRF first ranked higher academic & research institute, Indian Institute of Science (IISc), Bangalore for a period of 05 years during 2014-2018. A total of 12,130 research papers were retrieved as SCIE publication from WoS bibliographical database and analyzed. The study is focused to find out the year wise institutional contribution in research, compound annual growth rate, areas of interest, collaborating institutions and countries, mode of publications, research funding agencies, prolific journals, prolific authors, authorship pattern, degree of collaborations etc. Different scientometric tools and techniques were used to …

Breaking The Chains: Reversing The School-To-Prison Pipeline Through The Academic Experiences Of Formerly Incarcerated Black Males, Folasade Ogunbanwo

Master's Theses

This case study explores the academic experiences of formerly incarcerated Black males. The goal of the case study is to inform policymakers and critical race scholars who take interest in the prison-to-school pipeline and ultimately dismantle the school-to-prison pipeline. The historical impact of slavery has manifested into this vicious pipeline and the overrepresentation of Black males in the prison industrial complex. This case study is to demonstrate how the net is casted on those affected by the incarceration system and that break the cycle for themselves by pursuing an education to create an upward academic trajectory.

Evaluating The Job Performance Of Librarians In Universities In South-East, Nigeria., Obinna A. Nwokike Phd, Vincent E. Unegbu Phd

Library Philosophy and Practice (e-journal)

Job performance consists of a set of employees’ behaviours that are perceived to be in agreement with organizational goals that can be measured, monitored and assessed as an achievement at an individual level. The librarian’s job performance is that aspect of work behaviour that is of relevance to the library’s success. This paper presents findings from a self-rating questionnaire on the levels of job performance of librarians in universities in one region of Nigeria. The study was carried out using a cross-sectional survey design to collect data from 210 respondents in 21 universities based on total enumeration. Data was analyzed …

Analyzing Two-Year College Student Success Using Structural Equation Modeling, Jessica Taylor

Graduate Theses, Dissertations, and Capstones

The goal of this study is to more fully understand the scope of community college student success using the principles of mindset, engagement, and college readiness. Using structural equation modeling ensures this study is able to measure the combined effects these concepts have on student success, group differences, and the combined model of student success. Findings suggest student success can be significantly impacted by self-belief and mindset behaviors that can outweigh the initial effect of academically under-prepared students. Groups included in this study are non-traditional students, minority populations, first generation students, and Pell eligible students.

Effect Of Using “Just-In-Time Teaching (Jitt)” Method And “Modified Lecture” Method In Teaching Cataloguing And Classification Courses In Anambra State, Tochukwu Victor Nwankwo, Angela Ifeoma Ndanwu Mrs, Victoria Obianuju Ezejiofor Mrs

Library Philosophy and Practice (e-journal)

This study was designed to investigate the effect of just-in time on the academic achievement and interest of students offering cataloguing and classification course in Anambra State. In other to effectively carry out the study, it adopted the quasi experimental design particularly the pretest and posttest non-equivalent control group. The sample for the study comprised of 81 students from 2 selected tertiary schools (Nnamdi Azikiwe University, Awka; and Federal Polytechnic Oko) out of five tertiary schools in the area using purposive random sampling technique. The instrument for data collection was Cataloguing and Classification Achievement Test (CCAT) validated by two lectures …

Communicating Computational Concepts And Practices Within High School Students’ Portfolios Of Making Electronic Textiles, Debora Lui, Justice T. Walker, Sheri Hanna, Yasmin B. Kafai, Deborah A. Fields, Gayithri Jayathirtha

Instructional Technology and Learning Sciences Faculty Publications

Portfolios have recently gained traction within computer science education as a way to assess students’ computational thinking and practices. Whereas traditional assessments such as exams tend to capture learning within artificial settings at a single point in time, portfolios provide more authentic opportunities to document a trajectory of students’ learning and practices in everyday contexts. Furthermore, because communication itself has been defined as an important computational thinking practice, portfolios give students a place to practice this skill in the classroom. In this study, we report on the implementation of a digital portfolio with a class of 21 high school students …

To And Through College: Investigating Attitudes Towards, Enrollment In, And Graduation From College, Elise Swanson

Graduate Theses and Dissertations

Postsecondary access and degree completion are increasingly important concerns for individuals and policymakers. This dissertation presents evidence on three distinct strategies for increasing students’ level of preparedness for higher education, rates of postsecondary enrollment, and rates of postsecondary degree completion. The first is an intervention aimed at increasing eighth-grade students’ familiarity with college life. Results from an experimental study indicate that students assigned to participate in campus visits demonstrate higher levels of knowledge about college, are more likely to have conversations with school personnel about college, put forth higher levels of effort while completing a college-related survey, and express a …

Student Withdrawals In A Job Training Program, Amy Lawrence

Master's Projects

Within the context of a competitive market, shifting funding sources, and a new regulatory environment, the purpose of this paper is not to examine educational attainment, but rather to research student drop out, or withdrawal, at the post-secondary job training institution of Center for Employment Training (CET). The foremost research questions to be answered are what are the characteristics of students who withdraw from job training programs provided by Center for Employment Training, and what factors may influence withdrawal.

Evaluating The Effectiveness Of Motor Planning With Core Vocabulary: A Behavior Analytic Account, Alison Judith Karnes

Graduate Theses and Dissertations

As the prevalence of autism spectrum disorders (ASD) increases, it is important for practitioners to continue to improve evidence-based practices (EBP) for the treatment of ASD symptoms (i.e., impairments in social communication and repetitive behaviors and restricted interests; American Psychiatric Association [APA], 2013). It is estimated that 30-50% of individuals with autism do not acquire functional speech (Wodka, Mathy, & Kalb, 2013). These individuals would make appropriate candidates for Augmentative and Alternative Communication (AAC; Mirenda, 2003). One form of AAC is the speech-generating device (SGD). Over the last ten years, tablet-based technologies including iPad minisⓇ have been emphasized in the …

"Assessing The Library: A Christian Liberal Arts College's Library-Wide Assessment Project", Amy James

The Christian Librarian

This article reports on a library-wide assessment project at Spring Arbor University’s White Library. It highlights the methods used to assess each element, along with a recap of the findings, and a section covering the successes and caveats. The library’s website was evaluated using a focus group strategy where users completed a set of tasks using the website. The physical space was evaluated using a whiteboard approach. The freshman research instruction program at the White Library consists of one and two shot library sessions. The current teaching approach was assessed using “muddiest point cards”along with surveys.