Educational Assessment, Evaluation, and Research Commons^™

Intercultural Competencies Among Undergraduates In The College Of Arts & Humanities At Minnesota State University, Mankato, Jonathon Arndt, Olivia Thomas

Education Presentations at National and International Conferences

This study examined the impact of an intercultural communication course in arts and humanities on the intercultural competency (ICC) among a group of university students. ICC was defined as “the capability to accurately understand and adapt behavior to cultural difference and commonality.” Globalization has led to increased contact between different cultures, so individuals must know how to communicate between one another and to understand the culture behind the communication (Melles & Frey, 2017). Students must strive for acceptance and understanding of religion, language, communication style, music, or any other aspect of culture. The research questions were: (1) What is the …

Preparing Teachers For A Diverse Classroom, Sean O'Rourke, Jonathon Arndt

Education Presentations at National and International Conferences

This project investigated the research question: How do changes in inter-cultural competency (ICC) compare among pre-service teachers at three data collection points? Intercultural competency was defined as “the capability to accurately understand and adapt behavior to cultural differences and commonalities” (Hammer & Bennett, 2010). The study was based on the Developmental Model of Intercultural Sensitivity (Bennett, 1986), which identified five orientations toward cultural differences: denial, polarization, minimization, acceptance, and adaptation. Data was collected from 48 undergraduate students who majored in elementary education. Investigators hypothesized that students would have a statistically significant change in their ICC from the beginning of their …

Is Collegiate Political Correctness Fake News? Relationships Between Grades And Ideology, Matthew Woessner, Robert Maranto, Amanda Thompson

Education Reform Faculty and Graduate Students Publications

While considerable quantitative research demonstrates ideological liberalism among American professors, only qualitative work examines whether this affects undergraduate education. Using the HERI dataset surveying students in their first and fourth years in college (n=7,207), we use OLS regressions to test whether students’ political beliefs are associated with reported college grades and perceived collegiate experiences. We find that while standardized test scores are the best predictors of grade point average, ideology also has impacts. Even with controls for SES, demographics, and SAT scores, liberal students report higher college grades and closer relationships with faculty. Nevertheless, conservative students consistently show higher levels …

The Credentialed Workforce: Examining Success Rates Across Short-Term Noncredit Training Programs Aligned With Industry Credentials, Rochelle Fisher

Masters Theses, 2010-2019

A new grant program implemented to provide subsidized training costs for students enrolling in short-term noncredit programs aligned with high-demand industry credentials leading to middle-skill jobs was implemented in July 2016. The grant program follows a pay-for-performance model where students are given a two-thirds discount on tuition but required to pay back an additional one-third if they do not successfully complete their short-term noncredit training. An exploratory study was conducted to provide training program completion and credential attainment rates for the overall program and by student demographic groups (age, race, and gender). Results showed little variation among training program completion …

Sulitest®: A Mixed-Method, Pilot Study Of Assessment Impacts On Undergraduate Sustainability-Related Learning And Motivation, Alicia Mason

Faculty Submissions

A United Nations international collaboration between the Education for Sustainable Development (ESD) and the Principles for Responsible Management Education (PRME) resulted in the creation of Sulitest® (aka Sustainability Literacy Test) an open, online training and assessment tool freely available to higher education institutions globally. This study analyzes the effectiveness of the newly developed Sulitest® to not only measure sustainability literacy of higher education student populations, but also act as a catalyst for boosting affective learning outcomes by: (a) generating interest in sustainability-related issues, (b) improving sustainability-related understandings, and (c) enhancing students’ interests in the subject matter. In order to do …

Developing A Rubric To Assess Critical Thinking In A Multidisciplinary Context In Higher Education, Sadia Muzaffar Bhutta, Sahreen Chauhan, Syeda Kausar Ali, Raisa Gul, Shanaz Cassum, Tashmin Khamis

Institute for Educational Development, Karachi

Critical thinking (CT) is a generic attribute that is greatly valued across academic disciplines in higher education, and around the globe. It is also defined as one of the graduate attributes of higher education for the sample private university where this research was conducted, as it is perceived that CT helps the graduate to become ‘engaged citizens’ in the twenty-first century. Despite the well-documented importance of CT, its assessment remains a challenge. This study addresses this challenge through the systematic development and field-testing of a rubric for assessing critical thinking in a multidisciplinary context in higher education. A multidisciplinary group …

An Exploratory Investigation Of A Flipped Classroom Model In Human Services Education, Nicola A. Meade, Narketta M. Sparkman-Key Phd

Journal of Human Services: Training, Research, and Practice

Human services education has unique needs due to the practical elements that are a part of preparing students for the field. One aspect is for students to graduate with a firm capacity to enact the skill detailed by the National Organization of Human Services (NOHS, n.d.). A blending of on-campus and on-line components has been found to encourage higher order thinking and offer experiential learning (Rehfuss, Kirk-Jenkins, & Milliken, 2015). The flipped classroom pedagogical model offers one potential way for educators to create an environment that facilitates the learning needed and recommended. This study altered a class to the flipped …

Bridgewater State University Factbook, 2018-2019, Office Of Institutional Research, Bridgewater State University

Factbook

No abstract provided.

Common Data Set, 2019-2020, Office Of Institutional Research, Bridgewater State University

Common Data Sets

No abstract provided.

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Integrated Engineering Department Publications

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

Report From The Stem 2026 Workshop On Assessment, Evaluation, And Accreditation, Rebecca Bates, Angela Arnold, Cary Komoto, Peggy Brickman, R. Alan Cheville, Elizabeth Longley, Jose Mestre, Mihaela Sabin, James Warnock

Reports

A gathering of science, technology, engineering, and math (STEM) higher education stakeholders met in November 2018 to consider the relationship between innovation in education and assessment. When we talk about assessment in higher education, it is inextricably linked to both evaluation and accreditation, so all three were considered. The first question we asked was can we build a nation of learners? This starts with considering the student, first and foremost. As educators, this is a foundation of our exploration and makes our values transparent. As educators, how do we know we are having an impact? As members and implementers of …

What Prompts College Students To Participate In Online Surveys?, Kunsoon Park, Narang Park, Wookjae Heo, Kim Gustafson

Consumer Sciences Faculty Publications

Online surveys are frequently used in higher education to collect students’ opinions. This study investigated the factors associated with students’ willingness to respond to online surveys. Using 540 samples from undergraduate and graduate students in the United States, this study conducted a factor analysis to categorize the reasons that students willingly participate in online surveys. Four factors were identified: Format, Affiliation, Content, and Contact. The regression analysis revealed format was significantly associated with the undergraduate students’ online survey participation, while content was significantly related to the graduate students’ online survey participation. These findings indicate the behavior of responding to online …

Factors Contributing To Student Retention In Online Learning And Recommended Strategies For Improvement: A Systematic Literature Review, Pauline S. Muljana, Tian Luo

STEMPS Faculty Publications

Aim/Purpose

This systematic literature review investigates the underlying factors that influence the gap between the popularity of online learning and its completion rate. The review scope within this paper includes an observation of possible causal aspects within the non-ideal completion rates in online learning environments and an identification of recommended strategies to increase retention rates.

Background

While online learning is increasingly popular, and the number of online students is steadily growing, student retention rates are significantly lower than those in the traditional environment. Despite the multitude of studies, many institutions are still searching for solutions for this matter.

Methodology

A …

Perceptions Of Assessment In Norwegian Occupational Therapy Students, Tore Bonsaksen, Astrid Gramstad, Gry Mørk, Susanne G. Johnson

Journal of Occupational Therapy Education

In addition to securing minimum standards of learning among students, assessment is increasingly used as a tool to improve students’ learning. Assessment quality is measured as part of the Course Experience Questionnaire; however, the original ‘appropriate assessment’ scale has demonstrated ambiguous psychometric properties. The current study aimed to gain knowledge about occupational therapy students’ perceptions of assessment, and this was achieved by examining the factor structure and internal consistency of the six items on the ‘appropriate assessment’ scale. Students from six Norwegian universities (n = 187, response rate 61.3 %) completed the scale and reported demographic information. The factor …

Technology-Enhanced Pre-Instructional Peer Assessment: Exploring Students' Perceptions In A Statistical Methods Course, Yosep Dwi Kristanto

REID (Research and Evaluation in Education)

There has been strong interest among higher education institution in implementing technology-enhanced peer assessment as a tool for enhancing students' learning. However, little is known on how to use the peer assessment system in pre-instructional activities. This study aims to explore how technology-enhanced peer assessment can be embedded into pre-instructional activities to enhance students' learning. Therefore, the present study was an explorative descriptive study that used the qualitative approach to attain the research aim. This study used a questionnaire, students' reflections, and interview in collecting student's perceptions toward the interventions. The results suggest that the technology-enhanced pre-instructional peer assessment helps …

The Japan University Experience Survey (Jues), Darren Matthews, Leyna Clarke

Higher education research

An overview of the Japan University Experience Survey (JUES) including its background and aims, and the ACER - Kawaijuku Group partnership. The presentation discusses the development, delivery, reporting and results of the survey, and considers Japanese and Australian UES/SES comparisons and the potential for benchmarking.

(In)Visible Men On Campus: Campus Racial Climate And Subversive Black Masculinities At A Predominantly White Liberal Arts University, Quaylan Allen

Education Faculty Articles and Research

There is an emerging body of literature examining the academic success of Black men attending predominantly White colleges and universities, though less is known about Black college men’s experiences at liberal arts institutions. In this paper, I draw upon semi-structured and photovoice interview data from a study on Black male college students attending a predominantly White liberal arts institution in the USA. Specifically, I will present narrative and visual data of how Black college men perceive the campus racial climate and make sense of their (in)visibility at the university. Drawing upon poststructuralist theories of gender and critical race theory, I …

Assessment Of University Support Services For Regional And Remote Students On Transition To University: Final Report, Darren Matthews, Gina Milgate, Leyna Clarke

Higher education research

This report details the development and piloting of an Assessment of university support services for regional and remote students on transition to university. The project forms part of the Australian Government’s response to the Independent Review into Regional, Rural and Remote Education led by Emeritus Professor John Halsey. In its recommendations, the Review highlighted how critical it is to “Support RRR [regional, rural and remote] students to make successful transitions from school to university, training, employment and combinations of them”. In relation to this recommendation, this project is designed to support the Australian Government’s response to the Halsey Review by …

Surviving And Thriving At A University In The United Kingdom, Roxanne S. Duvivier, Gina Oswald, Lindsey Steller, Kate Bumhoffer

Human Services Faculty Publications

While considerable research on college student surviving and thriving has been conducted in the United States, fewer studies exist that examine these phenomenon multinationally. This mixed methods study, conducted at a large multi-campus university in the United Kingdom, examines factors purported to contribute to college student retention and engagement in a British context. Data were collected and analysed in the five theme categories of belonging, student support services, academic engagement, decision-making and resilience. Significant differences were found in student engagement by metropolitan vs. suburban campus, and in levels of engagement in academic and student life by gender.

Development Of A Tool To Assess Students’ Conceptual Understanding In Introductory Statistics, Nathan L. Tintle, Jill Vander Stoep

Faculty Work Comprehensive List

Few tools exist to assess students’ conceptual understanding in post-secondary, introductory statistics courses. The CAOS test is widely considered to be the gold standard, but was first published in 2007 and does not necessarily reflect some of the changes in student learning at the secondary level. Furthermore, it may not be sensitive enough to measure student conceptual understanding in modern post-secondary statistics courses (e.g., simulation-based inference). In this paper we will describe the process of developing a new instrument which uses some CAOS items, as well as additional new items to improve validity and reliability. We will share the validity …

The Industrial Revolution Of Higher Education, Adriel Adon Hilton, Kevin Mcclain, Donavan L. Outten

Journal of Research Initiatives

For generations, higher education has accommodated its scholars through analog forms of instruction akin to blackboards and textbooks. As society blossomed into a globalized marketplace with information readily available at the stroke of a button, higher education has had to meet the needs of an evolving student population. Through the use of business models like Six Sigma, higher education has attempted to adapt and keep up with the times. This article will highlight the key impacts Six Sigma has had on higher education and supplementary improvements needed within the marketplace.

Designing Rubrics For Authentic Assessment, Kathryn Richardson, Anne-Marie Chase

Initial Teacher education

This presentation looks at the steps in developing authentic rubrics, from determining the constructs that will be assessed; breaking down the constructs into a set of broad capabilities that need to be observed; transferring capabilities into indicative behaviours (indicators or criteria); and determining the different levels of proficiency.

In Pursuit Of Transformative Learning: Exploring The Stimulation Of Curiosity Through Critical Reflection In The College Classroom, Bo Y. Bae

Dissertations

Educators in higher education are faced with growing pressures to shift pedagogical practices in order to accommodate the growing population of learners and improve student learning outcomes. While the acquisition of knowledge and skills are important to the learning process, they are insufficient in preparing students to function in rapidly changing environments. Curiosity is a vital component in the learning process that, when stimulated, has the potential to increase students’ capacity to think critically. Implementing teaching practices that intentionally focus on how curiosity can be stimulated and enhanced develops students’ abilities to access higher levels of thinking that are essential …

Aligning To Extend Resource Capacities And Enhance Students' Acquisition Of Social And Cultural Capital, Michelle Maloney, Allison Dumas

Pacific's Annual Assessment Conference

No abstract provided.

Getting To Square One: Managing Cognitive Load, Eleanor Wittrup

Pacific's Annual Assessment Conference

No abstract provided.

Integrated Leadership And Critical Thinking Assessment Study, Tarianne Goteli Cotton, Sandra Mahoney

Pacific's Annual Assessment Conference

No abstract provided.

A Longitudinal Study Of Pacific Students' Alcohol And Other Drug Use: Using Data To Inform Prevention And Intervention Strategies, Heather Dunn Carlton

Pacific's Annual Assessment Conference

No abstract provided.

Tiger Pathways Creating A Cohort Experience To Support First Year Students, Anne Eastlick, Jesus Margarito

Pacific's Annual Assessment Conference

No abstract provided.

What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston

Pacific's Annual Assessment Conference

University of the Pacific’s Stockton Campus Library is currently in the process of a multi-phase renovation that will offer 21st century design and functionality. Our team conducted several assessment methods to understand more fully how our students use –or choose not to use—study spaces and various pieces of furniture in the Stockton library. The results of this project will help answer the questions: “What do our students want or need in library learning spaces – both academic and social?” and “How might we create learning spaces in the library that will enable a variety of student use preferences?” We have …

What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston

University Libraries Librarian and Staff Presentations

University of the Pacific’s Stockton Campus Library is currently in the process of a multi-phase renovation that will offer 21st century design and functionality. Our team conducted several assessment methods to understand more fully how our students use –or choose not to use—study spaces and various pieces of furniture in the Stockton library. The results of this project will help answer the questions: “What do our students want or need in library learning spaces – both academic and social?” and “How might we create learning spaces in the library that will enable a variety of student use preferences?” We have …