Educational Assessment, Evaluation, and Research Commons^™

Happiness And Healthiness: A Replication Study, Kobena Osam, Brad Shuck, Jason Immekus

Faculty and Staff Scholarship

Research coalescing around psychological climate, engagement, and well-being has been receiving considerable attention in management and human resource development (HRD) literature. However, research associated with these variables has generally been limited to for-profit businesses and organizations with little attention within the context of institutions of higher education. In response, this cross-sectional replication study examined the extent to which psychological climate, engagement, and well-being were associated with each other in higher educational institutions. Study data included a sample of 259 individuals employed by institutions of higher education in the United States. Using mediation analyses, the study found that psychological climate, engagement, …

Examining The Pedagogical Practices Of Business Faculty: A Qualitative Analysis To Inform Library Support, Ashley Ireland, Dana Statton Thompson, Brian Bourke

Faculty & Staff Research and Creative Activity

During the 2018-2019 academic year, the Murray State University Libraries conducted a study to examine the pedagogical practices of business instructors who teach undergraduates at Murray State University. The study was part of a larger suite of parallel studies of business instructors at higher education institutions in the United States and was coordinated by Ithaka S+R, a non-profit organization that provides research and strategic guidance to help libraries navigate economic and technological change. Participating institutions, including Baruch College (CUNY), Bowling Green State University, Georgia Tech, Grand Valley State University, Kansas State University, Michigan Technological University, Murray State University, North Carolina …

Learning From Incidents To Reduce The Risk Of Drowning In Swimming Pools: Implementation Of Experience-Based Feedback Regarding Near-Misses In Four Public Facilities In France, Élie Vignac, Pascal Lebihain, Bastien Soulé

International Journal of Aquatic Research and Education

The prevention of sports accidents must rely on a detailed knowledge of accident circumstances and risk factors. Today, very few studies have investigated in depth non-fatal drowning incidents that have occurred in public swimming pools (PSP). Learning from incidents seems likely to advance the knowledge of accident scenarios. This research study aimed to capture minor incidents that might identify safety lessons and preventive measures. Incidents of minor and major aquatic events were collected from four PSPs that had hosted 700,000 bathers per year. About 800 incidents and 300 aquatic rescues performed by lifeguards were recorded within a time frame of …

The Nuclear Environment Of The Nls1 Mrk 335: Obscuration Of The X-Ray Line Emission By A Variable Outflow, Dirk Grupe

Faculty Research at Morehead State University

We present XMM–Newton, NuSTAR, Swift, and Hubble Space Telescope observations of the Narrow-line Seyfert 1 galaxy Mrk 335 in a protracted low state in 2018 and 2019. The X-ray flux is at the lowest level so far observed, and the extremely low continuum flux reveals a host of soft X-ray emission lines from photoionized gas. The simultaneous UV flux drop suggests that the variability is intrinsic to the source, and we confirm this with broad-band X-ray spectroscopy. The dominance of the soft X-ray lines at low energies and distant reflection at high energies, is therefore due to the respective emission …

Three Propositions On The Education In Programming Languages, Euijin Kim

Faculty Research at Morehead State University

In the age of Big Data and artificial intelligence, programming languages are important for college students because the knowledge of programming can help them understand the modern technologies and make better decisions about the technologies. Nonetheless, programming language courses are not popular among college students. To attract more students, several suggestions have been made such as computational thinking (Wing, 2006) or application of the concept with easy programming approaches(Lye & Koh, 2014). These approaches, however, overlook the nature of programming (e.g., programming is about understanding computers). In this paper, a straight approach with three propositions on the education in programming …

Factors Influencing Disciplinary Committee Effectiveness: The Case Of Public Secondary Schools In Ondo State, Nigeria, Akindele Matthew Ige

Journal of Research Initiatives

This study investigated the factors influencing the effectiveness of the Disciplinary Committee in schools, using Public Secondary Schools in Ondo State, Nigeria. Descriptive-survey design was adopted. The 304 Public Secondary Schools in the state were the main population while Principals and Vice-Principals of the schools were targets. Multistage, stratified, and simple-random sampling techniques were adopted to select 40 secondary schools for the study. Three questions and three hypotheses guided this study. A questionnaire, validated, and tested for reliability(r-0.85), and structured on 4-point Likert Scale, was used to collect data, which were analyzed using frequency distribution table, mean, and SPSS package. …

Measuring The Value Of Professional Indexing, Philip Hider, Pru Mitchell, Robert Parkes

Information Management

This study provides both a quantitative estimate and qualitative analysis of the additional ‘retrieval power’ that professionally assigned subject indexing affords users of a typical database in the field of education. A full version of Informit’s A+ Education database and one stripped of its subject indexing were searched by four research assistants tasked with compiling exhaustive bibliographies on forty-eight topics. The searchers were then surveyed about their use of the two databases, while their bibliographies and search logs were also examined. A two-way ANOVA model was constructed to estimate the percentage of additional resources found by the searchers on the …

Insights From Alumni: A Grounded Theory Study Of A Graduate Program In Sustainability Leadership, Heather Burns, Megan Schneider

Educational Leadership and Policy Faculty Publications and Presentations

This grounded theory action research study examines the impact of a graduate sustainability leadership program through the lens of its alumni. The study reveals elements of the leadership program that had the most impact on the lives and careers of its alumni, as well as suggestions for how the program could better prepare students in the future. This study finds that impactful sustainability leadership programs might incorporate opportunities for: paradigm and perspective shifts; a culture of support and care; holistic personal growth and development; experiential community-based learning opportunities; and leadership tools and skills that students can practice and use. This …

Class Matters: School Affluence And Other Predictors Of Attainment For Wealthy And Poor Students, Alison Brockhouse

Dissertations, Theses, and Capstone Projects

Public schools in the United States are becoming increasingly segregated by socioeconomic status. Though the educational consequences of socioeconomic segregation are well researched, segregation is often ignored or exacerbated by education reform. To learn more about the wider implications of socioeconomic segregation, this study utilizes theoretical frameworks derived from Max Weber’s theory of social stratification to analyze over 10,000 students’ experiences from the National Center for Education Statistics (NCES) Education Longitudinal Study (ELS) 2002, 2004, and 2012 waves of data collection. More specifically, this research explores the impact of attending an affluent high school on long-term educational attainment. It finds …

Co-Design Of An Orchestration Tool: Supporting Engineering Teaching Assistants As They Facilitate Collaborative Learning., Luettamae Lawrence, Emma Mercier

Instructional Technology and Learning Sciences Faculty Publications

This paper describes a design-based implementation research (DBIR) project, focused on the co-design and implementation of an orchestration tool for teaching assistants (TAs) in required engineering classes. Building on our collaboration with the engineering department, we identified a need for a tool that provides insight into groups to help TAs intervene in realtime. This paper presents two phases of our iterative co-design process. The first phase includes the initial design of the tool from design workshops with TAs. The second phase focuses on a 16-week implementation of the orchestration tool and reports on interviews with TAs to understand how they …

Teachers' Perceptions Regarding Reaching Struggling Learners In An Elementary School Mathematics Classroom, Colleen Kelleher

All Theses And Dissertations

Elementary school is a critical educational period during which students develop early mathematics skills and build a foundation for future academic success. The purpose of this study was to document the instructional practices and interventions teachers use to identify and meet the needs of struggling learners in a K-3 mathematics classroom. Specific areas of focus included how K-3 teachers identify areas of need and plan for interventions, the resources they rely on in that process, and their own self-efficacy regarding addressing students’ specific needs. Results from online surveys and semi-structured, one-on-one interviews indicated that teachers identify a range of student …

The Impact Of Pbl As A Stem School Reform Model, Michael R. L. Odell, Teresa J. Kennedy, Eric Stocks

Interdisciplinary Journal of Problem-Based Learning

Project/problem-based learning (PBL) can provide an effective model for school reform when implemented with fidelity. In the report, Rising Above the Gathering Storm, it was recommended that if the U.S. is to remain competitive in the 21st-century economy, there must be a serious effort to “enlarge the pipeline of students who are prepared to enter college and graduate with a degree in STEM” (National Academy of Sciences, National Academy of Engineering, & Institute of Medicine, 2007, p. 6). The report included the recommendation that states develop statewide specialty STEM high schools (National Academy of Sciences, National Academy of Engineering, …

Recursive Reflective Reports: Embedded Assessment In Pbl Courses For Second Language Teacher Education, Cynthia A. Caswell

Interdisciplinary Journal of Problem-Based Learning

This conceptual article begins with a general definition of reflection and the soft skills of PBL: collaboration, agency, and metacognition. Then it presents theoretical frameworks for reflection from second language teacher education (SLTE) (Farrell, 2015; Pennington & Richards, 2016) and illustrates six types of reflection with examples from the field of SLTE. The article features a reflective self- and peer-assessment instrument, utilized in a graduate SLTE program. The standard yet flexible template of the reflective teaching report (RTR) allows these teacher educators to interact with their students’ development in the soft skills and the content of the SLTE knowledge base. …

Performance Assessment Practice As Professional Learning, Vanessa Svihla, Tim Kubik, Tori Stevens-Shauger

Interdisciplinary Journal of Problem-Based Learning

While performance assessment (PA) is well aligned to project-based learning (PjBL), teachers find it challenging to design and implement PA that is faithful to the authentic context of their projects and viewed externally as rigorous. In contrast to standardizing PA tasks — thereby diminishing authenticity — we formed a research-practice partnership (Coburn, Penuel, & Geil, 2013) that developed and used a “shell” to guide teachers in planning, implementing, and engaging in rigorous dialogues that evaluate and elevate PA practice across four PjBL schools. Drawing from analysis of artifacts and audio-recorded professional development sessions, we highlight how the effort to standardize …

A Teacher’S Perspective: Valued Leadership Behaviors As Related To Preferences In School Culture And Professional Motivation, Jeremy R. Philips

Dissertations

Schools need effective leaders to embrace the many challenges of today’s school systems and to adequately prepare students for the 21st century (Bayar, 2016; Coggins & Diffenbaugh, 2013). Bartoletti and Connelly (2013) asserted, “Great schools do not exist apart from great leaders” (p. 1). The last few years have provided volumes of highquality research confirming leadership matters (Bartoletti & Connelly, 2013). The purpose of this study was to examine the relationship among the following variables: teachers’ perceptions of what they value in leadership behaviors (consideration and initiating structure), what they value in a school’s culture, and what they find professionally …

Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond

Journal of Media Literacy Education

The ability to critically access, analyze, evaluate, and create media messages is crucial in the process of becoming an informed and engaged citizen throughout life. Asking critical questions is not only a valuable dimension of media literacy, but also an indispensable aspect of participating in a democracy. Yet, measuring the effectiveness of media literacy is still a major challenge for the field. It is unclear to what extent people of all ages may engage in critical questioning habits with regards to media. To address this gap, we studied the changes in critical questioning habits for college-aged students enrolled in media …

Creating Global Citizens Through Returnee Programming, Kristen Foos

Capstone Collection

The purpose of study abroad is to facilitate students’ journey to global citizenship and a large part in doing this is having effective returnee programming. This research focused on what type of program models best facilitate this goal and are of interest to students at Washington State University (WSU). To answer this question, 12 WSU peer advisors, 4 global learning advisors at WSU, and 5 global learning advisors at other institutions were all interviewed. Along with that, a survey was sent out to all WSU student who had studied abroad within the past year. The results demonstrated that when WSU …

Tools Enabling A Student Who Is Blind In A Liberal Arts Chemistry Laboratory Course, Jessica Michael, H. David Wohlers

Journal of Science Education for Students with Disabilities

Chemistry laboratories ordinarily involve a number of visual observations and require qualitative and quantitative explanations of these observations. A student with blindness at Truman State University successfully completed the laboratory portion of the nonmajors liberal arts chemistry course with the assistance of a senior undergraduate chemistry education major, the guidance of a chemistry professor with blindness, and a variety of alternative laboratory methods. Volumes were measured using a notched syringe or the graduated cylinder pipet technique. Changes in color were measured by a Color Analysis Laboratory Sensor (CALS) and a Submersible Audio Light Sensor (SALS). Balance and Vernier probe measurements …

Stem Opportunities - High School 2019, Huey-Xian Kelly Wong, Madeleine Rauhauser, Annie Morgan Nelson

Honors Program: Expanded Learning Clubs

This publication details the lesson plan for the “Opportunities in STEM” club for the summer of 2019. This club began out of a desire to educate high school students about the opportunities and careers available in the science, technology, engineering, and mathematics fields. Often, students feel that the prospect of entering a STEM field is daunting and out of their grasp. What it means to be a scientist is often unclear, and students never consider opportunities out of the fear of the unknown, particularly when science is associated with complexity and difficulty. This lesson plan integrates experiments with a wealth …

Assessment Of Climate Science Knowledge And Perceptions Of Deaf And Hard-Of-Hearing Students, Annemarie Ross, Kyle Edenzon, Susan Smith Pagano, Randy Yerrick, Todd Pagano

Journal of Science Education for Students with Disabilities

Curricula related to sustainability and climate science are being integrated into academic science courses and programs. We set out to assess the knowledge of some of these environmental concepts among a group of Deaf/Hard-of-Hearing (D/d/HH) postsecondary students. A survey that attempted to gauge student understanding and perceptions of climate science was developed, administered to D/d/HH and hearing college students, and analyzed. Preliminary results showed that there could be some gaps in related knowledge among the D/d/HH group. Rasch analysis was then used to assess the quality of the survey for the intended outcomes and improved iterations of the survey were …

Wcag 2.1 Meets Stem: Application, Interpretation, And Opportunities For Further Standard Development, Jason White

Journal of Science Education for Students with Disabilities

This paper offers an overview of changes introduced in the recent Web Content Accessibility Guidelines (WCAG) 2.1 standard that have implications for the accessibility of content in science, technology, engineering and mathematics (STEM) disciplines. In reviewing new provisions of WCAG 2.1, interpretive questions are raised regarding their application to mathematical and scientific materials. The paper is concluded with a brief discussion of opportunities for further enhancing accessibility of STEM materials in future revisions of the Guidelines.

Variations In Implementation Of Specifications Grading In Stem Courses, Mai Yin Tsoi, Mary E. Anzovino, Amy H. Lin Erickson, Edward R. Forringer, Emily Henary, Angela Lively, Michael S. Morton, Karen Perell-Gerson, Stan Perrine, Omar Villanueva, Marygeorge Whitney, Cynthia M. Woodbridge

Georgia Journal of Science

Specifications grading is an assessment strategy based on mastery learning, clear learning objectives, and frequent evaluations and feedback. Twelve instructors at a southeastern four-year public college implemented the specifications grading method across eight discrete courses in four STEM areas. In this modified assessment strategy, the students controlled their grades through multiple attempts, with limitations, on assessments of course objectives. The instructors designed and executed specifications grading in unique ways that aligned with their content areas, teaching beliefs, and individual teaching styles.

Preliminary observations suggest that, regardless of subject area, specifications grading can be used as an alternative to traditional assessment …

Assessing Computational Thinking, Daniel Duckworth

2009 - 2019 ACER Research Conferences

This paper provides some context for the role of computation thinking (CT) in the Australian Curriculum, an abridged literature review of CT as a problem-solving framework from the International Computer and Information Literacy Study (ICILS) 2018 assessment framework and some examples of how CT has been used to solve real-world problems. Finally, this paper presents ways to teach and assess CT.

What Can Early Childhood Education And Care Settings Teach Us About Skills For The 21st Century?, Dan Cloney, Kellie Picker

2009 - 2019 ACER Research Conferences

Early childhood education and care (ECEC) settings are naturally oriented towards promoting 21st century skills. This can be seen in Australia, where learning is defined as the development of identity, social and emotional skills, problem-solving, and communication skills. A 21st century orientation is also seen in the playbased pedagogies implemented in ECEC settings. A gap, however, exists in the ability of the ECEC sector to communicate its successes. This gap relates to the lack of measurement tools to quantify the quality of the adult–child interactions in ECEC settings, and children’s growth in these 21 century skills and abilities. This paper …

Key Skills For The 21st Century: An Evidence-Based Review, Esther Doecke, Quentin Maire

2009 - 2019 ACER Research Conferences

It is vital that education systems deliver quality outcomes for all young people and prepare them well for their future in the economy and society. To do so, many systems have traditionally had a strong focus on developing academic skills, particularly in literacy and numeracy. In recent years, education systems have developed greater expectations that schools will also equip young people with a broader set of skills for the 21st century (e.g. creativity, critical thinking, problem-solving). This paper addresses these developments and the challenges they present. Building on an evidence-based review, this paper asks what are the key skills required …

Assessment In The Interpersonal Domain: Experiences From Empathy Assessment In Medical Education, Neville Chiavaroli

2009 - 2019 ACER Research Conferences

Frameworks for the teaching and assessment of 21st-century skills commonly recognise the importance of learning and skill development in the interpersonal domain. They also usually acknowledge the challenge of reliably and validly assessing students in this domain. In the field of medical education and in selecting students for medical courses, the concept of empathy has become central to representing the particular interpersonal understandings and skills expected of students and practising doctors. Attempts to assess these attributes during medical training are just as challenging as in school contexts. This presentation draws on several years’ experience of working with medical educators to …

Digital Literacy: Myths And Realities, Julian Fraillon

2009 - 2019 ACER Research Conferences

Digital literacy, under a wide variety of names, is routinely classified as a 21st-century skill and is frequently reported as an area of high priority in school education systems internationally. In comparison with students in other countries, Australian students have high levels of access to digital technologies both at and outside of school. With this access comes the expectations that students will be highly-proficient users of digital technologies and that schools will use digital technologies in transformative ways to support student learning. This session will examine how concepts of digital literacy have developed over time, what data from large-scale assessments …

Assessing And Understanding Social And Emotional Skills: The Oecd Study On Social And Emotional Skills, Sue Thomson

2009 - 2019 ACER Research Conferences

In an increasingly fast-changing and diverse world, the importance of developing social and emotional skills is becoming more evident. The large body of accumulated evidence shows that these skills have strong relationships with life outcomes and they have been referred to as a key component of 21st century skills. The Organisation for Economic Co-operation and Development (OECD) Study on Social and Emotional Skills is a new international assessment of these skills in students at primary and secondary schools. This study also gathers information on students’ families, schools and community learning contexts, aiming to provide information about the conditions or practices …

Teaching And Assessing The General Capabilities In A Secondary School Context, Loren Clarke, Melissa Hughes

2009 - 2019 ACER Research Conferences

Education researchers, policymakers and private enterprise agree that, in addition to content knowledge, students in the 21st century need to acquire particular skills to equip them for active citizenship in the modern world. This is a real challenge for teachers today: how do they teach and assess the skills needed to live and work in the 21st century? This paper will explore the development of Eltham High School’s focus on teaching and assessment of collaboration, problem-solving, and critical thinking over the past seven years. It will explore the development of the assessment program, its connection to the school and state …

Using Learning Analytics To Measure 21st-Century Skills, Dragan Gašević

2009 - 2019 ACER Research Conferences

The unprecedented opportunities to collect data about learning and contexts in which learning occurs has attracted great attention in education. The use of data analytics and machine learning methods have offered much potential to address many relevant questions in education. This talk will focus on the use of learning analytics to measure 21st-century skills in education and outline the types of data commonly used. It will also discuss approaches that are used for analysis and modelling of relevant learning processes and outline the ways in which learning analytics can be used to track learning progression and how the validity of …