Educational Assessment, Evaluation, and Research Commons^™

Multiple True–False Questions Reveal The Limits Of The Multiple-Choice Format For Detecting Students With Incomplete Understandings, Brian A. Couch, Joanna K. Hubbard, Chad E. Brassil

School of Biological Sciences: Faculty Publications

By having students select one answer among several plausible options, multiple-choice (MC) questions capture a student’s preferred answer but provide little information regarding a student’s thinking on the remaining options. We conducted a crossover design experiment in which similar groups of introductory biology students were assigned verbatim questions in the MC format or multiple true–false (MTF) format, which requires students to separately evaluate each option as either true or false. Our data reveal that nearly half of the students who select the correct MC answer likely hold incorrect understandings of the other options and that the selection rates for individual …

Breaking The Language Barrier: Equitable Assessment In General Chemistry, Eshani Lee

UNLV Theses, Dissertations, Professional Papers, and Capstones

Because language provides the framework through which knowledge is constructed, it is crucial to consider the ways in which students with limited English proficiencies are able to express their understanding. English language learners (ELLs) make up a significant portion of the student body in the education system and represent many ethnic and racial minorities in STEM (Science, Technology, Engineering & Mathematics) fields (Burke & Mattis, 2007). Despite the national push to build a more diversified, STEM-ready workforce, there is little research that considers the way ELLs are assessed in STEM courses at the postsecondary level. Literature reports that science tests …

Does The Test Work? Evaluating A Web-Based Language Placement Test, Avizia Long, Sun-Young Shin, Kimberly Geeslin, Erik Willis

Faculty Publications

In response to the need for examples of test validation from which everyday language programs can benefit, this paper reports on a study that used Bachman’s (2005) assessment use argument (AUA) framework to examine evidence to support claims made about the intended interpretations and uses of scores based on a new web-based Spanish language placement test. The test, which consisted of 100 items distributed across five item types (sound discrimination, grammar, listening comprehension, reading comprehension, and vocabulary), was tested with 2,201 incoming first-year and transfer students at a large, Midwestern public university. Analyses of internal consistency and validity revealed the …

Empowering Students To Perform An Enhanced Role In The Assessment Process: Possibilities And Challenges, Paul Dervan

Articles

Assessment is key to student learning. This paper examines the case for increased participation by higher education students in the assessment process to deepen learning and improve learner motivation. While increased student participation may not solve all problems relating to assessment, a review of the literature dealing with enhancing the role of students in the assessment process, and original research conducted amongst academics and students at the author's institution, suggests improvements can be made leading to increased student satisfaction, motivation and competency. This paper therefore argues for change in the approach to assessment by empowering students to become partners in …

2017-2018 Continuous Improvement, Southwestern Oklahoma State University

Assessment Center Reports

The 2017-2018 Continuous Improvement report produced by the SWOSU Assessment Center

Listening To Our Graduate Students' Feedback: Graduate Student Exit And Alumni Surveys, Alison W. Hong-Novotney

Cal Poly Humboldt theses and projects

Student and alumni surveys have become some of the most widely-used methods of assessment of student learning in higher education. While the majority of literature on student surveys and assessment focuses on undergraduate students, this study looks specifically at why graduate student exit and alumni surveys can be valuable tools within a comprehensive assessment plan. Listening to the feedback of current and former graduate students, and then acting upon that feedback, is crucial for the engagement and success of this unique population of students who bring their particular strengths and needs to their educational experiences. This study examined how master’s …

Coupling K-12 Music Education With Science, Technology, Engineering And Math (Stem) Curricula: Implementation Of A Stemusic Outreach Program, Mallory Maestri

Civil Engineering Undergraduate Honors Theses

Many studies have investigated the effects of music on evoking human emotions and diverse types of brain responses. One study by Juslin and Vastfjall indicates that hearing music can stimulate brain stem reflexes, create emotional contagion, recall episodic memories and provoke visual imagery. Due to the influence music has on human brain waves, researchers have been studying the effect of music on enhancing the spatial abilities of young students. Science, Technology, Engineering and Math (STEM) professions rely heavily on spatial skills. Research on the connection of music with spatial skills proposes that when the brain processes rhythm a “mental rotation” …

Lifting Achievement Levels And Improving The Return On Australia’S Investment In Schooling : Submission To The Review To Achieve Educational Excellence In Australian Schools (Chair: Mr David Gonski), Australian Council For Educational Research (Acer)

Program monitoring and evaluation

Many students in our schools are not learning as well as they could because they are not being given learning opportunities at an appropriate level of challenge. Instead, students are grouped by year level (age) and teachers deliver curricula assumed to be appropriate for all students in the same year of school. However, the most advanced ten per cent of students in any year of school are five to six years ahead of the least advanced ten per cent. For less advanced students, the year-level curriculum is often too far ahead. Many are judged to be underperforming year after year, …

Future Goals And Actions Of Faculty Development, Catherine Haras, Margery Ginsberg, Eva Fernández, Emily Daniell Magruder

Publications and Research

No abstract provided.

Institutional Investment In Teaching Excellence, Steven C. Taylor, Catherine Haras, Emily Daniell Magruder, Eva Fernández, Margery Ginsberg, Jake Glover

Publications and Research

No abstract provided.

Introduction: History And Conceptual Basis Of Assessment In Higher Education, Peter Ewell, Tammie Cumming

Publications and Research

Assessment and accountability are now inescapable features of the landscape of higher education, and ensuring that these assessments are psychometrically sound has become a high priority for accrediting agencies and therefore also for higher education institutions. Bringing together the higher education assessment literature with the psychometric literature, this book focuses on how to practice sound assessment.

This volume provides comprehensive and detailed descriptions of tools for and approaches to assessing student learning outcomes in higher education. The book is guided by the core purpose of assessment, which is to enable faculty, administrators, and student affairs professionals with the information they …

Universal Design For Learning: A New Clinical Practice Assessment Tool Toward Creating Access And Equity For All Students, Diane Fogarty

LMU Theses and Dissertations

To examine to what extent current general education pre-service teachers within a teacher preparation program at a private institution of higher education know and understand the principles of Universal Design for Learning (UDL), expert focus groups were conducted. General education program syllabi were examined for UDL content and found to be lacking in such content. General education pre-service teachers videotaped lessons were reviewed for UDL content and were also found to be inadequate in demonstrating knowledge and understanding of Universal Design for Learning principles. Focus groups comprised of university fieldwork instructors and teacher education experts were asked to review and …

Design And Assessment Of Deep And Active Learning In Science, Technology, Engineering, And Mathematics (Stem) Education, Juhong Christie Liu Ph.D., Elizabeth Johnson Ph.D., Jin Joy Mao Ph.D.

Libraries

This presentation draws academic significance from a focused literature review and initial data for learning design in Science, Technology, Engineering, and Mathematics (STEM) education. The presenters will discuss strategies of fostering deep, active learning, alignment with assessment, and development of assessment instruments and methods. The presenters will share the design and development of an assessment kit to measure learning outcomes that matter in the 21st century STEM education. Through shared evidence and interactive reflection, the audience will take away up-to-date design strategies for deep and active learning as well as assessment in STEM education. The project is sponsored by National …

Assessment Online: Informing Teaching And Learning, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Online assessments are capable of providing significantly improved feedback to teaching and learning. Experience in schools is demonstrating the potential of online assessment – provided the foundations are right.

Using Concept Maps To Monitor Knowledge Structure Changes In A Science Classroom, Leah J. Cook

Dissertations

The aim of this research is to determine what differences may exist in students’ structural knowledge while using a variety of concept mapping assessments. A concept map can be used as an assessment which connects concepts in a knowledge domain. A single assessment may not be powerful enough to establish how students’ new knowledge relates to prior knowledge. More research is needed to establish how various aspects of the concept mapping task influence the output of map creation by students. Using multiple concept maps and pre-instruction and postinstruction VNOS instruments during a 16-week semester, this study was designed to investigate …

What Impacts Do Oer Have On Students? Students Share Their Experiences With A Health Psychology Oer At New York City College Of Technology, Cailean Cooney

Publications and Research

This article reports findings from a study conducted with students in three sections of a Health Psychology course that replaced a traditional textbook with open educational resources (OER) as the primary course material. The purpose of the study was to learn how OER impacted students. Data were collected in Fall 2015 with students from New York City College of Technology (City Tech), of the City University of New York (CUNY), a comprehensive college located in Brooklyn. Students were assigned the OER by their course instructor, who developed it as part of a library funded OER pilot initiative. Two research instruments …

Stitching Codeable Circuits: High School Students' Learning About Circuitry And Coding With Electronic Textiles, Breanne Krystine Litts, Yasmin B. Kafai, Debora A. Lui, Justice T. Walker, Sari A. Widman

Instructional Technology and Learning Sciences Faculty Publications

Learning about circuitry by connecting a battery, light bulb, and wires is a common activity in many science classrooms. In this paper, we expand students’ learning about circuitry with electronic textiles, which use conductive thread instead of wires and sewable LEDs instead of lightbulbs, by integrating programming sensor inputs and light outputs and examining how the two domains interact.We implemented an electronic textiles unit with 23 high school students ages 16–17 years who learned how to craft and code circuits with the LilyPad Arduino, an electronic textile construction kit. Our analyses not only confirm significant increases in students’ understanding of …

Argument Education In Higher Education: A Validation Study, Paul E. Mabrey Iii

Dissertations, 2014-2019

Argument education can play an important role in higher education for leadership development and responding to increasing calls for post-secondary accountability. But to do so, argumentation teachers, scholars, and practitioners need to develop a clearer definition and research agenda for the purposes of teaching and assessing argumentation. The research conducted here contributes to this project by first establishing a definitional construct and observable behaviors associated with learning and practicing argumentation. Second, an argument education assessment instrument was created based off of the literature-supported definition of argumentation. Third, debate and argument education subject matter experts reviewed the definition, behaviors, and assessment …

The Consequential Validity Of The M-Step And Third-Grade Retention, Michelle L. Sprouse

Language Arts Journal of Michigan

This paper applies Slomp, Corrigan, and Sugimoto’s (2014) consequential validity framework to the third-grade Michigan Student Test of Educational Progress (M-STEP) in English language arts (ELA). Slomp et al.’s (2014) consequential validity framework provides for a holistic examination of the validity of the assessment and its consequences. Using this framework, this paper considers the construct of reading developed in the adopted standards, assessment design, sample assessment items, disaggregated performance data, and the assessment consequences. The number and magnitude of validity concerns raised in all aspects of the framework call into question the consequential validity of the assessment.

Teaching, Learning, And Assessment: Insights Into Students’ Motivation To Learn, Simon R. Walters, Pedro Silva, Jennifer Nikolai

The Qualitative Report

This study draws upon the perspectives of sport and recreation undergraduate students in New Zealand who were involved in the design of their own assessments, and discusses the implication of the teaching and learning environment on this process. In a previous study, student criticism had emerged of current teaching strategies and assessment methods at their institution. The purpose of this current study was to directly address some of these concerns and for lecturers and students to work collaboratively to develop a more learner-centred teaching and learning environment. Students from a second-year sociology of sport paper were invited to design their …

Using Educative Assessment In A Science Classroom, Jordan Truitt

Honors Projects

The focus of this study is to consider educative assessment in the science classroom and its effectiveness in assessing student-centered learning. By using educative assessment to measure learning, student work can be evaluated by rubric in addition to a traditional summative assessment. In comparing the student learning measured using the rubric results and traditional results, there was no statistical difference between the two assessments. However, the educative assessment provided greater insight into higher levels of learning. Conversational data also showed evidence of skills-based learning in the field of science. Further research into the applications for ‘at-risk’ students is required.

The Introduction Of Informal Cooperative Learning Into Our Programming Laboratories, Guity Ravai, Ronald Erdei, Ludmila Nunes, Sahithya Kodam

IMPACT Presentations

Presentation given at the Midwest SoTL Conference. Discusses the effects of implementing informal cooperative learning techniques in an introductory programming course.

Evaluating The State Of The Adjunct Faculty Relationship To The College Of Aeronautics, Embry-Riddle Aeronautical University – Worldwide, Narcrisha Norman, Federica Robinson-Bryant

Publications

The research outlined in this report evaluated the current state of adjunct faculty within the College of Aeronautics, Embry-Riddle Aeronautical University – Worldwide as 0f 10/22/2015. The approach was to streamline complex challenges as they relate to adjunct faculty population through three strategic goals:

• Goal 1 – Clearly state and understand COA challenges
• Goal 2 – Consider current practices, universal challenges, and best practices
• Goal 3 – Create tailored strategies for those challenges unique to Worldwide

This research will demonstrate five specific steps outlined in Goal 3 to ensure that the college hires and retains quality adjunct faculty as part …

Assessing Assessments: A Comparative Study Of Three Assessments Of Inquiry Skills In Tenth Grade High School Biology Students, Heather K. Murphy

Dissertations, Master's Theses and Master's Reports

Inquiry is an educational technique where students develop scientific knowledge and understanding through processes similar to those used by scientist. One of the obstacles to implementing the techniques is the need for teachers to self-evaluate their teaching and determine the effectiveness of inquiry-based teaching techniques with respect to developing higher-order thinking (HOT) skills in students. Feedback from an assessment permits teachers to adjust their curriculum to incorporate the most effective inquiry-base lessons.

This report considers three short assessments of inquiry that were modified for use in the high school biology classroom. First there three assessments were compared against one another …

The Experiences Of University Faculty Expected To Implement Edtpa Within A Teacher Preparation Program, Lance Kilpatrick

Doctoral Dissertations and Projects

The purpose of this transcendental phenomenological study was to examine the experiences of university faculty expected to implement a teacher performance assessment called edTPA within a teacher preparation program. This study synthesized the experiences university faculty members have when preparing and implementing the edTPA. A deep examination of 12 university faculty members who teach in teacher preparation programs in a Midwestern state where the edTPA is required for licensure offer their experience through a questionnaire, an individual interview, and a focus group interview. The data were collected, organized, and analyzed by employing transcendental phenomenological systematic data analysis procedures positioned to …

Advancing Evaluation In Community Colleges: A Mixed Methods Case Study Of Outcomes-Based Assessment Training In Student Affairs, Tammy L. Russell

Dissertations

Many student affairs departments struggle to contribute to an institution’s evidence base of student learning. In part, this results from student affairs personnel not having adequate training in how to assess learning outside the classroom. This is a particular challenge for small community colleges, in which individual units (e.g., admissions or financial aid) may have only one or two employees. Failure to assess co-curricular learning poses challenges to institutions in meeting accreditation standards, placing them at risk for increased scrutiny and loss of state funding under a performance-based system. The purpose of this mixed methods study was to use a …

An Exploratory Study Into The Nature Of The Relationship Between Pre-Service Teacher Fixed Factor Characteristics And Edtpa Performance Ratings, Timothy David Gouraige

Seton Hall University Dissertations and Theses (ETDs)

This study used a quantitative, analytical, non-experimental, explanatory research design. The study used simultaneous multiple regression analysis and analysis of covariance to investigate the factors that may influence the outcome of pre-service teachers’ performance on the edTPA, and to contribute to the overall knowledge of edTPA as a pre-service teacher performance assessment. The study explored the relationship between pre-service teacher demographic and academic performance characteristics and his or her edTPA summative performance ratings in an effort to determine if a relationship exists between these fixed factors and student performance on edTPA. Additionally, this study used comparative statistics, specifically ANCOVA, to …

Reform And The Senior Secondary School, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Traditional ways of thinking about learning, assessment and educational qualifications are being challenged. Professor Geoff Masters AO discusses the three challenges that a senior secondary school can expect to face.

Gatton Academy Study Abroad Program Effects On Perceptions Of Community Belongingness And Personal Growth And Development, Derick Brandon Strode

Dissertations

This dissertation’s focus is at the intersection of study abroad, impact assessment, and a population of gifted and talented students at a specialized, residential high school called The Gatton Academy. A summative impact evaluation was conducted to assess effects of Gatton Academy study abroad programs on student participants’ perceptions of peer belongingness, mentor belongingness, and personal growth and development, as well as to compare differences among three different program models being employed by the school. The three program models studied included a Non-Credit program, a Faculty-led Field-Study, and a Faculty-led Traditional program. The research was conducted amidst documented calls for …

A Mixed-Method Investigation Of Common Assessments Within A Suburban Secondary School, Matthew Irvin

Dissertations

The purpose of this mixed method case study, on the continued implementation of common assessments developed within Professional Learning Communities (PLCs), was to investigate possible relationships between teacher collaboration, common assessments and End of Course (EOC) assessments. The researcher investigated the perceptions of teachers and administrators in a Midwest secondary setting on common assessment development and utilization on the culture of teaching and data-driven decision making. The information from this study will provide the researched school district as well as others with insights into their implementation of PLCs and specifically the development and utilization of common assessments. In order to …