Education Commons^™

Assessment Essentials: Engaging A New Audience, Michael J. Mastalski Iii, Jo Campbell, Anat Levtov

Michael J Mastalski III

No abstract provided.

Adventures In Paragraph Writing: The Development And Refinement Of Scalable And Effective Writing Exercises For Large-Enrollment Engineering Courses, Rebecca R. Essig, Cary David Troy, Brent K. Jesiek, Josh Boyd, Natascha Michele Trellinger

IMPACT Publications

Adventures in paragraph writing: the development and refinement of scalable and effective writing exercises for large enrollment engineering courses. The ability to communicate effectively is a highly desirable attribute for today’s graduating engineers. Additionally, the inclusion of communication components in technical courses has been shown to enhance learning of technical content and can be leveraged to satisfy non-technical learning outcomes. However, the incorporation of such components in undergraduate engineering curricula remains challenging due to resource limitations, credit hour crunches, and other issues. This paper presents the design considerations and preliminary results from our ongoing work to create an effective, transferrable, …

What Can Student Affairs Learn From Nielsen Audio? Benefits Of Using A Modified Arbitron Assessment In Higher Education, Oscar T. Mcknight Ph.D., Kerri Carmichael, Jonathan Locust Jr

Oscar T McKnight Ph.D.

This presentation explores the history and evolution of an Arbitron assessment model (Nielsen Audio) when applied in higher education, specifically Student Affairs. Highlighted are the differences between traditional models of Student Affairs assessments and a modified Arbitron assessment. This new Student Affairs assessment model allows an institutional researcher to study student feedback minute to minute, day to day, week to week basis, etc. Discussed are the strengths and weaknesses of a Nielsen Audio model when applied to Student Affairs.

Children, Mathematics, And Videotape: Using Multimodal Analysis To Bring Bodies Into Early Childhood Assessment Interviews, Amy Noelle Parks, Mardi Schmeichel

Department of Teaching, Learning, and Teacher Education: Faculty Publications

Despite the increased use of video for data collection, most research using assessment interviews in early childhood education relies solely upon the analysis of linguistic data, ignoring children’s bodies. This trend is particularly troubling in studies of marginalized children because transcripts limited to language can make it difficult to analyze embodied power relations between majority researchers and minority children. This article responds to this problem by outlining a theoretical position on power and bodies, describing multimodal analysis strategies, and using these strategies to analyze the subject positions available during a mathematical assessment interview for three African American preschool child-participants and …

The Impact Of Library Resource Utilization On Undergraduate Students' Academic Performance: A Propensity Score Matching Design, Felly Chiteng Kot, Jennifer Jones

University Library Faculty Publications

This study uses three cohorts of first-time, full-time undergraduate students (N=8,652) at a large, metropolitan, public research university to examine the impact of student use of three library resources (workstations, study rooms, and research clinics) on academic performance. To deal with self-selection bias and estimate this impact more accurately, we used propensity score matching. Using this unique approach allowed us to construct treatment and control groups with similar background characteristics. We found that using a given library resource was associated with a small, but also meaningful, gain in first-term grade point average, net of other factors.

Development Of The Biostatistics And Clinical Epidemiology Skills Assessment For Medical Residents, Patrick Brian Barlow

Doctoral Dissertations

This study developed the Biostatics and Clinical Epidemiology Skills (BACES) assessment, and established its preliminary item characteristics and validity evidence. Unlike previous instruments, the BACES assessment was developed and tested using an item response theory (IRT) approach to measurement to create a new, adaptive biostatistics and clinical epidemiology knowledge assessment for graduate medical professionals. Thirty multiple-choice questions were written to focus on interpreting relevant examples of clinical epidemiology and statistical methods. A four person expert panel reviewed these items for content validity. After this review, the BACES assessment was administered to 147 medical residents across three academic medical centers. Results …

The Academic Library And High-Impact Practices For Student Retention: Perspectives Of Library Deans, Adam L. Murray

Dissertations

Dramatic declines in state appropriations for postsecondary education, the rise of performance-based funding models, and limitations on tuition increases have resulted in a focus on student retention as a matter of importance to institutions of higher education. Concomitantly, academic libraries face changes in service models brought about by technology and the rising costs of providing access to an ever-expanding field of literature required by academic programs and faculty. The value proposition of the academic library is reduced in the face of budget interests that impact recruitment and retention. Many researchers and university leaders have called on academic libraries to develop …

Assessment: Getting To The Essence, Geoff N. Masters

Assessment and Reporting

The author argues that assessment in education has become over-conceptualised and overcomplicated, and assessment concepts and terminology introduced over the past half century sometimes now function as impediments to clear thinking and good practice. The one fundamental purpose of assessment in education, he says, is to establish and understand where learners are in an aspect of their learning at the time of assessment. When this is recognised, many supposedly important distinctions become less significant. Currently, however, such distinctions tend to result in fragmentation of the field, with proponents championing one assessment purpose or method while denigrating others. He explains why …

What’S The Story? Making Sense Of Conflicting Literacy And Numeracy Results, Juliette Mendelovits

Juliette Mendelovits

No abstract provided.

Rethinking Assessment In Vet, Dave Tout

David (Dave) Tout

No abstract provided.

Some Reflections On Teaching And Learning From Numeracy And Mathematical Literacy Assessments, Dave Tout

David (Dave) Tout

No abstract provided.

Ask Standards [Presentation With Audio], Kelcie Dixion

Assessment & Accountability in Student Affairs & Higher Education (CNS 610)

No abstract provided.

Developing An Exit Evaluation For A Public Service Graduate Program, Emma Gelsinger

Muskie School Capstones and Dissertations

Students in a public service graduate program vary in their motivation, background, professional experience and educational goals. This variety requires evaluations be tailored to the needs of students to ensure effective program development and improvement for the student experience. Student needs can range from assistance with a financial aid application or the effect of faculty advising on their graduate student experience. An exit evaluation that is easily accessible to students and useful to faculty and administrators is essential to any public service graduate program.

A combination of semi-structured interviews, background research, coursework from the Public Policy and Management graduate program, …

Perceptions Of General Education Deans And Department Chairs Of Their Colleges As Learning Organizations, May Charmayne Mulligan

Dissertations

Higher education institutions are being pushed towards increased assessment practices because of rising costs, mass access, new delivery methods, and rising competition on the national and global scale. Academic deans and department heads are at the center of these assessment efforts, and assessment should guide changes within the organization for improvement. Learning organization theory provides a framework for creating an environment favorable to assessment and improvement. Six learning organization principles – learning, communication, measurement, problem-solving, structure, and vision – were used for this study.

An online questionnaire was used to capture the perceptions of deans and department heads as to …

Measuring New Media Literacies: Towards The Development Of A Comprehensive Assessment Tool, Ioana Literat

Journal of Media Literacy Education

This study assesses the psychometric properties of a newly tested self-report assessment tool for media literacy, based on the twelve new media literacy skills (NMLs) developed by Jenkins et al. (2006). The sample (N=327) consisted of normal volunteers who completed a comprehensive online survey that measured their NML skills, media exposure, digital participation, and civic engagement. A factor analysis performed on the survey items yielded 10 NMLs that emerged as significant subscales. A series of multivariate analyses of variance indicate a strong relationship between these NMLs and respondents’ exposure to new media forms, their participation in Web 2.0 …

Web-Based Student Peer Review: A Research Summary, Edward F. Gehringer

Edward F Gehringer

Interest in Web-based peer-review systems dates back nearly 20 years. Systems were built to let students give feedback to other students, mainly to help them improve their writing. But students are not necessarily effective peer reviewers. Left to their own devices, they will submit cursory reviews, which are not very helpful to their peers. Techniques have been developed to improve the quality of reviews. Calibration is one such technique. Students are asked to assess samples of writing that have previously been assessed by experts. Students must submit an evaluation “close enough” to the experts’ before they are allowed to review …

The Early Grade Reading Assessment: Assessing Children's Acquisition Of Basic Literacy Skills In Developing Countries (Superseded Version), Australian Council For Educational Research

Assessment GEMS

The Early Grade Reading Assessment (EGRA), administered individually in about 15 minutes, measures the most basic foundation skills for literacy acquisition in the early grades. The assessment was developed by the Research Triangle Institute (RTI) through funding provided by the United States Agency for International Development (USAID) and the World Bank (Gove & Wetterberg, 2011), in addition to resources provided by RTI. The EGRA was developed to provide a battery of assessments of basic reading skills for developing countries to monitor the status of early reading in primary schools. The assessment tool was first implemented in The Gambia and Senegal …

The 'Literacy' Idea, Ross Turner

Assessment GEMS

A central reason why researchers and practitioners refer to domain literacy is to draw attention to the kinds of things students learn in the domain. In a traditional learning domain the focus might be on the acquisition of discrete facts, skills and procedures that have little obvious connection or utility. In a learning domain with a literacy orientation, the focus is on applying the domain’s facts, skills and procedures to support creativity and inventiveness, to solve novel problems and to deal with the kinds of challenges that life presents outside the classroom. In the case of mathematics, for example, a …

Developing Outcomes Assessments For Collaborative, Cross-Institutional Benchmarking : Progress Of The Australian Medical Assessment Collaboration, Daniel Edwards, David Wilkinson, Benedict Canny, Jacob Pearce, Hamish Coates

Dr Daniel Edwards

The Australian Medical Assessment Collaboration (AMAC) began in 2010. This article charts the development of the collaboration over its initial years. AMAC was instigated as a way of improving the quality of medical education through the recognition of the need for tools for comparison and evaluation of learning outcomes, acknowledgement of the need for high quality assessment, and to share expertise in these areas. In a climate of increasing regulation and accountability, this collaboration was formed as a means of increasing assessment practices by, with and for medical schools. This article provides an overview of the background issues stimulating the …

Assessment Practices Of Students With Learning Disabilities In Lebanese Private Schools: A National Survey, Rasha Elhage

Wayne State University Dissertations

Education is intended to provide diverse students with the skills and competencies needed to enhance their lives (Salvia, Ysseldyke & Bolt, 2011). This includes assessment practices that enable teachers to identify students' current level of skills, their strength and weaknesses, target instruction at student's personal level, monitor student learning and progress and plan and conduct adjustments in instruction, and evaluate the extent to which students have met instructional goals. This study intended to discover, describe, and evaluate the assessment practices of teachers and administrators working with students with learning disabilities in Lebanese private schools via the Context, Input, Process and …

Comprehensive Multi-Disciplinary Assessment Protocol For Autism Spectrum Disorder, Janet L. Dodd, Lauren K. Franke, Jeanette K. Grzesik, Jenna Stoskopf

Communication Sciences and Disorders Faculty Articles and Research

Legal mandates established under IDEA specify a student must be assessed in all areas of suspected disability. Never is this task more overwhelming than its application to the assessment of a student suspected of a diagnosis of autism. The assessment of an individual suspected of an autism spectrum disorder (ASD) diagnosis is a complex task and is dependent on the integration of information gleaned from assessments conducted by an array of professionals, each with their own distinct area of expertise. The purpose of this article is to introduce the Comprehensive Multidisciplinary Assessment Protocols-Autism Spectrum Disorder, referred to as the CMAPs, …

Experiential Project Presentation Using Story Sack, Geraldine French

Assessment & Feedback Cases

This use case describes how one assessment method was designed and implemented by a lecturer or a group of lecturers in DIT. The use case was compiled from an interview conducted as part of DIT’s RAFT project (2013‐14), the aim of which was to provide a database of assessment practices designed and implemented by academic staff across DIT.

The Perils Of Prescribed Grade Distributions: What Every Medical Educator Should Know, Kenneth D. Royal, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

A common practice in medical education is to create a prescribed distribution of grades or ratings so that only a certain percentage of students receive the highest marks. This approach typically is employed to curb grade inflation and as a means to help faculty distinguish outstanding performers. Despite the well-intentioned reasoning for using prescribed grade distributions, a number of associated problems and probable consequences may result from this practice. Thus, the purpose of this article was to discuss the assumptions underlying this potentially unwise practice, the defensibility of this evaluation practice in the high-stakes arena of medical education, and the …

Valuing Assessment In Teacher Education - Multiple-Choice Competency Testing, Dona L. Martin, Diane Itter

Australian Journal of Teacher Education

When our focus is on assessment educators should work to value the nature of assessment. This paper presents a new approach to multiple-choice competency testing in mathematics education. The instrument discussed here reflects student competence, encourages self-regulatory learning behaviours and links content with current curriculum documents and with collaborative and cooperative learning episodes.

Title: How Do Preservice Teacher Education Students Move From Novice To Expert Assessors?, Peter R. Grainger, Lenore Adie

Australian Journal of Teacher Education

Despite the acknowledged importance of assessment in education, there has been minimal research into the preparation of preservice teachers for the important role of involving preservice teachers in marking, grading, moderating and providing feedback on student work. This article reports on a pilot project in which preservice teachers participated in an ongoing peer assessment and social moderation process in a dedicated course on assessment. The purpose of the project was to investigate specific ways in which key assessment processes can be effectively taught to preservice teachers. The research involved 96 preservice teachers who completed a Likert scale survey and free …

Authentic Assessment Of Reflection In An Eportfolio: How To Make Reflection More Real For Students, Pauline Roberts, Helen Farley, Sue Gregory

Research outputs 2014 to 2021

In a doctoral study that focused on the enhancement of reflection through an ePortfolio-based learning environment, students’ indicated that they felt reflection was not real when it was used for assessment. This led to an examination of assessment practices linked to reflection and ways to make it authentic. The literature revealed that reflection is often a component of authentic assessment rather than being a focus of it. The practices associated with the assessment of reflection are examined in order to formulate 4 guiding principles. These principles aim to make the process of reflection more ‘real’ to students in higher education …

Learning To Retell Stories Through Comparative Teaching: Writing And Drawing, Rachel L. Lindle

Theses and Dissertations--Art and Visual Studies

Students who are emergent readers and writers are often difficult to assess, as they are unable to communicate understanding in writing. From my observations, these students communicate ideas best through concrete forms of expression, rather than the abstract formation of letters and writing that is unfamiliar to them. Drawing provides an alternate form of expression from writing. Based on information found in literature review and personal experiences from working with students who are emergent readers and writers, pictures and drawings are a bridge to communicate ideas with these students. This form of expression and communication may be a useful assessment …

The Effect Of Academic Coaches On Teachers' Effective Use Of Data For Instructional Decisions, Barbara Quillen Shoemaker

Online Theses and Dissertations

One of the common themes in education reform is the use of data-driven decision making. The data provides the information we use to improve our knowledge of classroom instruction. Teachers need professional development to improve their ability to enable data driven decision-making. What data are available? What information can be gleaned from the data? What instructional changes based on data occur? Professional development, the nature of coaching, and their effect on teacher use of data have not been adequately treated in educational literature. This study will be based on an evaluation of an academic coaching project in a large urban …

Exploring The Attitudes Of Criminal Justice And Homeland Security Students Regarding Assessment Techniques In Online Courses, Terry Allen Taylor

Online Theses and Dissertations

Substantial increases in online education since the start of the 21st century requires investigation in to how online courses differ from traditional face-to-face courses. It is particularly important to discover how online students learn and which assessment methods they prefer and see as most beneficial to online learning. Using online assessment techniques that correspond with those rated highly my online students can lead to better student experiences in online courses and improved persistence rates in online courses, which have traditionally be lower compared to face-to-face courses.

The participants for the study sample included online students majoring in Bachelor of Science …

The Importance Of Formative Assessment In Science And Engineering Ethics Education: Some Evidence And Practical Advice, Matthew W. Keefer, Sara E. Wilson, Harry Dankowicz, Michael C. Loui

School of Engineering Education Faculty Publications

Recent research in ethics education shows a potentially problematic variation in content, curricular materials, and instruction. While ethics instruction is now widespread, studies have identified significant variation in both the goals and methods of ethics education, leaving researchers to conclude that many approaches may be inappropriately paired with goals that are unachievable. This paper speaks to these concerns by demonstrating the importance of aligning classroom-based assessments to clear ethical learning objectives in order to help students and instructors track their progress toward meeting those objectives. Two studies at two different universities demonstrate the usefulness of classroom-based, formative assessments for improving …