Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Assessment

Discipline
Institution
Publication Year
Publication
Publication Type
File Type

Articles 1 - 30 of 1644

Full-Text Articles in Education

Assessment And Evaluationin Labs For Public Service Interpreting Training, Carmen Valero Garcés, Denis Socarrás-Estrada Jul 2021

Assessment And Evaluationin Labs For Public Service Interpreting Training, Carmen Valero Garcés, Denis Socarrás-Estrada

International Journal of Interpreter Education

This study reports on the development and application of two bilingual interpreting tests given to master’s students during three academic years (2009–2012) at the University of Alcalá, Madrid, Spain. Its main objective is to compare trainees’ test performance at two different points in time. The study analyzes the degree of accuracy and the speed of response, considering the variables of mother tongue, gender, age, and undergraduate education. Our customized tests drew upon two aptitude tests developed by Pöchhacker (2009) and Russo (2009) and combine oral-aural exercises with tasks requiring listening skills, expressional fluency, and public-service-setting terminology. The tests ...


Sharing The Construction Of Assessment Rubrics With Students: A Model For Collaborative Rubric Construction, Jason K. Morton, Maria T. Northcote, Peter Kilgour, Wendy Jackson Jul 2021

Sharing The Construction Of Assessment Rubrics With Students: A Model For Collaborative Rubric Construction, Jason K. Morton, Maria T. Northcote, Peter Kilgour, Wendy Jackson

Education Papers and Journal Articles

Traditionally, rubrics were used simply as grading tools to provide marking frameworks that were transparent to students. More recently, rubrics have been promoted as educational tools to inform students of good practice with the assumption that they engage with these rubrics to guide their learning. However, some tensions arise from this approach, including the assumption that students actually engage with assessment rubrics and, most notably, whether students understand the purpose of rubrics and the language used within. In response, this paper promotes the practice of teachers involving their students in the co-construction of rubrics by presenting a Model of Collaborative ...


Evaluation Of The Educational Qualification Diploma Program In The Light Of National Academic Standards At Palestine Technical University, رندة العالم Jul 2021

Evaluation Of The Educational Qualification Diploma Program In The Light Of National Academic Standards At Palestine Technical University, رندة العالم

Jerash for Research and Studies Journal مجلة جرش للبحوث والدراسات

This study aimed to evaluate the educational qualification diploma program in the light of the national academic standards at Palestine Technical University from the students' point of view. The study sample consists of all students enrolled and graduated from the program, who numbered (108), of whom (15) were enrolled in the program and (93) graduated from the program. The researcher followed the survey and descriptive approach. To achieve the goals of the study, the researcher prepared a questionnaire that consisted of 24 paragraphs. In light of the results of the study, the researcher recommends the following:

1. Urging the Ministry ...


Investigating The Fit Of The Generalized Graded Unfolding Model (Ggum) When Calibrated To Irt Generated Data From Dominance And Ideal Point Models, Abdulla Alzarouni Jul 2021

Investigating The Fit Of The Generalized Graded Unfolding Model (Ggum) When Calibrated To Irt Generated Data From Dominance And Ideal Point Models, Abdulla Alzarouni

Public Access Theses, Dissertations, and Student Research from the College of Education and Human Sciences

The assessment of model fit in latent trait modelling, better known as item response theory (IRT), is an integral part of model testing if one is to make valid inferences about the estimated parameters and their properties based on the selected IRT model. Though important, the assessment of model fit has been less utilized in IRT research than it should. For example, there have been less research investigating fit for polytomous dominance models such the Graded Response Model (GRM), and to a lesser extent ideal point models such as the Generalized Graded Unfolding Models (GGUM), both in its dichotomous and ...


Assessing Self-Regulation In Grade 1 Writers: An Evaluation Of The Reliability And Validity Of The Interview On Self-Regulation In Early Writing, Ashley A. Bildfell Jun 2021

Assessing Self-Regulation In Grade 1 Writers: An Evaluation Of The Reliability And Validity Of The Interview On Self-Regulation In Early Writing, Ashley A. Bildfell

Electronic Thesis and Dissertation Repository

Few studies have considered the reliability and validity of the measures used to assess self-regulation in writing. The purpose of the current study was to evaluate the reliability and validity of the Interview on Self-Regulation in Early Writing, a novel task-specific measure designed to assess self-regulation in writing in Grade 1. This eight-item interview was designed to assess the planning, goal setting, strategy, self-statements, self-monitoring, coping, reviewing, and self-reinforcement aspects of self-regulation on separate transcription and composition dimensions. The data from 117 Grade 1 students were used to evaluate inter-rater reliability and the internal consistency of the scale. A principal ...


Eight Issues To Consider When Developing Animated Videos For The Assessment Of Complex Constructs, Anastasios Karakolidis, Darina Scully, Michael O'Leary Jun 2021

Eight Issues To Consider When Developing Animated Videos For The Assessment Of Complex Constructs, Anastasios Karakolidis, Darina Scully, Michael O'Leary

Practical Assessment, Research, and Evaluation

As part of the growing interest in the measurement of complex constructs in recent years, a body of research examining the extent to which videos are a useful alternative to written text in tests and assessments has emerged. Early attempts to replace written text with videos featured actors, but lately, animated videos have become more popular. However, the few studies that have examined the use of videos (animated or acted) in assessment have focused purely on reporting the results of these endeavors, with little to no information provided about the process of transforming a test from text to video format ...


Learning From Our Limits: Lessons To Hold Tight, Kara B. Douma Jun 2021

Learning From Our Limits: Lessons To Hold Tight, Kara B. Douma

New Jersey English Journal

United to prioritize our humanity, we clear the plate to more comfortably make space for what matters most. Educators achieve this by focusing on priority Standards, partnering with students for content, and reframing our needs to use assessment as learning.


Defining And Assessing Spiritual Formation: A Necessity For Christian Schooling, James Drexler, Amy H. Bagby Jun 2021

Defining And Assessing Spiritual Formation: A Necessity For Christian Schooling, James Drexler, Amy H. Bagby

International Christian Community of Teacher Educators Journal

Assessing Spiritual Formation Abstract

Virtually every Christian school promises a “Christian” this, a “God-centered” that, or a “biblical” something else in its mission and philosophy statements. These commitments are used in marketing, and are regarded as educational outcomes for each school. Christian schools are fairly skilled with their assessments of academic outcomes, but many are not even trying to assess the spiritual formation of their students. With the development of qualitative research methods over the past few decades, Christian educators now have reliable, robust, and usable methods to complete this important evaluation of their programs and practices. This article explores ...


Beyond The Checklist Approach: A Librarian-Faculty Collaboration To Teach The Beam Method Of Source Evaluation, Jenny Mills, Rachael Flynn, Nicole Fox, Dana Shaw, Claire Wiley Jun 2021

Beyond The Checklist Approach: A Librarian-Faculty Collaboration To Teach The Beam Method Of Source Evaluation, Jenny Mills, Rachael Flynn, Nicole Fox, Dana Shaw, Claire Wiley

Library Faculty Scholarship

Evaluating information is an essential skill, valued across disciplines. While librarians and instructors share the responsibility to teach this skill, they need a common framework in order to collaborate to design assignments that give students multiple opportunities to learn. Librarians and First Year Seminar faculty at Belmont University collaborated to design a unit of instruction on source evaluation using the BEAM method. BEAM requires students to apply a use-based approach to evaluation, to read and engage with sources more closely, and to think about how they might use a source for a specific purpose. Structured annotated bibliographies that included BEAM ...


The Art And Science Of Self- Reflection, Kristina Arena, Paula Ogg, Ala’ Alhyari, Jason Dennison, Rabya Razi, Simran Kaur Johal, Seden Yesildag, Wafa Benmahmoud May 2021

The Art And Science Of Self- Reflection, Kristina Arena, Paula Ogg, Ala’ Alhyari, Jason Dennison, Rabya Razi, Simran Kaur Johal, Seden Yesildag, Wafa Benmahmoud

Publications and Scholarship

Sheridan College students from 1st, 2nd, and 3rd year of the Child and Youth Care (CYC) program participated in an innovative project to co-create a rubric for self-reflection assignments which is a significant skill in both academic and professional practice. Students co-designed this self-reflection rubric for use throughout the program for assessment in all self-reflection assignments rather than having a different rubric for every assignment. The students went through many steps to ensure the rubric had intra-rater and inter-rater reliability. We followed rubric best practices for criteria, levels, and descriptors. The extensive design thinking process of discussion and consultation resulted ...


A Review Of Program Evaluation In School Counseling: Improving Comprehensive And Developmental Programs, Amanda D. Rumsey May 2021

A Review Of Program Evaluation In School Counseling: Improving Comprehensive And Developmental Programs, Amanda D. Rumsey

Journal of School-Based Counseling Policy and Evaluation

This book review includes a detailed overview and discussion of Michael S. Trevisan and John C. Carey’s book: Program Evaluation in School Counseling: Improving Comprehensive and Developmental Programs, New York, NY: Routledge, 132 pages, $124.00 (hardcover), ISBN 9781138346574. The review includes strengths and potential issues regarding the text’s value and uses in graduate programs and school counseling practice. Overall, the book is a great resource and would be helpful knowledge for anyone working in the context of school counseling.


Promoting Equity By Scaling Up Summer Engineering Experiences: A Retrospective Reflection On Tensions And Tradeoffs, Walter C. Lee, David B. Knight, Monica E. Cardella May 2021

Promoting Equity By Scaling Up Summer Engineering Experiences: A Retrospective Reflection On Tensions And Tradeoffs, Walter C. Lee, David B. Knight, Monica E. Cardella

Journal of Pre-College Engineering Education Research (J-PEER)

A central challenge in engineering education is providing experiences that are appropriate for and accessible to underserved communities. However, to provide such experiences, we must better understand the process of offering a geographically distributed asset-based out-of-school program. This paper focuses on a collaborative research project that examined the broad implementation of the Summer Engineering Experiences for Kids (SEEK) program organized by the National Society of Black Engineers (NSBE). SEEK is a three-week summer program that engages participants in hands-on, team-based engineering design projects. NSBE’s goal is to make SEEK culturally sustaining, community-connected, and scalable. The purpose of this paper ...


Faculty Perceptions Of Dyadic Advising Relationships, Power, And Cultural Consciousness On College Student Learning Outcomes, Hind Albana May 2021

Faculty Perceptions Of Dyadic Advising Relationships, Power, And Cultural Consciousness On College Student Learning Outcomes, Hind Albana

Seton Hall University Dissertations and Theses (ETDs)

Abstract

Academic advising in institutions of higher education lack consistent assessment and evaluation of practices impairing the ability to define the role, objectives, and methods utilized. Over-reliance on student satisfaction surveys for evaluating advising reinforces this phenomenon. To break the cycle, this study used survey responses from a nationwide sample (N = 156) of faculty advisors from public and private 4-year colleges and universities to examine the relationship between and among the constructs of a working relationship, shared power, cultural consciousness, and student learning outcomes. The questionnaire instrument score produced a Cronbach's alpha of .927, illustrating substantially strong internal consistency ...


Reflection Practices In Consulting Projects For The Learner And Instructor, Sophia Koustas, Christine Blais May 2021

Reflection Practices In Consulting Projects For The Learner And Instructor, Sophia Koustas, Christine Blais

Experiential Learning & Teaching in Higher Education

Reflection practices in consulting projects are an integral part of both the instructor/coach and student learning journeys. Using reflection tools as an instructor/coach models behavior to encourage students to share what they observe, do, learn, and feel.

This roundtable will contribute to this year’s theme by using reflection as a tool for assessment, to promote program excellence, and to encourage student success. This session will encourage participants to share best reflection practices in consulting projects.


Rasch Measurement V. Item Response Theory: Knowing When To Cross The Line, Steven E. Stemler, Adam Naples May 2021

Rasch Measurement V. Item Response Theory: Knowing When To Cross The Line, Steven E. Stemler, Adam Naples

Practical Assessment, Research, and Evaluation

When students receive the same score on a test, does that mean they know the same amount about the topic? The answer to this question is more complex than it may first appear. This paper compares classical and modern test theories in terms of how they estimate student ability. Crucial distinctions between the aims of Rasch Measurement and IRT are highlighted. By modeling a second parameter (item discrimination) and allowing item characteristic curves to cross, as IRT models do, more information is incorporated into the estimate of person ability, but the measurement scale is no longer guaranteed to have the ...


Institutional Accreditation: Making The Process More Efficient, Effective, And Meaningful To Colleges And Universities, Cynthia J. Requa May 2021

Institutional Accreditation: Making The Process More Efficient, Effective, And Meaningful To Colleges And Universities, Cynthia J. Requa

Ed.D. Dissertations in Practice

Institutional accreditation is a voluntary, peer-review process that is overseen through the seven institutional accreditors governed by the U.S. Department of Education. The purpose of accreditation is to ensure institutional quality standards are being met by colleges and universities. The purpose of this study was to identify how the accreditation process could be improved with foci on efficiency, effectiveness, and more meaningful impact to the institutions. Drawing on Heifetz et al.’s (2009) theory of adaptive leadership, Kotter’s (2012) accelerators and the integrated planning principles of Stephens (2017) and Immordino et al., (2016), this study employed grounded theory ...


Creating A Culture Of Assessment To Elevate Students’ Voices, Amber Knight Apr 2021

Creating A Culture Of Assessment To Elevate Students’ Voices, Amber Knight

M.A. in Higher Education Leadership: Action Research Projects

The purpose of this study was to investigate how the University of San Diego’s department of Student Activities and Involvement (SAI) could strengthen its assessment practices and execute consistent data-driven decision making. The following question guided my research: How can I promote a culture of assessment so that SAI’s programs and advising are directly informed by a more thorough data collection process that elevates students’ voices? Building on the work of assessment scholars, this study serves as a model for assessing student affairs assessment. By critically evaluating SAI’s existing assessment culture, administering assessments to understand departmental needs ...


Investigating Alignment In A Quantitative Literacy Course For Social Sciences Students, Vera Frith, Pam Lloyd Apr 2021

Investigating Alignment In A Quantitative Literacy Course For Social Sciences Students, Vera Frith, Pam Lloyd

Numeracy

The Numeracy Centre at the University of Cape Town has taught a one-semester quantitative literacy course for social sciences students since 1999. This study aims to provide an example for how the design of such a course can be assessed for alignment with quantitative reasoning goals. We propose a framework of learning outcomes for the course and use that framework to analyse the assessments and student performance on them. We find that just under half of the overall mark for the course was devoted to the interpretation and communication of quantitative information (our “main” outcomes), and about a quarter was ...


Strengthening The Connections Between Library Instruction And Student Success, Lucinda R. Wittkower, Joleen Westerdale Mcinnis Apr 2021

Strengthening The Connections Between Library Instruction And Student Success, Lucinda R. Wittkower, Joleen Westerdale Mcinnis

Libraries Faculty & Staff Presentations

This poster will share the results from a three-year study that investigated correlations between student participation in library instruction and student academic achievement. Using rigorous research practice and acknowledging ethical concerns by use of an in-depth student consent process, the researchers will share their findings regarding the relationships that exist between student participation in library instruction and completion of course for which instruction was attended and the relationships between student participation in library instruction and their grade in course. Additionally, the researchers will share the unexpected, but interesting finding related to student withdrawal rates. Finally, the researchers will include information ...


Opening Act: The Academic Library's Role In Orientation Planning And Evaluation, Zachary Lewis, Katy Kelly Apr 2021

Opening Act: The Academic Library's Role In Orientation Planning And Evaluation, Zachary Lewis, Katy Kelly

Roesch Library Faculty Publications

This article describes a private, mid-sized university library’s experience of hosting a music festival-themed event in the library building as part of new student orientation, with program evaluation and student learning assessment at the forefront of planning. The authors and co-planners will discuss four years of data to explore the connection between library outreach and students’ use of the library, their perceptions of the institution, and the role the event plays in shaping student success. It offers recommendations for collaborating with academic libraries and approaches in future cross-campus collaborations, including using a scaffolding approach to outline the goals and ...


Modeling Through Model-Eliciting Activities: An Analysis Of Models, Elements, And Strategies In High School. The Cases Of Students With Different Level Of Achievement, Jair J. Aguilar Apr 2021

Modeling Through Model-Eliciting Activities: An Analysis Of Models, Elements, And Strategies In High School. The Cases Of Students With Different Level Of Achievement, Jair J. Aguilar

Teaching and Learning Faculty Publications and Presentations

A mathematical client-driven task known as Model-Eliciting Activities was implemented with students of different levels of achievement (i.e., low, average, and high) at the high-school level. The study strived to prove that Model-Eliciting Activities can be solved by students at any achievement level and be used as an assessment tool. Students collaborated in teams of three to develop solutions that met the client’s needs. The model-solutions were compared and contrasted among several dimensions and achievement levels, considering the quality of the final product-solution based on the Quality Assessment Guide, the intermedia product composed of the type of models ...


Investigating The Predictive Relationship Between Sportsmanship And Class, Age, Type Of Sport, And Gender At The United States Military Academy, Daniel J. Furlong Apr 2021

Investigating The Predictive Relationship Between Sportsmanship And Class, Age, Type Of Sport, And Gender At The United States Military Academy, Daniel J. Furlong

Doctoral Dissertations and Projects

Traditionally, military leaders accentuate military skill development over developing the moral character of soldiers. However, researchers have made recommendations to investigate components of sportsmanship with the intent to align better with the goals of other development programs that seek to promote character. The purpose of this quantitative, correlational design study was to use a multiple linear regression on an archival data set of Character in Sport Index scores to determine if the linear combination of the variables class, age, type of sport, and gender have predictive significance for Character in Sport Index scores. Subjects included 8,701 cadets between the ...


The Implementation Of Oral Assessment In An Introduction To Proof Course Using Multiple Assessment, Nurul Wahyuni Schraeder, Nicole Engelke Infante, Ben Davies Apr 2021

The Implementation Of Oral Assessment In An Introduction To Proof Course Using Multiple Assessment, Nurul Wahyuni Schraeder, Nicole Engelke Infante, Ben Davies

Graduate Student Scholarship

This study investigated how four assessors implemented an oral assessment when a little direction was provided to the assessors. We focused on the interrater reliability of oral grading and the types of follow-up questions asked. We observed three interaction types during oral assessment: no follow-up, follow-up related to the problem, and follow-up not directly related to the problem. As expected, assessors differed on several aspects of the assessment, including grading standards and follow-up experiences for students. Our findings revealed interrater reliability of oral grading with three-point scale was excellent, but not so much when six-point scale was implemented. Moreover, we ...


Interactive Video Tutorials From Scratch: Experiences And Lessons Learned Six Years On, Gina Garber, Scott Shumate, Christina Chester-Fangman Mar 2021

Interactive Video Tutorials From Scratch: Experiences And Lessons Learned Six Years On, Gina Garber, Scott Shumate, Christina Chester-Fangman

Georgia International Conference on Information Literacy

In 2014, Austin Peay State University’s (APSU) Woodward Library developed an online, interactive video tutorial for the American Psychological Association (APA) Style Guide. APSU’s College of Education (CoE) approached the library about creating a tutorial similar to an existing video, Plagiarism: Making the Right Choices, for use in their upper division and graduate level courses. Through a collaborative process using content previously in the form of a PowerPoint presentation, the library generated a script, storyboards, and eventually a full video. Now, how best to engage the students with the assessment?

The existing Plagiarism tutorial did not quite live ...


Digital Research Logs: Free, Easy & Engaging Direct Measures For Assessment Of Information Literacy Outcomes, Bernadette Mirro, Mason Yang Mar 2021

Digital Research Logs: Free, Easy & Engaging Direct Measures For Assessment Of Information Literacy Outcomes, Bernadette Mirro, Mason Yang

Georgia International Conference on Information Literacy

  • Join us to learn about how an accidental collaboration turned into an intentionally designed online research log that serves as a direct measure for assessing information literacy outcomes in a freshman level composition class. Using Google Sheets we have created a free CCC licensed research log for use in a synchronous instruction session or paired with digital instructional tutorials in an asynchronous library instruction session. The research log is engaging and intuitive, helps students stay focused on the task and goes beyond the function of a traditional handout to serve as a tool they can use throughout the semester. Also ...


Building And Maintaining Sanctuary Spaces Through Face To Face Writing Assessment, Jeffrey Austin, Ann Burke, Ellen Foley, Gretchen Rumohr Mar 2021

Building And Maintaining Sanctuary Spaces Through Face To Face Writing Assessment, Jeffrey Austin, Ann Burke, Ellen Foley, Gretchen Rumohr

Teaching/Writing: The Journal of Writing Teacher Education

Seasoned secondary and college instructors discuss successful face-to-face assessment, especially in virtual settings. F2F assessment frees educators to co-create equitable literacy learning experiences with students, encourages agency, demystifies the grading process, develops the classroom community, and brings meaningful inquiry about writers’ own skills and practices, ultimately disrupting inequities and inequalities of traditional grading and creating “sanctuary spaces” for all writers.


Covid-19 Modifications To A Service-Learning Project Designed To Prepare Special Education Students To Be Effective Participants In Transdisciplinary Collaborations, Kathy R. Doody, Katrina Fulcher-Rood, Pamela Schuetze Mar 2021

Covid-19 Modifications To A Service-Learning Project Designed To Prepare Special Education Students To Be Effective Participants In Transdisciplinary Collaborations, Kathy R. Doody, Katrina Fulcher-Rood, Pamela Schuetze

Excelsior: Leadership in Teaching and Learning

This research study examined the impact of COVID-19 on university students’ perceptions about the effectiveness of a community-based service-learning project designed to prepare graduate students in special education and undergraduate students in psychology and speech-language pathology to work in transdisciplinary teams in early childhood settings. Students were placed into transdisciplinary teams and assigned to one of two community-based early childhood programs to administer a universal screening tool that assessed young children in several domains. The project was in its sixth year when the country stood still because of the COVID-19 pandemic. The project was re-envisioned, mid-course, to provide an equitable ...


Pace Yourself: Impact Of Covid-19 On Patient-Centered Care Experience, Kristen Wilhite, Mikael D. Jones, Clark D. Kebodeaux Feb 2021

Pace Yourself: Impact Of Covid-19 On Patient-Centered Care Experience, Kristen Wilhite, Mikael D. Jones, Clark D. Kebodeaux

Pharmacy Practice and Science Faculty Publications

(1) Background: The outbreak of the novel coronavirus, COVID-19, forced colleges of pharmacy to implement new online learning methodologies to ensure that students could complete required courses. This transition was especially acute for laboratory simulation courses that require students to practice professional skills. This study aims to compare student assessment performance within a simulation-based laboratory course for students who completed the module prior to and after the online transition. (2) Methods: This study was a retrospective cohort comparison of student outcome performance with two distinct content delivery methods. Students were organized into two tracks at the beginning of the semester ...


Stem For Everyone: A Mixed Methods Approach To The Conception And Implementation Of An Evaluation Process For Stem Education Programs For Students With Disabilities, Amy Jane Griffiths, John Brady, Nicholas Riley, James Alsip, Vanessa Trine, Lauren Gomez Feb 2021

Stem For Everyone: A Mixed Methods Approach To The Conception And Implementation Of An Evaluation Process For Stem Education Programs For Students With Disabilities, Amy Jane Griffiths, John Brady, Nicholas Riley, James Alsip, Vanessa Trine, Lauren Gomez

Education Faculty Articles and Research

Some students with autism spectrum disorder and other learning differences may have superior visual acuity, increased attentional focus, and logical thinking abilities, lending to an affinity for science, technology, engineering, and mathematics (STEM) fields. At the same time, economists report that, the United States will experience a 28.2% increase in STEM-related jobs between 2014 and 2024. Although students with disabilities (SWD) can help to fill those positions, 85% of SWD graduates are either underemployed or unemployed as they enter young adulthood. Thus, there is a need to develop, evaluate, and report outcomes of STEM preparation programs specifically tailored to ...


Uptodate Use As A Predictor Of Medical Student Success, Connor Buechler, Kurt Wendland, Jason Booza, Diane Levine Jan 2021

Uptodate Use As A Predictor Of Medical Student Success, Connor Buechler, Kurt Wendland, Jason Booza, Diane Levine

Medical Student Research Symposium

Background

Both practicing physicians and student learners prioritize speed of access and ease of use over most other criteria in choosing how to look up clinical information, with electronic resources far outpacing books for these reasons. While there are many variations of electronic reference materials available, UpToDate is one of, if not the most, frequently referenced clinical knowledge resources. It is professionally written and edited by practicing clinicians with frequent updates as new information or studies become available to inform care, allowing the learner to answer clinical questions rapidly, correctly, and fully. Given its proven popularity, the usefulness of UpToDate ...