Educational Assessment, Evaluation, and Research Commons^™

Impact Of Computer-Based Testing On Dental Students, Sinky Zheng, Daniel Bender

Pacific's Annual Assessment Conference

No abstract provided.

The Discipline Of Evaluation: Teaching Students Expert Level Reading Skills, Eleanor Wittrup

Pacific's Annual Assessment Conference

No abstract provided.

Hbcus: Accreditation, Governance And Survival Challenges In An Ever-Increasing Competition For Funding And Students, Jerry Crawford Ii

Journal of Research Initiatives

Historically Black Colleges and Universities (HBCUs) are facing challenges to their continued existence on several fronts. One is fiscally, as federal funding for education has been cut and the responsibility for paying for higher education has been levied on students and parents. Another challenge is the amount of endowment dollars available to them and lastly, there are questions today as to if HBCUs are still needed in a society that has allowed African-Americans to enroll in Predominantly White Institutions (PWIs). Both of these challenges are contingent on the most critical issue – accreditation. The loss of accreditation of units and …

Real Data Is Messy... And Manageable, Beverly Wood, Carl Clark

Publications

Using real data in an introductory statistics course is a delicate balance between reality and manageability. The internet is awash with data that is useful for students to answer questions of interest to them but it is not always formatted as neatly as textbook data. The ASA's recently endorsed GAISE College Report 2016 points to the plausibility of considering multivariable thinking even if only at a rudimentary level. With both messy and multivariable data in mind, we present some activities/projects and sources for data to give introductory students the opportunity to engage with real data.

Inquiry-Based Learning: Assessing Students' Science Inquiry Skills, Abha Bhagat

Teacher India

Inquiry-based approaches to teaching yield substantial benefits to students, but assessment of students' science inquiry skills indicate more emphasis is needed on the development of inquiry-based teaching and learning in the classroom.

2016-2017 Continuous Improvement, Southwestern Oklahoma State University

Assessment Center Reports

The 2016-2017 Continuous Improvement report produced by the SWOSU Assessment Center

Evaluating The State Of The Adjunct Faculty Relationship To The College Of Aeronautics, Embry-Riddle Aeronautical University – Worldwide, Narcrisha Norman, Federica Robinson-Bryant

Publications

The research outlined in this report evaluated the current state of adjunct faculty within the College of Aeronautics, Embry-Riddle Aeronautical University – Worldwide as 0f 10/22/2015. The approach was to streamline complex challenges as they relate to adjunct faculty population through three strategic goals:

• Goal 1 – Clearly state and understand COA challenges
• Goal 2 – Consider current practices, universal challenges, and best practices
• Goal 3 – Create tailored strategies for those challenges unique to Worldwide

This research will demonstrate five specific steps outlined in Goal 3 to ensure that the college hires and retains quality adjunct faculty as part …

Spring, Summer, Fall 2017 Graduation Survey Responses, Uno Office Of Institutional Effectiveness

Graduation

Spring, Summer, Fall 2017 Graduation survey responses master file without identifiers.

Assessing Written Narratives: Current Versus Theoretical Practices, Megan Chamberlin, Michelle Tatko, Marissa Mcelligott, Savannah Lovitt

Undergraduate Theses, Professional Papers, and Capstone Artifacts

Language sample analysis (LSA) provides a non-standardized, culturally sensitive method of language assessment and is considered a best practice by the American Speech-Language and Hearing Association (ASHA). One type of LSA is the elicitation and analysis of children’s written narratives. Narratives, one type of language discourse, either fictional or personal, can be thought of as stories.

Across the literature, there are differences in the types and clinical implications of the individual types of discourse and narratives. For example, eliciting conversational discourse for LSA is less demanding for the student than eliciting narrative discourse. Additionally, research shows that students with a …

Evidence-Based Assessment In Adapted Physical Education- Affective Outcomes: A Meta-Analysis, Breanna L. Ketel

Cal Poly Humboldt theses and projects

Currently there is a lack of evidence about assessment in adapted physical education (APE) settings concerning the justification for methods or curricula being implemented by teachers in their classrooms, that is perhaps due to a lack of understanding of the central notion of evidence-based practices (Jin & Yun, 2010). The purpose of the current investigation was to conduct a meta-analytic review that evaluates assessment practices to determine the overall effect on specific student affective outcomes. A secondary purpose was to evaluate the moderating effects of different methodological, sample, and study variables. Electronic database searches were performed in SPORT …

Evidence-Based Assessment In Adapted Physical Education-Cognitive Outcomes: A Meta-Analysis, James Robert Kunkel

Cal Poly Humboldt theses and projects

There is little data to show evidence-based practices in adapted physical education and whether or not such practices are successful. Currently there is a lack of information on the frequency of which assessments are being administered, on the disabilities that are being assessed or should be assessed during each test, and on the uses for which assessments are being conducted. The aim of this paper is to assess and synthesize all evidence-based practices on cognitive outcomes in adapted physical education using a meta-analysis. Data was sourced from computerized searches using the following databases: SPORT Discus, PsycINFO, PsycARTICLES, Pub Med (Medline), …

Assessing Assessments: A Comparative Study Of Three Assessments Of Inquiry Skills In Tenth Grade High School Biology Students, Heather K. Murphy

Dissertations, Master's Theses and Master's Reports

Inquiry is an educational technique where students develop scientific knowledge and understanding through processes similar to those used by scientist. One of the obstacles to implementing the techniques is the need for teachers to self-evaluate their teaching and determine the effectiveness of inquiry-based teaching techniques with respect to developing higher-order thinking (HOT) skills in students. Feedback from an assessment permits teachers to adjust their curriculum to incorporate the most effective inquiry-base lessons.

This report considers three short assessments of inquiry that were modified for use in the high school biology classroom. First there three assessments were compared against one another …

The Doctoral Comprehensive Examination In Counselor Education: Faculty Members’ Perception Of Its Purposes, Katie Kostohryz

Journal of Counselor Preparation and Supervision

This research focused on faculty members’ perceptions of the comprehensive examination in counselor education doctoral programs. A between-within repeated measure analysis of variance was computed to evaluate significant differences in perceptions of faculty toward five stated purposes of the comprehensive examination related to their current format of the comprehensive examination. Findings showed significant differences in perceptions within the five stated purposes of the comprehensive examination. There was no significant mean difference between faculty’s perceptions of the stated purposes and the current format of the comprehensive examination; however, a significant interaction was found between the format and purposes of the exam. …

The Experiences Of University Faculty Expected To Implement Edtpa Within A Teacher Preparation Program, Lance Kilpatrick

Doctoral Dissertations and Projects

The purpose of this transcendental phenomenological study was to examine the experiences of university faculty expected to implement a teacher performance assessment called edTPA within a teacher preparation program. This study synthesized the experiences university faculty members have when preparing and implementing the edTPA. A deep examination of 12 university faculty members who teach in teacher preparation programs in a Midwestern state where the edTPA is required for licensure offer their experience through a questionnaire, an individual interview, and a focus group interview. The data were collected, organized, and analyzed by employing transcendental phenomenological systematic data analysis procedures positioned to …

Advancing Evaluation In Community Colleges: A Mixed Methods Case Study Of Outcomes-Based Assessment Training In Student Affairs, Tammy L. Russell

Dissertations

Many student affairs departments struggle to contribute to an institution’s evidence base of student learning. In part, this results from student affairs personnel not having adequate training in how to assess learning outside the classroom. This is a particular challenge for small community colleges, in which individual units (e.g., admissions or financial aid) may have only one or two employees. Failure to assess co-curricular learning poses challenges to institutions in meeting accreditation standards, placing them at risk for increased scrutiny and loss of state funding under a performance-based system. The purpose of this mixed methods study was to use a …

An Exploratory Study Into The Nature Of The Relationship Between Pre-Service Teacher Fixed Factor Characteristics And Edtpa Performance Ratings, Timothy David Gouraige

Seton Hall University Dissertations and Theses (ETDs)

This study used a quantitative, analytical, non-experimental, explanatory research design. The study used simultaneous multiple regression analysis and analysis of covariance to investigate the factors that may influence the outcome of pre-service teachers’ performance on the edTPA, and to contribute to the overall knowledge of edTPA as a pre-service teacher performance assessment. The study explored the relationship between pre-service teacher demographic and academic performance characteristics and his or her edTPA summative performance ratings in an effort to determine if a relationship exists between these fixed factors and student performance on edTPA. Additionally, this study used comparative statistics, specifically ANCOVA, to …

A Commitment To Growth, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Students begin each school year at very different stages in their learning and development. Nevertheless, every student should be expected to make excellent progress in their learning regardless of their starting point, Professor Geoff Masters AO writes.

Blockchain Technology And Its Applications, Andy Wang

ASA Multidisciplinary Research Symposium

Blockchain technology enables all stakeholders in higher education to improve trust and transparency. As electronic portfolios evolve from information repositories to robust tools for showcasing student learning, the next generation of assessment tools, measuring program quality and student learning outcomes, will be built using Blockchain technology. The presentation discusses the state of the art in Blockchain technology and its applications, focusing on applications in higher education.

Reform And The Senior Secondary School, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Traditional ways of thinking about learning, assessment and educational qualifications are being challenged. Professor Geoff Masters AO discusses the three challenges that a senior secondary school can expect to face.

A Mixed-Method Investigation Of Common Assessments Within A Suburban Secondary School, Matthew Irvin

Dissertations

The purpose of this mixed method case study, on the continued implementation of common assessments developed within Professional Learning Communities (PLCs), was to investigate possible relationships between teacher collaboration, common assessments and End of Course (EOC) assessments. The researcher investigated the perceptions of teachers and administrators in a Midwest secondary setting on common assessment development and utilization on the culture of teaching and data-driven decision making. The information from this study will provide the researched school district as well as others with insights into their implementation of PLCs and specifically the development and utilization of common assessments. In order to …

A Phenomenology Of Sixth Grade Students’ Perspectives On Their Experience Using A Rubric For Criterion-Referenced Assessment, Julie Quast

Doctoral Dissertations and Projects

The purpose of this phenomenological study was to examine sixth grade literacy students’ perspectives of rubric-referenced assessment at an inner-city school in central Arkansas. The theories guiding this study were Vygotsky’s zone of proximal development, as rubrics scaffold students learning (Reeves & Stanford, 2009) and social cognitive theory, as rubrics help students regulate their learning (Covill, 2012) and control their actions (Bandura, 1997). The sample size included 29 students completing a questionnaire, 12 students participating in a focus group session, and two students journaling their experience. The research questions focused on the experiences, perspectives, approach to assignments, and response to …

Gatton Academy Study Abroad Program Effects On Perceptions Of Community Belongingness And Personal Growth And Development, Derick Brandon Strode

Dissertations

This dissertation’s focus is at the intersection of study abroad, impact assessment, and a population of gifted and talented students at a specialized, residential high school called The Gatton Academy. A summative impact evaluation was conducted to assess effects of Gatton Academy study abroad programs on student participants’ perceptions of peer belongingness, mentor belongingness, and personal growth and development, as well as to compare differences among three different program models being employed by the school. The three program models studied included a Non-Credit program, a Faculty-led Field-Study, and a Faculty-led Traditional program. The research was conducted amidst documented calls for …

Is A Good Student Also A Happier One? Traditional Measures Of School Functioning As Predictors Of Students' Well-Being, Yael Israel-Cohen, Gabriela Kashy-Rosenbaum, Oren Kaplan

Journal of Educational Leadership in Action

Academic achievement, behavior, and school connectedness have long been considered central measures for assessing students’ optimal functioning in school. With the growing interest in positive education and its’ inclusion of well-being as a central educational goal, attention has been turned to the extent to which these traditional measures of school functioning are related to students’ well-being. Based on a sample of 314 Israeli middle school students from one school, this study focuses on the relationship between the latter measures of school functioning and students’ well-being, operationalized as life satisfaction, positive and negative affect, hope, and gratitude. Using structural equational modelling, …

Correlating English Language Learner Crct Scores On The Basis Of English Language Learner Access Scores, Nancy Mcneal

Doctoral Dissertations and Projects

The purpose of this quantitative correlational study was to test the sociocultural theory that relates English language learner students’ scores on the Georgia Assessing Comprehension and Communication in English State to State (ACCESS) test to English language learner students’ scores on the Georgia Criterion Referenced Competency Test (CRCT). The assessments scored students in language use and proficiency in listening, speaking, reading, writing, English/language arts, math, science and social studies. Specifically, the study assessed the predictive power of student scores on the ACCESS test on the criterion variable of student scores on the Georgia CRCT. The participants in the study were …

The Juvenile Addiction Risk Rating For Use In Vocational Rehabilitation, Paul Tyler Hickerson

Graduate Theses and Dissertations

The prevalence of substance use among adolescents warrants considerable concern since it often has detrimental effects on an individual’s physical and mental health, and correlates with worsened Social, physical, and employment outcomes. Research shows that adolescents with disabilities are especially susceptible to the development of substance use disorders. To address this concern and to ensure accurate rehabilitation service planning, effective screening for substance use risk is necessary. Unfortunately, the most common screening instruments for adolescent substance use rely on information obtained solely from self-report. This type of data, although useful, is also susceptible to inaccuracies due to such factors as …

Alternative Assessment And Accountability: A Case Study Of Policy Reform And Teacher Practice At The District Level, Amy Lynn Abbott

Teaching & Learning Theses & Dissertations

Deliberations on the topic of alternatives to standardized assessments spurred the 2014 Virginia General Assembly legislation (House Bill 930/Senate Bill 306) that removed five, end-of-year Virginia Standards of Learning tests from select elementary and middle school subjects and supplant them with alternative measures (Virginia Department of Education, 2014). In light of the reform, the purpose of this study was to develop a descriptive account of one large Virginia school district’s implementation of alternative, locally developed assessments designed as an intervention to enhance teaching and learning. Emphasis was on the impact of policy change in social studies practice to capture teachers’ …

Guidelines For Assessment And Instruction In Statistics Education (Gaise) College Report 2016, Robert Carver, Michelle Everson, John Gabrosek, Nicholas Horton, Robin Lock, Megan Mocko, Allan Rossman, Ginger Holmes Roswell, Paul Velleman, Jeffrey Witmer, Beverly Wood

Publications

In 2005 the American Statistical Association (ASA) endorsed the Guidelines for Assessment and Instruction in Statistics Education (GAISE) College Report. This report has had a profound impact on the teaching of introductory statistics in two- and four-year institutions, and the six recommendations put forward in the report have stood the test of time. Much has happened within the statistics education community and beyond in the intervening 10 years, making it critical to re-evaluate and update this important report. For readers who are unfamiliar with the original GAISE College Report or who are new to the statistics education community, the full …

International Developments (No.6) 2016

International Developments

In this issue of International Developments we look at the purposeful collection of educational data through progressive achievement testing to enable teachers to establish where students are in their long-term learning, diagnose individual strengths and weaknesses, identify the best next steps for action, decide on appropriate evidence-based interventions, monitor the progress students make over time, and evaluate the effectiveness of their own teaching decisions and approaches. We also explore how a new primary years assessment is helping teachers, curriculum designers and policymakers to better measure the learning achievement of students in South East Asia; investigate the impact of a professional …

Judging Airline Pilots’ Performance With And Without An Assessment Model: A Comparison Study Of The Scoring Of Raters From Two Different Airlines, David Weber

Journal of Aviation/Aerospace Education & Research

Various models have been suggested to assess the performance of airline pilots. However, the influence of a model on assessors’ scoring remains largely unexplored. The aim of the present study was to contrast the assessments of raters from two airlines, who assessed performance in pairs of the same airline and rank by using or not using an assessment model. The results showed differences between the assessors of the two airlines in terms of their scoring. Implications were drawn in regards to the usage of a model and its influence on pilot performance assessment.

Gaiseing Into The New Guidelines, Robert Carver, Megan Mocko, Jeffrey Witmer, Beverly Wood

Publications

The first GAISE College Report came out in 2005. Over the past ten years our discipline has changed in many ways, including but not limited to what type of data is easily available, the technology that we use, as well as how we teach students. In this presentation we will briefly start with how the new GAISE 2016 guidelines and goals have changed, including the two new emphases of statistical thinking: giving students experience with multivariable thinking and with the investigative process. So how do you start to implement these new ideas? In this presentation, we will demonstrate an activity …