Educational Assessment, Evaluation, and Research Commons^™

Recognising The Value Of The Arts And Humanities In A Time Of Austerity, Ellen Hazelkorn, Mairtin Ryan, Andrew Gibson, Elaine Ward

Reports

No abstract provided.

Assessment In Simulations, Chad Raymond, Simon Usherwood

Faculty and Staff - Articles & Papers

Simulations are employed widely as teaching tools in political science, yet evidence of their pedagogical effectiveness, in comparison to other methods of instruction, is mixed. The assessment of learning outcomes is often a secondary concern in simulation design, and the qualitative and quantitative methods used to evaluate outcomes are frequently based on faulty paradigms of the learning process and inappropriate indicators. Correctly incorporating assessment into simulation design requires that an instructor identify whether a simulation should produce positive changes in students' substantive knowledge, skills, and/or affective characteristics. The simulation must then be assessed in ways that accurately measure whether these …

Gaise In Discipline-Specific Courses, Beverly Wood

Publications

While acknowledging the diverse setting, audience, and purpose of introductory courses, existing research assumes that courses offered by different disciplines share the same goals and teaching practices. The purpose of this study is to examine the objectives for student outcomes and pedagogical delivery of introductory statistics courses designed for students in a specific major, providing explicit evidence for this assumption.

The American Statistical Association’s Guidelines for Assessment and Instruction in Statistics Education (GAISE) are meant to apply to all introductory courses. The College Report’s Goals for Students and Recommendations for Teaching are used as a framework for a qualitative study …

Making Grades Matter: Connections Between Teacher Grading Practices And Attention To State Assessment, Gregory D. Warsen

Dissertations

Research suggests that traditional grading practices are fraught with subjective problems and that many factors go into grading that have little, if anything, to do with what a student knows or is able to do. More recent research, however, has made connections between teacher-assigned grades and subsequent performance on the American College Test using correlational studies. This study reinforces and extends that work by, first, testing the relationship between grade point averages (GPAs) and ACT scores for four graduating high school classes in two case study high schools. Then, this study qualitatively examines teacher thinking and decision making around planning …

Instruction Matters: Purdue Academic Course Transfomation, Chantal Levesque-Bristol, Tomalee Doan

IMPACT Presentations

Webinar presentation given at Wiley Learning. Summarizes Instruction Matters Purdue Academic Course Transformation (IMPACT). Describes IMPACT goals, campus-wide collaboration, professional development program, IMPACT classrooms, assessment plan and progress to date. Discrusses student perceptions and learning gains.

Europe Looks For Better Ways To Measure The Value Of The Arts And Humanities, Ellen Hazelkorn

Other resources

No abstract provided.

Assessing The Research Process Improves The Product: Results Of A Faculty-­Librarian Collaboration, Divonna M. Stebick, Janelle L. Wertzberger, Margaret E. Flora, Joseph W. Miller

Education Faculty Publications

When an education professor and a reference librarian sought to improve the quality of undergraduate student research, their partnership led to a new focus on assessing the research process in addition to the product. In this study, we reflect on our collaborative experience introducing information literacy as the foundation for undergraduate teacher education research. We examine the outcomes of this collaboration, focusing on the assessment of the process. Using a mixed methods approach, we found that direct instruction supporting effective research strategies positively impacted student projects. Our data also suggest that undergraduate students benefit from not only sound research strategies, …

Improving Basic Electrical Principles In Motor Apprentice Education, Peter Kenny

Teaching Fellowships

The objective of this project was to develop a set of both theoretical and practical electrical exercises/assessments in the form of a diagnostic test to assist motor apprentices with their course work as well as helping to improve their core skills of basic electricity and electronics during attendance of their ten week, Phase 6 motor apprenticeship off-the-job training course at the Technological University Dublin.

The diagnostic test was conducted in two stages, one at the beginning of the ten week training course and the second one towards the end of the ten week course. Data obtained from the diagnostic test …

Reflections On A Decade Of Global Rankings: What We've Learned And Outstanding Issues, Ellen Hazelkorn

Articles

Ten years after the first global rankings appeared, it is clear that they have had an extraordinary impact on higher education. While there are fundamental questions about whether rankings measure either quality or what’s meaningful, they have succeeded in exposing higher education to international comparison. Moreso, because of the important role higher education plays as a driver of economic development, rankings have exposed both an information deficit and national competitiveness. Accordingly, both nations and institutions have sought to maximise their position vis-á-vis global rankings with positive and perverse effects. Their legacy is evident in the way rankings have become an …

Increasing The Visibility Of The Quality Of The Ehea: Benchmarking The Total Student Experience, Ellen Hazelkorn

Other resources

No abstract provided.

Ideas, Hints, And Tricks: So Much More Than What's On The Surface: Assessing Reference Services At Academic Libraries, Paula M. Adams

Georgia Library Quarterly

Much of what's missing from the discussion of assessing reference services is the dire need to fully realize the value of qualitative assessment. The need for more academic libraries to utilize this method of gathering statistics can open up a much needed discussion concerning the nuanced impact of reference services on student learning outcomes and the broader picture of higher education.

The Gaise College Report: The American Statistical Association Meets Sound Pedagogy In Central Virginia, Beverly Wood

Publications

Research in undergraduate statistics education often centers on the introductory course required for a large percentage of college students. While acknowledging the diverse setting, audience, and purpose of introductory courses, existing research assumes that courses offered by different disciplines share the same goals and teaching practices. The purpose of this study is to examine the objectives for student outcomes and pedagogical delivery of introductory statistics courses in various academic departments to provide explicit evidence for this assumption. The American Statistical Association’s Guidelines for Assessment and Instruction in Statistics Education (GAISE) are meant to apply to all introductory courses. The College …

The Effect Of Differentiated Instruction On Standardized Assessment Performance Of Students In The Middle School Mathematics Classroom, Kimberly Gail Williams

Doctoral Dissertations and Projects

Changing demographics, student diversity, and increased accountability have compelled educators to challenge the uniform constraints of traditional instruction and create an environment focused on individual achievement. Differentiated instruction empowers teachers to target multiple learning styles through varied themes, adapted content delivery, and assessment options. This quantitative quasi-experimental research study examined the effects of differentiated instruction on seventh grade student performance on standardized mathematics assessments using a repeated-measures design. Two independent research trials, controlling for initial group differences with 2011 Texas Assessment of Knowledge and Skills (TAKS) scores, provided inconclusive assessment results. Significant differences between students who received differentiated instruction compared …

Collection Of Online Learning Objects For Research Success (Colors) Pilot Project, Andrea Falcone, Stephanie Wiegand

University Libraries Publications

The availability of library-related videos is growing; yet it is difficult to justify the impact of such time-consuming projects. In order to investigate the impact of such projects and a possible solution, the researchers asked students to create videos that appeal to their peers. The following research questions were posed:

• Will creation of media projects enable students to learn core research concepts and skills?
• Will a series of peer-created media engage students and help them acclimate to researching in an academic library?

By asking students to create videos, the researchers were able to observe how users interact with and perceive …

Information Literacy At Johnson & Wales University 2011-2012, Ariela Mccaffrey, Lori Micho, Nicole Covone, Joe Eshleman

Library Staff Publications

This initial document details some ideas and thoughts related to the development of librarians who instruct at the four Johnson & Wales University campuses. A group of five librarians at the four campuses developed the document; Amanda Samland, Ariela McCaffrey, Nicole Covone, Lisa Spicola, and Joe Eshleman, Seven aspects of library instruction are addressed as well as ideas for the application of the guidelines. Finally, next steps towards application of the guidelines are listed.

The Effect Of The Private Classroom Blog On The Acquisition Of Formal Writing Proficiency With Spanish Iii High School Students, Olga Glymph

Doctoral Dissertations and Projects

This study examined the impact of a private classroom blog implemented as an instructional technology on student writing proficiency in a world language with the focus on formal writing. The nonequivalent control-group, pre-posttest design was used to determine if the use of the private classroom blog in teaching world language formal writing affected student writing proficiency with the specific focus on task completion, comprehensibility, level of discourse, vocabulary, and language control. This research study used a convenience sample of sophomore, junior, and senior students in a Georgia public high school. Independent raters evaluated students' writings using the Fairfax County Public …

Teacher Evaluation Systems And Multi-Cultural Commonalities And Challenges: England, Mexico, Portugal, Finland, Ireland, And Turkey, Jacqueline P. Kelleher, Sandra Kase

Education Faculty Publications

Our hope is that policymakers, educators, and concerned citizens will focus on teacher evaluation (in the United States) as a way to ensure high quality teaching and to promote both professional development and reflective self assessment. We advocate for credible tools and appropriate preparation of evaluators conducting the assessment of teachers and school-based staff. Further, we argue for time - time allocation for school leaders to observe and evaluate in meaningful ways, followed by targeted, rich dialogue about practice and professional growth. District level policies will need to be developed and 17 implemented to ensure this exchange can occur right …

Relationship Between Assessment And Students’ Learning, Babar Khan

Professional Development Centre, Gilgit

Assessment is a critical aspect of teaching and learning process which aim at collecting, interpreting and analyzing the regarding students’ performance. The quality of learning is determined by the quality of assessment practices in the classroom. There are many purposes of assessment that focus on the different dimensions of educational development, however, the most dominant purposes of assessment are improving students’ learning and develop accountability measures for learning at classroom and school levels. For effective assessment, using appropriate assessment strategies is significant. There are number of that can be employed to enhance students’ learning outcome but teacher rely on only …

Internships And The Assessment Of Student Learning, William K. Templeton, Karel A. Updyke, Robert B. Bennett

Scholarship and Professional Work - Business

The use of internships is a powerful learning tool that allow business students to make connections between their classroom experience and the world of work. If designed appropriately and positioned correctly in the curriculum, they can also be an ideal opportunity to conduct assurance of learning activities related to business school accreditation. This study reports on survey results relating to business schools’ use of internships in their assurance of learning efforts and describes one school’s successful attempt to use internships as the key platform for its well-developed assurance of learning program.

A Teaching Practice Review Of The Use Of Multiple-Choice Questions For Formative And Summative Assessment Of Student Work On Advanced Undergraduate And Postgraduate Modules In Engineering, Aidan O'Dwyer

Articles

This paper reflects on, reports on and evaluates the use of multiple-choice questions, in both formative and summative assessment modes, on control engineering modules taken by advanced undergraduate and postgraduate engineering students, over four academic years. The material covered by the modules is analytical in nature. The rationale for examining the assessment strategy was the poor performance by students in a closed book traditional terminal examination on one of the advanced undergraduate modules over some years. The change in assessment strategy has improved student learning, as measured by assessment data; student feedback on the assessment methods is broadly positive. The …

Principles For Designing An Effective, Post-Compulsory Music Curriculum Suitable For Western Australia, Andrew T. Sutherland

Theses: Doctorates and Masters

A new post-compulsory Music course known as the Western Australian Certificate of Education (WACE) Music course was recently introduced into Year 11 and 12 in Western Australian (WA) schools. Following a convoluted process of creation, its implementation into classrooms has been problematic. Given criticism levelled at its process of creation and implementation, the researcher questions whether the WACE Music course embodies effective, recognised principles to support the effective teaching and learning of music. This study investigates the principles which should form the basis of an effective, post-compulsory music curriculum, suitable for WA. It involved a literature review which sought to …

A Study Of K–12 Music Educators' Attitudes Toward Technology-Assisted Assessment Tools, Lance D. Nielsen

Glenn Korff School of Music: Dissertations, Theses, Student Creative Work, and Performances

The purpose of this study was to examine K-12 music educators’ attitudes regarding the use of technology in the assessment of music learning. There is a considerable range of musical behaviors with different levels of complexity that can be assessed (Boyle & Radocy, 1987). A variety of software and web-based assessment tools are available for music educators. However, it is unclear how many teachers are taking advantage of incorporating these technological assessment tools into their instructional practice. This study provided current data about the demographics of teachers using technology to assess musical growth and the variables that might motivate a …

Student, Practitioner, Or Both?:Separation And Integration Of Identities In Professional Social Care Education, Fiona Mcsweeney

Articles

This paper presents and discusses some of the findings from a qualitative study of identities in work-related learners. The theoretical framework of structural symbolic interactionism is outlined and the two identities of interest, that of student and practitioner discussed. The aim of professional education is viewed as enabling the practitioner to deal with ambiguity and change through critical examination of work practices and location of these within theoretical frameworks. It is argued that for knowledge and behaviour to transfer to the work setting the student and worker identities need to be integrated rather than kept separate. Factors identified as influencing …

Simulation And Visualization Enhanced Engineering Education- Development And Implementation Of Virtual Experiments In A Laboratory Course, Sushil K. Chaturvedi, Kaustubh A. Dharwadkar

Mechanical & Aerospace Engineering Faculty Publications

This paper presents results from a National Science Foundation grant titled "Simulation and Visualization Enhanced Engineering Education", funded by the EEC division. Although the scope of the project is quite broad, embracing a wide range of courses in three engineering disciplines, the present work describes the results obtained from application of simulation and visualization for development and implementation of web-based virtual engineering laboratories. The present work leverages the advancement in hardware and software technologies to map physical experiments into web-based virtual experiments that can be used to enrich student's laboratory experience. Four physical experiments in the thermo-fluids laboratory course have …

Design Of Computer-Based Assessment Secondary Education For Understanding Of Mathematics, Mark Damian Lewis

Boise State University Theses and Dissertations

The purpose of this study was to evaluate the effectiveness of a computer-based assessment to reveal mathematical understanding. Relevant literature suggested that developments in cognitive science and computer-based assessments could allow the outcomes of cognitively guided instruction to be made explicit. An assessment instrument designed to make mathematical thinking explicit was developed and administered, consisting of 15 animations showing the solutions of one and two digit multiplication problems. A consistent set of five questions followed each animation. The assessment was administered to four classes of fourth grade students in two elementary schools participating in cognitively guided instruction professional development programs. …

The Relationship Between Formative Assessment And Student Engagement At Walters State Community College., Cary E. Jenkins

Electronic Theses and Dissertations

The purpose of this study was to determine whether there was a relationship between formative assessment and student engagement at Walters State Community College. Additionally, a secondary purpose examined differences in the in the dimensions of student engagement dimensions (skills engagement, emotional engagement, participation or interaction, performance) based on gender, school classification (freshman, sophomore), and age.

Two hundred thirty-nine Walters State Community College students taught with face-to-face pedagogy comprised the population for the study. The survey instruments included a 15-item formative assessment survey selected from the Walters State Community College Student Opinion of Teaching and Course (WSCCSOTC) and the Student …

Electronic Portfolios Across The Disciplines: Using Technology As An Authentic Assessment Tool, Linda Anstendig, Beth Klingner

Cornerstone 3 Reports : Interdisciplinary Informatics

No abstract provided.

Assessing Europe's University-Based Research, European Commission:Expert Group On Assessment Of University-Based Education, Ellen Hazelkorn

Reports

This report presents findings of the Expert Group on Assessment of University-Based Research set up by the European Commission, DG Research in 2008 to identify the framework for a new and more coherent methodology to assess the research produced by European universities.

The Enhancement Of Student Learning Through Engagement And Feedback In The Assessment Process, Niall Delaney, Alan O'Donnell

Conference Papers

The Technological University Dublin is one of the largest multi-level higher education providers in Ireland, catering for over 22000 students annually. Under the 1999 Qualifications (Education and Training) Act, DIT became an awarding body in its own right. Programme provision covers apprenticeships, short continuous professional development courses, taught undergraduate and postgraduate, research MPhil and PhDs. The Institute’s traditional mission has always been focused on learning and teaching in the field of advanced technical vocational education and training (TVET), and one of its current agendas is to foster and encourage changes in teaching practice and methodology in order to enhance a …

The Future Of Natural Selection Knowledge Measurement: A Reply To Anderson Et Al. (2010), Ross Nehm, Irvin Sam Schonfeld

Publications and Research

The development of rich, reliable, and robust measures of the composition, structure, and stability of student thinking about core scientific ideas (such as natural selection) remains a complex challenge facing science educators. In their recent article (Nehm & Schonfeld 2008), the authors explored the strengths, weaknesses, and insights provided by a detailed exploration of three commonly used measures of student thinking about natural selection in a large sample of underrepresented minority students. One of their core findings was that all of the tools they studied--including the CINS--have strengths and weaknesses that must be carefully taken into consideration by those …