Education Commons^™

Rethinking Assessment In Response To Generative Artificial Intelligence, Jacob Pearce, Neville Chiavaroli

Higher education research

The use of decision-making support tools during assessments, such as electronic differential diagnosis in examinations, is just the tip of the iceberg when it comes to how technology is currently changing assessment practice. We have reached a transformative stage in the development of artificial intelligence (AI). We can no longer rely on non-invigilated assessments and submitted ‘artefacts’ to demonstrate student learning and competence. This is bringing many long-term demands on educators, course coordinators and curriculum designers, forcing us to rethink assessment approaches. Going forward, we see an important distinction between ‘assisted’ assessments and ‘unassisted’ assessments. With the recent increase and …

2022-2023 Annual Student Assessment Report, Southwestern Oklahoma State University

Assessment Center Reports

Annual Student Assessment Report produced by the SWOSU Assessment Center.

2021-2022 Annual Student Assessment Report, Southwestern Oklahoma State University

Assessment Center Reports

Annual Student Assessment Report produced by the SWOSU Assessment Center.

Peer Review Of Teaching Benchmark Portfolio - Nres/Wats/Bio 459/859: Limnology, Jessica Corman

UNL Faculty Course Portfolios

Limnology (NRES/BIO/WATS 459/859) is an upper-division course taken primarily by Fisheries and Wildlife and Water Science majors in the College of Agricultural Sciences and Natural Resources (CASNR) at the University of Nebraska-Lincoln. Although the course enrollment is open to graduate students, none were enrolled in the year in which this portfolio was written. Learning outcomes focus on understanding the interdisciplinarity of limnological sciences, assessing anthropogenic impacts on lake ecosystems, learning basic limnological field techniques, and investigating and critically evaluating relevant, publicly available datasets. The course satisfies the “ACE 10” requirement for undergraduate students; students meet this requirement by completing a …

Designing Rubrics For Authentic Assessment, Kathryn Richardson, Anne-Marie Chase

Dr Anne-Marie Chase

This presentation looks at the steps in developing authentic rubrics, from determining the constructs that will be assessed; breaking down the constructs into a set of broad capabilities that need to be observed; transferring capabilities into indicative behaviours (indicators or criteria); and determining the different levels of proficiency.

Student Perspectives On The Immediate Feedback Assessment Technique, Lauren E. Milton, Laura E. Landon

Journal of Occupational Therapy Education

A retrospective qualitative study was conducted to explore first-year occupational therapy graduate student perspectives on the Immediate Feedback Assessment Technique (IF-AT) which was implemented during a two-semester neuroscience course. The IF-AT system was used during small group application activities six times across a two-semester course sequence. Students discussed multiple-choice questions in small groups, used critical thinking skills and collaboration to select answers, then finally used the IF-AT scratch-off cards to indicate selections. At the conclusion of the second semester, 33 students provided qualitative feedback regarding their experience using the IF-AT. Conventional content analysis was used to capture the student voice …

Developing A Global Health Assessment Collaboration: Ancillary Report, Daniel Edwards, Jacob Pearce, David Wilkinson

Dr Daniel Edwards

This document reports on a project designed to develop an assessment collaboration between medical schools in both Australia and the United Kingdom. The project was funded by the Office for Learning and Teaching (OLT), utilising surplus funding from a broader assessment collaboration project – the Australian Medical Assessment Collaboration (OLT ID12-2482). The Global Health Assessment Collaboration (GHAC) involved five universities in Australia and the United Kingdom (UK). It developed an assessment framework and item specifications, undertook assessment item drafting workshops, built in a process of review and resulted in the development of a focused suite of assessment items. This report …

Designing Rubrics For Authentic Assessment, Kathryn Richardson, Anne-Marie Chase

Teacher education

This presentation looks at the steps in developing authentic rubrics, from determining the constructs that will be assessed; breaking down the constructs into a set of broad capabilities that need to be observed; transferring capabilities into indicative behaviours (indicators or criteria); and determining the different levels of proficiency.

Developing A Global Health Assessment Collaboration: Ancillary Report, Daniel Edwards, Jacob Pearce, David Wilkinson

Higher education research

This document reports on a project designed to develop an assessment collaboration between medical schools in both Australia and the United Kingdom. The project was funded by the Office for Learning and Teaching (OLT), utilising surplus funding from a broader assessment collaboration project – the Australian Medical Assessment Collaboration (OLT ID12-2482). The Global Health Assessment Collaboration (GHAC) involved five universities in Australia and the United Kingdom (UK). It developed an assessment framework and item specifications, undertook assessment item drafting workshops, built in a process of review and resulted in the development of a focused suite of assessment items. This report …

Governance Models For Collaborations Involving Assessment, Australian Medical Assessment Collaboration (Amac), Ben Canny, Hamish Coates

Higher education research

This paper is driven by a desire to improve assessment in higher education to yield better outcomes for communities, professions and individuals. The analysis unfolds within the field of medicine but is conceptualised to be of much broader relevance to other professional fields and academic disciplines. The focus is on assessment during the course as opposed to assessment for admissions or licensing purposes. The interest in assessment is not simply to produce practitioners, but to develop better practitioners. As well, the remarks are bounded by the context of universities in Australia and hence the complex but important assumption of academic …

Checklist For Assessing Graduate Student Competencies In Voice Disorders, Amy F. Teten, Shari L. Deveney, Mary J. Friehe

Special Education and Communication Disorders Faculty Publications

Low-incidence clinical disorders such as voice, nasal resonance, and fluency present challenging areas for graduate-level speech-language pathology training programs to help students acquire necessary knowledge and skills. A checklist of competencies for fluency disorders exists in the literature. The authors are presently collecting pretest/posttest data on the fluency disorders checklist over several cohorts of graduate students to determine student level of proficiency and confidence regarding these competencies. Preliminary data analysis suggests significant student perception of growth as a result of completing course requirements. These data have been useful to the second author, who teaches a course in fluency disorders and …

Designing Online Assessment For Improved Student Learning And Experience, Roy Wybrow, Pauline Taylor, David Smorfitt

Associate Professor Pauline Taylor-Guy

The Australian Medical Assessment Collaboration: Developing The Foundations For A National Assessment Of Medical Student Learning Outcomes, David Wilkinson, Daniel Edwards, Hamish Coates, Ben Canny, Jacob Pearce, Jennifer Schaefer, Tracey Papinczak, Lindy Mcallister

Higher education research

In late December 2010 the Australian Learning and Teaching Council Ltd (ALTC) provided a grant to The University of Queensland along with the Australian Council for Educational Research (ACER) and Monash University to develop foundations for a national assessment that evaluates the learning outcomes of later‐year medical students in Australia. The project, titled ‘Developing the foundation for a national assessment of medical student learning outcomes’ responds to the growing need to prove and improve the standards of medical education by establishing an Australian Medical Assessment Collaboration (AMAC). This project includes scoping work, wide‐ranging sector engagement, development of an assessment framework, …

Mega Champs Field Trip: A Lesson In Character Development, Kim Akinyanju, Korrie Allen, Edward Lorek

Academic Leadership: The Online Journal

The existence of a policy does not necessarily mean that a school will ‘enact’ it (Fulcher, 1997). Queensland Government’s current P-12 Curriculum Framework provides schools with a direction to achieve “a curriculum for all”. However, experience with working with secondary school staff is that they are commonly unaware of the implications of this policy to their everyday work. In fact, they usually respond to any references by the writer to a “curriculum for all” (meaning providing a curriculum for all students in their class, including those with disabilities) with “Where does it say I have to do that?” Meaning, “…where …

Assessment Practices In English Language At The Nigerian Secondary School Level: A Psycholinguistic Issue, Oluwole Akinbode, Anthony Dairo

Academic Leadership: The Online Journal

The major purposes to which the results of assessment could be put were diagnosis, evaluation, guidance, grading prediction, and selection. In Nigeria, it is unfortunate that the results of many examinations have been used almost exclusively for grading and promotion exercises and inevitably there has been a neglect of diagnosis, guidance and evaluation although considerable informal use of assessment for these purposes are made by teachers in the classroom.

Outcomes Assessment, Michele Langbein

Academic Leadership: The Online Journal

Outcomes assessment is an intense topic that has been debated and discussed on university campuses around the world. Educational accountability is a very important topic. There is tremendous pressure from accreditation agencies to comply with outcomes assessment requirements to maintain accreditation. In addition, to be competitive in a market of many choices, students, employers, and legislators are seeking trustworthy programs. This has raised many questions for Provosts, Deans, and Department Chairs. What are the purposes of outcomes assessment? What should we assess? What methods should we use? How do we overcome faculty objections? Do we need to hire additional administrators …

Fundamental Issues In L2 Classroom Assessment Practices, Esmael Hamidi

Academic Leadership: The Online Journal

The purpose of this paper is to provide L2 teachers with a succinct, conceptual framework of implementing the assessment forms to facilitate the relevant practical issues in L2 classrooms while focusing the current theories and views of assessment issues in L2 classrooms. I begin with giving a good rinse-out to assessment by distinguishing it from testing and evaluation. Then, following a brief account of the pedagogical history of assessment with a major focus on its ‘authentic’ aspect as the current concern to the educators of the field, I will discuss four criteria regarding the quality of assessment. The paper will …

Predicting Adequate Yearly Progress: Leaving Explanation Behind, Jenifer Moore

Academic Leadership: The Online Journal

The purpose of this research was to determine if the variables included in the Mississippi Report Card utilized for the calculation of AYP can be used to predict whether or not Mississippi LEAs will attain adequate yearly progress in reading and math using the logistic regression technique. This study demonstrated that using the variables utilized for the calculation of AYP, a predictive model can be successfully utilized to classify Mississippi LEAs that will and will not attain AYP in reading and math with an accuracy greater than that which can be attributed to chance.

Implementing An Assessment Program: A Faculty Member’S Perspective, Robert Becker

Academic Leadership: The Online Journal

In 1999, after several exploratory meetings, the college administration established an ad-hoc interdisciplinary assessment committee to begin a conversation about what students were taught and how faculty knew what was learned and what was not. At the first meeting of this committee, composed of representatives of the college’s seventeen teaching departments, the library, student affairs, institutional planning, research, and assessment, and academic affairs, several impediments to a formalized college-wide assessment initiative immediately became apparent. While a culture of informal assessment already existed as instructors daily grappled with effectively teaching their students, the notion of a widespread institutionalized plan was alien. …

A Pilot Study: The Relationship Of Hope And Anxiety In Graduate-Level Counseling Students Anticipating Taking A Tests And Measurements Course., Sandeep Kaur

Academic Leadership: The Online Journal

The ability of comprehend test-based assessments implies careful training and the question arises of the dynamics of the tests and measurements course which are required for masters level counseling students. Research has focused thoroughly on education and training in psychological assessments addressing issues such as how students ought to be trained in the area (Childs & Eyde, 1990), however little investigation has been done on how students perceive the tests and measurements course. While studies have shed light on the fact that often students themselves tend to question the adequacy of their training (Dempster, 1990; Hilsenroth & Handler, 1995), there …

Why Are Faculty Wary Of Assessment?, D. Haviland

Academic Leadership: The Online Journal

Explanations for faculty hesitancy may be practical or principled, based on experience or hearsay, emerge from more general concerns about change, or be related to assessment in particular. Ultimately the reasons fall into four main categories: worries about the new work assessment presents, a “culture gap” in the way assessment is presented, poor word of mouth about assessment systems, and concerns about academic freedom.

Y Cant They Rite?: Integrating Writing Assessment Across The Undergraduate Political Science Major, Shala Mills, Bryan Bennett

Academic Leadership: The Online Journal

Historically, student assessment in the Political Science Department at Fort Hays State University was left to the individual faculty member to embed into his or her courses via exams and writing assignments. Our curriculum and learning objectives were based largely on faculty interest in particular courses and on broad perspectives of what substantive knowledge a political science major should demonstrate. Over the years, writing courses such as advanced research methods and upper division theory courses served as unofficial capstone experiences. As such, approaches and expectations varied depending upon who was delivering the course.

Implementing An Assessment Program: A Faculty Member’S Perspective, Robert Becker

Academic Leadership: The Online Journal

In 1999, after several exploratory meetings, the college administration established an ad-hoc interdisciplinary assessment committee to begin a conversation about what students were taught and how faculty knew what was learned and what was not. At the first meeting of this committee, composed of representatives of the college’s seventeen teaching departments, the library, student affairs, institutional planning, research, and assessment, and academic affairs, several impediments to a formalized college-wide assessment initiative immediately became apparent. While a culture of informal assessment already existed as instructors daily grappled with effectively teaching their students, the notion of a widespread institutionalized plan was alien. …

Leading Assessment: From Faculty Reluctance To Faculty Engagement, Don Haviland

Academic Leadership: The Online Journal

Assessing college student learning consumes substantial energy, driven or encouraged by accrediting bodies, the Federal and state governments, and other stakeholders. One might think, for these reasons as well as the longevity assessment has displayed as a movement, that it would be celebrating its many successes in transforming higher education.

An Investigation Of Assessment Practices By Teachers Business Education Subjects, Janet Adetayo

Academic Leadership: The Online Journal

Assessment is the process of gathering information about a student in order to make decisions about his or her education. Assessment is used for different purposes within different levels of the educational system, for example external assessment in most cases serve as accountability measures and as a result they induce teachers to devote significant amounts of instructional time to preparing students to excel in these examinations even when those examinations do not match the curricula.