Digital Commons Network^™

Practical And Pedagogical Aspects Of Learning Through Participation: The Ltp Assessment Design Framework, Jacqueline A. Mackaway, Theresa Winchester-Seeto, Debra Coulson, Marina Harvey

Journal of University Teaching & Learning Practice

Assessment of student learning in experience-based education is recognised as being a complex but important task. Practitioners are faced with a myriad of practical and pedagogical issues that influence what and how they assess, and can severely impact the effectiveness of assessment strategies.

This paper presents a synthesised overview of the literature about assessment of student learning that is usually discussed in dispersed arenas and under different headings, such as work-integrated learning, cooperative education, practicum, project-based learning and service-learning etc. The term Learning through Participation (LTP) is introduced to cover all of these areas, but especially those where students undertake …

Indirect Feedback: A Dialoguing Approach To Assessment, Dimitrios Vlachopoulos, Ricardo Tejeiro, Anthony Edwards, Estefania Campos

Higher Learning Research Communications

Whilst there is consensus in the current literature that feedback plays a fundamental role to student performance and learning, there is also debate about what makes it effective. Particularly, some assessment instruments, like the National Student Survey in the United Kingdom, reveal that evaluation and feedback are systematically amongst the areas that students are less satisfied with. This paper aims to describe the ‘indirect feedback’ (IF) technique, which was utilised by the principle author in his previous tenure as a Professor at the University of Cadiz (Spain) and to reflect on how it can be applied to overcome some of …

Assessment Of Acculturation: Issues And Overview Of Measures, Ozgur Celenk, Fons J.R. Van De Vijver

Online Readings in Psychology and Culture

Publicly available acculturation measures are systematically reviewed based on three criteria: scale descriptors (name of the scale, authors, year, target group, age group, subscales, and number of items), psychometric properties (reliabilities) and conceptual and theoretical structure (acculturation conditions, acculturation orientations, acculturation outcomes, acculturation attitudes, acculturation behaviors, conceptual model and life domains). Majority of the reviewed acculturation measures are short, single-scale instruments that are directed to specific target groups. Additionally, they mainly assess behavioral acculturation outcomes than acculturation conditions and orientations. Regarding the psychometric properties; most measures have an adequate internal consistency; yet cross-cultural validity of the instruments have not been …

Assessing The Culture Of Fresh Produce Safety Within A Leafy Green Producing Community, Kurt D. Nolte, Charles A. Sanchez, Jorge M. Fonseca

The Journal of Extension

The 2006 Escherichia coli outbreak in spinach prompted the implementation of unprecedented production strategies (Arizona Leafy Green Products Shipper Marketing Agreement) to minimize microbial risk in leafy greens. As the new procedures require assessments of physical intrusion and excrement in fields, outreach was initiated to educate adult (20-35, 35-50, and > 50 years) Yuma, Arizona residents about these guidelines and animal (e.g., pets, horses) stewardship. Pre- and post-assessments revealed that while sensitivity to fresh produce safety improved, adults over 35 years were more industry responsive. Citizen-based outreach programs, in communities where fresh produce is grown, could benefit field-level safety mitigation.

A Successful Multi-Institutional Blog For Transferring Garden And Landscape Information To The Public, Jeffrey Gillman, Linda Chalker-Scott, Holly Scoggins, Bert Cregg

The Journal of Extension

In July 2009 four faculty members from four different institutions created a blog to educate consumers and professionals about plant-related issues. Online resources were used to measure the number of times that the blog was viewed and its impacts. The blog averages about 200 views a day, and 80% of those responding to a survey could name specific impacts that the blog had on their gardening and landscape practices.

Evaluation Of Academic Competencies Through Standardized Instruments, Oscar Garcia López, Gema Santiago Gómez, Sara Redondo Duarte

Higher Learning Research Communications

The aim of this investigation is to assess the correlation among different competencies-assessment systems available on the market to measure social skills in the university environment. In order to carry out the research, three self-perception competency tests were used, and 30 competencies were evaluated in a Likert scale with several response levels: the LPA-Q, the ESCI-U, and the CompeUEM. The three questionnaires were completed by 57 university students. The results show a low degree of agreement among the different questionnaires in relation to measuring the same competencies, as well as an unclear factor structure.

Assessment Training In Principal Preparation Programs, Bettye Grigsby, Winona Vesey

Administrative Issues Journal

The role of the administrator has evolved over the past 30 years from manager to instructional leader. As instructional leaders, administrators are now responsible for student achievement on high-stakes state-mandated assessments. Therefore, it is imperative principal preparation programs provide the necessary training instructional leaders need to analyze and interpret assessment data and make informed decisions toward school improvement. This descriptive study analyzes four syllabi components to determine the extent to which testing and measurement are covered in each course: objectives, classroom sessions, resources, and activities. Based on responses from 30 universities across the United States, less than 30% of principal …

Assessing Individual Student Progress: Meeting Multiple Accreditation Standards And Professional Gatekeeping Responsibilities, Virginia A. Kelly

Journal of Counselor Preparation and Supervision

Counselor education departments are often required to meet multiple accreditation standards that include assessment of individual student learning. Additionally, faculty in counselor education departments are responsible for acting as professional gatekeepers. The authors propose a model for assessment of individual student potential at the time of program admission. In addition, a comprehensive assessment process applied as students make the transition into clinical fieldwork is described.

Using Learning Contracts In The Counselor Education Classroom, Kim C. O'Halloran, Megan E. Delaney

Journal of Counselor Preparation and Supervision

Adult students in counselor education programs bring diverse experiences to the classroom. In order to attract and retain students, institutions are exploring multiple delivery systems of instruction. The following study provides an overview of learning styles and characteristics of adult graduate students and explores the degree to which learning contracts may be a beneficial tool to positively impact student learning in the counselor education classroom. Surveys were administered pre- and post-participation in a master’s level counselor education classroom regarding the use of a learning contract. Results indicated that participants found the learning contract to be useful and allowed the students …

Faculty Perspective On Competency Development In Higher Education: An International Study, Paloma Julia Velasco, Begoña Learreta, Claudia Kober, Irene Tan

Higher Learning Research Communications

The purpose of this research is to establish common ground on how faculty development should be instituted and the needs it should address on an international level, with its major focus being the development of competencies. A survey was developed and distributed to a sample of 764 university teaching professionals. Results show that 90% find that it is either important or very important to develop competencies in higher education, and that 73% find they are well or very well trained in developing and assessing competencies, particularly with regard to applying theoretical knowledge in practice, teamwork, and oral and written communication …

General Education: Learning From The Past, Preparing For The Future, Karen Gersten

Higher Learning Research Communications

This article explores the widening gap between business and societal needs and current general education curricula. Research is presented that documents gaps between projected needs of industry and current practices in postsecondary education especially in the general education areas. Positive efforts to close the gap are highlighted. Also highlighted are changing regulatory environments, some that support forward-thinking approaches to liberal education and others that revert to traditional educational practices. With a focus on adaptability and intentional teaching and learning, recommendations are presented for flexible curriculum, intentional pedagogy, and a backwards approach to the teaching-learning enterprise that begins with authentic assessment …

Development And Assessment Of Key Skills In Undergraduate Students: An Action-Research Experience, Ana Fernández-Santander, María José García-García, Beatriz Sáez-Pizarro, María José Terrón-López

Higher Learning Research Communications

Employers look for professionals able to work in a team, able to approach problems, with the capacity to analyze and resolve problems, under the constant renewal of knowledge and competencies. In this paper, a group of University teachers from different areas of knowledge presents an experience to introduce key employability skills in the higher education students’ curricula. This work has been developed under the action research scope. The first goal was to make an analysis of terms referred to key skills, generating an integrated denomination for each competency. The elaboration of general templates for key skills is proposed here as …

Parts Of The Whole: An Algebra Lesson, Dorothy Wallace

Numeracy

This column draws on research of Eon Harper to demonstrate how an understanding of his proposed stages of algebra acquisition would inform a systemic overhaul of algebra education. Harper's stages also explain why students may pass a series of algebra courses yet still be unable to make sense of calculus, as well as offering insight on what aspects of algebra support quantitative literacy.

Quantitative Reasoning In The Contemporary World, 3: Assessing Student Learning, Stuart Boersma, Caren Diefenderfer, Shannon W. Dingman, Bernard L. Madison

Numeracy

In this third paper in a series describing the Quantitative Reasoning in the Contemporary World course, the authors provide an adaptation of the Association of American Colleges and Universities quantitative literacy VALUE rubric. Describing achievement levels in six core competencies (interpretation, representation, calculation, analysis/synthesis, and communication), the resulting Quantitative Literacy Assessment Rubric (QLAR) is applicable to grading student work and has exhibited a high degree of reliability in two separate scoring tests (97% and 88% respectively). The distribution of the six core competencies across the 24 case studies in the authors’ quantitative reasoning casebook shows that interpretation, calculation, and analysis/synthesis …

Quantitative Literacy At Michigan State University, 2: Connection To Financial Literacy, Dennis Gilliland, Vince Melfi, Alla Sikorskii, Edward Corcoran, Eleanor Melfi

Numeracy

The lack of capability of making financial decisions has been recently described for the adult United States population. A concerted effort to increase awareness of this crisis, to improve education in quantitative and financial literacy, and to simplify financial decision-making processes is critical to the solution. This paper describes a study that was undertaken to explore the relationship between quantitative literacy and financial literacy for entering college freshmen. In summer 2010, incoming freshmen to Michigan State University were assessed. Well-tested financial literacy items and validated quantitative literacy assessment instruments were administered to 531 subjects. Logistic regression models were used to …

Quantitative Literacy At Michigan State University, 1: Development And Initial Evaluation Of The Assessment, Alla Sikorskii, Vince Melfi, Dennis Gilliland, Jennifer Kaplan, Suzie Ahn

Numeracy

Development, psychometric testing, and the results of the administration of a quantitative literacy (QL) assessment to undergraduate students are described. Three forms were developed covering a wide range of skills, contexts, and quantitative information presentation formats. Following item generation and revision based on preliminary testing and cognitive interviewing, a total of 3,701 consented undergraduate students at Michigan State University completed one of the three forms. Two of the forms contained 14 multiple-choice items, and one form contained 17 multiple-choice items. All forms were completed by students in less than 30 minutes. Evidence of validity and reliability were obtained for the …

Development Of An Assessment Of Quantitative Literacy For Miami University, Rose Marie Ward, Monica C. Schneider, James D. Kiper

Numeracy

Quantitative Literacy is a competence as important as general literacy; yet, while writing requirements are seemingly ubiquitous across the college curriculum, quantitative literacy requirements are not. The current project provides preliminary evidence of the reliability and validity of a quantitative literacy measure suitable for delivery online. A sample of 188 undergraduate students from Miami University, a midsize university in the midwestern U.S., participated in the current study. Scores on the measure, were inversely related to statistical/mathematical anxiety measures, directly related to subjective assessment of numeracy, and did not differ across gender or year in school. The resulting measure provides a …

Communicating Quantitative Literacy: An Examination Of Open-Ended Assessment Items In Timss, Nals, Ials, And Pisa, Karl W. Kosko, Jesse L. M. Wilkins

Numeracy

Quantitative Literacy (QL) has been described as the skill set an individual uses when interacting with the world in a quantitative manner. A necessary component of this interaction is communication. To this end, assessments of QL have included open-ended items as a means of including communicative aspects of QL. The present study sought to examine whether such open-ended items typically measured aspects of quantitative communication, as compared to mathematical communication, or mathematical skills. We focused on public-released items and rubrics from four of the most widely referenced assessments: the Third International Mathematics and Science Study (TIMSS-95): the National Adult Literacy …

Psychological Assessment: What Will The Future Bring?, Ibpp Editor

International Bulletin of Political Psychology

The author discusses the (de)valuation of psychological assessment from various perspectives.

Using Self- And Peer-Assessment To Enhance Students’ Future-Learning In Higher Education., Glyn Thomas, Dona Martin, Kathleen Pleasants

Journal of University Teaching & Learning Practice

In higher education settings, assessment tasks get the attention of students, but once students submit their work they typically become disengaged with the assessment process. Hence, opportunities for learning are lost as they become passive recipients of assessment outcomes. Future-learning oriented assessment engages students in the assessment process to improve both short- and long-term outcomes by requiring students to make sophisticated judgments about their own learning, and that of their peers. In this paper, we describe and critique three initiatives that experimented with future-learning oriented assessment within a faculty of education. These initiatives involved self- and peer-assessment in a mathematics …

From Compliance To Engagement: Lessons Learned From Applying A Transformational Approach To Ncate Standard 4-Diversity, Robert Shockley, John Hardman, Eliah Watlington, Patricia Heydet-Kirsch

Educational Considerations

In March 2007, Florida Atlantic University hosted a joint NCATE/Florida Department of Education site visit. This successful site visit and following Unit Accreditation Board report resulted in full NCATE accreditation with only one weakness cited.

An Assessment Of Agriculture And Natural Resource Extension Program Needs On American Indian Reservations In Idaho, Nevada, Oregon, And Washington, Loretta Singletary, Staci Emm, George Hill

The Journal of Extension

This article summarizes the results of a needs assessment involving American Indians and outreach professionals on reservations in Idaho, Nevada, Oregon and Washington. The survey featured 36 questions about agricultural and natural resource issues that may pose challenges on reservation lands. A comparison between reservation residents and outreach professionals indicates that issue perceptions differ significantly for 23 of the 36 issues. Acknowledging these perceptual differences can help Extension to identify program gaps and opportunities with tribal nations. It can also increase Extension's appreciation for cultural diversity, thereby improving its capacity to execute its outreach mission on American Indian reservations.

Expect (And Collect) A Response From Everyone In The Classroom, Karen Bronshteyn

Communications in Information Literacy

A positive and descriptive book review of Derek Bruff's 2009 book Teaching with Classroom Response Systems: Creating Active Learning Environments.

Pedagogical Design For A Cross-Functional Course In The Accelerated Mba Program, Bhanu Balasubramnian, Tanja Steigner, Kevin R. Coulson

Administrative Issues Journal

The sub-prime financial crisis exposed weaknesses in the financial risk management of several prominent firms. A deficient risk management is mainly attributed to the lack of integration of finance with other business disciplines. In this paper, we describe a tested implementation of a cross-functional project that improves students’ understanding of firm-value creation and risk management. While this approach can be implemented in any MBA program, we focus specifically on accelerated MBA programs with tight time constraints. Our methods are different from most other integrated courses in several ways. Our cross-functional project bridges the knowledge gaps of students in the area …

The Valued Living Questionnaire: Defining And Measuring Valued Action Within A Behavioral Framework, Kelly G. Wilson, Emily K. Sandoz, Jennifer Kitchens, Miguel Roberts

The Psychological Record

A number of cognitive-behavior therapies now strongly emphasize particular behavioral processes as mediators of clinical change specific to that therapy. This shift in emphasis calls for the development of measures sensitive to changes in the therapies’ processes. Among these is acceptance and commitment therapy (ACT), which posits valued living as one of its primary core processes. This article offers a definition of values from a behavioral perspective and describes the Valued Living Questionnaire (VLQ) as a first attempt at assessment of valued living. The VLQ is a relatively brief and easily administered instrument derived directly from the primary text on …

What Really Matters: Assessing Individual Problem-Solving Performance In The Context Of Biological Sciences, Steven M. Mitchell, William L. Anderson, Cheryl A. Sensibaugh, Marcy Osgood

International Journal for the Scholarship of Teaching and Learning

The evaluation of higher-level cognitive skills can augment traditional discipline-based knowledge testing by providing timely assessment of individual student problem-solving abilities that are critical for success in any professional development program. However, the wide-spread acceptance and implementation of higher level cognitive skills analysis has been delayed by the lack of rapid, valid, and reliable quantified-scoring techniques. At the University of New Mexico School of Medicine, Department of Biochemistry & Molecular Biology, we have developed an examination format that can be routinely and sequentially implemented for both formative and summative assessments of individual students in large classes. Rather than providing results …

Calculus, Biology And Medicine: A Case Study In Quantitative Literacy For Science Students, Kim Rheinlander, Dorothy Wallace

Numeracy

This paper describes a course designed to enhance the numeracy of biology and pre-medical students. The course introduces students with the background of one semester of calculus to systems of nonlinear ordinary differential equations as they appear in the mathematical biology literature. Evaluation of the course showed increased enjoyment and confidence in doing mathematics, and an increased appreciation of the utility of mathematics to science. Students who complete this course are better able to read the research literature in mathematical biology and carry out research problems of their own.

Personal And Professional Numeracy: A Unit For Pre-Service Teachers At The University Of Tasmania, Jane M. Watson

Numeracy

This paper addresses issues associated with the development of a unit preparing pre-service teachers to be quantitatively literate in three respects. These issues surround (i) the need to be aware of numeracy demands across the curriculum, (ii) the need to model numerate behavior in all interactions of teachers, and (iii) the need to be able to interpret and use system data provided from local and national testing programs. The context for the unit described is Australia, where a national testing program for literacy and numeracy requires teachers to analyze extensive data on their students, a national curriculum requires teachers of …

Spreadsheets Across The Curriculum, 2: Assessing Our Success With Students At Eckerd College, Laura Reiser Wetzel

Numeracy

The Spreadsheets Across the Curriculum (SSAC) library consists of activities to reinforce or teach quantitative literacy or mathematical concepts and skills in context. Each SSAC “module” consists of a PowerPoint presentation with embedded Excel spreadsheets. Each student works through a presentation, thinks about the in-context problem, figures out how to solve it mathematically, and builds spreadsheets to calculate and examine answers.

To assess the effectiveness of SSAC modules, I surveyed Eckerd College undergraduates in two separate studies. Two undergraduate research assistants and I generated pre- and post-tests for 10 SSAC modules. We hired 21 undergraduates who conducted 62 individual module …

Life, Death, And Iq: It's Much More Than Just A Score: Understanding And Utilizing Forensic Psychological And Neuropsychological Evaluations In Atkins Intellectual Disability/Mental Retardation Cases, John Matthew Fabian, William W. Thompson, Jeffrey B. Lazarus

Cleveland State Law Review

This article highlights best practices for assessing MR and ID in capital cases with an emphasis on Atkins trial preparation and potential problems the authors have noted through experience. These best practices in Atkins hearings concern issues for the lawyers, forensic psychologists, and neuropsychologists, which include:

1. Practice effects and IQ testing

2. Consistency of IQ scores over time

3. Flynn Effect

4. Malingering versus cognitive suboptimal effort

5. Lack of records indicating pre-age 18 diagnosis of MR/ID

6. Retrospective assessment of adaptive behaviors

7. Death row trends of increasing IQ over the years while incarcerated

8. Maladaptive behaviors versus …