Education Commons^™

Evaluating The Blending Of An E-Learning Module Into A Knowledge Management Course: A Case Study From The Singapore Management University (Smu), Thomas Menkhoff, Tze Yian Thang, Yue Kee Wong

Research Collection Lee Kong Chian School Of Business

In 2005, the authors of this essay led the development and launch of SMU’s (Singapore Management University) first e-learning package on ‘Knowledge Management’. The package is aimed at supporting SMU’s mission to be committed to an interactive, participative and technologically-enabled learning experience. Since its inception in 2000, SMU’s educational and administrative practices are modelled after American institutions, in particular the Wharton School of the University of Pennsylvania. To support SMU’s unique pedagogy, wireless technology for mobile computing is a central feature at SMU. Against this background, the paper features a self-critical and reflective case study of the roll out of …

Crt Assessment Instrument, Janet L. Applin

Kentucky Teacher Educator

The Culturally Responsive Teaching Assessment Instrument (CRT) is an observation instrument that was developed to assess teachers' use of culturally responsive teaching in applied classroom settings.

The Development Of The Culturally Responsive Teaching Assessment Instrument, Janet L. Applin

Kentucky Teacher Educator

This article is concerned with developing an instrument to assess Culturally Responsive Teaching. A study was conducted to explore the process of developing a valid and reliable CRT Assessment Instrument. Teaching behaviors widely accepted to indicate culturally responsive teaching were operationalized and an observation instrument was developed to assess teachers' use of culturally responsive teaching in applied classroom settings. Teachers were observed using the instrument and it was evaluated for its reliability and validity. Results of the study indicated that the instrument was found to have acceptable inter-rater reliability for approximately half of the indicators. The results supported the content …

Evaluating The Feasibility Of A Performance Improvement Initiative At Byu Broadcasting, Brandon L. Smith

Theses and Dissertations

The purpose of this project was to evaluate the feasibility of bridging performance gaps in the program stream between BYU Broadcasting's post production and master control environments by implementing a technical infrastructure that supports a file-based workflow. The system that was evaluated was an Apple Xsan running specialized software, called FORK. Performance gaps were identified and a technical evaluation of the system was conducted. Figuring out how the change initiative would affect and be affected by non-technical factors, such as human nature and social and cultural concerns, was integral to the evaluation process. The evaluation concluded that the System was …

Evaluating The Impact On Users From Implementing A Course Management System, Charles R. Graham, Meghan M. Kennedy, Gregory L. Waddoups, Richard E. West

Faculty Publications

Nearly all colleges and universities are using some form of e-learning system, usually an expensive course management system (CMS), to create online course offerings or to enhance regular, classroom-oriented courses. Our university has invested a large amount of resources into purchasing and supporting one of the two most popular CMS vendors, and it has become imperative to understand what the effects from using this technology have been, as well as how we can improve the integration of this and other educational technologies into different instructional contexts. This project, through a combination of surveys, call-log analysis, and interviews, was used to …

Reconciling Organisational Realities With The Research Mission Of The Irish Institutes Of Technology, Deirdre Lillis

Conference papers

A key principle in systems theory is that a system, such as a Higher Education Institute (HEI), will self-correct and stabilise to align itself with its overarching ‘system goals’, irrespective of interventions. System goals may be explicit and obvious, such as published performance indicators, however change initiatives can often fail because the initiative is acting against some underlying, implicit and/or hidden system goal. In addition, if one accepts the premise that people will work toward what is recognised and rewarded then the measures of performance used within a HEI are likely to be important forces for change in their own …

Engaging The Academic Heartland:A Key Factor In The Effectiveness Of Strategic Planning And Self Study Programs., Deirdre Lillis

Conference papers

Conventional wisdom in the literature attests to the importance of involving academic staff in strategic planning and self study programs but there is a lack of empirical evidence to substantiate this argument. This paper reports on the findings of an empirical investigation of the effectiveness of three strategic planning and three self study programs, undertaken in one Higher Education Institute (HEI), between 1997 and 2006. It was found that the level of engagement of academic staff was a key factor in the effectiveness of the programs – the more engagement the more effective the programs were. The research methodology was …

Influence Of Questionnaire Format On The Response Rate Of Training Session Evaluations, Yumiao Zhu

OTS Master's Level Projects & Papers

To answer this problem, the following research questions were established: What were respondents' concerns when they completed questionnaires after training? What were the participants' preferences regarding format when responding to a training evaluation questionnaire?

Supervision And Evaluation Of Probationary Teachers: Policies And Practices In Class Ii And Class Iii Nebraska School Districts, Robert W. Michl

Department of Educational Administration: Dissertations, Theses, and Student Research

The purpose of this study was to identify policies and practices used to supervise and evaluate probationary teachers in Class II and Class III Nebraska school districts. A secondary purpose was to identify differences existing between policies and practices applicable to tenured and probationary teachers.

Two samples were studied. The sample of the survey instrument study was 48 randomly selected principals who supervised and evaluated certificated employees of Class II and Class III school districts in Nebraska during the Spring Semester, 2006.

The sample of the policy study was a set of 49 randomly selected Class II and Class III …

Annual Progress Report: Nebraska Reading First Two Year Implementation, Guy Trainin, Oren Yagil, Malinda M. Murphy

Research and Evaluation in Education, Technology, Art, and Design

This report outlines the results of a two year implementation of the Nebraska's Reading First initiative. Over three thousand six hundred students from Kindergarten to Third grade were included in the project. Results indicated significant growth across all demographic groups. Student performance in the earlier grades has shown great promise for later years. Growth in fluency and comprehension in grades 2 and 3 were not as impressive and require additional attention. The assessment results were triangulated by observations in the classrooms, interviews, and teacher responses to professional development- teachers know how to teach Phonemic Awareness and the alphabetic principle but …

An Inquiry Into Retention And Achievement Differences In Campus Based And Web Based Ap Classes, Michael Barbour, Dennis Mulcahy

Education Faculty Publications

A decade ago the Advanced Placement (AP) program was introduced into the Canadian province of Newfoundland and Labrador. Initially, schools embraced this opportunity to provide their students with opportunities that were previously unavailable. However, within a few years the AP program was relegated to urban and large regional high schools. Few smaller, and particularly rural schools, were able to offer AP courses only to the brightest one or two students taking it as an independent study. In 1997-98, schools began to delivery AP courses in a web-based method. The purpose of the study is to examine the retention rates and …

Nebraska Reading First Winter Report 2005-2006, Guy Trainin, Oren Yagil

Research and Evaluation in Education, Technology, Art, and Design

The Winter Progress Report offers an overview of student mid-year achievement. Student achievement will be interpreted through two separate comparisons. In each section we start with a comparison of this year’s winter achievement and last year’s mid-year achievement; a between cohorts comparison. This comparison will show whether the mid-year achievement of Reading First schools is higher than last year as we anticipated. A second comparison focuses on following student achievement from fall to winter of 2005-2006 school year. This within cohort comparison shows the sustainability of this year’s baseline.

Nebraska's Reading First State Report Fall 2005-6, Guy Trainin

Research and Evaluation in Education, Technology, Art, and Design

The Fall Progress Report offers an overview of student baseline achievement. Student achievement will be interpreted through two separate comparisons. In each section we start with a comparison of this year’s baseline and last year’s baseline; a between cohorts comparison. This comparison will show whether the starting point of Reading First schools is higher this year as we anticipated. A second comparison focuses on following student achievement from spring of 2004-2005 school year to fall of 2005-2006. This within cohort comparison shows the sustainability of last year’s gains and the effects of the Summer Reading Setback.

Nebraska's Reading First State Report Fall 2005-6, Guy Trainin, Oren Yagil

Research and Evaluation in Education, Technology, Art, and Design

The Fall Progress Report offers an overview of student baseline achievement. Student achievement is interpreted through two separate comparisons. In each section we start with a comparison of this years’ baseline and last years’ baseline; a between cohorts comparison. This comparison will show whether the starting point of Reading First schools is higher this year as we anticipated. A second comparison focuses on following student achievement from spring of 2004-2005 to fall of 2005-2006. This within cohort comparison shows the sustainability of last years gains and the effects of the Summer Reading Setback.

Scholarly Use Of Information: Graduate Students' Information Seeking Behaviour, Carole A. George, A. Bright, T Hurlbert, E C. Linke, G St. Clair, J Stein

Carole A. George

Introduction. This study explored graduate students' information behaviour related to their process of inquiry and scholarly activities. Method. In depth, semi-structured interviews were conducted with one hundred graduate students representing all disciplines and departments from Carnegie Mellon University. Analysis. Working in pairs, we coded transcripts of interviews into meaningful categories using ATLAS.ti software. The combined use of quantitative and qualitative analysis aimed to reduce subjectivity. Results. Graduate students often begin with a meeting with professors who provide direction, recommend and provide resources. Other students help to shape graduate students' research activities, and university library personnel provide guidance in finding resources. …

Harnessing Innovative Technologies In Higher Education, Kathleen P. King, Joan K. Griggs

Kathleen P King

This publication is an attempt to capture the evolution of distributed higher education over the last decade by tracing the applications of new technologies funded by the Fund for the Improvement of Postsecondary Education (FIPSE). As FIPSE surveyed the current state of distance/distributed education, there existed an opportunity to help post econdary education make the transition to this new generation of distance education made possible by the explosive growth of the Internet and other new technologies. These technologies created the potential for students to access learning that was interactive, customized, and self-paced; to more easily merge lifelong learning with the …

Steering By Engagement:Towards An Integrated Planning And Evaluation Framework In Higher Education Institutes, Deirdre Lillis

Conference papers

Higher Education Institutes (HEIs) worldwide are investing significant resources in strategic planning and self study programs to improve institutional performance. Both are expensive undertakings in terms of the time invested by participants and it is not unusual to see both programs underway in a HEI at the same time. The underlying knowledge produced about the challenges facing the Institution and the necessary responses can be broadly similar although their methodologies and presentation may differ. This paper reports on the comparative effectiveness of three strategic planning and three self study programs undertaken in one HEI over an 8 year timeframe under …

Faculty Development In Member Institutions Of The Florida Faculty Development Consortium: Strategic Plans, Evaluation Models, Organization, And Funding, Laura Ross

Electronic Theses and Dissertations

The purpose of this study was to examine strategic plans and evaluation models in light of organizational structures and funding to determine if member institutions in the Florida Faculty Development Consortium were investing in faculty development based on strategic and measurable criteria. Data were gathered through a mixed method survey mailed electronically to the individuals responsible for faculty development at 31 member institutions of the Florida Faculty Development Consortium. Even though the Consortium was comprised of public and private four-year institutions and public two-year institutions, faculty development programs in these institutions had similarities. Most programs had strategic plans, centralized faculty …

Harnessing Innovative Technologies In Higher Education: Access, Equity, Policy & Instruction, Kathleen P. King, Joan K. Griggs

Leadership, Counseling, Adult, Career and Higher Education Faculty Publications

This publication is an attempt to capture the evolution of distributed higher education over the last decade by tracing the applications of new technologies funded by the Fund for the Improvement of Postsecondary Education (FIPSE). As FIPSE surveyed the current state of distance/distributed education, there existed an opportunity to help post econdary education make the transition to this new generation of distance education made possible by the explosive growth of the Internet and other new technologies. These technologies created the potential for students to access learning that was interactive, customized, and self-paced; to more easily merge lifelong learning with the …

The Relationship Among Wellness, Severity Of Disturbance, And Social Desirability Of Entering Master's-Level Counseling Students, Heather Smith

Electronic Theses and Dissertations

A wellness paradigm may hold promise for unifying and strengthening the identity of the counseling profession. The construct of wellness may also hold implications for assessment of entering master's-level counseling students, as a tool for continuous evaluation of students, or for overall program evaluation. In this study, the only counseling-based wellness assessment measure, the Five Factor Wellness Evaluation of Lifestyle, was tested for its relationship to two other constructs: psychological disturbance and social desirability. In order to test the research hypotheses, a total of nine programs (in five states) and 204 entering master's-level counseling students completed instrumentation packets comprised of …

Bar Raising Or Navel-Gazing?:The Effectiveness Of Self-Study Programmes In Eading To Improvements In Institutional Performance, Deirdre Lillis

Conference papers

Higher Education Institutes worldwide are investing significant resources in self study programmes to improve institutional performance, to enhance quality and to meet external stakeholder demands. The institutional impacts of both internally and externally mandated self study programmes is an area where little empirical research exists. A key question is whether self study programmes are effective (or otherwise) in leading to improvements in institutional performance and the reasons why. Covering an eight year period, from 1997–2006, this paper reports on the use of systematic evaluation methodology (Rossi et al., 2003) to evaluate the effectiveness of three self study programmes in leading …

Consequence Of Competing And Complementary Evaluation Approaches: A Case Study., Brandon Youker, Chris Coryn, Daniela Schröter, Michelle Bakerson

Brandon W. Youker Ph.D

A poster presentation demonstrating an evaluation of a summer school program for middle schoolers in which the evaluators divided into two teams and simultaneously evaluated the program. The first team examined the students' performance according to the program's ability to achieve stated goals while the second team intentionally avoided any knowledge of or reference to the stated goals and objectives throughout the entire evaluation. The two teams wrote separate reports and then a combined report.

Review Of Exploring Evaluator Role And Identity., Carolyn Sullins, Brandon Youker

Brandon W. Youker Ph.D

A book review of "Exploring Evaluator Role and Identity" edited by Katherine E. Ryan and Thomas A. Schwandt (2002).

Values Driven Evaluation, P. Cristian Gugiu, Nadini Persuad, Brandon Youker

Brandon W. Youker Ph.D

Values are the basis for defining what aspects of the evaluand should be considered meritous in a particular context. They are something which is in principle or quality intrinsically valuable or desirable. So in evaluation, factual premises describe performance, while value premises can be thought of as the qualities that, when converted to standards, determine the degree to which the performance was good or bad, worthwhile or worthless, and significant or insignificant. Value premises can be validated using commonsense or based on such things as the severity of needs, resource efficiency, legal requirements, professional requirements, and so on. There are …

Review Of The Evaluation Exchange, Volume Xi(1), Xi(2), And Xi(3), Brandon W. Youker Ph.D

Brandon W. Youker Ph.D

The Evaluation Exchange is a free, online evaluation periodical (http://www.gse.harvard.edu/hfrp/eval.html) published by the Harvard Family Research Project (HFRP) three or four times annually. It is aimed at addressing issues that program evaluators frequently encounter. The journal emphasizes innovative methods and approaches to evaluation, emerging trends in practice, and practical applications of evaluation theory. It is designed to serve as a medium for evaluators, program practitioners, funders, and policymakers.

What Is Comprehensive Sexuality Education Really All About? Perceptions Of Students Enrolled In An Undergraduate Human Sexuality Course, Eva Goldfarb

Department of Public Health Scholarship and Creative Works

The purpose of this study was to use qualitative evaluation techniques to explore the perceptions of students enrolled in undergraduate human sexuality classes regarding their expectations for the course as well as outcomes. One hundred forty-eight students were surveyed at the beginning and again at the end of the semester-long course. While pregnancy and STI prevention were considered important components of their courses, other outcomes associated with positive, healthy sexuality were given greater emphasis. Results suggest that while primary and secondary level sexuality education have been increasingly focused on abstinence-only education with a focus on pregnancy and STI reduction, this …

Educational Development Projects At Ied: Towards School Improvement, Khalid Mahmood, Nilofar Vazir

Institute for Educational Development, Karachi

The M.Ed. program at The Aga Khan University-Institute for Educational Development helps to develop Course Participants (CPs) as teacher educators / educational leaders. The institute always welcomes innovations in its various programmes. The Educational Development Project (EDP) was conceived as an alternative to research to develop CPS’ knowledge and skills required for developmental work. The EDP is concerned with capacity building at classroom and school level depending on the needs of the relevant stakeholders. A contextually relevant model was adapted for EDP at the institute. The research reported in this paper discussed the question: To what extent does the course …

Investigating The Links Between Teacher Professional Development And Student Learning Outcomes, Marion Meiers, Lawrence Ingvarson

Professional learning for teachers and school leaders

This report, in two volumes, describes an investigation of the links between teacher professional development and student learning outcomes. The study, funded by the Australian Government, provides a review of the research literature and of national and international initiatives linking professional development with student outcomes. It provides detailed case studies of the school-based trials of ten professional development programs in a number of different sites. It examines the repeated measures of student achievement from students in the classes of teachers in the school-based trials. Analysis and discussion of a common questionnaire completed by teachers in the school-based trials is provided. …

Development Of The Motivational Interviewing Supervision And Training Scale, Michael B. Madson, Todd Campbell, David E. Barrett, Michael J. Brondino, Timothy P. Melchert

College of Education Faculty Research and Publications

The movement to use empirically supported treatments has increased the need for researchers and supervisors to evaluate therapists’ adherence to and the quality with which they implement those interventions. Few empirically supported approaches exist for providing these types of evaluations. This is also true for motivational interviewing, an empirically supported intervention important in the addictions field. This study describes the development and psychometric evaluation of the Motivational Interviewing Supervision and Training Scale (MISTS), a measure intended for use in training and supervising therapists implementing motivational interviewing. Satisfactory interrater reliability was found (generalizability coefficient p2 = .79), and evidence was found …

Brief 19: The Dean’S Role In Faculty Evaluation, New England Resource Center For Higher Education, University Of Massachusetts Boston

New England Resource Center for Higher Education Publications

Faculty work continues to change in response to the increased emphases on diversity requirements in undergraduate education, partnerships between academic and student affairs, and computer technology (O’Meara, et al, 2003). As even more is learned about strategies for the educational success of their students, faculty will be counted on to tailor their skills and pedagogies to new populations of students. At the same time, colleges and universities must keep pace with these changes by ensuring that expectations about faculty work are clearly defined and are reflected in evaluation and reward structures—and that faculty are supported in their efforts. The quality …