Education Commons^™

A Comparative Study Of Interrater Reliability Coefficients Obtained From Different Statistical Procedures Using Monte Carlo Simulation Techniques, Ebrima Nying

Dissertations

Reliability estimation is a key research component within the global area of educational assessment. The literature reports numerous studies using different statistical techniques for estimating reliability of educational measures. However, few have focused on the estimation of interrater reliability of performance assessment (Abedi, Baker, & Herl, 1995). Specifically, this study compared three different methods for estimating interrater reliability to determine if there are differences among these estimates as a function of: sample size, measurement scale, number of raters and the theoretical population reliability (rho). The three methods of estimation were the Intraclass Correlation (ICC(2, k )) (Shrout & Fleiss, 1979), …

Teachers’ Career Decisions In A Cognitive Framework: Logistical Regression Analysis Of A National Data Set, Tamara H. Rosier

Dissertations

Research was conducted in order to determine if extrinsic, cognitive or situative sets of variables could predict teachers' career decisions using the Schools and Staffing Survey (SASS). Questions from the survey were divided into three cognitive perspectives: extrinsic, cognitive, and situative. Stepwise logistic regression analyses were used to predict group membership among those who chose to stay in their current position and those who left the profession.

Results for the extrinsic set of variables indicated that while the model was a good fit, the ability of the model to predict was low. Teachers agreeing that student behavior interferes with ability …

Structural Equation Modeling As A Tool For Multisite Evaluation, Carl Edward Hanssen

Dissertations

Two fundamental purposes exist for program evaluation: to document program results and to improve programs. These purposes are commonly called summative and formative evaluation. The fundamental questions related to these purposes are (1) what occurred in the program? and (2) how can the program be improved? The answer to the second question implies the need to explain why program results occurred.

This dissertation developed an approach to support formative evaluation and answering the question of why program results occur. This approach integratedmultisite evaluation, theory-based evaluation and structural equation modeling. The context for this dissertation was the National Science Foundation's Advanced …

Use Of Evaluation Findings In Michigan’S 21St Century Community Learning Center Programs, Wendy L. Tackett

Dissertations

There is a lack of empirical evidence demonstrating the use of evaluation findings within grant programs such as the 21st Century Community Learning Centers programs (CCLCs). This study was designed using Michigan's federally-funded CCLCs to meet the following purposes: to explore the use of evaluation findings; to determine the relationship of the use of evaluation findings by local school administrators to the employment of an internal or external evaluator; to identify evaluator qualifications connected to evaluation use; and to determine whether there are relationships between the Program Evaluation Standards (Joint Committee on Standards for Educational Evaluation, 1994) utility domains and …

Teacher Perceptions Of Internet-Based Distance Education In Adventist Colleges And Universities : A Mixed-Methods Study, Susan B. Smith

Dissertations

Problem. An examination of Internet-based distance education (IBDE) is important in order to maintain the delivery of quality higher education and to encourage the systemic adoption of policies and practices that promote excellence in IBDE. The quality of online distance education will increasingly become the standard by which students choose a program as their educational options have multiplied with the dramatic growth in distance education.

Method. This was a sequential exploratory mixed-methods study o f the perceptions of teachers on IBDE. It was conducted collaboratively with Pamela Cress who examined administrator perceptions. Data were collected for both studies from teachers …

Instructional Implications Of The Michigan Educational Assessment Program As An Accountability Instrument, Daniel J. Applegate

Dissertations

Problem. In Michigan, early elementary school teachers are held accountable for instructional decisions they made based on the number of children who pass the state standardized reading test, the Michigan Educational Assessment Program (MEAP). Although state officials claim the MEAP can inform instruction, no data are regularly collected to describe reading instructional practices or the relationship between current practices and the percentage of students who pass the MEAP.

Method. Using a survey instrument, this study measured the amount of instructional time Kindergarten through Grade 4 teachers reported that they devoted to the development of 19 different components or activities within …