Education Commons^™

The Assessment Of The Program Theory And Processes Of Books For Keeps’ Literacy Mentoring Program, Allison Shaw

Graduate Research Showcase

The significance of reading proficiency is frequently emphasized by the time a student reaches the third grade. Third-grade reading proficiency serves as a crucial indicator of a student's potential success in high school and beyond, including college. Research indicates that a failure to attain grade-level reading proficiency by the third grade correlates with increased challenges in comprehending educational requirements and meeting the demands necessary for graduation.

This study focuses on the Books for Keeps Literacy Mentoring Program in Athens, Georgia, which is designed to cultivate supportive relationships between mentors and students, fostering enthusiasm for reading. The examination of the program …

Executive Functioning In Language Learning Disabilities: Defining Executive Functioning, Executive Functioning Deficits, And Clinical Intervention Strategies To Support Children, Kaylie Trumble

Honors Theses

This thesis aims to select a working definition of executive functioning (EF) to identify possible EF deficits and clinical interventions strategies to support children. Included are EF deficits, ways of assessing EF components, and intervention strategies for executive dysfunction in LLD. Scenarios are provided to demonstrate both matching strategies to a child and strength/deficit in EF, along with a sample intervention script.

Investigating The Fit Of The Generalized Graded Unfolding Model (Ggum) When Calibrated To Irt Generated Data From Dominance And Ideal Point Models, Abdulla Alzarouni

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The assessment of model fit in latent trait modelling, better known as item response theory (IRT), is an integral part of model testing if one is to make valid inferences about the estimated parameters and their properties based on the selected IRT model. Though important, the assessment of model fit has been less utilized in IRT research than it should. For example, there have been less research investigating fit for polytomous dominance models such the Graded Response Model (GRM), and to a lesser extent ideal point models such as the Generalized Graded Unfolding Models (GGUM), both in its dichotomous and …

When You Can’T R.I.O.T., R.I.O.: Tele-Assessment For School Psychologists, Michael R. Hass, Brian P. Leung

Education Faculty Articles and Research

The acronym R.I.O.T., record review, interview, observation, and test, is a well-known tool for conceptualizing a comprehensive assessment. With COVID-19 and the need to provide school psychological services virtually, it is important to reconsider R.I.O.T. in light of the limitations of virtual assessment. We describe the limitations of virtual assessment and argue that in spite of these barriers, the first three elements of R.I.O.T., record review, interviews, and observations, when used systematically, can provide useful comprehensive assessment data. Specific recommendations are provided for implementing assessment virtually.

Development Of A Faculty Appreciation Of Pedagogy Scale, Carol A. Hurney, Jordan D. Troisi, Lori H. Leaman

To Improve the Academy: A Journal of Educational Development

Evidencing the value of programs and services challenges educational developers to measure a range of outcomes. While direct measures of faculty use of effective teaching behaviors and student learning are desirable, these methods are time consuming and resource intensive. We provide a scale that is easy to deploy and can be adapted to different programs. Our psychometrically sound scale measures one facet of faculty learning about teaching—appreciation of pedagogy. The scale measures awareness, knowledge integration, emotions, beliefs, and self-reported behaviors related to the appreciation of pedagogy. We also examine scale correlates, including teaching identity, confidence, and control.

Students Helping Students Provide Valuable Feedback On Course Evaluations, Adriana Signorini, Mariana Abuan, Gautam Panakkal, Sandy Dorantes

To Improve the Academy: A Journal of Educational Development

The purpose of the student evaluations of teaching (SET) are to help instructors enhance the teaching and learning experience in their courses; however, student feedback can often be more unconstructive than useful because students are usually requested to evaluate instruction with little or no formal training. As a result, SET become missed opportunities for students to effectively communicate their learning needs and for instructors to collect actionable information about how the course is perceived. This project aims to improve the quality of student responses to the open-ended questions that instructors receive by partnering with undergraduates in demonstrating to their peers …

Assessment Literacy In College Teaching: Empirical Evidence On The Role And Effectiveness Of A Faculty Training Course, Kyle D. Massey, Christopher Deluca, Danielle Lapointe-Mcewan

To Improve the Academy: A Journal of Educational Development

This research explores how faculty members’ conceptions of assessment and confidence in assessment change as a result of an instructor training course. Based on a sample of 27 faculty members enrolled in a semester-long instructional development course, this survey-based study provides initial evidence that faculty members can develop confidence in assessment while adopting increasingly complex conceptions of assessment. Based on this study’s findings, we argue that instructional development programs for college faculty have a critical role to play in stimulating faculty learning about assessment of student learning and are an important component in promoting a positive assessment culture.

Cultivating And Sustaining A Faculty Culture Of Data-Driven Teaching And Learning: A Systems Approach, Marsha Lovett, Chad Hershock

To Improve the Academy: A Journal of Educational Development

A prominent goal of colleges and universities today is to enact data-driven teaching and learning. Faculty clearly play a key role, and yet they tend to have limited time, a lack of training in assessment or education research, and few incentives for engaging in this work. We describe a framework designed to address the practical and cultural aspects of these challenges via a cycle of educational development and support: motivate, educate, facilitate, disseminate. We illustrate this systems approach with concrete examples and conclude with lessons learned from our experiences that should translate to a variety of institutional contexts.

Context And Regulation Of Homeschooling: Issues, Evidence, And Assessment Practices, Janet F. Carlson

Buros Center: Professional Staff Publications

The article discusses salient factors that influence the current context within which homeschooling occurs. Individual states have applied various approaches to establish regulations that both preserve the rights of homeschooling parents and fulfill the state’s obligation to ensure that its residents receive the education to which they are constitutionally entitled. Case and ethnographic studies or research involving small and selected samples often appear in outlets associated with homeschool advocacy groups or in outlets that are not mainstream. The paucity of empirical evidence derived from methodologically strong research paradigms has led to little certainty about many aspects of homeschooling including its …

Broaching Threshold Concepts: The Trouble With “Skills” Language In Defining Student Learning Goals, Angela J. Zito

To Improve the Academy: A Journal of Educational Development

This essay argues that description of student learning goals as various “skills” presents a conceptual threshold lying between and connecting routinely dichotomized characterizations of student learning—most notably, “concrete” versus “abstract.” Qualitative analysis of instructor interviews shows that “skills” language tends to conceal abstract (that is, affective) learning goals behind more concrete (that is, cognitive) ones. Ultimately, this essay proposes that cognitive and affective student learning goals might be more clearly articulated using threshold concepts within and across disciplines, and that the recognition of “skills” as both affective and cognitive is itself a threshold concept in educational development.

The Fearless Teaching Framework: A Model To Synthesize Foundational Education Research For University Instructors, Alice E. Donlan, Sandra M. Loughlin, Virginia L. Byrne

To Improve the Academy: A Journal of Educational Development

There is often a disconnect between the unit of analysis in rigorous education research, and the types of recommendations that instructors find the most useful to improve their teaching. Research often focuses on narrow slices of the student experience, and university instructors often require broad recommendations. We present the Fearless Teaching Framework to address this gap between research and practice. In this framework, we define four pieces of effective teaching: classroom climate, course content, teaching practices, and assessment strategies. We argue that these are appropriate areas of focus for instructor growth, based on their relations to student engagement.

Evaluation Of The Feasibility Of A Two-Method Measurement Design For The Assessment Of Healthy Physical Activity Behavior In Youth, Amelia A. Miramonti

College of Education and Human Sciences: Dissertations, Theses, and Student Research

Purpose: Assess the reliability and validity of self- and parent-report survey responses regarding physical activity (PA), sedentary behaviors, and PA self-efficacy and determine if these data can be combined with objective physical activity monitor data to model the latent construct healthy physical activity behavior (HPAB).

Methods: 126 underserved 4^th-5^th grade students participated in a 12-week after-school nutrition, cooking, and physical activity program (WeCook: Fun with Food and Fitness). Participants and parents (n=103) completed surveys pre- and post-program and participants wore PA monitors for one week at PRE and POST. Unidimensionality and internal consistency reliability were …

Culturally Responsive Interviewing Practices, Michael Hass, Annmary S. Abdou

Education Faculty Articles and Research

As communities and school populations continue to become more culturally, economically, and linguistically diverse, the need for comprehensive training and explicit guidelines for culturally responsive school mental health practices also grows. School Psychologists are both expected and ethically responsible to competently assess and serve diverse student and family populations, regardless of potential language or cultural barriers. The current article is focused on describing background and rationale for culturally responsive interviewing practices as they pertain to the roles and responsibilities of School Psychologists. Building on the guidelines and principles of the Cultural Formulation Interview (CFI), developed by the American Psychiatric Association, …

The Validity Of Validity In Debra P.: Judicial And Psychometric Perspectives On Test Consequences, Charles Olney, Brent Duckor

Faculty Publications

We explore the uses and functions of ‘validity’ as a boundary marker between legal theory and psychometrics. Standardized testing regimes rely on experts to articulate the limits of validity. When challenged in courts, these limits become the subject of contestation, requiring practitioners to litigate the validity of validity. This process generates significant discontinuities, resulting from different conceptual relationships to the idea of validity. Through a qualitative textual analysis of specific case law and a quantitative examination of Lexis-Nexis database archives, we trace how legal reasoning elides new developments in psychometric research that would broaden and enrich judicial treatments while showing …

Predicting Teacher Value-Added Results In Non-Tested Subjects Based On Confounding Variables: A Multinomial Logistic Regression, Nathan Street

Doctoral Dissertations and Projects

Teacher value-added measures (VAM) are designed to provide information regarding teachers’ causal impact on the academic growth of students while controlling for exogenous variables. While some researchers contend VAMs successfully and authentically measure teacher causality on learning, others suggest VAMs cannot adequately control for exogenous influences on the classroom. Furthermore, because VAMs are primarily connected to student performance on standardized, high-stakes exams and those exams are resoundingly considered to be inadequate measures of true student learning, educators and educational leaders assert VAM results are moot. The purpose of this study was to consider the potential for student background, teacher preparation, …

Educational Development Efforts Aligned With The Assessment Cycle, Phyllis Blumberg

To Improve the Academy: A Journal of Educational Development

Using an assessment cycle as an organizing framework, this article illustrates how educational development and assessment mutually complement each other. It describes an assessment study conducted to determine if two colleges at a small university met their strategic goals to increase the adoption of learning-centered teaching. This study served the parallel function of assessing the impact of sustained educational development efforts by the Centers for Teaching and Learning (CTL) to promote learning-centered teaching. The majority of interviewed faculty reported using learning-centered approaches. The data collection method itself also served as a teachable moment for faculty who do not attend CTL …

The Aspirational Curriculum Map: A Diagnostic Model For Action-Oriented Program Review, Eric Metzler, George Rehrey, Lisa Kurz, Joan Middendorf

To Improve the Academy: A Journal of Educational Development

When the process of curriculum mapping begins with the faculty’s articulations of the knowledge, skills, and attitudes students should master upon graduation, a curriculum map results that enables faculty to review the curriculum for effectiveness, see the workings of the whole curriculum at a glance, plan assessments, and recognize where adjustments or changes need to be made. This article explains these benefits and lays out a step by step process for building such a curriculum map that can be adapted to any institutional context. We also describe a variety of outcomes from and reactions to our process.

Evaluating Centers For Teaching And Learning: A Field-Tested Model, Susan R. Hines

To Improve the Academy: A Journal of Educational Development

This paper provides a program evaluation model, along with field-testing results, that was developed in response to the need for an evaluation model able to support systematic evaluation of teaching and learning centers (CTLs). The model builds upon the author’s previous studies investigating the evaluation practices and struggles experienced at 53 CTLs. Findings from these studies attribute evaluation struggles to contextual issues involving evaluation capacity, ill- structured curricula, and ill-conceived evaluation frameworks. This field-tested Four-Phase Program Evaluation Model addresses these issues by approaching evaluation in a comprehensive manner that includes an evaluation capacity analysis, curricular conceptualization, evaluation planning, and plan …

Assessment From An Educational Development Perspective, Mary C. Wright, Molly Goldwasser, Wayne Jacobson, Christopher Dakes

To Improve the Academy: A Journal of Educational Development

As assessment, already well established in higher education, gains attention in the field of educational development (ED), we ask: What does it mean to practice assessment from an ED perspective? In response, we examine four principles that are central to this endeavor: (a) bridging work across communities and multiple institutional levels; (b) collective, collaborative ownership; (c) action-oriented focus on student-centered learning; and (d) intentionality about inclusiveness to recognize diverse experiences of participants and stakeholders. We apply these principles to four examples of assessment practice at different institutions and offer a rationale for why this lens has utility for the improvement …

A Phenomenology Of Sixth Grade Students’ Perspectives On Their Experience Using A Rubric For Criterion-Referenced Assessment, Julie Quast

Doctoral Dissertations and Projects

The purpose of this phenomenological study was to examine sixth grade literacy students’ perspectives of rubric-referenced assessment at an inner-city school in central Arkansas. The theories guiding this study were Vygotsky’s zone of proximal development, as rubrics scaffold students learning (Reeves & Stanford, 2009) and social cognitive theory, as rubrics help students regulate their learning (Covill, 2012) and control their actions (Bandura, 1997). The sample size included 29 students completing a questionnaire, 12 students participating in a focus group session, and two students journaling their experience. The research questions focused on the experiences, perspectives, approach to assignments, and response to …

Correlating English Language Learner Crct Scores On The Basis Of English Language Learner Access Scores, Nancy Mcneal

Doctoral Dissertations and Projects

The purpose of this quantitative correlational study was to test the sociocultural theory that relates English language learner students’ scores on the Georgia Assessing Comprehension and Communication in English State to State (ACCESS) test to English language learner students’ scores on the Georgia Criterion Referenced Competency Test (CRCT). The assessments scored students in language use and proficiency in listening, speaking, reading, writing, English/language arts, math, science and social studies. Specifically, the study assessed the predictive power of student scores on the ACCESS test on the criterion variable of student scores on the Georgia CRCT. The participants in the study were …

Don’T Box Me In: Rubrics For Ártists And Designers, Natasha Haugnes, Jennifer L. Russell

To Improve the Academy: A Journal of Educational Development

Two faculty developers at a professional art and design university were met with uneasy faculty attitudes toward grading when they opened their CTL 13 years ago. Conversations revealed that the faculty artists and designers suspected that grading would somehow shatter the fragile muse of creativity, which is so central to the processes of producing art and design. The developers’ quest for transparent, consistent grading, and assessment practices resulted in an approach to rubric creation that taps into artists’ reverence for the critique. This narrative account reveals how the approach allowed an interactive introduction of rubrics as teaching tools, ensured their …

Review Of The Pe Metrics Cognitive Assessment Tool For Fifth Grade Students, Michael Hodges, Chong Lee, Kent A. Lorenz, Daniel Cipriani

Physical Therapy Faculty Articles and Research

Study aim: this study examined the item difficulty and item discrimination scores for the HRFK PE Metrics cognitive assessment tool for 5th-grade students. Materials and methods: ten elementary physical education teachers volunteered to participate. Based on convenience, participating teachers selected two 5th grade physical education classes. Teachers then gave students (N = 633) a 28-question paper and pencil HRFK exam using PE Metrics Standards 3 and 4. Item difficulty and discrimination analysis and Rasch Modeling were used data to determine underperforming items. Results: analysis suggests that at least three items are problematic. The Rasch Model confirmed this …

Library Instruction For First Year Students, Amrita Dhawan, Ching-Jung Chen

Publications and Research

Purpose

Design/methodology/approach

Measuring The Promise: A Learning Focused Syllabus Rubric, Michael Palmer, Dorothe Bach, Adriana Streifer

To Improve the Academy: A Journal of Educational Development

To enrich the resources for measuring the impact of educational development work, we have created a rubric to assess the degree to which a syllabus achieves a learning orientation. The rubric provides qualitative descriptions of components that distinguish learning focused syllabi and uses a quantitative scoring system that places syllabi on a spectrum from content focused to learning focused. It is flexible enough to accommodate a diverse range of levels, disciplines, institutions, and learning environments, yet nuanced enough to provide summative information to developers using the tool for assessment purposes and formative feedback to instructors interested in gauging the focus …

Information Literacy At Johnson & Wales University 2011-2012, Ariela Mccaffrey, Lori Micho, Nicole Covone, Joe Eshleman

Library Staff Publications

This initial document details some ideas and thoughts related to the development of librarians who instruct at the four Johnson & Wales University campuses. A group of five librarians at the four campuses developed the document; Amanda Samland, Ariela McCaffrey, Nicole Covone, Lisa Spicola, and Joe Eshleman, Seven aspects of library instruction are addressed as well as ideas for the application of the guidelines. Finally, next steps towards application of the guidelines are listed.

Kanyininpa (Holding): A Way Of Nurturing Children In Aboriginal Australia, Fiona Ryan

Aboriginal Policy Research Consortium International (APRCi)

This paper discusses aspects of traditional Australian Aboriginal nurturance of infants, children, and young people through an exploration of the meaning of certain words selected from Central and Western Desert Aboriginal languages. Connections are drawn between this traditional form of child rearing and Bowlby’s theory of attachment. Aspects of traditional Aboriginal methods of nurturing infants, children, and young people, which have been retained in contemporary Aboriginal child-rearing practices, are also explored. Practitioners, policy makers, and researchers in child protection are encouraged to listen to Aboriginal people, and through listening and reflecting on their own practice, to identify and work with …

Visual Culture Art Education: Critical Pedagogy, Identity Formation And Generative Studio Practices In Art, Kim Barker

Art Graduate Theses and Projects

This paper explores visual culture and its emergence as a (inter-) disciplinary field of study and practice within art education. Visual Culture Art Education (VCAE), while still in the process of defining itself, inserts itself among myriad academic disciplines as well as our everyday living experiences outside the classroom. Due to its discursive nature, VCAE draws extensively on contemporary pedagogical praxis. I advocate for the integration of visual culture, with an emphasis on popular culture, into art curricula as a means to increase the relevancy of art instruction for students. The inclusion of (popular) visual culture in the art classroom …