Education Commons^™

Observing How College Students Process Culturally Responsive Test Items, Chris R. Patterson

Dissertations, 2020-current

Typical approaches to test and item development are rooted in the Standards for Educational and Psychological Testing. Culturally responsive and antiracist assessment practices are two new processes that challenge the typical process noted in the Standards, incorporating critical race theory and cultural responsiveness into the item development process. Given these two approaches are relatively new, there is minimal research on how test takers process and comprehend test items created using these approaches.

This dissertation modified multiple-choice test items through the lenses of cultural responsiveness and antiracism to create two sets of item types (diversity-infused and sociopolitical consciousness; DI and …

Taking Time: Part-Time Students And Student Learning Outcomes Assessment, Sarah K. H. Macdonald

Dissertations, 2020-current

For decades, higher education institutions have undertaken comprehensive and systematic efforts to explore, document, and improve the assessment of student learning outcomes, as well as improving learning itself. However, many of these assessment practices have been designed for full-time traditional students, even as the number of non-traditional students enrolled in higher education continues to grow. One group of these non-traditional students remains particularly invisible on their campuses, in their classrooms, and in assessment practices: part-time students.

Part-time students, defined by the U.S. Department of Education’s Integrated Postsecondary Education Data System (IPEDS), are students who are not full-time (USDOE, n.d.). This …

Writing While Black: African American Vernacular English (Aave) And Perceived Writing Performance, Jaylin N. Nesbitt

Masters Theses, 2020-current

In the education system, there have historically been inequities that have severely disadvantaged Black students academically. One area in which these inequities surface is on writing assessments in the form of lower scores. I argue that because the U.S. education system is centered around Standard American English (SAE), it disadvantages those from different linguistic backgrounds, specifically Black students, as they are most likely to be speakers of African American Vernacular English (AAVE). Although there are theoretical justifications for this, past literature has not empirically tied inequities on writing assessments to Black students’ use of AAVE. The current study used Natural …

Learning Improvement At Scale: Improving Rhetorical Awareness In A First-Year Writing Program, Caroline Prendergast

Dissertations, 2020-current

Despite decades of increasing assessment activity in higher education, the literature provides few examples of assessment leading to improved student learning (Banta & Blaich, 2011). The simple model for learning improvement provides an avenue for linking assessment efforts with faculty development and pedagogical changes in order to increase students’ knowledge, skills, and abilities (Fulcher et al., 2014). Although this model has been applied successfully in prior improvement efforts, previous initiatives have focused on relatively small programs (reaching 200 or fewer students). This dissertation reflects a large-scale application of the learning improvement model to improve rhetorical awareness in general education writing …

An Entrepreneurial Mindset: Not Just For Entrepreneurs, Lindsay M. King

Dissertations, 2020-current

Abstract: An entrepreneurial mindset is beneficial for all individuals regardless of their career aspirations. College students, in particular, can benefit from the development of an entrepreneurial mindset as they will be inclined to desire to achieve more and continually strive for personal growth. Entrepreneurial development within college students can be realized through experiential learning aimed to cultivate entrepreneurial capabilities such as critical, creative, and innovative thought. These capabilities, coupled with a passion for personal achievement through life-long learning, an entrepreneurial mindset can be developed. This study first proposed an abbreviated measure of College Student Entrepreneurial Development (CSED) by revising an …

Assessing Perceptions Of Group Work Using Team-Based Learning, Lauren Ferry, Phillip J. Wong, Kathryn Hogan

James Madison Undergraduate Research Journal (JMURJ)

Group work is frequently incorporated into courses; however, student perceptions of their experiences and the benefits of group work might differ based on the structure of course. In this study, we examined student perceptions of group work in a team-based learning (TBL) course. Undergraduate students completed pre- and post-surveys on their team work experiences over a semester. Students had lower agreement with the statement “working in groups usually ends up with one person doing all of the work” and higher agreement with “working in a group makes me feel as though I am part of a learning community” at post-test. …

Impacts Of An International Professional Development Program: A Qualitative Study, Marijn W. T. De Waal

Masters Theses, 2020-current

This qualitative study with phenomenological components examined the impacts of a U.S. State Department-funded teacher professional development program, hosted at a liberal-arts university on the east coast of the United States in the spring semester of 2018. An initial review of the public literature revealed that it was challenging to find evaluation data pertaining to this particular program or ones of a similar nature. Through semi-structured synchronous online interviews with five program alumni, the researcher probed if—and if so, how—the professional development (PD) program had made the intended impacts on participants’ (1) teaching methods/curriculum, (2) content knowledge in their personal …

Evidence-Informed Programming In Student Affairs: A Mixed Methods Study Examining Behaviors, Perceptions, And Barriers Related To The Use Of Theory And Research In Program Development, Andrea M. Pope

Dissertations, 2020-current

For decades, professional organizations and leaders in the field of student affairs have called for student affairs professionals to engage in evidence-informed programming (EIP). EIP refers to the use of theory and empirical research to build programs intended to impact specific student learning or development outcomes. The benefits of EIP range from increasing the likelihood that newly developed programs will “work” to increasing the efficiency of the assessment process and facilitating the use of assessment results for program improvement. Despite the many calls for EIP, there is concern that EIP in student affairs is rare; however, empirical research on professionals’ …

Why Assessment Matters: On The Road For Change, Kelsey P. Bowen, Kate A. Bergey, Shannon S. Edmond

Showcase of Graduate Student Scholarship and Creative Activities

In higher education, assessment is used to intentionally develop, implement, and modify programs that are grounded in student learning outcomes (SLOs). Assessment results may highlight program effectiveness, or lack thereof. This gives educators the chance to revise components of the program in order to improve student learning (Meixner, 2016). Assessment also creates a sense of accountability by offering methods to justify the value of a program, especially when time and resources are limited. We offer a model for assessment as foundational to program development by highlighting our course-related consulting work with the Dux Leadership Center’s pilot On the Road for …

Learners’ Perspectives On The Use And Support Of Student Created Video Assignments At James Madison University, Annette Bruff Liskey

Showcase of Graduate Student Scholarship and Creative Activities

This research is an exploratory analysis of the use of student created video assignments at JMU, a pedagogical strategy that is increasingly common but not widely researched. The study collected quantitative data via an online survey of JMU students with the objective of examining the use, design, and outcomes of student created video assignments at James Madison University. Survey topics included the requirements of the assignment, the course that included the assignment, resources available and/or used to complete the assignment, students’ perceptions of the learning outcomes, as well as non-identifying information about each respondent’s demographics and academic experience at JMU. …

Facilitated Departmental Dialogues Assessment, Kathryn Kinniburgh, Caitlin Powell

Showcase of Graduate Student Scholarship and Creative Activities

In the fall of 2016, PYSC 600 students consulted with James Madison University’s Office of Access and Inclusion to create assessment efforts for the Facilitated Departmental Dialogues. The Dialogues are the result of a collaborative effort among the Office of Access and Inclusion, Human Resources, and the Provost’s Faculty Diversity Council. They were developed following the 2013-2014 Diversity Task Force to give departments the space to discuss crucial matters of values, diversity, access, and inclusion within the context of their academic unit.

Utilizing notions of the Assessment Cycle, the decision was made, in collaboration with Arthur Dean, Executive Director of …

Examining The Effects Of Specifying Bayesian Priors On The Wald's Test For Dif, Paulius Satkus, Christine E. Demars

Department of Graduate Psychology - Faculty Scholarship

No abstract provided.

An Applied Example Of A Two-Tier Multiple-Group Testlet Model, Paulius Satkus, Christine E. Demars

Department of Graduate Psychology - Faculty Scholarship

No abstract provided.

Rewriting Honors 300: Teaching For Teaching Assistants, Nina Schenk

Senior Honors Projects, 2010-2019

The purpose of this project is to rewrite the curriculum of Honors 300: Teaching Honors for Honors Students. After conducting research via survey and reading and analyzing works by Gonzales, Dallimore, and other university and pedagogy websites, meeting with organizations on campus, and getting feedback from other Honors TAs, the goal of my final project is to rewrite the Honors 300 curriculum and syllabus; this includes a restructuring of the TA selection and pairing process, a series of suggestions on training and orientation, and the recommendation for renaming the Teaching Assistants. I developed the following by consulting literature on pedagogy, …

Test Emotions, Value, And Self-Efficacy: A Longitudinal Model Predicting Examinee Effort And Performance On A Low-Stakes Test, Paulius Satkus

Masters Theses, 2010-2019

The validity of scores from low-stakes tests may be compromised by examinee motivation. Expectancy-Value theory (EV) has been used to frame the antecedents of examinee motivation in low-stakes testing contexts. According to EV theory, the perceived value of the test and the expectancy to succeed on the test directly affect examinee effort, which then affects test performance. Cross-sectional research studies in low-stakes testing contexts offer some support of EV theory. Control-Value theory (CV) serves as another theory to understand motivation toward a task. CV theory encompasses the constructs of expectancy and value from EV theory, but incorporates test emotions as …

Development Of A School Boredom Proneness Scale For Children, Taylor Carrington

Educational Specialist, 2009-2019

One common phrase heard from students is, “I’m bored.” However, there is no real understanding of what this actually means. In this study, elementary-age students were asked to respond to a newly developed School Boredom Proneness Scale (SBPS) including questions relating to a five-factor model of boredom. Students were also asked to rate how often they become bored at school and how bored they seem compared to classmates. In addition to student responses, parents and teachers were asked to rate how bored they thought the student was, and teachers were additionally asked to rate students’ level of work completion. The …

An Initial Development Of A Hardiness Scale For Elementary School Students, Stephen Ferrara

Educational Specialist, 2009-2019

There are limited studies that have investigated levels of hardiness in children. There is even less information on finding hardiness scales that have been normed on children in elementary school. The purpose of this study was to test the validity and reliability of the Hardiness Scale for Children (HSC), which assesses the three subscales of hardiness: Challenge, Control, and Commitment. 121 elementary school students (2^nd-5^th grade) were selected to complete the HSC. Their parents were also asked to complete a three-item scale to measure their child’s hardiness. The results indicated that older children tended to give themselves …

The Credentialed Workforce: Examining Success Rates Across Short-Term Noncredit Training Programs Aligned With Industry Credentials, Rochelle Fisher

Masters Theses, 2010-2019

A new grant program implemented to provide subsidized training costs for students enrolling in short-term noncredit programs aligned with high-demand industry credentials leading to middle-skill jobs was implemented in July 2016. The grant program follows a pay-for-performance model where students are given a two-thirds discount on tuition but required to pay back an additional one-third if they do not successfully complete their short-term noncredit training. An exploratory study was conducted to provide training program completion and credential attainment rates for the overall program and by student demographic groups (age, race, and gender). Results showed little variation among training program completion …

Failure To Launch?: Advancing The Case For Financial Literacy Interventions In Postsecondary Education, Cathleen Snyder

Dissertations, 2014-2019

For college undergraduates, the thought of managing money is often new, exciting, and terrifying in the same breath. Some students have learned well from their parental and prior academic influences, and yet others may be overwhelmed by a lack of those same resources. As postsecondary institutions endeavor to level the proverbial playing field, helping college graduates launch into meaningful, financially independent lives, it begs additional consideration on the intervention methods that might be most impactful.

This study examined a for-credit, curriculum-based intervention specific to personal finance topics. It attempted to answer several key questions: How knowledgeable are students relative to …

Considerations In S-Χ2: Rest Score Or Summed Score, Priors, And Violations Of Normality, Christine E. Demars, Derek Sauder

Department of Graduate Psychology - Faculty Scholarship

The S-χ2 item fit index is one of the few item fit indices that appears to maintain accurate Type I error rates. This study explored grouping examinees by the rest score or summed score, prior distributions for the item parameters, and the shape of the ability distribution. Type I error was slightly closer to the nominal level for the total-score S-χ2 for the longest tests, but power was higher for the rest-score S-χ2 in every condition where power was < 1. Prior distributions reduced the proportion of estimates with extreme standard errors but slightly inflated the Type I error rates in some conditions. When the ability distribution was not normally distributed, integrating over an empirically-estimated distribution yielded Type I error rates closer to the nominal value than integrating over a normal distribution.

Posterior Predictive Model Checking Of Local Misfit For Bayesian Confirmatory Factor Analysis, Chi Hang Au

Masters Theses, 2010-2019

Posterior predictive model checks (PPMC) are one Bayesian model-data fit approach. Thus far, PPMC for Confirmatory Factor Analytic applications focused primarily on global fit evaluation, ignoring the nuanced information in local misfit diagnostics. This study developed a PPMC approach for local misfit and applied it to a test-taking motivation scale. If the PPMC approach is effective, fit conclusions derived from the PPMC approach should be congruent with the fit conclusions derived from the Frequentist approach. Number of item-pairs flagged as misfitting and number of disagreements were computed to evaluate congruence. Congruence is achieved if the number of item-pairs flagged as …

The Application Of The Specific Learning Disability Exclusionary Clause As Practiced By Virginia School Psychologists, Kaitlynn Carter

Educational Specialist, 2009-2019

When special education eligibility is being determined under Specific Learning Disability, the exclusionary clause needs to be carefully considered. The current study was concerned with the exclusions of cultural factors, environmental or economic disadvantage, and limited English proficiency. The study used a semi-structured interview to explore when and how the exclusionary clause is considered by school psychologists in Virginia and what type of impact it has on eligibility decisions. Ten school psychologists were contacted via the email database of the Virginia Department of Education and completed a phone interview. Grounded theory was used to investigate the themes and ideas regarding …

The Art Curriculum As A Model Approach For Cultivating Higher Order Thinking Skills, Nicole Ross

Masters Theses, 2010-2019

As a life-long learner, I am fascinated by the abyss of knowledge that characterizes and composes a life of consciousness. As a teacher and mentor, I am committed to igniting this quest for knowledge in others and developing effective practices in doing so. The curriculum functions as an invitation to knowledge—or what can be seen as the crux of an education. The question I am most interested in answering is: “how can we most effectively approach curriculum in a way that inspires higher order thinking?” Throughout this study, I examined the factors that go into the formation of curriculum, the …

A New Paradigm For Improvement: Student-Faculty Partnership In Learning Outcomes Assessment, Nicholas A. Curtis

Dissertations, 2014-2019

In the United States, higher education institutions assess the impact of program-level educational experiences through the process of program-level student learning outcomes assessment. The final step of the assessment cycle is to use assessment interpretations to make changes to educational programming. Nevertheless, few programs can demonstrate the use of assessment results in this way. Perhaps assessment work is missing a key perspective: that of the students it assesses. Cook-Sather, Bovill, and Felton (2014) define student-faculty partnership as “a collaborative, reciprocal process through which all participants have the opportunity to contribute equally, although not necessarily in the same ways, to curricular …

Journeying The James: A Study Of A Multidisciplinary Environmental Education Program In The Non-Formal Sector, Ashley A. James

VA Engage Journal

Because the world is faced with an abundance of environmental problems, environmental education is essential in creating citizens that can solve them. Many studies show that when people are educated about the environment, they become environmental stewards. This paper investigates an experience and place-based environmental education program for high school students by the James River Association, a non-governmental organization in Richmond, Virginia. The study aims to identify whether or not the program meets the goals of environmental education, as well as its own goals. Fifty-four past program participants responded to an internet survey. Descriptive statistics and analysis of qualitative data …

The Impact Of Student Leadership Engagement On Meaning In Life And Work During College, Heather Janel Strine-Patterson

Dissertations, 2014-2019

The rising need, cost, and debt for postsecondary education has increased attention and scrutiny on its value, and colleges and universities must underscore outcomes beyond employment of graduates. Psychological well-being is a promising area to expand the value of postsecondary education. Using correlations, multiple regression, and multivariate analysis of variance (MANOVA), this study seeks to contribute to an emergent body of empirical knowledge about the impact of postsecondary education on students’ well-being by specifically examining the relationship between participation in cocurricular and extracurricular experiences and students’ well-being defined by their sense of meaning in life and work. To this end, …

Should We Think About The Scale When We Weigh The Pig?, Kathy E. Clarke, Gretchen A. Hazard

Libraries

To make a heavier pig, then it makes perfect sense to weigh it – twice – prior to feeding him and afterwards. But what if we more interested in the overall health of the pig, or, if our big is rounder post-food, or if our pig can make pig-fattening food choices? To answer those questions, assessors would need to consider a highly-attuned instrument or one that measures something different than the information a scale provides. In this presentation, we hope to engage participants to consider the how of assessment and in particular consider how we assess influences what we find …

Technology, Information Literacy And Social Work Education, Laura Trull, David Vess

Libraries

This poster will demonstrate a unique series of interactive lessons, designed and implemented collaboratively by Social Work and Library faculty to support student information literacy skill development. This series of six lessons was implemented with junior-level social work students and focused on topics such as determining quality of sources, constructing citations, identifying research methodology, utilizing technology, research ethics and search techniques. Lesson outlines will be made available to participants and future research and evaluation plans will be discussed.

Design And Assessment Of Deep And Active Learning In Science, Technology, Engineering, And Mathematics (Stem) Education, Juhong Christie Liu Ph.D., Elizabeth Johnson Ph.D., Jin Joy Mao Ph.D.

Libraries

This presentation draws academic significance from a focused literature review and initial data for learning design in Science, Technology, Engineering, and Mathematics (STEM) education. The presenters will discuss strategies of fostering deep, active learning, alignment with assessment, and development of assessment instruments and methods. The presenters will share the design and development of an assessment kit to measure learning outcomes that matter in the 21st century STEM education. Through shared evidence and interactive reflection, the audience will take away up-to-date design strategies for deep and active learning as well as assessment in STEM education. The project is sponsored by National …

An Exploratory Study To Understand Elementary School Students’ Conceptions Of Food Chains, Shelby Snowden

Senior Honors Projects, 2010-2019

Research has shown that elementary school is a critical time to pique children’s interest in science. However, many enrichment activities known to pique this interest in young children are not available to students of low socioeconomic status, English Language Learners, racial minorities, and students with disabilities. This has encouraged many higher education institutions to develop STEM outreach programs. Because of the cognitive gap between STEM professionals and young children and the logistics of implementing student-centered activities in heterogeneous classrooms, programs usually consist of activities that impress students with “sophisticated” science but are beyond the cognitive levels of most students and …