Open Access. Powered by Scholars. Published by Universities.®

Psychology Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 9 of 9

Full-Text Articles in Psychology

The Reliability Of Single-Item Assessments, Sijun Zhang Jan 2020

The Reliability Of Single-Item Assessments, Sijun Zhang

Legacy Theses & Dissertations (2009 - 2024)

Single-item assessments have become more popular recently in distinct areas, even though there is no consensus about whether they are sufficiently reliable. Researchers have developed methods to estimate the reliability of single-item assessments, some are based on factor analysis (method FA), correction for attenuation (method CA), and others employ Molenaar and Sijtsma’s theory (method MS), coefficient λ6 (method λ6), or latent class model (method LCRC). However, no empirical study has investigated which method estimates the reliability of single-item assessment most precisely. This study investigated this question via a simulation study. To represent assessments as found in practice, the simulation study …


Evaluating The Validity Of Technology-Enhanced Educational Assessment Items And Tasks: An Empirical Approach To Studying Item Features And Scoring Rubrics., Ally Thomas Sep 2016

Evaluating The Validity Of Technology-Enhanced Educational Assessment Items And Tasks: An Empirical Approach To Studying Item Features And Scoring Rubrics., Ally Thomas

Dissertations, Theses, and Capstone Projects

With the advent of the newly developed Common Core State Standards and the Next Generation Science Standards, innovative assessments, including technology-enhanced items and tasks, will be needed to meet the challenges of developing valid and reliable assessments in a world of computer-based testing. In a recent critique of the next generation assessments in math (i.e., Smarter Balanced), Rasmussen (2015) observed that many aspects of the technology “enhancements” can be expected to do more harm than good as the computer interfaces may introduce construct irrelevant variance. This paper focused on issues surrounding the design of TEIs and how cognitive load …


Measuring The Outliers: An Introduction To Out-Of-Level Testing With High-Achieving Students, Karen Rambo-Hernandez, Russell Warne Feb 2015

Measuring The Outliers: An Introduction To Out-Of-Level Testing With High-Achieving Students, Karen Rambo-Hernandez, Russell Warne

Russell T Warne

Out-of-level testing is an underused strategy for addressing the needs of students who score in the extremes, and when used wisely, it could provide educators with a much more accurate picture of what students know. Out-of-level testing has been shown to be an effective assessment strategy with high-achieving students; however, out-of-level testing has not been shown to work well with low-achieving students. This article provides a brief history of out-of-level testing, along with guidelines for using it.


Using Above-Level Testing To Track Growth In Academic Achievement In Gifted Students, Russell Warne Dec 2013

Using Above-Level Testing To Track Growth In Academic Achievement In Gifted Students, Russell Warne

Russell T Warne

Above-level testing is the practice of administering aptitude or academic achievement tests that are designed for typical students in higher grades or older age-groups to gifted or high-achieving students. Although widely accepted in gifted education, above-level testing has not been subject to careful psychometric scrutiny. In this study, I examine reliability data, growth trajectories, distributions, and group differences of above-level test scores obtained from the Iowa Tests of Basic Skills and Iowa Tests of Educational Development. Two hundred twenty-four middle school students participated in this study. All participants were tested at least 1 time for an overall total of 435 …


A Preliminary Investigation Of The Validity Of Time-Based Measures Of Sustained Attention For Children, Michael R. Kulfan Jan 2013

A Preliminary Investigation Of The Validity Of Time-Based Measures Of Sustained Attention For Children, Michael R. Kulfan

Antioch University Full-Text Dissertations & Theses

This study is a preliminary investigation of the validity of using time-based measures to quantify sustained attention in children ages 6-12. Problems with sustained attention negatively affect childhood learning and development. The prevalence of disorders known to impact sustained attention performance continue to rise in the United States. Currently, commercially available, objective measures of sustained attention use normative comparisons that provide limited information about the effect such problems have on child performance in natural settings. We reviewed test data from 290 charts of children ages 6-12 referred for neuropsychological evaluation. The Test of Everyday Attention for Children (TEA-Ch) is an …


Bully/Victim Power Inventory: Measuring The Power Imbalance In The Bully/Victim Relationship, Marybeth Plonkey-Lehto Jan 2012

Bully/Victim Power Inventory: Measuring The Power Imbalance In The Bully/Victim Relationship, Marybeth Plonkey-Lehto

Electronic Theses and Dissertations

The empirical study of the power imbalance in the bully/victim relationship has impeded research synthesis, and the need for a quantitative measure of this key component has been well established in the literature. Lack of differentiation between victimization with and without power imbalance has been cited as a possible cause for imprecise measurement. Increased precision in bully victimization measurement is needed to accurately inform research investigating psychosocial health, treatment and positive outcomes, in addition to prevention and intervention programs. Therefore, the purpose of this dissertation was the initial development and validation of the Bully/Victim Power Inventory aimed at differentiating perceived …


The National Survey Of Student Engagement As A Predictor Of Academic Success, Paul Michael Fursman Jan 2012

The National Survey Of Student Engagement As A Predictor Of Academic Success, Paul Michael Fursman

All Graduate Theses, Dissertations, and Other Capstone Projects

Student engagement measures have been shown to be excellent predictors of desirable educational outcomes, and in some cases, these measures are being used as a means of institutional accountability. The National Survey of Student Engagement (NSSE) is one of the most widely used measures of student engagement. In this study, I examine the relationship between NSSE subscale scores and measures of student academic success. I also examine the extent to which pre-college ability and ethnicity moderate the relationship between engagement scores and academic outcomes. Results indicate that the benchmark academic challenge was a significant predictor of freshmen GPA and the …


Development And Validation Of The Counterfactual Thinking For Negative Events Scale, Tarika Daftary Kapur, Mark S. Rye, Melissa B. Cahoon, Rahan S. Ali Apr 2008

Development And Validation Of The Counterfactual Thinking For Negative Events Scale, Tarika Daftary Kapur, Mark S. Rye, Melissa B. Cahoon, Rahan S. Ali

Department of Justice Studies Faculty Scholarship and Creative Works

We examined the psychometric properties of the newly created Counterfactual Thinking for Negative Events Scale (CTNES) in two studies involving university undergraduates. In Study 1 (N = 634), factor analysis revealed four subscales that correspond with various types of counterfactual thinking: Nonreferent Downward, Other-Referent Upward, Self-Referent Upward, and Nonreferent Upward. The subscales were largely orthogonal and had adequate internal consistency and test–retest reliability. The CTNES subscales were positively correlated with a traditional method of assessing counterfactual thinking and were related as expected to contextual aspects of the negative event, negative affect, and cognitive style. In Study 2 (N …


The Pond You Fish In Determines The Fish You Catch: Exploring Strategies For Qualitative Data Collection, Muninder Kaur Ahluwalia, Lisa A. Suzuki, Agnes Kwong Arora, Jacqueline S. Mattis Mar 2007

The Pond You Fish In Determines The Fish You Catch: Exploring Strategies For Qualitative Data Collection, Muninder Kaur Ahluwalia, Lisa A. Suzuki, Agnes Kwong Arora, Jacqueline S. Mattis

Department of Counseling Scholarship and Creative Works

Qualitative research has increased in popularity among social scientists. While substantial attention has been given to various methods of qualitative analysis, there is a need to focus on strategies for collecting diverse forms of qualitative data. In this article, the authors discuss four sources of qualitative data: participant observation, interviews, physical data, and electronic data. Although counseling psychology researchers often use interviewing, participant observation and physical and electronic data are also beneficial ways of collecting qualitative data that have been underutilized.