Open Access. Powered by Scholars. Published by Universities.®

Psychology Commons

Open Access. Powered by Scholars. Published by Universities.®

Education

Psychometrics

Institution
Publication Year
Publication
Publication Type
File Type

Articles 1 - 22 of 22

Full-Text Articles in Psychology

Validation Of The Child And Adult Social Support Scale (Casss) Which Measures Social Support In The Indonesian Version, Endah Mastuti, Fajrianthi, Fitri Andriani Oct 2022

Validation Of The Child And Adult Social Support Scale (Casss) Which Measures Social Support In The Indonesian Version, Endah Mastuti, Fajrianthi, Fitri Andriani

International Conference on Assessment and Learning (ICAL)

Social support has an important role, so that students in online learning can reduce the various problems they face. Social support here comes from parents, teachers, classmates, close friends, and the school itself as an institution. Based on this, it is necessary to do research related to social support to get an overview of the support from whom students need in online learning. Furthermore, this can be used as input to intervene in the problems faced by students. To conduct this research, it is necessary to have a measuring tool to conduct social support research. One of the comprehensive measuring …


Multiracial Individuals And Educational Testing, Karen Alexander Oct 2021

Multiracial Individuals And Educational Testing, Karen Alexander

The Nebraska Educator: A Student-Led Journal

A literature review focused on quantitative measures and methods regarding multiracial individuals and educational testing revealed that multiracial individuals are uniquely different than monoracial individuals in terms of their racial identity and these unique identities interact with test scores. Until recently, this uniqueness has been ignored by institutions and within the field of educational testing. The uniqueness of multiracial identity should be taken into consideration when using test measures to make decisions for selection and when comparing group outcomes. The review provides a brief picture regarding the history of categorization of multiracial individuals and current research which connects the multiracial …


A Psychometric Evaluation Of The Best In Class Adherence And Competence Scale, Katrina A. Markowicz Jan 2021

A Psychometric Evaluation Of The Best In Class Adherence And Competence Scale, Katrina A. Markowicz

Theses and Dissertations

It is critical to utilize treatment integrity instruments to support the evaluation of evidence-based programs in early classroom contexts. However, in the early childhood field, guidelines for collecting treatment integrity data are underdeveloped. Consequently, most treatment integrity instruments employed in the field solely assess adherence, vary in design features and have little psychometric evidence supporting their use. As such, this represents a gap in the field that might slow efforts to implement evidence-based programs. The current study examines the score reliability and validity of an observational treatment integrity instrument (The BEST in CLASS Adherence and Competence Scale [BiCACS]; Sutherland et …


The Reliability Of Single-Item Assessments, Sijun Zhang Jan 2020

The Reliability Of Single-Item Assessments, Sijun Zhang

Legacy Theses & Dissertations (2009 - 2024)

Single-item assessments have become more popular recently in distinct areas, even though there is no consensus about whether they are sufficiently reliable. Researchers have developed methods to estimate the reliability of single-item assessments, some are based on factor analysis (method FA), correction for attenuation (method CA), and others employ Molenaar and Sijtsma’s theory (method MS), coefficient λ6 (method λ6), or latent class model (method LCRC). However, no empirical study has investigated which method estimates the reliability of single-item assessment most precisely. This study investigated this question via a simulation study. To represent assessments as found in practice, the simulation study …


The Trouble With Test Banks, Harvey Richman, Molly Hrezo Aug 2017

The Trouble With Test Banks, Harvey Richman, Molly Hrezo

Perspectives In Learning

We compared the psychometrics of quiz questions randomly selected from a test bank with the psychometrics of quiz questions the instructor had selected from the bank for quality and modified (if necessary). On multiple psychometric indices, the instructor selected/modified questions were superior to questions randomly selected from the test bank. Most notably, when compared with instructor written/modified questions, randomly selected bank questions were nearly 6.5 times more likely to contain a distractor that drew more responses than the correct answer. Details and implications are discussed.


Dimensionality Analysis Of The Pals Classroom Goal Orientation Scales, Angela K. Tombari Jan 2017

Dimensionality Analysis Of The Pals Classroom Goal Orientation Scales, Angela K. Tombari

Theses and Dissertations--Educational, School, and Counseling Psychology

Achievement goal theory is one of the most broadly accepted theoretical paradigms in educational psychology with over 35 years of influencing research and educational practice. The longstanding use of this construct has led to two consequences of importance for this research: 1) many different dimensionality representations have been debated, and 2) methods used to confirm dimensionality of the scales have been supplanted from best practice. A further issue is that goal orientations are used to inform classroom practice, whereas most measurement studies focus on the structure of the personal goal orientation scales rather than the classroom level structure. This study …


Alcohol Use And Strenuous Physical Activity In College Students: A Longitudinal Test Of 2 Explanatory Models Of Health Behavior, Heather A. Davis, Elizabeth N. Riley, Gregory T. Smith, Richard S. Milich, Jessica L. Burris Dec 2016

Alcohol Use And Strenuous Physical Activity In College Students: A Longitudinal Test Of 2 Explanatory Models Of Health Behavior, Heather A. Davis, Elizabeth N. Riley, Gregory T. Smith, Richard S. Milich, Jessica L. Burris

Psychology Faculty Publications

Objective: To help clarify the effect of gender on the bidirectional relationship between alcohol use and strenuous physical activity in college students. Participants: Five hundred twenty-four (52% female) college students recruited in August 2008 and 2009 and followed up in April 2009 and April 2011, respectively. Methods: Participants reported their alcohol use and strenuous physical activity on 2 occasions (baseline and follow-up) spaced approximately 1 or 2 years apart. Results: For females, alcohol use quantity at baseline was associated with increased strenuous physical activity at 1- and 2-year follow-ups, and alcohol use frequency at baseline was …


Identifying Examinees Who Possess Distinct And Reliable Subscores When Added Value Is Lacking For The Total Sample, Joseph A. Rios Nov 2016

Identifying Examinees Who Possess Distinct And Reliable Subscores When Added Value Is Lacking For The Total Sample, Joseph A. Rios

Doctoral Dissertations

Research has demonstrated that although subdomain information may provide no added value beyond the total score, in some contexts such information is of utility to particular demographic subgroups (Sinharay & Haberman, 2014). However, it is argued that the utility of reporting subscores for an individual should not be based on one’s manifest characteristics (e.g., gender or ethnicity), but rather on individual needs for diagnostic information, which is driven by multidimensionality in subdomain scores. To improve the validity of diagnostic information, this study proposed the use of Mahalanobis Distance and HT indices to assess whether an individual’s data significantly departs …


Evaluating The Validity Of Technology-Enhanced Educational Assessment Items And Tasks: An Empirical Approach To Studying Item Features And Scoring Rubrics., Ally Thomas Sep 2016

Evaluating The Validity Of Technology-Enhanced Educational Assessment Items And Tasks: An Empirical Approach To Studying Item Features And Scoring Rubrics., Ally Thomas

Dissertations, Theses, and Capstone Projects

With the advent of the newly developed Common Core State Standards and the Next Generation Science Standards, innovative assessments, including technology-enhanced items and tasks, will be needed to meet the challenges of developing valid and reliable assessments in a world of computer-based testing. In a recent critique of the next generation assessments in math (i.e., Smarter Balanced), Rasmussen (2015) observed that many aspects of the technology “enhancements” can be expected to do more harm than good as the computer interfaces may introduce construct irrelevant variance. This paper focused on issues surrounding the design of TEIs and how cognitive load …


Development And Validation Of A Survey Of Knowledge Of Autism Spectrum Disorder, Laura Katherine Hansen Dec 2015

Development And Validation Of A Survey Of Knowledge Of Autism Spectrum Disorder, Laura Katherine Hansen

Master's Theses

As autism spectrum disorder (ASD) is more commonly diagnosed, having knowledge of the disorder becomes increasingly important for educators, parents, and the general public. Previous research regarding knowledge of ASD, focused mainly on knowledge possessed by those in the educational field, has found that individuals may perceive themselves as possessing average knowledge regarding ASD but have low actual knowledge (as defined by the researchers) regarding specific aspects of the disorder (Williams et al., 2011). Studies support the notion that there is a general lack of knowledge of different aspects of ASD among teachers; however, there has been little research regarding …


Measuring The Outliers: An Introduction To Out-Of-Level Testing With High-Achieving Students, Karen Rambo-Hernandez, Russell Warne Feb 2015

Measuring The Outliers: An Introduction To Out-Of-Level Testing With High-Achieving Students, Karen Rambo-Hernandez, Russell Warne

Russell T Warne

Out-of-level testing is an underused strategy for addressing the needs of students who score in the extremes, and when used wisely, it could provide educators with a much more accurate picture of what students know. Out-of-level testing has been shown to be an effective assessment strategy with high-achieving students; however, out-of-level testing has not been shown to work well with low-achieving students. This article provides a brief history of out-of-level testing, along with guidelines for using it.


Reliability Generalization Of The Multigroup Ethnic Identity Measure-Revised (Meim-R), Hayley Marie Herrington Jul 2014

Reliability Generalization Of The Multigroup Ethnic Identity Measure-Revised (Meim-R), Hayley Marie Herrington

Theses and Dissertations

The strength of ethnic identity has been linked to higher academic achievement, academic attainment, and overall psychological wellbeing. The Muligroup Ethnic Identity Measure (MEIM) was developed to measure ethnic identity development, and this measure has been used widely. The MEIM has since been updated to the Multigroup Ethnic Identity Measure–Revised (MEIM–R). The relatively new MEIM–R has not been widely studied. In order to solidify researchers' confidence in the measure, a reliability generalization analysis was performed and the data compared to the original MEIM. Random-effects weighted models evaluated internal consistency coefficients (Chronbach's alpha). The MEIM–R demonstrated adequate reliability coefficients (average α …


The Application Of Information Integration Theory To Standard Setting: Setting Cut Scores Using Cognitive Theory, Christopher C. Foster Apr 2014

The Application Of Information Integration Theory To Standard Setting: Setting Cut Scores Using Cognitive Theory, Christopher C. Foster

Doctoral Dissertations

Information integration theory (IIT) is a cognitive psychology theory that is primarily concerned with understanding rater judgments and deriving quantitative values from rater expertise. Since standard setting is a process by which subject matter experts are asked to make expert judgment about test content, it is an ideal context for the application of information integration theory. Information integration theory (IIT) was proposed by Norman H. Anderson, a cognitive psychologist. It is a cognitive theory that is primarily concerned with how an individual integrates information from two or more stimuli to derive a quantitative value. The theory focuses on evaluating the …


Using Above-Level Testing To Track Growth In Academic Achievement In Gifted Students, Russell Warne Dec 2013

Using Above-Level Testing To Track Growth In Academic Achievement In Gifted Students, Russell Warne

Russell T Warne

Above-level testing is the practice of administering aptitude or academic achievement tests that are designed for typical students in higher grades or older age-groups to gifted or high-achieving students. Although widely accepted in gifted education, above-level testing has not been subject to careful psychometric scrutiny. In this study, I examine reliability data, growth trajectories, distributions, and group differences of above-level test scores obtained from the Iowa Tests of Basic Skills and Iowa Tests of Educational Development. Two hundred twenty-four middle school students participated in this study. All participants were tested at least 1 time for an overall total of 435 …


A Preliminary Investigation Of The Validity Of Time-Based Measures Of Sustained Attention For Children, Michael R. Kulfan Jan 2013

A Preliminary Investigation Of The Validity Of Time-Based Measures Of Sustained Attention For Children, Michael R. Kulfan

Antioch University Full-Text Dissertations & Theses

This study is a preliminary investigation of the validity of using time-based measures to quantify sustained attention in children ages 6-12. Problems with sustained attention negatively affect childhood learning and development. The prevalence of disorders known to impact sustained attention performance continue to rise in the United States. Currently, commercially available, objective measures of sustained attention use normative comparisons that provide limited information about the effect such problems have on child performance in natural settings. We reviewed test data from 290 charts of children ages 6-12 referred for neuropsychological evaluation. The Test of Everyday Attention for Children (TEA-Ch) is an …


Bully/Victim Power Inventory: Measuring The Power Imbalance In The Bully/Victim Relationship, Marybeth Plonkey-Lehto Jan 2012

Bully/Victim Power Inventory: Measuring The Power Imbalance In The Bully/Victim Relationship, Marybeth Plonkey-Lehto

Electronic Theses and Dissertations

The empirical study of the power imbalance in the bully/victim relationship has impeded research synthesis, and the need for a quantitative measure of this key component has been well established in the literature. Lack of differentiation between victimization with and without power imbalance has been cited as a possible cause for imprecise measurement. Increased precision in bully victimization measurement is needed to accurately inform research investigating psychosocial health, treatment and positive outcomes, in addition to prevention and intervention programs. Therefore, the purpose of this dissertation was the initial development and validation of the Bully/Victim Power Inventory aimed at differentiating perceived …


The National Survey Of Student Engagement As A Predictor Of Academic Success, Paul Michael Fursman Jan 2012

The National Survey Of Student Engagement As A Predictor Of Academic Success, Paul Michael Fursman

All Graduate Theses, Dissertations, and Other Capstone Projects

Student engagement measures have been shown to be excellent predictors of desirable educational outcomes, and in some cases, these measures are being used as a means of institutional accountability. The National Survey of Student Engagement (NSSE) is one of the most widely used measures of student engagement. In this study, I examine the relationship between NSSE subscale scores and measures of student academic success. I also examine the extent to which pre-college ability and ethnicity moderate the relationship between engagement scores and academic outcomes. Results indicate that the benchmark academic challenge was a significant predictor of freshmen GPA and the …


A Reliability Generalization Of The Overexcitability Questionnaire-Two (Oeqii), Russell Warne Oct 2011

A Reliability Generalization Of The Overexcitability Questionnaire-Two (Oeqii), Russell Warne

Russell T Warne

Reliability generalization (RG) is a meta-analysis that combines and synthesizes reliability coefficients from different studies to ascertain the average observed reliability across studies. An RG study was conducted on previously reported data from 16 samples of the Overexcitability Questionnaire–Two (OEQII) with a combined N of 5,275. Cronbach’s alpha was found to be consistently higher on all OEQII subscales when scale variance was high and the sample consisted of adults. Sample size, gender composition of the sample, number of items from the subscale used, and location of sample (United States or a different county) had varying effects on observed alpha levels …


An Investigation Of Measurement Invariance Across Genders On The Overexcitability Questionnaire-Two (Oeqii), Russell Warne Jul 2011

An Investigation Of Measurement Invariance Across Genders On The Overexcitability Questionnaire-Two (Oeqii), Russell Warne

Russell T Warne

The Overexcitability Questionnaire–Two (OEQII) is a quantitative instrument for assessing overexcitabilities as they are described in Dabrowski’s theory of positive disintegration. This article uses multigroup confirmatory factor analysis to examine the measurement invariance of OEQII scores across genders. Results indicate that raw OEQII scores cannot be compared across genders. Caution should be used in interpreting OEQII scores.


A Construct Validity Study Of Differentiation Of Self Measures And Their Correlates, Mary Jane Maser Jan 2011

A Construct Validity Study Of Differentiation Of Self Measures And Their Correlates, Mary Jane Maser

Seton Hall University Dissertations and Theses (ETDs)

.


Development And Validation Of The Counterfactual Thinking For Negative Events Scale, Tarika Daftary Kapur, Mark S. Rye, Melissa B. Cahoon, Rahan S. Ali Apr 2008

Development And Validation Of The Counterfactual Thinking For Negative Events Scale, Tarika Daftary Kapur, Mark S. Rye, Melissa B. Cahoon, Rahan S. Ali

Department of Justice Studies Faculty Scholarship and Creative Works

We examined the psychometric properties of the newly created Counterfactual Thinking for Negative Events Scale (CTNES) in two studies involving university undergraduates. In Study 1 (N = 634), factor analysis revealed four subscales that correspond with various types of counterfactual thinking: Nonreferent Downward, Other-Referent Upward, Self-Referent Upward, and Nonreferent Upward. The subscales were largely orthogonal and had adequate internal consistency and test–retest reliability. The CTNES subscales were positively correlated with a traditional method of assessing counterfactual thinking and were related as expected to contextual aspects of the negative event, negative affect, and cognitive style. In Study 2 (N …


The Pond You Fish In Determines The Fish You Catch: Exploring Strategies For Qualitative Data Collection, Muninder Kaur Ahluwalia, Lisa A. Suzuki, Agnes Kwong Arora, Jacqueline S. Mattis Mar 2007

The Pond You Fish In Determines The Fish You Catch: Exploring Strategies For Qualitative Data Collection, Muninder Kaur Ahluwalia, Lisa A. Suzuki, Agnes Kwong Arora, Jacqueline S. Mattis

Department of Counseling Scholarship and Creative Works

Qualitative research has increased in popularity among social scientists. While substantial attention has been given to various methods of qualitative analysis, there is a need to focus on strategies for collecting diverse forms of qualitative data. In this article, the authors discuss four sources of qualitative data: participant observation, interviews, physical data, and electronic data. Although counseling psychology researchers often use interviewing, participant observation and physical and electronic data are also beneficial ways of collecting qualitative data that have been underutilized.