Social and Behavioral Sciences Commons^™

The Set Of Test Tasks Assessing Special Physical Fitness Of 17-Year-Old Soccer Players, Andrzej Szwarc, Bartosz Dolanski, Patrycja Lipinska

Baltic Journal of Health and Physical Activity

Background: The objective of the research was to work out the set of test tasks assessing special physical fitness of 17-year-old soccer players. Material/Methods: At first, on the basis of the analysis of the said issue in literature and the authors’ own coaching experience, 13 test tasks were selected. Next, reliability and accuracy of the chosen test tasks were examined on the group of 16 athletes from the Centre of Sports training for youth in Gdansk. The reliability was assessed by the test-re-test method and the accuracy according to a criterion of internal accuracy tests. Except for one task, all …

Determination Of Maximal Oxygen Uptake Through A New Basketball-Specific Field Test, Ersen Adsiz, Gulbin Rudarli Nalcakan, S. Rana Varol, Faik Vural

Baltic Journal of Health and Physical Activity

The aim of this study was to develop a new basketball-specific field test (BSFT) that determines the maximal oxygen uptake indirectly and to determine the reliability and validity of the test for measuring aerobic power. An aerobic endurance-based test totalling 1.5 miles on a basketball court including side steps and running was designed to be completed as quickly as possible. 15-year-old, male basketball players’ maximal oxygen uptake (VO2max) levels measured directly as the gold standard laboratory test. Laboratory test results showed a significant negative correlation between the VO2max level and the duration of the BSFT (r = -0.705, p = …

Athlete Self-Efficacy Scale: Development And Psychometric Properties, Çalık Veli Koçak

Baltic Journal of Health and Physical Activity

Background: It is important that psychological structures have an impact on athlete performance, such as self-efficacy can be measured consistently. The aim of this study is to develop a measurement tool with psychometric properties that can measure the self-efficacy beliefs of athletes. Material and methods: The participants of the study consisted of 325 athletes (age 21.6 ± 4.2) who actively pursue sports in various sports branches in Turkey. In the validity and reliability analysis of the scale, exploratory and confirmatory factor analyzes were used. Cronbach’s Alpha reliability coefficient value of the total scale is .88. Results: The validity and reliability …

Validation Of The Lithuanian Version Of The Perceived Parental Success Standards In Sport Scale (Ppsss), Enrika Kromerova-Dubinskiene, Saulius Sukys

Baltic Journal of Health and Physical Activity

Background: The recently developed Perceived Parental Success Standards Scale (PPSSS) provides a new opportunity to understand better how parents perceive success in sport from the young athlete’s perspective. The aim of the present study was to adapt and validate the Lithuanian-language version of the PPSSS. Material and methods: The study included 587 adolescents (mean age = 14.3, SD = 1.11) from different sport teams in Lithuania. Confirmatory factor analysis (CFA) and additionally exploratory Pearson’s correlation and regression analysis were performed to test discriminant, concurrent, and predictive validity. Results: Exploratory structural equation modelling provided an acceptable fit of a two-factor model …

The Reliability And Intensity Dependence Of Maximum Mouth Pressure During Bench Press Exercise In Healthy Athletes, Dusan Blazek, Anna Pisz, Ondrej Pecha, Petr Kubový

Baltic Journal of Health and Physical Activity

Background: Respiratory muscle strength is an important indicator of human health and sport condition. The aim of this study was to assess the test/retest reliability of mouth pressure (MP) measured by a created pressure sensor mouthpiece in the sitting position and during bench pressing at various intensities. Material and methods: 23 healthy athletes were measured in 3 separate sessions for MP in the sitting position and during flat bench press at an intensity of one repetition maximum (1RM), 3 x 90% of 1RM, 8 x 80% of 1RM and 12 x 60% of 1RM. Results: The measurement device showed acceptable …

Content, Construct, And Criterion Validity, Reliability, And Objectivity For Aquatic Readiness Assessment For Brazilian Children, Nadia C. Valentini, Keila R G Pereira, Glauber C. Nobre

International Journal of Aquatic Research and Education

The Aquatic Readiness Assessment (ARA) is an assessment instrument for measuring children's aquatic readiness. The objective of the study was to translate the English version into Portuguese and to investigate the content, construct, and criterion validity as well as the reliability and rater objectivity of the ARA for Brazilian children. Twenty-three professionals and 464 children, newborn to 13 years-old participated in the study. We found strong content (94% to 100% of judges’ agreement) and criterion validity, internal consistency (α from .96 to .97), and inter-rater objectivity (ICC from .81 to .98), and test-retest reliability (ICC from .94 to .98). Appropriate …

A Psychometric Evaluation Of The Best In Class Adherence And Competence Scale, Katrina A. Markowicz

Theses and Dissertations

It is critical to utilize treatment integrity instruments to support the evaluation of evidence-based programs in early classroom contexts. However, in the early childhood field, guidelines for collecting treatment integrity data are underdeveloped. Consequently, most treatment integrity instruments employed in the field solely assess adherence, vary in design features and have little psychometric evidence supporting their use. As such, this represents a gap in the field that might slow efforts to implement evidence-based programs. The current study examines the score reliability and validity of an observational treatment integrity instrument (The BEST in CLASS Adherence and Competence Scale [BiCACS]; Sutherland et …

Maximizing Data Quality And Shortening Survey Time: Three-Form Planned Missing Data Survey Design, E. Whitney G. Moore, Kyle M. Lang, Elizabeth M. Grandfield

Kinesiology, Health and Sport Studies

Simulation studies have shown the three-form planned missing data design efficiently collects high quality data while reducing participant burden. This methodology is rarely used in sport and exercise psychology. Therefore, we conducted a re-sampling study with existing sport and exercise psychology survey data to test how three-form planned missing data survey design implemented with different item distribution approaches effect constructs’ internal measurement structure and validity. Results supported the efficacy of the three-form planned missing data survey design for cross-sectional data collection. Sample sizes of at least 300 (i.e., 100 per form) are recommended for having unbiased parameter estimates. It is …

Psychometric Developments Of The Ace-Iq: Understanding The Trauma History Of Latine Immigrants, Jorli K. Swingen Dr.

Theses and Dissertations

Adverse childhood experiences (ACEs) have a profound effect on an individual’s physical and mental health. The World Health Organization has recently updated the ACE questionnaire so it could be used with international populations. The Adverse Childhood Experiences-International Questionnaire (ACE-IQ), has not been translated to Spanish or used with Latine immigrants.

This study translated the ACE-IQ into Spanish, evaluated the psychometric properties of the questionnaire, and collected data on 184 four adult English Language Learners in Chesterfield County, VA.

There is evidence of internal consistency for the ACE-IQ as a whole (α = .908) and within subscales. Three factors were identified …

The Reliability Of Single-Item Assessments, Sijun Zhang

Legacy Theses & Dissertations (2009 - 2024)

Single-item assessments have become more popular recently in distinct areas, even though there is no consensus about whether they are sufficiently reliable. Researchers have developed methods to estimate the reliability of single-item assessments, some are based on factor analysis (method FA), correction for attenuation (method CA), and others employ Molenaar and Sijtsma’s theory (method MS), coefficient λ6 (method λ6), or latent class model (method LCRC). However, no empirical study has investigated which method estimates the reliability of single-item assessment most precisely. This study investigated this question via a simulation study. To represent assessments as found in practice, the simulation study …

Evaluation Of Modern Missing Data Handling Methods For Coefficient Alpha, Katerina Matysova

College of Education and Human Sciences: Dissertations, Theses, and Student Research

When assessing a certain characteristic or trait using a multiple item measure, quality of that measure can be assessed by examining the reliability. To avoid multiple time points, reliability can be represented by internal consistency, which is most commonly calculated using Cronbach’s coefficient alpha. Almost every time human participants are involved in research, there is missing data involved. Missing data means that even though complete data were expected to be collected, some data are missing. Missing data can follow different patterns as well as be the result of different mechanisms. One traditional way to deal with missing data is listwise …

Role Competency Scale On Shared Decision-Making Nurses: Development And Psychometric Properties, Joseph D. Tariman Phd, Pamela Katz, Jessica Bishop-Royse Phd, Lisa Hartle Ms, Cns, Rn, Katharine Szubski Bsn, Rn, Toreend Enecio, Ima Garcia, Nadia Spawn Msn, Katherine Jones Masterton

Joseph D Tariman PhD, RN, ANP-BC, FAAN

On The Same Page: A Formal Process For Training Multiple Interviewers, Carolyn Sattin-Bajaj

The Qualitative Report

The increased utilization of qualitative methodologies as part of mixed-method health and social science research has highlighted the need for training procedures for every stage of qualitative data collection and analysis. Yet, few group training models exist for collecting reliable, valid qualitative interview data. This article presents a multi-stage, collaborative interview training process for a large team of research assistants. The training program combines insights and techniques used in both structured and semi-structured interviewing. It also includes ongoing instruction and feedback prior to and during data collection in an effort to ensure consistency and reliability. In the article, I describe …

Reliability And Validity Of Michigan School Libraries For The 21st Century Measurement Benchmarks, Natosha Nicole Floyd

Wayne State University Dissertations

The purpose of this study was to examine the psychometric properties of the Michigan School Libraries for the 21st Century Measurement Benchmarks (SL21). The instrument consists of 19 items with three subscales: Building the 21st Century Learning Environment Subscale, Teaching for 21st Century Learning Subscale, and Leading the Way to 21st Century Learning Subscale. The sample consisted of 54 respondents who were administered the instrument in 2014 and 2015. Cronbach’s alpha for the total instrument was 0.807 (n = 19 items). Exploratory factor analysis (EFA) was used to measure construct validity. The findings derived from the EFA did not tend …

An Early Years Toolbox For Assessing Early Executive Function, Language, Self-Regulation, And Social Development: Validity, Reliability, And Preliminary Norms, Steven J. Howard, Edward Melhuish

Faculty of Social Sciences - Papers (Archive)

Several methods of assessing executive function (EF), self-regulation, language development, and social development in young children have been developed over previous decades. Yet new technologies make available methods of assessment not previously considered. In resolving conceptual and pragmatic limitations of existing tools, the Early Years Toolbox (EYT) offers substantial advantages for early assessment of language, EF, self-regulation, and social development. In the current study, results of our large-scale administration of this toolbox to 1,764 preschool and early primary school students indicated very good reliability, convergent validity with existing measures, and developmental sensitivity. Results were also suggestive of better capture of …

The Create Critical Appraisal Tool: Establishing The Validity, Reliability And Feasibility Of A Tool To Appraise Research From Aboriginal And Torres Strait Islander Perspective, Stephen Harfield, O Gibson, Kathryn Anne Morey, Elaine Kite, Karla Canuto, K Glover, Judith Streak Gomersall, Carol Davy, D Carter, Edoardo Aromataris, Annette J. Braunack-Mayer

Faculty of Social Sciences - Papers (Archive)

Abstract presented at the Global Evidence Summit: Using evidence. Improving lives, 13-16 September 2017, Cape Town, South Africa

Random Number Simulations Reveal How Random Noise Affects The Measurements And Graphical Portrayals Of Self-Assessed Competency, Edward Nuhfer, Christopher Cogan, Steven Fleisher, Eric Gaze, Karl Wirth

Numeracy

Self-assessment measures of competency are blends of an authentic self-assessment signal that researchers seek to measure and random disorder or "noise" that accompanies that signal. In this study, we use random number simulations to explore how random noise affects critical aspects of self-assessment investigations: reliability, correlation, critical sample size, and the graphical representations of self-assessment data. We show that graphical conventions common in the self-assessment literature introduce artifacts that invite misinterpretation. Troublesome conventions include: (y minus x) vs. (x) scatterplots; (y minus x) vs. (x) column graphs aggregated as quantiles; line …

Test-Retest Reliability Of A Single-Channel, Wireless Eeg System, Jeffrey M. Rogers, Stuart J. Johnstone, Anna Aminov, James Donnelly, Peter H. Wilson

Faculty of Social Sciences - Papers (Archive)

Recording systems to acquire electroencephalogram (EEG) data are traditionally lab-based. However, there are shortcomings to this method, and the ease of use and portability of emerging wireless EEG technologies offer a promising alternative. A previous validity study demonstrated data derived from a single-channel, wireless system (NeuroSky ThinkGear, San Jose, California) is comparable to EEG recorded from conventional lab-based equipment. The current study evaluated the reliability of this portable system using test-retest and reliable change analyses. Relative power (RP) of delta, theta, alpha, and beta frequency bands was derived from EEG data obtained from a single electrode over FP1 in 19 …

Expected Profiles And Temporal Stability Of The Look, Sierra Marie Baird

Theses and Dissertations

The LOOK is an iOS based iPad app designed to measure viewing time as an estimate of sexual interest. Participants used a 7-point Likert scale to rate 154 images based on sexual attractiveness. The images belonged to 14 differentiated gender and age categories from infants to elderly adults. Before rating each image participants were asked to complete an additional task of locating and touching a small dot found in one of the four corners of the screen. This was included to make sure that participants we attending to each image, and to add another level of information to the results.The …

Screening And Diagnostic Validity Of Affinity 2.5, Heather Lynn Stephenson

Theses and Dissertations

Affinity 2.5 is a computer-based instrument designed to assess sexual interest using viewing-time measures. Viewing-time measures of sexual interest have been developed to identify individuals with deviant sexual interest. The purpose of this study is to examine the validity of Affinity 2.5 in screening and diagnosing individuals with sexually deviant interests. This study used viewing time profiles of known sexual offenders compared to norm-referenced profiles of an exclusively heterosexual, non-pedophilic college population. Participants were 155 males and 3 females who had sexually offended against children and 63 male and 84 female non-offender college students. Results show that 43.7% of offenders …

Reliability Generalization Of The Multigroup Ethnic Identity Measure-Revised (Meim-R), Hayley Marie Herrington

Theses and Dissertations

The strength of ethnic identity has been linked to higher academic achievement, academic attainment, and overall psychological wellbeing. The Muligroup Ethnic Identity Measure (MEIM) was developed to measure ethnic identity development, and this measure has been used widely. The MEIM has since been updated to the Multigroup Ethnic Identity Measure–Revised (MEIM–R). The relatively new MEIM–R has not been widely studied. In order to solidify researchers' confidence in the measure, a reliability generalization analysis was performed and the data compared to the original MEIM. Random-effects weighted models evaluated internal consistency coefficients (Chronbach's alpha). The MEIM–R demonstrated adequate reliability coefficients (average α …

Developing A Measure Of Scientific Literacy For Middle School Students, Helenrose Fives, Mark Nicolich, Amanda Birnbaum, Wendy Huber

Department of Public Health Scholarship and Creative Works

Scientific literacy reflects “a broad and functional understanding of science for general education purposes” (DeBoer, 2000, p. 594). Herein, we present the ongoing development of the Scientific Literacy Assessment (SLA), a work‐in‐progress measure to assess middle school students' (ages 11–14) scientific literacy. The SLA includes a selected response measure of students’ demonstrated scientific literacy (SLA‐D) and a motivation and beliefs scale based on existing measures of self‐efficacy, subjective task value, and personal epistemology for science (SLA‐MB). Our theoretical conceptualization of scientific literacy guided the development of our measure. We provide details from three studies: Pilot Study 1 (n = …

Where Do Older Australians Receive Their Health Information? Health Information Sources And Their Perceived Reliability, Pippa Burns, Sandra C. Jones, Donald C. Iverson, Peter Caputi

Sandra Jones

Background: Chronic disease prevalence is increasing, in part due to the ageing population, adding further pressure to Australia's over-stretched primary health care services. While patients are encouraged to self-manage their chronic disease(s) in order to minimise the impact on their day-to-day functioning, little is known about where older adults receive health information and their perceptions of the reliability of these sources. Such knowledge would facilitate the development of self-management support strategies using health information sources that are acceptable to older adults. Methods: A cross-sectional design was utilised to investigate where older adults receive their health information and their perceptions of …

The Reliability And Validity Of The Thin Slice Technique: Observational Research On Video Recorded Medical Interactions, Tanina Suzanne Foster

Wayne State University Dissertations

The Reliability and Validity of the Thin Slice Technique: Observational Research on Video Recorded Medical Interactions

Introduction: Observational research using the thin slice technique has been routinely incorporated in observational research methods, however there is limited evidence supporting use of this technique compared to full interaction coding. The purpose of this study was to determine if this technique could be reliability coded, if ratings are consistent between the first, second and third slice, and if they are indeed representative of full interactions.

Methods: Three 30-second thin slices were sampled from the beginning, middle and end of a full-length video-recorded …

Investigating The Reliability And Validity Of Candidate Psychophysiological Endophenotypes Of Affective Processing, David A. Camfield, Rodney J. Croft, Keith A. Wesnes, Sarah Boyall, Monique Taylor, Rachael Tasca, Emma Kornfield

Faculty of Social Sciences - Papers (Archive)

Abstract presented at The 17th World Congress of Psychophysiology (IOP2014) of the International Organization of Psychophysiology (IOP) Hiroshima, Japan, September 23rd to 27th, 2014

Reliability And Validity Of A Short Ffq For Assessing The Dietary Habits Of 2-5-Year-Old Children, Sydney, Australia, Victoria Flood, Li Ming Wen, Louise Hardy, Chris Rissel, J Simpson, Louise Baur

Faculty of Social Sciences - Papers (Archive)

Objective A simple FFQ which ranks young children's dietary habits is necessary for population-based monitoring and intervention programmes. The aim of the present study was to determine the reliability and validity of a short FFQ to assess the dietary habits of young children aged 2–5 years.

Design Parents completed a seventeen-item FFQ for their children by telephone on two occasions, two weeks apart. Sixty-four parents also completed 3 d food records for their children. The FFQ included daily servings of fruit and vegetables, frequency of eating lean meat, processed meats, take-away food, snack foods (biscuits, cakes, doughnuts, muesli bars), potato …

Using Above-Level Testing To Track Growth In Academic Achievement In Gifted Students, Russell Warne

Russell T Warne

Above-level testing is the practice of administering aptitude or academic achievement tests that are designed for typical students in higher grades or older age-groups to gifted or high-achieving students. Although widely accepted in gifted education, above-level testing has not been subject to careful psychometric scrutiny. In this study, I examine reliability data, growth trajectories, distributions, and group differences of above-level test scores obtained from the Iowa Tests of Basic Skills and Iowa Tests of Educational Development. Two hundred twenty-four middle school students participated in this study. All participants were tested at least 1 time for an overall total of 435 …

Where Do Older Australians Receive Their Health Information? Health Information Sources And Their Perceived Reliability, Pippa Burns, Sandra C. Jones, Donald C. Iverson, Peter Caputi

Faculty of Social Sciences - Papers (Archive)

Background: Chronic disease prevalence is increasing, in part due to the ageing population, adding further pressure to Australia's over-stretched primary health care services. While patients are encouraged to self-manage their chronic disease(s) in order to minimise the impact on their day-to-day functioning, little is known about where older adults receive health information and their perceptions of the reliability of these sources. Such knowledge would facilitate the development of self-management support strategies using health information sources that are acceptable to older adults. Methods: A cross-sectional design was utilised to investigate where older adults receive their health information and their perceptions of …

The Forms Of Bullying Scale (Fbs): Validity And Reliability Estimates For A Measure Of Bullying Victimization And Perpetration In Adolescence, Therese M. Shaw, Julian J. Dooley, Donna S. Cross, Stephen R Zubrick, Stacey K. Waters

Research outputs 2013

The study of bullying behavior and its consequences for young people depends on valid and reliable measurement of bullying victimization and perpetration. Although numerous self-report bullying-related measures have been developed, robust evidence of their psychometric properties is scant, and several limitations inhibit their applicability. The Forms of Bullying Scale (FBS), with versions to measure bullying victimization (FBS-V) and perpetration (FBS-P), was developed on the basis of existing instruments, for use with 12-to 15-year-old adolescents to economically, yet comprehensively measure both bullying perpetration and victimization. Measurement properties were estimated. Scale validity was tested using data from 2 independent studies of 3,496 …

Statistical Methods Used In Gifted Education Journals, 2006-2010, Russell Warne, Maria Lazo, Tami Ramos, Nicola Ritter

Russell T Warne

This article describes the statistical methods used in quantitative and mixed methods articles between 2006 and 2010 in five gifted education research journals. Results indicate that the most commonly used statistical methods are means (85.9% of articles), standard deviations (77.8%), Pearson’s r (47.8%), χ2 (32.2%), ANOVA (30.7%), t tests (30.0%), and MANOVA (23.0%). Approximately half (53.3%) of the articles included reliability reports for the data at hand; Cronbach’s alpha was the most commonly reported measure of reliability (41.5%). Some discussions of best statistical practice and implications for the field of gifted education are included.