Digital Commons Network^™

Accounting For Oral Language Skills In Children With Dyslexia: A Systematic Review Of The Literature, Natalie Kay Olsen Miller

Theses and Dissertations

Purpose: In the present study, we conducted a systematic review to determine whether studies involving children with dyslexia include the assessment of oral language skills in their assessment batteries across various professional disciplines. Overlooking assessment of oral language in children with dyslexia may result in the misinterpretation of research findings and applications to children who present with both dyslexia and Developmental Language Disorder (DLD) or experience secondary oral language deficits. Method: According to the Preferred Reporting Items for Systematic Reviews and MetaAnalyses (PRISMA) guidelines, we searched the Elsevier Scopus database and obtained and analyzed 764 articles, up to 40 articles …

A Process For Improving The Quality Of Multiple-Choice Certification Exams, Tanner Kohler

Instructional Psychology and Technology Graduate Student Projects

This paper describes a process for improving the content validity and overall difficulty multiple-choice certification exams. The report describes an initial evaluation of existing certification exams and outlines how to basic tables of specifications to identify areas of weakness and guide improvements with the help of subject-matter experts.

Crafting A Writing Response Community Through Contract Grading, Sarah Klotz, Kristina Reardon

Journal of Response to Writing

As labor-based grading contracts gain momentum in first year writing classrooms, new kinds of response to writing take center stage. We explore how session notes composed by embedded peer tutors and students become rich tools in a writing process and create a gateway to the writing center for first-year students. By reading session notes in conversation with students’ reflective writing, we put forward three key findings: students articulate a relationship between building confidence in their writing and their willingness to seek, receive, and value feedback; students discuss how the labor required for an ‘A’ pushed them to access and learn …

Improving Student Success In A Large-Enrollment Introductory Accounting Course, Melissa P. Larson

Theses and Dissertations

This dissertation follows a three-article format presentation. The topic addresses improving student success in a large enrollment introductory accounting course. The first article is a literature review of pre-class activities within a flipped classroom setting in higher education. The review of 34 articles identified as relevant to the literature review explored what the literature tells us about pre-class learning activities and synthesized what instructors can do to design pre-class activities that encourage students' preparation for class. The review showed the importance of pre-class learning in a flipped classroom and that more research is needed to better understand students' behaviors and …

Thriving In College: The Contribution Of Career Services To Student Success, Jodi M. Chowen

Theses and Dissertations

Career services in higher education has a long history of supporting student development and post-graduation success (American Council on Education, 1937; Rayman, 1999; Dey & Cruzvergara, 2014). However, there is a dearth of research identifying specific connections between engagement with career services and student success. College student thriving has been established in previous studies as positively contributing to traditional measures of college student success, including intention to persist, grade point average, institutional fit and satisfaction, and self-reported learning gains (Schreiner, 2013). Examining the relationship of student experience with career services and thriving provides a new way to evaluate the contribution …

Comparing Relative And Absolute Reliability Of Short Versus Long Narrative Retells, Jenna Hollis

Theses and Dissertations

The purpose of the current study was to examine and compare relative and absolute reliability estimates between brief, linguistically compact narrative retells and longer, more linguistically diffuse narrative retells. The participants included 190 school-age children in firstsixth grade from Utah, Arizona, and Colorado. Participants completed two brief narrative retells using the Narrative Language Measures (NLM) Listening subtest of the CUBED assessment and one longer narrative retell using the wordless picture book Frog, Where Are You? (FWAY). These language samples were then analyzed for language productivity, complexity, and story grammar elements using the Systematic Analysis of Language Transcripts software program and …

The Development, Design, And Implementation Of A Library Assessment Framework, Holt Zaugg

Faculty Publications

Common in the language and actions of libraries is the desire to develop and foster a culture of assessment and evaluation. However, most employees in a library have had limited or no experience in designing, conducting, analyzing, and disseminating library assessments. Those who do have experience tend to draw from their personal discipline background that emphasizes one type of method over another. Typically, when these assessments happen, the efforts are one-off or siloed assessments. To create and foster a culture of assessment a framework is needed to guide and support all library assessments. A library assessment framework helps library employees …

Assessing Urban Vulnerability And Resilience To Extreme Heat With Big Data And Machine Learning: The Case Of July 2019 European Heatwave, Mikhail Sirenko

International Congress on Environmental Modelling and Software

Climate change has put residents of many cities around the world at risk. The challenge for urban planners is not only to understand which people are vulnerable and where they are located but also assess how resilient the city is to climatic shocks. To assess vulnerability and resilience, we proposed a framework based on open data and open-source machine learning libraries. We applied this framework to analyze the impact of July 2019 European heatwave on The Hague, the Netherlands. The framework combines a geodemographic grid of 500 by 500 m2 with 3,973,549 anonymized ambulance calls to capture citizens' vulnerability and …

Assessing Urban Vulnerability And Resilience To Extreme Heat With Big Data And Machine Learning: The Case Of July 2019 European Heatwave, Mikhail Sirenko

International Congress on Environmental Modelling and Software

Climate change has put residents of many cities around the world at risk. The challenge for urban planners is not only to understand which people are vulnerable and where they are located but also assess how resilient the city is to climatic shocks. To assess vulnerability and resilience, we proposed a framework based on open data and open-source machine learning libraries. We applied this framework to analyze the impact of July 2019 European heatwave on The Hague, the Netherlands. The framework combines a geodemographic grid of 500 by 500 m2 with 3,973,549 anonymized ambulance calls to capture citizens' vulnerability and …

Student-Led Assessment: A Small Study On Classroom Rubric Development And Peer Grading Practices, Brice Particelli

Journal of Response to Writing

Peer review is a common practice in writing studies. However, while there is considerable research on peer review, pedagogical studies on other forms of student-led assessment strategies are less prevalent. This study investigates the expansion of assessment practices into student-led rubric development and peer grading, focusing on their effect on student understanding of the writing process. Utilizing surveys and classroom observations in two second-year composition courses at a university in New York City, this study investigates student-led assessment strategies as a potent pedagogical tool, adding to literature that explores assessment as an active part of the writing process.

A Quantitative Motor Assessment Linked To Underlying Damage In Traumatic Brain Injury, Paula K. Johnson

Theses and Dissertations

Traumatic brain injury (TBI) is a leading cause of disability in the United States (Coronado et al., 2011). There is a recognized need for better motor assessments to help mitigate these disabilities. Advances in markerless motion capture and in magnetic resonance imaging (MRI) provide an opportunity to improve clinical assessments, and link them to damage measured in MRI scans. The primary aims of this research were to 1) develop a quantitative motor assessment (QMA), and seed a normative database to enable comparison of impaired behavior to unimpaired, 2) test the sensitivity of the QMA, and 3) link QMA results to …

Blended Teaching Competency Assessment, Emily Pulham

Instructional Psychology and Technology Graduate Student Projects

This report details the process of developing a competency assessment for K-12 blended teaching competence in four areas: technology-mediated interactions, personalization, blending online and in-person learning, and real time data practices. It was pilot tested with a group of students in a blended and online teaching course.

Measuring The Reliability Of The Early Expository Comprehension Assessment, Revised 3rd Edition, Garrett Frane Wilkes

Theses and Dissertations

During the past several years, the Common Core State Standards has created a greater demand for students in public schools to comprehend and analyze expository text. In order to prepare students for work with expository text, beginning with kindergarten, more emphasis and standards have become prevalent in preschool classrooms as well. The Early Expository Comprehension Assessment, Revised 3rd Edition (EECA R-3) was developed to aid preschool teachers in determining what aspects of expository text a student understands, including recognition of different structure types. This study with the EECA R-3 extends previous studies using earlier iterations of the assessment. One hundred …

Performance Self-Appraisal Calibration Of Esl Students On A Proficiency Reading Test, Jodi Mikolajcik Petersen

Theses and Dissertations

Self-assessment as a placement measure or accurate assessment of skill has been scrutinized in previous research. Findings have shown a general human tendency towards overconfidence in performance (Kruger & Dunning, 1999). This study looks at performance self-appraisals in an ESL population, with participants from varying cultural backgrounds. Performance self-appraisal calibration is a measure of the relationship between an examinee's perceived skill (or confidence) and their actual skill (or ability) on a given exam item (Phakiti, 2016). Being well-calibrated is an indication that test takers know their strengths and weaknesses and thus the difference between confidence and ability is minimal, whereas …

Future Directions In Assessment: Influences Of Standards And Implications For Language Learning, Troy L. Cox, Margaret E. Malone, Paula Winke

Faculty Publications

As Foreign Language Annals concludes its 50th anniversary, it is fitting to review the past and peer into the future of standards-based education and assessment. Standards are a common yardstick used by educators and researchers as a powerful framework for conceptualizing teaching and measuring learner success. The impact of standards on language assessment, teaching, curricula, course design, and educational policy is indisputable, but can they even be more impactful, more beneficial? In this article, we reflect upon the role of language learning standards on world language practices and assessments and discuss standards’ design, implementation, and appropriation issues that will challenge …

Specific Learning Disability Assessment Of English Language Learners: An Investigation Of The Current Assessment Practices Of Utah School Psychologists, Jesika Lee Forbush

Theses and Dissertations

The landscape of education and the students served in schools has changed over the last few decades and is becoming more diverse (National Center for Education Statistics, 2017). Methods of special education evaluation in schools are also changing to meet the needs of a dynamic population. Best practices for specific learning disability (SLD) identification recommend the use of effective evaluation methods that inform educational decisions. Many models of SLD identification have been proposed throughout the history of SLD classification. Though many school psychologists have relied on the discrepancy model of learning disability identification, many alternative evaluation methods are coming into …

Collaborating With Nonlibrary Faculty For Assessment And Improved Instruction, Holt Zaugg, Curtis Child

Faculty Publications

Collaboration with other entities and individuals has long been a standard practice of libraries. Typically, these collaborations seek to reduce redundancies, save money, and support educational and research efforts. However, a new model of collaboration exists that both assists discipline-specific research practices and informs library procedures. This article reviews two collaborations between an assessment librarian and a sociology class. The collaborations are unique because the library is the focus of the collaboration, with sociology students being able to apply classroom learning in a real-world setting. Several suggestions are provided for best practices when endeavoring to use this type of collaboration …

Are Badges Working? Student Perceptions Of The Ipt 286 Badging Program, Bryan B. Tanner

Instructional Psychology and Technology Graduate Student Projects

Dr. Richard West created and implemented the Educational Technology (ED TEC) badging program for the Brigham Young University’s Instructional Psychology and Technology “Technology for Teachers” course (IPT 286) in 2012 with the following objectives:

1. to allow IPT 286 students to customize their instruction to better accommodate the diversity of interests and department emphases of the students taking the class,

2. to motivate higher achievement through increased student engagement, and

3. to provide a resource for IPT 286 students to continue professional development and learn additional technologies beyond what is required of them in the course.

The IPT 286 badging …

Compassionate Writing Response: Using Dialogic Feedback To Encourage Student Voice In The First-Year Composition Classroom, Tialitha Macklin

Journal of Response to Writing

In addition to other unfortunate circumstances, teacher response that comes in the form of negative, generic, and unintelligible commentary causes students to become alienated from writing. This problematic response often results from the lack of supportive student-centered response pedagogies within the first-year composition classroom. In an attempt to prevent additional writerly estrangement and to undo students’ isolation from the writing process, this article explores Marshall Rosenberg’s nonviolent communication theory as a potential framework for a dialogic, compassionate writing response pedagogy.

Evidences Of Critical Thinking In The Writing Of First-Year College Students, Shannon Bryn Soper

Theses and Dissertations

A healthy civil society depends on citizens who have mature critical thinking skills and a willingness to entertain opposing points of view. The development of critical thinking in young adults has long been studied, but there has been little agreement on what the attributes of critical thinking are and how to reliably assess them. While many studies have attempted to assess the critical thinking abilities of college students, none have yet measured critical thinking through using the Critical Thinking Analytic Rubric (CTAR) to assess first-year college students' writing. This study used a modified version of the CTAR rubric to investigate …

Establishing The Viability Of The Multidimensional Quality Metrics Framework, Tyler A. Snow

Theses and Dissertations

The Multidimensional Quality Metrics (MQM) framework is a new system for creating customized translation quality assessment and evaluation metrics designed to fit specific translation needs. In this study I test the viability of MQM to determine whether the framework in its current state is ready for implementation as a quality assessment framework in the translation industry. Other contributions from this study include: (1) online software for designing and using metrics based on the MQM framework; (2) a survey of the typical, real-world quality assessment and evaluation practices of language service providers in the translation industry; and (3) a measurement scale …

Increasing Student Innovation: A Collaborative, Cross-Discipline Approach, Paul Skaggs

Journal of Undergraduate Research

The objective of this grant was to strengthen student and faculty understanding and use of innovation. To accomplish this objective this project focused on the development, teaching, and assessment of innovation curriculum.

The Role Of Pronunciation In Speaking Test Ratings, Rui Ma

Theses and Dissertations

This study explores the weight of pronunciation in a speaking proficiency test at an English as a Second Language (ESL) Intensive English Program (IEP) in America. As an integral part of speaking, beliefs, practices, and research of pronunciation teaching have experienced shifts over the decades (Morley, 1991). Most studies concerning speaking have focused on intelligibility, comprehensibility, and accentedness of speaking, with attempting to address the role of pronunciation in oral communication. However, the degree to which pronunciation is weighed in determining speaking proficiency levels is unclear (Higgs & Clifford, 1982, Kang, 2013). In an effort to contribute to the understanding …

Training Marriage And Family Therapists In Formal Assessment: Contributions To Students' Familiarity, Attitude, And Confidence, Scott C. Huff, Shayne R. Anderson, Lindsay L. Edwards

Faculty Publications

Studies suggest that few practicing marriage and family therapists use formal assessments and even fewer use systemic assessments. Given the potential value of formal assessment to both clinicians and clients, we surveyed current marriage and family therapy students (N = 91) about their familiarity, attitude, and confidence in training with assessment. Experience using assessments predicted familiarity. Having a supervisor that valued assessments predicted familiarity and confidence in training. The number of courses taken in assessment was not predictive of familiarity, attitude, or confidence. Implications for training and future research are discussed

High-Stakes Evaluation: Five Years Later, Tonya Rutherford-Hemming, Suzan Kardong-Edgren, Teresa Gore, Patricia K. Ravert, Mary Anne Rizzolo

Faculty Publications

This article compares the International Nursing Association of Clinical Simulation and Learning (INACSL) memberships' thoughts and discussions about the use of simulation for high- stakes evaluation in nursing education to a similar town hall discussion, five years ago. Data on the topic of high-stakes testing were collected through a survey before the INACSL conference in June 2014. During a town hall meeting at the conference, the survey data was presented, attendees shared their thoughts and reacted to prepared comments by selected simulation leaders. Half of the town hall attendees favored high stakes testing before the survey findings and discussion. This …

Tendinopathy: Setting The Record Straight, Craig Nuttall, Ryan Rasmussen

Faculty Publications

Tendinopathy is a commonly diagnosed injury. Traditionally, tendinopathy was considered to be caused by an inflammatory process. It is now known that a majority of tendinopathies are caused by tendinosis, a failed healing response resulting in a degenerated tendon. The recurrent nature of tendinopathies can present a challenge for the health care provider and be very frustrating for the patient. There are several principles that should be followed when treating tendinopathies. These principles include rest, ice, eccentric exercises, and avoidance of corticosteroid injections. Proper treatment of tendinopathies can lead to optimal healing and decrease the risk of recurrence.

The Spanish Language Proficiency Of Sequential Bilingual Children And The Spanish-English Language Proficiency Scale, Jessica Maribel Tavizón

Theses and Dissertations

The challenge facing children learning language bilingually has led to efforts to improve the assessment and treatment of language learning difficulties. One of these efforts is the development and validation of the Spanish-English Language Proficiency Scale (SELPS). Previous research has been performed to validate the scale for English language proficiency but not for Spanish language proficiency. Twenty-four sequential bilingual children produced spontaneous narrative language samples that were rated using the SELPS and coded for language sample variables using the Systemic Analysis of Language Transcripts software. Several language sample variables, most notably the Subordination Index, the number of omitted bound morphemes, …

Why Can't They Keep The Book Longer And Do We Really Need To Charge Fines? Assessing Circulation Policies At The Harold B. Lee Library: A Case Study, Duane E Wilson

Faculty Publications

In response to a charge from the library administration, the Circulation Committee of the Harold B. Lee Library at Brigham Young University designed and implemented a thorough assessment of circulation policies. Using multiple assessment methods including surveys, focus groups, and statistical analysis, the committee determined that the undergraduate checkout period was not sufficient and that the fine structure needed to change. Using the information obtained through the assessment, they were able to successfully lobby for an extension to the undergraduate checkout period and for the elimination of fines for regular overdue materials.

Student Perceptions Of Strategies Used For Reading Hispanic Literature: A Case Study, Rebecca Leigh Brazzale

Theses and Dissertations

This qualitative study investigated the experiences of students during their reading tasks for their university Spanish courses during the Fall 2013 semester at Brigham Young University in Provo, Utah. The purpose of this research was to explore what types of reading strategies university Spanish students use during literary readings tasks and their perceptions of the reading strategies they use. This case study employed stimulated recall protocol interviews, student reading logs and student notes in texts. Interviews were conducted within 24 hours of the reading, while reading logs and notes were completed during the reading. The data collected were analyzed for …

Patterns Of Student Curricular Experience In Psychology As Predictors Of Performance On The Ets Major Field Test, Jason J. Van Der Horst

Theses and Dissertations

The purpose of this dissertation is to evaluate the relationship between student performance and their performance on the Major Field Test (MFT). The MFT purports to adequately assess student mastery and achievement in the college major, in this case psychology. The major advantages of the MFT over internally-created instruments are its standardized content, its established national norms, and its connection to the Graduate Record Examination (GRE). The MFT is the most widely used standardized test for learning outcomes assessment within psychology departments. The first hypothesis, that MFT scores are reflective of summary curricular values (i.e. GPA), was not supported when …