Social and Behavioral Sciences Commons^™

Development And Initial Validation Of The Mindful Self-Regulated Learning Scale (M-Srls), Sarah Wolff

UNLV Theses, Dissertations, Professional Papers, and Capstones

Modern mindfulness is a catch-all term. Just exactly what it looks like within the context of education and how it is taught vastly varies. As such, program fidelity and integrity is questioned. Here a definition of mindful self-regulated learning is proposed and the Mindful Self-Regulated Learning Scale (m-SRLS) is developed. This includes item generation and development, systematic testing of item performance, scale dimensionality, convergent and divergent validity, measurement invariance across groups and subgroups, and scale reliability over a series of five pilot studies and five primary studies using independent samples. The resulting m-SRLS is a context specific measurement tool that …

Ungrading: Why Rating Students Undermines Learning (And What To Do Instead), Lori M. Costello

Journal of Applied Communications

Book review of Ungrading: Why Rating Students Undermines Learning (and What to Do Instead), edited by Susan D. Blum with a foreword by Alfie Kohn

Securing The Right Skills: A Longitudinal Assessment Of College Students’ Writing And Public Speaking Self-Efficacy, T. Kody Frey, Jessalyn I. Vallade

Basic Communication Course Annual

This research investigated the developmental patterns of students’ writing and public-speaking self-efficacy throughout their experience in the basic communication course (BCC). Questions were posed regarding (a) whether students grew in their reported writing and public speaking self-efficacy over two semesters, (b) whether growth differed based on biological sex, and (c) whether affinity and apprehension (as sources of performance self-efficacy) played a role in student growth. Two multilevel models revealed significant differences in students’ initial status and rate of growth for each outcome. Specifically, sex, affinity, and apprehension influenced students’ starting positions in the course, while only apprehension had a significant …

Drafting An Assessment Plan For Your Instruction Program: Sustainably Assessing Information Literacy In An Undergraduate Stem Course, Kevin Moore, Clinton K. Baugess

All Musselman Library Staff Works

Assessing student learning across a library instruction program can be infeasible without being strategic, intentional, and realistic. Librarians at a small college will share how they developed a sustainable, 3-year assessment plan for the ACRL Framework and targeted a 100-level biology course-one of the two high-enrollment STEM courses that receive library instruction on their campus each year. The presenters will share their assessment plan, flipped instruction model, workflow-management strategies, and lessons learned for collaborating with STEM faculty to assess information literacy.

Building Librarians’ Research Skills Through Experiential Learning, Raeda K. Anderson, Katherine Fisher, Emily Williams, George Usmanov

Georgia Library Quarterly

Experiential learning programs are an effective method to teach data-focused research skills and statistical analysis. We examine the effects of a participatory research training program developed and executed by a data librarian and administered to library employees at a large academic library. The program aimed to improve research skills and increase research productivity. This study employs a survey within a concurrent mixed methods methodological framework to examine the outcomes of the training program. Our findings show that the program served as a low-cost, short-term, effective method of teaching data collection and quantitative analysis that increased participants’ knowledge of the research …

Development Of A Scale To Measure School Psychologists' Self-Efficacy For Working With Gifted Populations, Brittany Marie Dodds

Dissertations

School psychologists are specialists in educational assessment, consultation, youth mental health, and social-emotional-behavioral development. As a result of their training, school psychologists are positioned to serve students with exceptionalities, including gifted students. However, research indicates that school psychologists' familiarity with gifted issues is lacking and that information regarding school psychologists' self-efficacy for working with this population is nonexistent. Therefore, the aim of the present study was to create a tool to assess school psychologists' self- efficacy for working with gifted populations. The Dodds Inventory of Gifted Self- Efficacy for School Psychologists (DIGS-SP) was developed and administered to 229 practicing school …

Strengthening The Connections Between Library Instruction And Student Success, Lucinda R. Wittkower, Joleen Westerdale Mcinnis

Libraries Faculty & Staff Presentations

This poster will share the results from a three-year study that investigated correlations between student participation in library instruction and student academic achievement. Using rigorous research practice and acknowledging ethical concerns by use of an in-depth student consent process, the researchers will share their findings regarding the relationships that exist between student participation in library instruction and completion of course for which instruction was attended and the relationships between student participation in library instruction and their grade in course. Additionally, the researchers will share the unexpected, but interesting finding related to student withdrawal rates. Finally, the researchers will include information …

Investigating The Predictive Relationship Between Sportsmanship And Class, Age, Type Of Sport, And Gender At The United States Military Academy, Daniel J. Furlong

Doctoral Dissertations and Projects

Traditionally, military leaders accentuate military skill development over developing the moral character of soldiers. However, researchers have made recommendations to investigate components of sportsmanship with the intent to align better with the goals of other development programs that seek to promote character. The purpose of this quantitative, correlational design study was to use a multiple linear regression on an archival data set of Character in Sport Index scores to determine if the linear combination of the variables class, age, type of sport, and gender have predictive significance for Character in Sport Index scores. Subjects included 8,701 cadets between the ages …

Communicating About Computational Thinking: Understanding Affordances Of Portfolios For Assessing High School Students’ Computational Thinking And Participation Practices, Deborah A. Fields, Debora Lui, Yasmin Kafai, Gayithri Jayathirtha, Justice Walker, Mia Shaw

Instructional Technology and Learning Sciences Faculty Publications

Background and Context: While assessment of computational thinking concepts, practices, and perspectives is at the forefront of K-12 CS education, supporting student communication about computation has received relatively little attention.

Objective: To examine the usability of process-based portfolios for capturing students’ communication about their computational practices regarding the process of making electronic textile projects.

Method: We examined the portfolios of 248 high school students in 15 introductory CS classrooms from largely underserved communities, using a formal rubric (top-down) to code computational communication and an open-coding scheme (bottom-up) to identify computational practices described.

Findings: Students demonstrated stronger …

Case Conceptualization As An Alternative To Educationally Related Mental Health Assessments, Michael R. Hass, Zack Maupin, Michael Doria

Education Faculty Articles and Research

School psychologists play an essential role in the provision of school-based mental health services yet continue to spend the majority of their time conducting psychoeducational assessments. In California, changes in law regarding the provision of mental health services have increased the tension around the role of school psychologists and led to models for determining the need for mental health services that are inefficient and present a potential barrier to students receiving services in a timely manner. The paper proposes case conceptualization as a more useful and efficient approach, than traditional assessment processes for determining students’ mental needs and writing goals.

When You Can’T R.I.O.T., R.I.O.: Tele-Assessment For School Psychologists, Michael R. Hass, Brian P. Leung

Education Faculty Articles and Research

The acronym R.I.O.T., record review, interview, observation, and test, is a well-known tool for conceptualizing a comprehensive assessment. With COVID-19 and the need to provide school psychological services virtually, it is important to reconsider R.I.O.T. in light of the limitations of virtual assessment. We describe the limitations of virtual assessment and argue that in spite of these barriers, the first three elements of R.I.O.T., record review, interviews, and observations, when used systematically, can provide useful comprehensive assessment data. Specific recommendations are provided for implementing assessment virtually.

The Role Of Test Making In Learning Process, Dilbar Xasanova, Hugh Cartwright Cheonan Assistant Professor

The Light of Islam

Almost always with the word "test" a question comes to mind with four or fve possible answers. Students usually think of multiple-choice questions (MCQs) when they are told to get tested. Testing means testing students' knowledge using different types of question forms. The proposed article examines the academic performance test, which was developed by the administration of the Uzbekistan English Teachers Association (UZTEA) for Year 2 students of lyceums and colleges. The purpose of this study is to discuss test constructs and propose a more reliable version of them if the reason for the unsatisfactory results depends on the evaluation …

Measuring Numeracy: Validity And The Programme For The International Assessment Of Adult Competencies (Piaac), Samuel L. Tunstall

Numeracy

A tension raised in recent scholarship is that between numeracy as a social practice and numeracy as a functional skill set. Such frameworks for conceptualizing numeracy pose a challenge to assessment because what individuals do with numeracy is not the same as what individuals can do (or express) in an assessment setting. This study builds on work related to numeracy assessment through a validity examination of a portion of a well-known assessment: the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC). In following a path set out by standards for assessment, I ask: What does the PIAAC numeracy …

Supporting Examination Reform In Nepal, Mee Young Han

Teacher India

ACER is helping to ensure that school assessment in Nepal focuses on testing higher-order thinking skills.

Measuring Media Literacy Inquiry In Higher Education: Innovation In Assessment, Evelien Schilder, Theresa Redmond

Journal of Media Literacy Education

The ability to critically access, analyze, evaluate, and create media messages is crucial in the process of becoming an informed and engaged citizen throughout life. Asking critical questions is not only a valuable dimension of media literacy, but also an indispensable aspect of participating in a democracy. Yet, measuring the effectiveness of media literacy is still a major challenge for the field. It is unclear to what extent people of all ages may engage in critical questioning habits with regards to media. To address this gap, we studied the changes in critical questioning habits for college-aged students enrolled in media …

Context And Regulation Of Homeschooling: Issues, Evidence, And Assessment Practices, Janet F. Carlson

Buros Center: Professional Staff Publications

The article discusses salient factors that influence the current context within which homeschooling occurs. Individual states have applied various approaches to establish regulations that both preserve the rights of homeschooling parents and fulfill the state’s obligation to ensure that its residents receive the education to which they are constitutionally entitled. Case and ethnographic studies or research involving small and selected samples often appear in outlets associated with homeschool advocacy groups or in outlets that are not mainstream. The paucity of empirical evidence derived from methodologically strong research paradigms has led to little certainty about many aspects of homeschooling including its …

What To Do With All This Data? Using Competency Assessment For Advising, Rachel A. Guimond, Hillary Cole

Scholar Week 2016 - present

While assessment serves a critical role in providing direction for program development, student outcome data can also foster individual growth. This presentation will explore the existing research on different advising models and the ONU Social Work Program’s system for using assessment for accreditation to advise students toward professional growth.

Setting The Foundation For Democratization: Assessing The Quality Of A Political Science Program In Egypt, Yasmin Khodary

Political Science

Purpose – The purpose of this paper is to investigate the quality of a political science program in an Egyptian private university through assessing three particular dimensions: knowledge of political science core facts and theories; reading comprehension skills; and critical thinking (CT).

Design/methodology/approach – A case study research approach was used. The study relies also on a quantitative methodology. Quantitative data were collected from students in the second and fourth years of political science to assess their knowledge of core political science facts and theories, reading comprehension and CT through the online California Critical Thinking Skills Test.

Findings – Unlike …

Winning The War On State-Sponsored Propaganda: Results From An Impact Study Of A Ukrainian News Media And Information Literacy Program, Erin Murrock, Joy Amulya, Mehri Druckman, Tetiana Liubyva

Journal of Media Literacy Education

From 2015-2016, IREX implemented a media literacy training program called Learn to Discern (L2D) that trained Ukrainian citizens to critically analyze news media messages and identify misinformation. In 2017, IREX conducted a quasi-experimental impact evaluation of news literacy skills, knowledge, and behavior using a stratified random sample of L2D participants and non-participants (n=412). The groups were matched for gender, age, region and education levels. A news literacy assessment was administered to both groups via an online survey. The assessment required participants to analyze an objective news article and a disinformation-based news article; demonstrate knowledge of the news media environment; and …

What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston

Veronica Wells

University of the Pacific’s Stockton Campus Library is currently in the process of a multi-phase renovation that will offer 21st century design and functionality. Our team conducted several assessment methods to understand more fully how our students use –or choose not to use—study spaces and various pieces of furniture in the Stockton library. The results of this project will help answer the questions: “What do our students want or need in library learning spaces – both academic and social?” and “How might we create learning spaces in the library that will enable a variety of student use preferences?” We have …

Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Sara Kuhn

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"The seven-level Researcher Skill Development framework extends the RSD's original 5 levels of student autonomy to include the degree of autonomy required for a successful research career. It therefore addresses not only students, but also early, middle and late career researchers. This involves the extension of the same facets of inquiry that appear in the original RSD framework to include two higher levels: 6 and 7." -- https://www.adelaide.edu.au/rsd/framework/rsd7/

For more information, see: Willison, J., & O’Regan, K. (2007). Commonly known, commonly not known, …

Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Sara Kuhn

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"Research Skill Development (RSD) is about making explicit and coherent in regular university coursework the incremental attainment of research skills in a specific discipline. In the RSD, there are six facets of the research process, identified from the literature and modified according to Bloom’s taxonomy and our experiences of using the framework in the disciplines. The meaning of ‘research’ in this context is: students actively finding information new to themselves. Underlying this notion is the ‘degree of knowness’ of knowledge: whether research involves …

Rsd7: Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Open Educational Resources

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"The seven-level Researcher Skill Development framework extends the RSD's original 5 levels of student autonomy to include the degree of autonomy required for a successful research career. It therefore addresses not only students, but also early, middle and late career researchers. This involves the extension of the same facets of inquiry that appear in the original RSD framework to include two higher levels: 6 and 7." -- https://www.adelaide.edu.au/rsd/framework/rsd7/

For more information, see: Willison, J., & O’Regan, K. (2007). Commonly known, commonly not known, …

Researcher Skill Development Framework (Us English Edition), John Willison, Kerry O'Regan, Sara K. Kuhn

Open Educational Resources

Created by John Willison and Kerry O'Regan.

www.rsd.edu.au

Adapted for the US context by Sara K. Kuhn.

"Research Skill Development (RSD) is about making explicit and coherent in regular university coursework the incremental attainment of research skills in a specific discipline. In the RSD, there are six facets of the research process, identified from the literature and modified according to Bloom’s taxonomy and our experiences of using the framework in the disciplines. The meaning of ‘research’ in this context is: students actively finding information new to themselves. Underlying this notion is the ‘degree of knowness’ of knowledge: whether research involves …

What Our Students Want In And From Their Library, Veronica Wells, Robin Imhof, Debbie Johnston

University Libraries Librarian and Staff Presentations

University of the Pacific’s Stockton Campus Library is currently in the process of a multi-phase renovation that will offer 21st century design and functionality. Our team conducted several assessment methods to understand more fully how our students use –or choose not to use—study spaces and various pieces of furniture in the Stockton library. The results of this project will help answer the questions: “What do our students want or need in library learning spaces – both academic and social?” and “How might we create learning spaces in the library that will enable a variety of student use preferences?” We have …

Imls Sparks Ignite Il Framework Cooperative Project Final Performance Report, Appendix F: Outcomes & Indicators For Student Performance, Jessame Ferguson

IMLS SPARKS Ignite IL Framework Cooperative Project for At-Risk Student Success in Smaller Colleges

This document is an appendix to the Final Performance Report for the IMLS Sparks Ignite IL Framework Cooperative project. It contains the four outcomes and the performance indicators for each outcome.

Imls Sparks Ignite Il Framework Cooperative Project Final Performance Report, Jessame Ferguson

IMLS SPARKS Ignite IL Framework Cooperative Project for At-Risk Student Success in Smaller Colleges

This is the Final Performance Report for the SPARKS Ignite IL Framework Cooperative Project for At‐Risk Student Success in Smaller Colleges. Through a partnership of five institutions led by McDaniel College, we developed new best practices for ensuring information literacy education programs at smaller institutions support success and persistence of at‐risk students in their critical first‐year. We used the newly adopted Association of College & Research Libraries Framework for Information Literacy for Higher Education to develop and test new assessment methodologies and engaging educational experiences for first‐year students. The project took place in 2017. The report summarizes our successes, challenges …

Does The Test Work? Evaluating A Web-Based Language Placement Test, Avizia Long, Sun-Young Shin, Kimberly Geeslin, Erik Willis

Faculty Publications

In response to the need for examples of test validation from which everyday language programs can benefit, this paper reports on a study that used Bachman’s (2005) assessment use argument (AUA) framework to examine evidence to support claims made about the intended interpretations and uses of scores based on a new web-based Spanish language placement test. The test, which consisted of 100 items distributed across five item types (sound discrimination, grammar, listening comprehension, reading comprehension, and vocabulary), was tested with 2,201 incoming first-year and transfer students at a large, Midwestern public university. Analyses of internal consistency and validity revealed the …

Using The Quantitative Literacy And Reasoning Assessment (Qlra) For Early Detection Of Students In Need Of Academic Support In Introductory Courses In A Quantitative Discipline: A Case Study, Nathan D. Grawe, Kristin O'Connell

Numeracy

As the number of young people attending college has increased, the diversity of college students’ educational backgrounds has also risen. Some students enter introductory courses with math anxiety or gaps in their quantitative training that impede their ability to master or even grasp relevant disciplinary content. Too often professors learn of these anxieties and gaps only during the post mortem of the first midterm. By that time, a good portion of a student’s grade is determined and successful recovery may be impossible. During the 2016-17 academic year, the Department of Economics at Carleton College ran a pilot project using the …

Measuring Faculty Teaching Effectiveness Using Conditional Fixed Effects, Maia K. Linask, James Monks

Economics Faculty Publications

Using a dataset of 48 faculty members and 88 courses over 26 semesters, the authors estimate Student Evaluation of Teaching (SET) ratings that are conditional on a multitude of course, faculty, and student attributes. They find that ratings are lower for required courses and those where students report a lower prior level of interest. Controlling for these variables substantially alters the SET ratings for many instructors. The average absolute value of the difference between the faculty ratings controlling just for time effects and fully conditional ratings is nearly one-half of a standard deviation in the students’ rating of how much …