Education Commons^™

Assessing Media Literacy Competences: Reflections And Recommendations From A Quantitative Study, Sara Pereira, Pedro Moura

Journal of Media Literacy Education Pre-Prints

The assessment of media literacy is a complex task, which might attempt to reconcile a research field traditionally developed within a critical paradigm with the task of evaluating and quantifying media literacy competences through essentially quantitative methods. Despite the non-existence of consensus regarding how to evaluate and measure media literacy, namely on the definition of its levels, this purpose is increasingly discussed and stimulated by political and regulatory stances, as well as studied within the academic world. Based on one of such attempts, a study on the media literacy competences of 679 Portuguese teenagers, this paper presents a review and …

Building Librarians’ Research Skills Through Experiential Learning, Raeda K. Anderson, Katherine Fisher, Emily Williams, George Usmanov

Georgia Library Quarterly

Experiential learning programs are an effective method to teach data-focused research skills and statistical analysis. We examine the effects of a participatory research training program developed and executed by a data librarian and administered to library employees at a large academic library. The program aimed to improve research skills and increase research productivity. This study employs a survey within a concurrent mixed methods methodological framework to examine the outcomes of the training program. Our findings show that the program served as a low-cost, short-term, effective method of teaching data collection and quantitative analysis that increased participants’ knowledge of the research …

The Promise Of Labor-Based Grading Contracts For The Teaching Of Psychology And Neuroscience, Jasmine Mena, Jennie Stevenson

Faculty Journal Articles

Introduction: Instructors assign grades to communicate to students how well they are learning the course content. However, students and instructors are often displeased with the process and outcome of grading. Statement of the Problem: We contend that conventional grading inadvertently detracts from student learning and simultaneously replicates systems of oppression in academia. We discuss Labor Based Grading Contracts (LBGC) as an alternative to conventional grading. Literature Review: We review the conceptual and empirical literature on LBGCs as an alternative method of assessing student work and extend its application to psychology and neuroscience courses. Teaching Implications: We present recommendations for implementing …

Aligning Metaliteracy With Self-Directed Learning To Expand Assessment Opportunities, Trudi E. Jacobson, Thomas P. Mackey, Jako Olivier

University Libraries Faculty Scholarship

Metaliteracy is a holistic model that emphasises information-related knowledge attainment whilst challenging individuals to take charge of their learning strategies and goals. It prepares learners to become informed consumers and responsible producers of information. Metacognition is a core concept in metaliteracy, just as it is in swelf-directed learning (SDL) and in methods of assessment appropriate to SDL, such as assessment as learning (AaL) and assessment for learning (AfL). This congruence provides clear avenues for using metaliteracy’s framework in ways that support SDL. The first part of the chapter explores metaliteracy and its connections with SDL and assessment. The remainder of …

Evaluation Of The Educational Qualification Diploma Program In The Light Of National Academic Standards At Palestine Technical University, رندة العالم

Jerash for Research and Studies Journal مجلة جرش للبحوث والدراسات

This study aimed to evaluate the educational qualification diploma program in the light of the national academic standards at Palestine Technical University from the students' point of view. The study sample consists of all students enrolled and graduated from the program, who numbered (108), of whom (15) were enrolled in the program and (93) graduated from the program. The researcher followed the survey and descriptive approach. To achieve the goals of the study, the researcher prepared a questionnaire that consisted of 24 paragraphs. In light of the results of the study, the researcher recommends the following:

1. Urging the Ministry …

Development Of A Scale To Measure School Psychologists' Self-Efficacy For Working With Gifted Populations, Brittany Marie Dodds

Dissertations

School psychologists are specialists in educational assessment, consultation, youth mental health, and social-emotional-behavioral development. As a result of their training, school psychologists are positioned to serve students with exceptionalities, including gifted students. However, research indicates that school psychologists' familiarity with gifted issues is lacking and that information regarding school psychologists' self-efficacy for working with this population is nonexistent. Therefore, the aim of the present study was to create a tool to assess school psychologists' self- efficacy for working with gifted populations. The Dodds Inventory of Gifted Self- Efficacy for School Psychologists (DIGS-SP) was developed and administered to 229 practicing school …

Investigating The Fit Of The Generalized Graded Unfolding Model (Ggum) When Calibrated To Irt Generated Data From Dominance And Ideal Point Models, Abdulla Alzarouni

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The assessment of model fit in latent trait modelling, better known as item response theory (IRT), is an integral part of model testing if one is to make valid inferences about the estimated parameters and their properties based on the selected IRT model. Though important, the assessment of model fit has been less utilized in IRT research than it should. For example, there have been less research investigating fit for polytomous dominance models such the Graded Response Model (GRM), and to a lesser extent ideal point models such as the Generalized Graded Unfolding Models (GGUM), both in its dichotomous and …

Beyond The Checklist Approach: A Librarian-Faculty Collaboration To Teach The Beam Method Of Source Evaluation, Jenny Mills, Rachael Flynn, Nicole Fox, Dana Shaw, Claire Wiley

Library Faculty Scholarship

Evaluating information is an essential skill, valued across disciplines. While librarians and instructors share the responsibility to teach this skill, they need a common framework in order to collaborate to design assignments that give students multiple opportunities to learn. Librarians and First Year Seminar faculty at Belmont University collaborated to design a unit of instruction on source evaluation using the BEAM method. BEAM requires students to apply a use-based approach to evaluation, to read and engage with sources more closely, and to think about how they might use a source for a specific purpose. Structured annotated bibliographies that included BEAM …

A Review Of Program Evaluation In School Counseling: Improving Comprehensive And Developmental Programs, Amanda D. Rumsey

Journal of School-Based Counseling Policy and Evaluation

This book review includes a detailed overview and discussion of Michael S. Trevisan and John C. Carey’s book: Program Evaluation in School Counseling: Improving Comprehensive and Developmental Programs, New York, NY: Routledge, 132 pages, $124.00 (hardcover), ISBN 9781138346574. The review includes strengths and potential issues regarding the text’s value and uses in graduate programs and school counseling practice. Overall, the book is a great resource and would be helpful knowledge for anyone working in the context of school counseling.

Creating A Culture Of Assessment To Elevate Students’ Voices, Amber Knight

M.A. in Higher Education Leadership: Action Research Projects

The purpose of this study was to investigate how the University of San Diego’s department of Student Activities and Involvement (SAI) could strengthen its assessment practices and execute consistent data-driven decision making. The following question guided my research: How can I promote a culture of assessment so that SAI’s programs and advising are directly informed by a more thorough data collection process that elevates students’ voices? Building on the work of assessment scholars, this study serves as a model for assessing student affairs assessment. By critically evaluating SAI’s existing assessment culture, administering assessments to understand departmental needs, and offering training …

Strengthening The Connections Between Library Instruction And Student Success, Lucinda R. Wittkower, Joleen Westerdale Mcinnis

Libraries Faculty & Staff Presentations

This poster will share the results from a three-year study that investigated correlations between student participation in library instruction and student academic achievement. Using rigorous research practice and acknowledging ethical concerns by use of an in-depth student consent process, the researchers will share their findings regarding the relationships that exist between student participation in library instruction and completion of course for which instruction was attended and the relationships between student participation in library instruction and their grade in course. Additionally, the researchers will share the unexpected, but interesting finding related to student withdrawal rates. Finally, the researchers will include information …

Investigating The Predictive Relationship Between Sportsmanship And Class, Age, Type Of Sport, And Gender At The United States Military Academy, Daniel J. Furlong

Doctoral Dissertations and Projects

Traditionally, military leaders accentuate military skill development over developing the moral character of soldiers. However, researchers have made recommendations to investigate components of sportsmanship with the intent to align better with the goals of other development programs that seek to promote character. The purpose of this quantitative, correlational design study was to use a multiple linear regression on an archival data set of Character in Sport Index scores to determine if the linear combination of the variables class, age, type of sport, and gender have predictive significance for Character in Sport Index scores. Subjects included 8,701 cadets between the ages …

Opening Act: The Academic Library's Role In Orientation Planning And Evaluation, Zachary Lewis, Katy Kelly

Roesch Library Faculty Publications

This article describes a private, mid-sized university library’s experience of hosting a music festival-themed event in the library building as part of new student orientation, with program evaluation and student learning assessment at the forefront of planning. The authors and co-planners will discuss four years of data to explore the connection between library outreach and students’ use of the library, their perceptions of the institution, and the role the event plays in shaping student success. It offers recommendations for collaborating with academic libraries and approaches in future cross-campus collaborations, including using a scaffolding approach to outline the goals and assessment …

Interactive Video Tutorials From Scratch: Experiences And Lessons Learned Six Years On, Gina Garber, Scott Shumate, Christina Chester-Fangman

Georgia International Conference on Information Literacy

In 2014, Austin Peay State University’s (APSU) Woodward Library developed an online, interactive video tutorial for the American Psychological Association (APA) Style Guide. APSU’s College of Education (CoE) approached the library about creating a tutorial similar to an existing video, Plagiarism: Making the Right Choices, for use in their upper division and graduate level courses. Through a collaborative process using content previously in the form of a PowerPoint presentation, the library generated a script, storyboards, and eventually a full video. Now, how best to engage the students with the assessment?

The existing Plagiarism tutorial did not quite live up to …

Digital Research Logs: Free, Easy & Engaging Direct Measures For Assessment Of Information Literacy Outcomes, Bernadette Mirro, Mason Yang

Georgia International Conference on Information Literacy

• Join us to learn about how an accidental collaboration turned into an intentionally designed online research log that serves as a direct measure for assessing information literacy outcomes in a freshman level composition class. Using Google Sheets we have created a free CCC licensed research log for use in a synchronous instruction session or paired with digital instructional tutorials in an asynchronous library instruction session. The research log is engaging and intuitive, helps students stay focused on the task and goes beyond the function of a traditional handout to serve as a tool they can use throughout the semester. Also, …

  ---

  Go to article

The Tasting Party Assessment: Can Educators Reliably Evaluate Preschoolers’ Willingness To Try New Foods In Group Settings?, Laura L. Bellows, Savannah Hobbs, Susan L. Johnson

Journal of Human Sciences and Extension

Food neophobia, defined as an unwillingness to consume novel and unfamiliar foods is common in young children. Assessment of neophobia or willingness to try new foods can be a challenge with this audience. With the increase in nutrition interventions focused on the young child, valid and reliable measures to assess willingness to try new foods that can be administered in groups by classroom teachers and Extension educators are needed. The Food Friends: Fun with New Foods (FWNF) program aims to increase children’s willingness to try new foods in childcare settings. The Tasting Party assessment was developed as the primary tool …

Evaluating The Trustworthiness Of Online Sources: Assessment For Students Of Universitas Indonesia, Yasmine Anabel Pandjaitan

International Review of Humanities Studies

In 2019’s presidential election in Indonesia, the Internet was flooded by unverified and contradicting claims, which only blurred the lines between fact, opinion, and straight-out hoax. This research investigates how an educated group (college students) evaluates online sources in the context of Indonesia’s political campaigns. An assessment was designed for the students to judge the credibility of five political news articles appearing online in April 2019, the election month. The framework used was inspired by similar assessments conducted by the Stanford History Education Group, researchers who study digital literacy among American students. For this research, fifty students from five faculties …

Thriving Instead Of Surviving: The Role Of The Reasoned Action Model In Assessing The Basic Course, Michael E. Burns, Kristen L. Farris, Mark Paz, Sean Dyhre

Basic Communication Course Annual

The current study investigates the use of the reasoned action model (Fishbein & Ajzen, 2010) as an assessment tool for the basic communication course. Specifically, this study examines how attitude towards behaviors, subjective norms, and perceived behavioral control influence students’ behavioral intentions to use communication behaviors taught in the basic course outside of class. In addition to the stated variables in the reasoned action model, this study also examines how knowledge gain influences behavioral intention. Data was collected from 2,228 students enrolled in a basic communication course at a large southwestern university, and a random sample of 666 students was …

A 14-Year Empirical Analysis Of Undergraduates’ Pre- And Post-Test Scores In Three Introductory Communication Courses: Lessons Learned For Pedagogy And Assessment, Sherwyn P. Morreale, Pamela S. Shockley-Zalabak, Barbara Gaddis, Janice Thorpe M.A., Constance M. Staley, Erica Allgood

Basic Communication Course Annual

Conducting long-term assessment of the impact of students’ participation in introductory communication courses is an important endeavor for enhancing pedagogy and understanding the contribution of communication instruction to the student experience. This 14-year study reports data from a campus-wide assessment program extending from 2004 to 2018. The study analyzed a large sample of undergraduate students’ self-reported pre- and post-test scores on critical variables related to student outcomes in three introductory communication courses. The variables examined were demographic characteristics, self-esteem and communication apprehension in both the public speaking course and the business communication course, and self-esteem and willingness to communicate in …

The Impact Of Communication Center Visits On Students’ Performance And Engagement, Nate S. Brophy, Adebanke Loveth Adebayo, Melissa A. Broeckelman-Post

Basic Communication Course Annual

This study sought to empirically evaluate the extent to which visiting the communication center before delivering the first major speech in an introductory communication course improved students’ academic performance and engagement. A total of 262 students were included in this study, half of whom visited the communication center prior to their first speech, and half of whom did not. Between-subjects MANOVAs showed that students who visited the communication center had significantly higher speech grades, course grades, and attendance than students who did not. Likewise, those who visited the communication center also had higher levels of behavioral and cognitive engagement, but …

Communicating About Computational Thinking: Understanding Affordances Of Portfolios For Assessing High School Students’ Computational Thinking And Participation Practices, Deborah A. Fields, Debora Lui, Yasmin Kafai, Gayithri Jayathirtha, Justice Walker, Mia Shaw

Instructional Technology and Learning Sciences Faculty Publications

Background and Context: While assessment of computational thinking concepts, practices, and perspectives is at the forefront of K-12 CS education, supporting student communication about computation has received relatively little attention.

Objective: To examine the usability of process-based portfolios for capturing students’ communication about their computational practices regarding the process of making electronic textile projects.

Method: We examined the portfolios of 248 high school students in 15 introductory CS classrooms from largely underserved communities, using a formal rubric (top-down) to code computational communication and an open-coding scheme (bottom-up) to identify computational practices described.

Findings: Students demonstrated stronger …

Diversity And Equity During Covid 19: An Analysis Of Student Attitude And Understanding In Pathophysiology, Sowmya Anjur

Faculty Publications & Research

To increase student engagement and reduce frustration over grades, data is being collected in my Pathophysiology classes on specific assessment questions which require students to think and apply what they have learned to answer assessment questions (“transfer” questions). These questions are being administered both before and after students have completed specific modules to assess their attitude and understanding of the material. Data is also being collected on student study habits before and after specific assessments for correlation with their scores on “transfer” questions. It is hoped to reduce student frustration over grades by analyzing their behavior and improving their understanding.

Case Conceptualization As An Alternative To Educationally Related Mental Health Assessments, Michael R. Hass, Zack Maupin, Michael Doria

Education Faculty Articles and Research

School psychologists play an essential role in the provision of school-based mental health services yet continue to spend the majority of their time conducting psychoeducational assessments. In California, changes in law regarding the provision of mental health services have increased the tension around the role of school psychologists and led to models for determining the need for mental health services that are inefficient and present a potential barrier to students receiving services in a timely manner. The paper proposes case conceptualization as a more useful and efficient approach, than traditional assessment processes for determining students’ mental needs and writing goals.

Counseling Clients With Traumatic Brain Injury: Exploring Counselors’ Perceived Knowledge, Comfort, And Self-Awareness, Michelle Bradham-Cousar

USF Tampa Graduate Theses and Dissertations

The number of traumatic brain injury (TBI) diagnoses continues to rise each year. Counseling is a critical factor in TBI treatment, and although numerous studies have investigated TBI outcomes, a paucity of researchers have studied professional counselors’ knowledge, comfort, and self-awareness when working with TBI clients. Due to the diversity of counselor caseloads, it is likely that counselors will serve clients with a dual diagnosis that includes TBI. These dual diagnoses include depression, posttraumatic stress disorder, anxiety, psychosis, or another neurocognitive disorder. The purpose of this study was to explore counselors’ knowledge, comfort, and self-awareness when working with individuals with …

When You Can’T R.I.O.T., R.I.O.: Tele-Assessment For School Psychologists, Michael R. Hass, Brian P. Leung

Education Faculty Articles and Research

The acronym R.I.O.T., record review, interview, observation, and test, is a well-known tool for conceptualizing a comprehensive assessment. With COVID-19 and the need to provide school psychological services virtually, it is important to reconsider R.I.O.T. in light of the limitations of virtual assessment. We describe the limitations of virtual assessment and argue that in spite of these barriers, the first three elements of R.I.O.T., record review, interviews, and observations, when used systematically, can provide useful comprehensive assessment data. Specific recommendations are provided for implementing assessment virtually.

The Role Of Test Making In Learning Process, Dilbar Xasanova, Hugh Cartwright Cheonan Assistant Professor

The Light of Islam

Almost always with the word "test" a question comes to mind with four or fve possible answers. Students usually think of multiple-choice questions (MCQs) when they are told to get tested. Testing means testing students' knowledge using different types of question forms. The proposed article examines the academic performance test, which was developed by the administration of the Uzbekistan English Teachers Association (UZTEA) for Year 2 students of lyceums and colleges. The purpose of this study is to discuss test constructs and propose a more reliable version of them if the reason for the unsatisfactory results depends on the evaluation …

Making Methods Relevant: Undergraduate Research Methods And The Content Analysis Project, Kevin E. Courtright, David A. Mackey

Scholarship of Teaching and Learning, Innovative Pedagogy

Teachers of undergraduate research methods classes may struggle at times to keep their courses engaging and to have students view the material as relevant to the occupations they will soon enter. This article discusses a content analysis assignment and how it offers a way for students to demonstrate critical thinking and acquire data analysis skills. Through the use of multiple high-impact learning practices, the assignment requires students, individually or in a group, to identify data appropriate for content analysis and then, with faculty guidance, develop research questions, manage the data, conceptualize and operationalize themes, perform content analysis, draw conclusions from …

Measuring Numeracy: Validity And The Programme For The International Assessment Of Adult Competencies (Piaac), Samuel L. Tunstall

Numeracy

A tension raised in recent scholarship is that between numeracy as a social practice and numeracy as a functional skill set. Such frameworks for conceptualizing numeracy pose a challenge to assessment because what individuals do with numeracy is not the same as what individuals can do (or express) in an assessment setting. This study builds on work related to numeracy assessment through a validity examination of a portion of a well-known assessment: the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC). In following a path set out by standards for assessment, I ask: What does the PIAAC numeracy …

Expanding Campus Peer-To-Peer Teaching & Learning: The Peer Scholars Program, Alexa Carter

Transforming Libraries for Graduate Students

In response to a growing need for training in advanced research and professional workplace skills, a team of research librarians at the NC State University Libraries have developed a platform to engage and enhance the expertise of early-career researchers on campus. The Peer Scholars Program offers graduate students and postdoctoral scholars a paid practical experience in creating and delivering effective instruction on core and emerging research skills to their peers. Participants are invited to suggest topics for library talks or workshops and partner with research librarians to develop and deliver interactive and engaging sessions in an informal teaching setting. Topics …

Did It Work?: The Effects Of Research Consultations On The Quality Of Sources Used In An Undergraduate Class., Jennifer Maddox, Leigh Stanfield

Georgia International Conference on Information Literacy

Do individual research consultations with a librarian affect the quality of sources undergraduates cite in research papers? This presentation examines the results of a study conducted by librarians to assess that question. The hypothesis was that students who participate in research consultations show an improvement in the type and quality of sources cited in their research papers.

There is a large body of research on the use of citation analysis by librarians for various purposes. This study compared the quality of citations used by two sections of an upper level education class. The same instructor taught both sections during two …