Educational Assessment, Evaluation, and Research Commons^™

Writing A “Good” Autoethnography In Educational Research: A Modest Proposal, Ufuk Keleş

The Qualitative Report

In this paper, I first discuss what autoethnography is elaborating on an autoethnographic spectrum. Then, I draw on several scholars’ understanding of what a “good” autoethnography is and propose a list of suggestions to contribute to autoethnography’s conceptualization and operationalization in qualitative educational research in the future. Believing that a good autoethnography is the work of a scholar who aims for the witty hand of an artist and the sharp/critical mind of a social scientist, I suggest that a good autoethnography (a) creates a sense of transformation through a story of illumination, healing, understanding, and/or learning, (b) engages readers as …

A Dashboard To Support Teachers During Students’ Self-Paced Ai-Supported Problem-Solving Practice, Vincent Aleven, Jori Blankestijn, Luettamae Lawrence, Tomohiro Nagashima, Niels Taatgen

Instructional Technology and Learning Sciences Faculty Publications

Past research has yielded ample knowledge regarding the design of analytics-based tools for teachers and has found beneficial effects of several tools on teaching and learning. Yet there is relatively little knowledge regarding the design of tools that support teachers when a class of students uses AI-based tutoring software for self-paced learning. To address this challenge, we conducted design-based research with 20 middle school teachers to create a novel real-time dashboard, Tutti, that helps a teacher monitor a class and decide which individual students to help, based on analytics from students’ tutoring software. Tutti is fully implemented and has been …

Local Norms And Gifted/Talented Identification In Arkansas, Sarah C. Mckenzie, Josh B. Mcgee, Bich Tran, Kathryn Barnes, Charlene A. Reid

Policy Briefs

In this brief, we summarize recent research from OEP examining if using school- or district-level norms from state assessments would increase the racial and programmatic diversity of Arkansas students identified as Gifted and Talented (G/T). Using ten years of administrative data to analyze the outcomes of a local norms approach compared to the current G/T identification strategies, we find no consistent evidence that using a local norms approach for G/T identification would improve racial or programmatic diversity.

Trauma-Informed Practices For Test-Taking Anxiety At The Elementary Grade Level, Kate Campbell, Shalini Mathew

Journal of Research Initiatives

Test -Taking Anxiety (TTA) is a challenging experience for children of all ages. Childhood exposure to trauma and adverse experience has been increasing. Fortunately, trauma-informed practices, such as mindfulness activities have become more widespread in schools throughout the last few years. Existing school counseling literature offers limited perspectives on how school counselors can support elementary students for TTA. This conceptual article explores the effects of trauma-informed practices on elementary-age students' test anxiety and overall academic success in schools and offers implications for practice.

Lesbian, Gay, And Bisexual Students Experiencing Homelessness And Substance Use In The School Context: A Statewide Study, Hadass Moore, Kris De Pedro

Education Faculty Articles and Research

PURPOSE

This study explored differences between lesbian, gay, and bisexual (LGB)-housed and homeless students regarding substance use patterns on and off school grounds and the unique contribution of homelessness to substance use in school.

METHODS

Data were from the 2013-2015 California Healthy Kids Survey, a statewide survey of school protective factors and risk behaviors. A representative sample of 9th- and 11th-grade students (N = 20,337) was used. Comparisons between housed (n = 19,456) and homeless (doubled up: n = 715; acute homeless: n = 166) LGB students were conducted. We used chi-square tests to compare rates of lifetime, past-30-day, and …

Positionality: The Interplay Of Space, Context And Identity, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article considers the way in which positionality shifts and is formed during a cross-cultural study to reveal the complexity of the insider-outsider status. As a researcher in a male-dominated game setting, I reflect on the research process and my interactions with participants to show the interplay of space, context, and identity in shaping a researcher’s status. I discuss the process of gaining access to the research site and participants, and data collection in relation to space, context, and identity. The interaction of my identities with space, and context informed my status at various moments. This interplay constructs a complex …

Applying Visual Methods To Document The History Of Psychological Testing: A Qualitative Approach, Analay Perez, Janet F. Carlson, Buros Center For Testing At The University Of Nebraska-Lincoln

Buros Center: Professional Staff Publications

The history of psychological testing is critical to many areas of applied psychology. Assessment forms a mainstay of clinical practice, second only to psychotherapy (Meyer et al., 2001). In industrial/organizational psychological practice, employee selection depends on testing to assess applicant qualifications. In educational contexts, testing is central to the evaluation of academic performance and college readiness, in addition to determining eligibility for various types of special educational services.

The history of testing is deeply rooted in myriad psychological specialties (Carlson & Geisinger, 2021). This fact prompted a qualitative examination and integration of three distinct historical threads identified by the proposal …

Building A Community Of Mentors In Engineering Education Research Through Peer Review Training, Karin Jensen, Lisa Benson, Kelsey Watts, Gary Lichtenstein, Evan Ko, Rebecca Bates

Integrated Engineering Department Publications

Peer review of scholarship is critical to the advancement of knowledge in a scholarly discipline. Despite this, scholars receive little or no training in effective and constructive peer review. The process of peer review has been routinely criticized in higher education for lack of quality reviews and reviewers, and reviews that are personal and not constructive. As a discipline, engineering education research (EER) benefits from diverse disciplinary backgrounds and perspectives of scholars, and as such relies on peer review of scholarship to generate, interpret, and translate knowledge. Supported by funding through the National Science Foundation, this project is developing, implementing, …

Diversity, Equity, And Inclusion: Three Essays In The Educational Context, James D. Paul

Graduate Theses and Dissertations

Many universities and K-12 public school systems express a significant, formal commitment to the ideals of diversity, equity, and inclusion (DEI). Relative to the emphasis on DEI in America’s educational institutions, however, there has been little research describing DEI trends and evaluating the efficacy of DEI bureaucracies. This three-chapter dissertation examines DEI trends that have been the subject of much discussion—but rarely studied empirically.

For example, chapter one analyzes how universities promote DEI when hiring new faculty. I audit a subset of academic job postings and present the first evidence on how many require DEI statements, as well as the …

Case Study: Exploring Inservice Teachers’ Perceptions And Experiences Of The Effectiveness Of Gifted Preparation And Training Programs In Saudi Arabia, Khlood Khaled Alshareef

Graduate Theses and Dissertations

In Saudi Arabia, the teaching of gifted and talented students is relatively new, and research that describes the quality and effectiveness of teachers' gifted preparation programs and the training sessions they receive remain rather limited and inconsistent. Purpose: This dissertation focuses on understanding the perceptions and experiences of in-service teachers regarding gifted-focused preparation and training programs in the country. Research Design: Data were collected through observation and semi-structured interviews with teachers of gifted and talented students in the country. Findings: Analysis of the data revealed six themes related to teachers’ perceptions and experiences of preparation and training programs in Saudi …

Informing The Community-Based Learning Experience With Harold Mcnaron And August White, Harold Mcnaron, August White

PDXPLORES Podcast

In this episode of PDXPLORES, Harold McNaron and August White discuss how a collaboration with the American Association of Colleges and Universities will provide new information on how students experience community-based learning at PSU. The data provided by the project will support the University's efforts to improve racial and social justice through community and service-based learning opportunities. This project is supported by the University's Community Engaged Research Academy.

Click on the "Download" button to access the audio transcript.

An Exploratory Multiple Case Study Of Discipline Practices In A Major Metropolitan Public School District: A Look Into The School To Prison Pipeline, Neil French, Kristin Calvert-French, Phyllis Jackson, Erin King

Dissertations

The school to prison pipeline is a phenomenon fed by exclusionary discipline practices that increase the likelihood that a student will have an interaction with the juvenile or criminal justice system at some time in their life; this phenomenon disproportionately affects Black students. Understanding the problem is key to slowing down the school to prison pipeline. This study of a school district in Missouri explores questions about how interpersonal relationships, implicit bias awareness, and school policies influence the learning environment, and how those factors relate to school discipline, which ultimately can lead to the school to prison pipeline. Drawing data …

The Influence Of A Learning Management System (Lms) And Microblogging On Social Presence, Sense Of Community, And User Interface Satisfaction In A Distance Education Course, Andrew G. Leach

Organization, Information and Learning Sciences ETDs

The impact of social media on everyday life is undeniable. Social media has transcended its initial purpose of connectivity and branched into other sociocultural aspects. Educators must create a rich and active learning environment where students can actively engage with their educational curriculum. This study used a mixed methods approach to investigate the influence that learning management systems (LMS) and microblogging (social media) have on key elements of distance education design. These elements include social presence, sense of community, and overall user interface design. Students’ perceptions of these elements were collected from students enrolled in a graduate course during summer …

Publication Dynamics: What Can Be Done To Eliminate Barriers To Publishing Full Manuscripts By The Postgraduate Trainees Of A Low-Middle Income Country?, Hafsa Majid, Lena Jafri, Sibtain Ahmed, Muhammad Abbas Abid, Mohammad Aamir, Aamir Ijaz, Aysha Habib Khan, Imran Siddiqui

Department of Pathology and Laboratory Medicine

Objectives: This study aimed to determine the publication rate of free paper abstracts presented by the postgraduate (PG) trainees and determine the reasons for non-publication. A mixed methods study was conducted. PG trainees presenting free papers at the at the Pakistan Society of Chemical Pathologist conferences from 2012 to 2018 were included. Three databases were searched to identify if the abstracts were published or not. The PG trainee authors of abstracts not published as full manuscript, were surveyed to determine the barriers and challenges in publishing a manuscript.
Results: The average rate of full manuscript publication was 51.8% (n = …

Measuring Creativity In The Fermi Problem, A Type Of Mathematical Modeling, Applying Information Theory, Hidemichi Okamoto

Journal of Educational Technology Development and Exchange (JETDE)

Many methods of measuring creativity have been studied - mainly in psychology. In recent years, there have been attempts to incorporate such creativity into mathematical modelling, a topic handled in mathematics education. Accordingly, some studies have been trying to assess creativity in it. However, there have been no clear criteria or formulas that can be used for any problem, since a rubric has been created for each problem and evaluated individually. In the present study, to measure creativity in the Fermi problem, a type of mathematical modelling, a formula that applies information theory used in information science is proposed and …

Incorporating Growth Mindsets To Attain Athletic And Academic Success., Michael E. Rutledge Ii

Journal of Research Initiatives

Higher education and intercollegiate athletics promote discovery processes that uncover boundaries of potentials in human development. The research associated with the academic progress of student athletes coincides with the general student population literature in the fact that student athletes also utilize effective study skills and achieve higher GPAs when implementing growth mindset (Joshi et al., 2022). The purpose of this study is to investigate the experiences of student athletes prior to college, through athletic careers, and through graduate school. Qualitative, ethnographic case study research methods rationalized the purpose of this study to advance theory, answer the research questions best, and …

Exploring The Impact Of A Brief Counseling Intervention For Improving Mental Health Factors And Learning Strategies Among College Students At An Hsi, James Ikonomopoulos, Kristopher Garza, Javier Cavazos Vela

Journal of Academic Underperformance

Abstract

This study evaluated a counseling intervention called the University Turn Around Program (U-Turn) for college students experiencing mental health issues and low academic performance. Social Anxiety, Hostility, and Alcohol Use were measured on the CCAPS-34, and Attitude, Information Processing, Selecting Main Ideas, Test Strategies, and Using Academic Resources were measured on the LASSI-3. Paired samples t-tests revealed improvement for each measure (d = 0.45 to 1.09) supporting the U-Turn program’s inclusion in university counseling centers.

Keywords: College Students, Quasi-Experimental, University Counseling Center

Assessing L2 Egyptian Colloquial Arabic (Eca) Learners’ Intercultural Communicative Competence, Ahmed Said Mohammed Elgebaly

Theses and Dissertations

This study assesses L2 Egyptian Colloquial Arabic (ECA) Learners' Intercultural Communicative Competence (ICC). The study participants were 19 L2 (ECA) learners who completed one semester at least in Egypt. The participants were only from two proficiency levels; the advanced and high-intermediate levels. The current study used a mixed methodological approach for data collection, beginning with an ICC test and concluding with a series of follow-up semi-structured interviews with ten participants. The ICC test employed in the current study was created based on a model that includes ten features of the ICC. The current study's findings revealed that although high-intermediate learners …

Machine Learning With Kay, Lasith Niroshan, James Carswell

Conference Papers

Computational power is very important when training Deep Learning (DL) models with large amounts of data (Wooldridge, 2021). Hence, High-Performance Computing (HPC) can be leveraged to reduce computational cost, and the Irish Centre for High-End Computing (ICHEC) provides significant infrastructure and services for research and development to both academia and industry. A portion of ICHEC's HPC system has been allocated for institutional access, and this paper presents a case study of how to use Kay (Ireland's national supercomputer) in the remote sensing domain. Specifically, this study uses clusters of Kay Graphics Processing Units (GPUs) for training DL models to extract …

Co-Designing Ai-Based Orchestration Tools To Support Dynamic Transitions: Design Narratives Through Conjecture Mapping, Luettamae Lawrence, Boyuan Guo, Kexin Yang, Vanessa Echeverria, Zimmy Kang, Vikrant Bathala, Christina Li

Instructional Technology and Learning Sciences Faculty Publications

Dynamically transitioning between individual and collaborative learning has been hypothesized to have positive effects, such as providing the optimal learning mode based on students’ needs. There are, however, challenges in orchestrating these transitions in real-time while managing a classroom of students. AI-based orchestration tools have the potential to alleviate some of the orchestration load for teachers. In this study, we describe a sequence of three design sessions with teachers where we refine prototypes of an orchestration tool to support dynamic transitions. We leverage design narratives and conjecture mapping for the design of our novel orchestration tool. Our contributions include the …

Can Blended Learning Address Indian Academic Issues?, Vijay Joshi, Sukanta K. Baral

International Review of Business and Economics

Over the years, India has implemented social reforms aimed at providing education to all. This is observed from the growth in GER (Gross Enrollment Ratio) over the years that has resulted in a decrease in the number of students absent in schools. Coronavirus, nonetheless, has disturbed this scenario and is testing the functions, efficiencies, and practices of India's schooling framework. This research paper, written for stakeholders in government, and the education sector, anticipate the extent to which there is a need of continuing the imparting of education. The main objective of this paper is to provide an overview of the …

Gaining A Better Understanding Of Higher Education: During And Post-Pandemic Scenario, Krati Sethi, Manas Roy

International Review of Business and Economics

Because of the coronavirus epidemic, faculty as well as the students have had to respond to “out of the ordinary” difficulty by quickly switching from traditional class - room education to online learning forms via “virtual classrooms”. Students facing challenges and continuing facing difficulties for various reasons required to adapt this modification in this delivery of curriculum becoming un attentive. Few solutions have been developed for students to assist them in freely transferring to virtual classrooms and maintaining proper online learning etiquette. A series of recommendations is offered in the present study to help students so that they can explore …

Ai And Ambitious Learning Practices, Cindy E. Hmelo-Silver, Sadhana Puntambekar, Krista Glazewski, Luettamae Lawrence, Nikol Rummel, Vincent Aleven, Gautam Biswas, Suraj Uttamchandani, Asmalina Saleh, Haesol Bae, Thomas Brush, Bradford Mott, James Lester, William Goss, Dana Gnesdilow, Rebecca Passonneau, Purushartha Singh, Chanmin Kim, Marcelo Worsley

Instructional Technology and Learning Sciences Faculty Publications

This symposium will provide opportunities for discussion about how Artificial Intelligence can support ambitious learning practices in CSCL. To the extent that CSCL can be a lever for educational equitable educational change, AI needs to be able to support the kinds of practices that afford agency to students and teachers. However, AI also brings to the fore the need to consider equity and ethics. This interactive session will provide opportunities to discuss these issues in the context of the examples presented here.

Mapping The Complexities And Benefits Of Research-Design Partnerships, Emma Mercier, Luettamae Lawrence, June Ahn, Christopher Wegemer, Maya Benichou, Yael Kali, Yotam Hod, Marcela Borge, Kimberley Gomez, Ung-Sang Lee, Susan Mckenney, Cindy Poortman, Paula Arce-Trigatti, Britte Haugan Cheng

Instructional Technology and Learning Sciences Faculty Publications

Increasingly our field is recognizing the necessity of close, collaborative relationships with educators, policy makers, students and other potential stakeholders if our design and research work is to have a lasting and more equitable impact on education. However, this work is not easy or quick, and we lack both detailed examples of how it is done and training for new (and current) scholars in how to do it. This symposium brings together a group of scholars who actively engage in RPPs and DBIR in order to highlight the lessons that have been learned and extend our discourse into the realities …

No Excuses Yet No Solutions: The Inherent Anti-Blackness Of The No-Excuses Charter School Model, Tshala A. Pajibo

Dissertations, Theses, and Capstone Projects

The No Excuses model of education has routinely been labeled abusive and harmful to students. The No Excuses model has garnered significant pushback from students, families, and stakeholders because of procedures and policies that have caused physical, mental, and bodily harm to young students. While many education stakeholders have examined how No Excuses charters and their policies have harmed Black children, not many have examined why. This paper argues that the No Excuses charter model is completely at odds with Black cultural and educational values. This paper suggests deeper studies of the educational mindsets and opinions of No Excuses …

Assessment Of Teachers' Perception Of The Provision, Use, And Maintenance Of Information And Communication Technology Facilities (Ict) In Ekiti State Primary School Libraries In Nigeria, Mensah Prince Osiesi, Chigozie Celestina Oke Dr, Adejimi Oluwatobi Busiyi Mr, Adenike Lucia Arulebe Mrs, Nnaemeka Chijioke Okorie Mr, Onyiye Maureen Okoh Mrs

Library Philosophy and Practice (e-journal)

This study assessed teachers' perception of the provision, use, and maintenance of ICT facilities in Ekiti State Primary school libraries in Nigeria. The study adopted the descriptive survey research type. The population of the study comprised all public primary school teachers in Ekiti State. The multistage sampling procedure was used in selecting the sample for the study. An instrument termed "Teachers' Perception of the Provision, Utilisation, and Maintenance of ICT Facilities in Primary School Libraries Questionnaire" was used for data collection, and was validated with its reliability ascertained. The data collected were analysed using descriptive statistics (frequency counts and percentages). …

Arkansas High School Freshmen Course Failures, Sarah C. Mckenzie, Josh B. Mcgee, Charlene A. Reid, Sarah R. Morris

Policy Briefs

In this brief, we examine course failures among Arkansas high school freshmen by different student demographic and programmatic characteristics. We find economically disadvantaged students most likely to fail a course their freshman year. We suggest policies to benefit all student demographic and programmatic characteristics

Which Police Departments Make Black Lives Matter, Which Don’T, And Why Don’T Most Social Scientists Care?, Robert Anthony Maranto, Wilfred Reilly, Patrick Wolf, Mattie Harris

Education Reform Faculty and Graduate Students Publications

In part via skillful use of social media, Black Lives Matter (BLM) has become among the most influential social movements of the past half century, with support across racial lines, and considerable financial backing (Fisher, 2019). Will this translate into public policy reforms which save Black lives? After all, higher education is a key institutional backer of BLM, and a considerable literature dating back decades (e.g., Lindblom & Cohen, 1979) casts doubt on the effectiveness of social science in solving social problems, for numerous reasons. Often, the best social science is simple counting. This paper makes two unique contributions. First, …

Teacher Perceptions Of Self-Efficacy Before And After Engaging In Hevruta Or Psychodrama-Based Online Workshops, Merav Berger

Expressive Therapies Dissertations

Teacher self-efficacy is a construct that continues to be extensively researched. With the onset of the Coronavirus pandemic, the learning environment has shifted dramatically and has had an impact on Jewish educators’ sense of efficacy. This study examined the pre- and post-test scores for self-efficacy of Jewish educators who engaged in either an online psychodrama-based professional development workshop, a hevruta-based workshop, or an integrated session using both psychodrama and hevruta study. The participants were 28 Jewish educators from around the United States who were split into one of six groups. Two psychodrama-based groups and two integrated groups met online for …

The Significance Of Sonic Branding To Strategically Stimulate Consumer Behavior: Content Analysis Of Four Interviews From Jeanna Isham’S “Sound In Marketing” Podcast, Ina Beilina

Student Theses and Dissertations

Purpose:
Sonic branding is not just about composing jingles like McDonald’s “I’m Lovin’ It.” Sonic branding is an industry that strategically designs a cohesive auditory component of a brand’s corporate identity. This paper examines the psychological impact of music and sound on consumer behavior reviewing studies from the past 40 years and investigates the significance of stimulating auditory perception by infusing sound in consumer experience in the modern 2020s.

Design/methodology/approach:
Qualitative content analysis of audio media was used to test two hypotheses. Four archival oral interview recordings from Jeanna Isham’s podcast “Sound in Marketing” featuring the sonic branding experts …