Education Commons^™

Higher Education Faculty Perceptions Of Chatgpt And The Influencing Factors: A Sentiment Analysis Of X, Yoseph Mamo, Helen Crompton, Diane Burke, Christine E. Nickel

STEMPS Faculty Publications

ChatGPT, an AI chatbot developed by OpenAI, was released in November 2022, sparking a significant surge in global awareness and utilization of generative AI across various domains. Although recent studies have acknowledged the significance of ChatGPT in the education sector, they have yet to focus on exploring faculty attitudes toward ChatGPT. We gathered a comprehensive corpus of tweets containing “#ChatGPT” and “#highered” between November 30th, 2022, and April 30th, 2023. We analyzed data by triangulating VADER, NRC lexicon, and ground coding. Findings suggest that 40% of the expressed sentiments were positive, 51% were neutral, and 9% were negative. The study …

Conducting A Formative Evaluation On A Course-Level Learning Analytics Implementation Through The Lens Of Self-Regulated Learning And Higher-Order Thinking, Pauline S. Muljana, Tian Luo, Greg Placencia

STEMPS Faculty Publications

Self-regulated learning (SRL) and higher-order thinking skills (HOTS) are associated with academic achievement, but fostering these skills is not easy. Scholars have suggested an alternative way to scaffold these important skills through learning analytics (LA). This paper presents a formative evaluation of a course-level LA implementation through the lens of self-regulated learning (SRL) and higher-order thinking skills (HOTS). We explored the changes in students’ SRL, HOTS, and perceptions at the end of the course term. Results indicate an increase in some elements of SRL and HOTS, and positive student perceptions. Discussion on implications and opportunities for informing future teaching strategies …

Women Students Learning A Stem Subject: An Analysis Of Note-Taking Practices In A Civil Engineering Course And The Association With Self-Efficacy, Cognitive Engagement, Test Anxiety, And Course Achievement, Monica Palomo, Pauline Muljana

STEMPS Faculty Publications

Women students are underrepresented in STEM education. The completion rate of women students in an engineering program are known to be low. Alongside this, the COVID-19 pandemic still occurs, threatening people’s health, leading to anxiety and depression, and influencing students’ learning. Numerous studies have displayed a negative association between self-efficacy and test anxiety, especially in quantitative subjects. All together may distract students from focusing on their cognitive goals. In turn, students may not be able to concentrate, disrupting their cognitive engagement to grasp knowledge. The present case study is aimed to investigate the note-taking strategies used in a fully-synchronous Civil …

Establishing Reflective Practice In Preservice Coursework, Elizabeth Burns

STEMPS Faculty Publications

The article focuses on establishing Reflective Practice in Preservice Coursework. Topics discussed include: Study participants benefited from journaling as a teaching tool when used to promote more-reflective practice; students were introduced to journaling in an early course in school library methods; and the study chronicled the journey of five school library students as they progressed through their coursework.

The Role Of Stereotype Threat In Ethnically Minoritized Students' Science Motivation: A Four-Year Longitudinal Study Of Achievement And Persistence In Stem, Delaram A. Totonchi, Tony Perez, You-Kyung Lee, Kristy A. Robinson, Lisa Linnenbrink-Garcia

STEMPS Faculty Publications

Grounded in expectancy-value and stereotype threat theories, this four-year longitudinal study examined associations between changes in stereotype threat and motivation (self-efficacy, task values, and perceived costs) among 425 undergraduates from racial/ethnic groups typically underrepresented in science, technology, engineering, and mathematics (STEM). Growth analyses indicated that students' stereotype threat and perceived cost of studying science increased during college, whereas science self-efficacy, intrinsic value, and attainment value declined. Parallel growth analyses suggested that higher initial stereotype threat related to a faster decline in attainment value and faster increase in perceived costs throughout college. Higher initial levels and a steeper increase in stereotype …

Guiding Students To Success: A Systematic Review Of Research On Guided Notes As An Instructional Strategy From 2009-2019, Bryan Biggers, Tian Luo

STEMPS Faculty Publications

Guided notes were introduced decades ago, but there is still debate over their efficacy in improving student outcomes. The purpose of this study is to examine peer-reviewed research on guided notes for adult learners in general populations since 2009, understanding the effects of guided notes on student learning, the knowledge and content areas supported by guided notes, and the impact of modality. Results of the 22 included studies indicate that students perceive guided notes in a positive light, and guided notes improve results in certain knowledge domains especially with complex content. However, modality does not influence the efficacy of guided …

Improving Classroom Management And Teacher Retention: A Needs Assessment, Jill Stefaniak, Jilian L. Reynolds, Tian Luo

STEMPS Faculty Publications

This case explores how a needs assessment was conducted at a middle school experiencing high rates of teacher turnover. Pamela Frost, an experienced instructional designer, was assigned to assess the situation and identify opportunities to improve professional development opportunities for the teachers. As a part of a needs assessment, Pamela gathered data to address needs pertaining to classroom management challenges, teacher attrition rates, and establishing relations with the local community. This case explores how Pamela gathered data and triangulated her findings to determine what interventions were needed.

School Librarians Making Global Connections: Conjecture Mapping And Researcher Practitioner Partnerships, Barbara Schultz-Jones, Marcia Mardis, Sue Kimmel

STEMPS Faculty Publications

Dr. Barbara Schultz-Jones (University of North Texas), Dr Marcia Mardis (Florida State University) and Dr Sue Kimmel (Old Dominion University, Virginia) share their research on a way to support evidence building of causal relationships between the school library and a teacher librarian’s contribution to student outcomes.

Technology Fatigue Of Faculty In Higher Education, Colleen Halupa, Doris U. Bolliger

STEMPS Faculty Publications

The study investigated technology fatigue in instructors employed at three universities located in the United States. Instructors at three private institutions of higher learning located in two states were invited to complete an online survey that was developed by the researchers. Technology fatigue was operationalized as technology-use related stress (technostress) and frequent change in technology (change fatigue). A total of 171 valid responses were received from participants during a four-week period. Results show that they experienced moderate levels of technology fatigue. No statistically significant differences in responses were found based on the two types of learning environments (campus-based and online). …

Science Identity Development Trajectories In A Gateway College Chemistry Course: Predictors And Relations To Achievement And Stem Pursuit, Kristy A. Robinson, Tony Perez, Justin H. Carmel, Lisa Linnenbrink-Garcia

STEMPS Faculty Publications

This investigation of undergraduates’ heterogeneous science identity trajectories within a gateway chemistry course identified three latent classes (High and Stable, Moderate and Slightly Increasing, Moderate and Declining) using growth mixture modeling. Underrepresented minorities were more likely to exhibit Moderate-and-Slightly-Increasing science identities versus High-and-Stable patterns. Students with higher perceived competence were more likely classified into the High-and-Stable class compared to the other classes. Students classified into the High-and-Stable class scored significantly higher on the final exam and appeared to be more likely to remain in a STEM major across fall and spring semesters compared to the other two classes. Results suggest …

Setting The Pace: Examining Cognitive Processing In Mooc Discussion Forums With Automatic Text Analysis, Robert L. Moore, Kevin M. Oliver, Chuang Wang

STEMPS Faculty Publications

Learning analytics focuses on extracting meaning from large amounts of data. One of the largest datasets in education comes from Massive Open Online Courses (MOOCs) that typically feature enrollments in the tens of thousands. Analyzing MOOC discussion forums presents logistical issues, resulting chiefly from the size of the dataset, which can create challenges for understanding and adequately describing student behaviors. Utilizing automatic text analysis, this study built a hierarchical linear model that examines the influence of the pacing condition of a massive open online course (MOOC), whether it is self-paced or instructor-paced, on the demonstration of cognitive processing in a …

Scaffolding Problem-Solving And Instructional Design Processes: Engaging Students In Reflection-In-Action And External Representations In Three Online Courses, Tian Luo, John Baaki, Marius Boboc (Ed.), Selma Koç (Ed.)

STEMPS Faculty Publications

Instructional design is an applied field of study that involves considerations for complex problem solving and authentic learning. Instructional guidance and scaffolding is particularly critical in facilitating online instructional design students, thus helping them succeed. In this chapter, the authors share how they designed and facilitated three instructional activities in three courses to scaffold a student-centered learning environment online. Using a case study approach, the authors describe their design considerations and how the instructor made decisions to incorporate external representations as a unique instructional technique into the three courses. Through student self-reporting, the instructor's formative and summative evaluation, and the …

Combined Srl-Based Cognitive-Motivational Modules Increase Undergraduate Biology Grades, Jennifer G. Cromley, Tony Perez, Avi Kaplan, Ting Dai, Kyle Mara, Michael J. Balsai

STEMPS Faculty Publications

Students’ success in undergraduate STEM courses requires effective study strategies, but also the motivation to enact them, drawing on two key tenets of Self-Regulated Learning. Interventions designed to promote students’ achievement and retention in STEM have commonly focused on either cognition or motivation. Building on Pintrich’s (2000) SRL framework, we iteratively-developed and tested the effect of different combinations of one of four cognition-focused with one of three motivation-focused intervention modules. Initial development took place in 2015-2016 and post-iterative experiments occurred in 2017. Participants were 3,092 undergraduate introductory biology students tested in 10 studies at 3 universities over 4 academic years. …

Repairing The Leaky Pipeline: A Motivationally Supportive Intervention To Enhance Persistence In Undergraduate Science Pathways, Lisa Linnenbrink-Garcia, Tony Perez, Michael M. Barger, Stephanie V. Wormington, Elizabeth Godin, Kate E. Snyder, Kristy Robinson, Abdhi Sakar, Laura S. Richman, Rochelle Schwartz-Bloom

STEMPS Faculty Publications

The current study reports on the efficacy of a multi-faceted motivationally designed undergraduate enrichment summer program for supporting science, technology, engineering and math (STEM) persistence. Structural equation modeling was used to compare summer program participants (n = 186), who participated in the program between their first and second years in college, to a propensity score matched comparison sample (n = 401). Participation in the summer program positively predicted science motivation (self-efficacy, task value), assessed eight months after the end of the program (second year in college). The summer enrichment program was also beneficial for science persistence variables, as …

Multiple Pathways To Success: An Examination Of Integrative Motivational Profiles Among Upper Elementary And College Students, Lisa Linnenbrink-Garcia, Stephanie V. Wormington, Kate E. Snyder, Jan Riggsbee, Tony Perez, Adar Ben-Eliyahu, Nancy E. Hill

STEMPS Faculty Publications

Two studies were conducted with distinct samples to investigate how motivational beliefs cohere and function together (i.e., motivational profiles) and predict academic adjustment. Integrating across motivational theories, participants (N_{Study 1} = 160 upper elementary students; N_{Study 2} = 325 college students) reported on multiple types of motivation (achievement goals, task value, perceived competence) for schooling more generally (Study 1) and in science (Study 2). Three profiles characterized by Moderate-High All, Intrinsic and Confident, and Average All motivation were identified in both studies. Profiles characterized by Very High All motivation (Study 1) and Moderate Intrinsic and …

Effects Of Light Reflection On Spatial Visualization Ability And Implications For Engineering Technology Students, Petros Katsioloudis, Mildred Jones

STEMPS Faculty Publications

Results from a number of studies indicate that the type of light generated by the reflection on the surface of different types of surfaces can influence the spatial visualization ability; however, research provides inconsistent results. Considering this, a quasi-experimental study was conducted to identify the existence of statistically significant effects on spatial visualization ability as measured by the Mental Cutting Test and Sectional View drawing ability due to the impacts of light reflection. In particular, the study compared three types of light reflection; mirror, specular and diffuse and whether a significant difference exists among engineering technology students. According to the …

Social Media & Teacher Professional Development, Tonia A. Dousay, Tutaleni I. Asino, Tian Luo, Dan G. Krutka, Spencer P. Greenhalgh, Luke Rodesiler, Dan E. Walster, Elizabeth Langran (Ed.), Jered Borup (Ed.)

STEMPS Faculty Publications

The idea of social media’s existing application and future potential for professional development drives a growing subset of academic research. As we encourage preservice and inservice teachers to engage in these platforms to hone or refine their classroom practice, a number of questions emerge: How do we assess participation in these spaces? What uses in particular should we recommend? Further, the very notion of conducting research in these spaces also poses interesting questions. From methodologies to frameworks, commonly accepted practices help shape the future of the field. Lastly, the issue of privacy and policy poses perhaps the most significant area …

Motivation As A Complex System: Semester-Long Recursive Dynamics Of Expectancy-Value Constructs In Undergraduate Biology, Avi Kaplan, Xi Hang Cao, Ting Dai, Zoran Obradovic, Tony Perez, Jennifer G. Cromley, Kyle Mara, Michael J. Balsai

STEMPS Faculty Publications

The predominant aggregate-statistical analyses in motivational research manifest assumptions that stand in tension with understandings of motivational phenomena as dynamic, contextual, and variable among individuals. Using constructs from expectancy-value theory, we collected 13 weekly waves of data from 145 undergraduate students during one semester of an introductory biology course. We analyzed the data using dynamic autoregressive mixed-effects modeling, which captures the individual-level recursive processes among constructs, and then examined patterns across individuals’ motivational trajectories to discern general principles by which the expectancy-value system operates. The findings contribute to robust theoretical understandings of expectancy-value processes, and demonstrate the application of an …

Combined Cognitive & Motivational Supports For Stem Learning Beta, Jennifer G. Cromley, Avi Kaplan, Tony Perez

STEMPS Faculty Publications

With funding from the US Department of Education, we created a Combined Cognitive & Motivational Support intervention for STEM Learning. The intervention materials are available here for download as a Blackboard module, together with a How-to guide. The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R305A140602 to Temple University. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.

Pursuing The "Half Empty Question": Biology Undergraduates' Differential Engagement In A Brief Relevance Writing Intervention, Ting Dai, Avi Kaplan, Ying Wang, Jennifer G. Cromley, Tony Perez, Kyle R. Mara, Michael Balsai

STEMPS Faculty Publications

Whereas relevance-writing interventions have shown effects on students’ achievement, a persistent finding is that interventions benefit students with low, but not high, outcome expectancies—a phenomenon that Schwartz et al. (2016) termed the half empty question. In the current mixed-methods study, we investigated the role of undergraduate students’ patterns of engagement in a relevance-writing intervention and their relations to biology course achievement. Ninety-six students who were administered four relevance writing assignments were found to manifest two patterns: Students who completed at least 50% of the intervention in a timely manner outperformed those who completed less-then-50% or completed it late, regardless of …

Workbooks For Instruction In Diagram Comprehension: High School Biology Part I, Jennifer G. Cromley, Tony Perez, Bradley W. Bergey

STEMPS Faculty Publications

Four methods were developed for teaching high school students how to better understand the diagrams in their biology textbooks. The 4 workbooks instantiate these methods: Conventions of Diagrams, Self-Explanation in Diagrams, Student-Completed Diagrams-Visual, and Student-Completed Diagrams-Verbal.

Business And Marketing Education Doctoral Students' Perceptions Of Their Profession, Michael F. Kosloski, John Ritz

STEMPS Faculty Publications

The future of the business and/or marketing education profession is dependent upon its future leadership. Many of those leaders are currently engaged in or have recently graduated from related doctoral programs. This study examined 22 doctoral students/recent graduates preparing for a career in business and/or marketing education and solicited their opinions on the future of their profession. Participants were surveyed and asked to identify what they believe to be true about future focus of instructional content, methods of teacher preparation, their commitment to their profession, and their opinions regarding the future of business and marketing education. Participants were in general …

Evaluation Of Static Vs. Dynamic Visualizations For Engineering Technology Students And Implications On Spatial Visualization Ability: A Quasi-Experimental Study, Petros Katsioloudis, Daniel Dickerson, Vukica Jovanovic, Mildred Jones

STEMPS Faculty Publications

The benefit of using static versus dynamic visualizations is a controversial one. Few studies have explored the effectiveness of static visualizations to those of dynamic visualizations, and the current state of the literature remains somewhat unclear. During the last decade there has been a lengthy debate about the opportunities for using animation in learning and instruction. More specifically it has been shown that dynamic visualizations often provide no advantages over static visualizations. If they had shown advantages, it was due to the fact that more information was available in the animated than in the static version. Given this result, the …

Generative Learning Strategy Use And Self-Regulatory Prompting In Digital Text, Alan J. Reid, Gary R. Morrison

STEMPS Faculty Publications

The digital revolution is shifting print-based textbooks to digital text, and it has afforded the opportunity to incorporate meaningful learning strategies and otherwise separate metacognitive activities directly into these texts as embedded support. A sample of 89 undergraduates read a digital, expository text on the basics of photography. The treatment prompted the reader with selfregulatory questions and embedded a generative strategy, paraphrasing, and confirmed previous research on the relationships between prior knowledge and level of self-regulation on reading comprehension.

A one-way between subjects ANOVA revealed significance for the level of self-regulation on comprehension-level items and for the level of prior …

Detection And Assessment Of Quality Indicators Of Visual Based Learning Material In Engineering Education Programs For Grades 7-12, Petros Katsioloudis

STEMPS Faculty Publications

The purpose of this study was to detect the quality indicators of visual-based learning material in technology education for grades 7-12. A three-round modified Delphi method was used to answer the following research questions: RQ1: What indicators should quality visual-based learning material in technology education have to be effective and efficient in transmitting information for grades 7-12? RQ2: What are the indicators of the learner’s characteristics that impact the selection of visual-based learning material in technology education for grades 7-12?