Educational Assessment, Evaluation, and Research Commons^™

Codebook For Classroom Observation Training Package, Hilary Hollingsworth, Debbie Wong, Elizabeth Cassity

Education Analytics Service

This Codebook is part of a classroom observation training package developed by the Australian Council of Educational Research to enable those observing early primary classes to make consistent and reliable observations. It is based on a purpose-built classroom observation tool developed to collect data on changes to teaching practice and a training program for local researchers. The Codebook offers detailed descriptions of the items to be observed during a lesson, including examples of relevant actions or activities. Observers use the Codebook to make decisions when coding.

A Braven New World: A Qualitative Case Study Of Career Readiness Efforts On Career Identity And Career Self-Efficacy For Students At A 4-Year Public University, Catherine W. Doederlein

Dissertations of Practice

A Braven New World: A Qualitative Case Study of Career Readiness Efforts on Career Identity and Career Self-Efficacy for Students at a 4-Year Public University

With much of the research on career courses being quantitative in nature, the purpose of this dissertation was to use a qualitative case study approach to understand, through student voices, how participation in a career preparation course can contribute to a college student’s career self-efficacy, career identity, and personal agency in pursuit of their intended career path. Findings revealed that students developed a more authentic confidence about their career development, experienced enhancement to their career …

Global Tracer Facility Longitudinal Global Tracer Survey 2023 (Year 8) - Survey Instrument, Australia Awards Global Tracer Facility

Australia Awards Global Tracer Facility

This survey instrument for the Year 8 Global Tracer Facility (GTF) Global Tracer Survey 2023 outlines the survey sections, area of focus, type of question and response options.

The 5cs Of Openness: Articulating An Open Education Infrastructure (Oer), Richard E. West, David Wiley

Entrepreneurship Faculty Research

Open education needs to evolve to fully realize its potential. Emerging innovations such as generative artificial intelligence (GenAI) and open credentials provide exciting opportunities for this growth. In this chapter, we briefly define the key characteristics of open education, describing its history, current opportunities for open education through generative AI, and then articulate an overarching 5Cs framework for open education that can guide research and practice into the future.

Understanding The Virginia Literacy Act, Candace Bechtold, Kimberly Bridges, David Naff, Joan A. Rhodes, Valerie Robnolt, Tara Davison, Suzanne Alexandre, Michael Crusco, Karli Johansen, Amber Butler, Allison Yandle, Jennifer Askue-Collins, Jean Samuel, Sharrie Merritte, Regina Frazier

MERC Publications

This research and policy brief from the Metropolitan Educational Research Consortium (MERC) offers an overview of the Virginia Literacy Act. It is structured to explore the following questions: 1) What are the recent trends in reading achievement in Virginia? 2) What are the policy implications of the VLA for Virginia school divisions? 3) What does the research say about Science of Reading (SoR)? 4) What core instructional programs are approved to meet the VLA? It concludes with a series of key takeaways and recommendations.

Click here to listen to our podcast episode on the Virginia Literacy Act and click here …

การพัฒนาโมเดลรู้จำภาษามือไทยโดยใช้การเรียนรู้เชิงลึกเพื่อการสื่อสารระหว่างนิสิตครูกับนักเรียนที่มีความต้องการพิเศษ : การประยุกต์โมเดลซีเอ็นเอ็นร่วมกับอาร์เอ็นเอ็น, ธีรวิชญ์ คะรานรัมย์

Chulalongkorn University Theses and Dissertations (Chula ETD)

การวิจัยนี้มีวัตถุประสงค์ 1) เพื่อวิเคราะห์ภาษามือไทยที่ครูใช้สื่อสารกับนักเรียนที่มีความต้องการพิเศษในชั้นเรียน 2) เพื่อพัฒนาและประเมินประสิทธิภาพโมเดลรู้จำภาษามือไทยโดยใช้การเรียนรู้เชิงลึก และ 3) เพื่อวิเคราะห์ผลการใช้โมเดลรู้จำภาษามือไทยเพื่อสนับสนุนการสื่อสารระหว่างนิสิตครูกับนักเรียนที่มีความต้องการพิเศษ การวิจัยแบ่งเป็น 3 ตอน ตอนที่ 1 การวิเคราะห์ภาษามือไทยที่ครูใช้สื่อสารกับนักเรียนที่มีความต้องการพิเศษในชั้นเรียน ตัวอย่างวิจัยคือครูการศึกษาพิเศษในโรงเรียนสอนคนหนูหนวก เครื่องมือวิจัยคือแบบสอบถามความถี่การใช้งานประโยคภาษามือ และวิเคราะห์ข้อมูลจากแบบสอบถามโดยใช้ค่าเฉลี่ยและร้อยละ ตอนที่ 2 การพัฒนาและประเมินประสิทธิภาพโมเดลรู้จำภาษามือไทยโดยใช้การเรียนรู้เชิงลึก ตัวอย่างวิจัยคืออาสาสมัครที่มีความสามารถในการใช้ภาษามือ การวิเคราะห์ข้อมูลผู้วิจัยเลือกใช้โมเดลการเรียนรู้เชิงลึก convolutional neural network (CNN) ร่วมกับ recurrent neural network (RNN) จำนวน 4 โมเดล ในการพัฒนาโมเดลรู้จำภาษามือไทยจำนวน 20 ประโยค โดยใช้ข้อมูลจากวิดีโอที่ถ่ายทำกับอาสาสมัคร จากนั้นเปรียบเทียบประสิทธิภาพของโมเดลโดยพิจารณาจากความถูกต้อง ขนาดของโมเดล เวลาที่ใช้ในการฝึกสอนโมเดล และเวลาที่ใช้ในการทำนาย เพื่อนำโมเดลที่มีประสิทธิภาพสูงสุดไปใช้ประเมินประสิทธิภาพของโมเดลในการจำแนกประโยคภาษามือในภาพรวมและในแต่ละประโยคโดยใช้ค่า accuracy precision recall และ F1-score ตอนที่ 3 การวิเคราะห์ผลการใช้โมเดลรู้จำภาษามือไทยเพื่อสนับสนุนการสื่อสารระหว่างนิสิตครูกับนักเรียนที่มีความต้องการพิเศษ ตัวอย่างวิจัยคือนิสิตครู เครื่องมือวิจัยคือแบบสอบถามการใช้โมเดลรู้จำภาษามือไทย และวิเคราะห์ข้อมูลจากแบบสอบถามโดยใช้ค่าเฉลี่ย ผลการวิจัยพบว่า 1) ภาษามือที่ใช้ในชั้นเรียนมักเป็นประโยคที่สั้นและกะทัดรัดมากกว่าภาษาพูด และภาษามือที่ใช้มากที่สุดจัดอยู่ในหมวดการเสริมแรง 2) การพัฒนาโมเดลรู้จำภาษามือไทยโดยใช้โมเดล EfficientNetB0 ร่วมกับ GRU สามารถจำแนกประโยคภาษามือได้มีประสิทธิภาพสูงสุดทั้งในด้านความถูกต้อง ขนาดของโมเดล เวลาที่ใช้ในการฝึกสอนโมเดล และเวลาที่ใช้ในการทำนาย และ 3) การประเมินประสิทธิภาพของโมเดลรู้จำภาษามือไทยโดยใช้ข้อมูลชุดทดสอบ โมเดลมีค่า accuracy เท่ากับ 0.78 ค่าเฉลี่ย precision เท่ากับ 0.79 ค่าเฉลี่ย recall เท่ากับ 0.78 และค่าเฉลี่ย F1-score เท่ากับ 0.78 โดยประโยคที่โมเดลสามารถจำแนกได้ดี ได้แก่ พร้อมยัง เข้าใจ และรู้ไหม และประโยคที่โมเดลจำแนกได้ไม่ดี ได้แก่ งานสวย ทำได้ไหม และถูกหรือผิด 4) การใช้โมเดลรู้จำภาษามือไทยสามารถช่วยสนับสนุนการสื่อสารระหว่างนิสิตครูกับนักเรียนที่มีความต้องการพิเศษได้ในระดับปานกลาง

Edrs 601: Educational Statistics I, Stephanie Lusk Smith Ph.D., Crc

GMAS Course Syllabi

No abstract provided.

Online Teaching Rubric, Brooke N. Burk

Online Teaching Resources

This rubric is designed to help instructors teaching on online to design a course that supports student learning.

Defining Success For An Introductory Mathematics Non-Stem Pathway Course, Clark D. Metz

Graduate Theses, Dissertations, and Problem Reports (ETD)

The enduring debate surrounding college algebra, traditionally a gateway for STEM pathways, underscores the necessity for curricular evolution in response to the rising popularity of non-STEM majors. This dissertation explores the success of an applied college algebra course designed for non-STEM students. The study aimed to determine whether this alternative course could meet diverse student needs while promoting academic achievement and fostering positive attitudes towards mathematics. Findings revealed through a novel approach of a difference-in-differences analysis that students enrolled in the applied college algebra course exhibited higher pass rates due to the introduction of the new course. The lower failure …

Development And Content Validation Of The Student Perception Of School Safety (Spss) Scale: An Expert Evaluation Of Item Relevance Ratings By Law Enforcement And School Guardians, Diana D. Scott

Graduate Thesis and Dissertation 2023-2024

There is "no one-size-fits-all solution" to school safety (Cybersecurity & Infrastructure Security Agency, 2022. p. 7). The growing number of school shootings and health problems at schools raise serious questions about the dimensions of school safety that should be measured. Prior extensive surveys measuring elementary student's views of safety in relation to relevant safety issues have not been conducted. There were four objectives for this study: 1) to investigate relevant dimensions of school safety and understand safety procedures that are currently in use; 2) to formulate and organize questions that would be approved to gauge elementary students' perceptions about school …

Integrating Digital Literacy Skills Into Chemistry Assessment In Secondary Schools: A Case Study Of Lindi Municipal, Tanzania, Francis Gaspar Sasu

Master of Education

In an era dominated by technology, the demand for digital literacy skills is ever-growing. As technology continues to shape our lives, the need for proficiency in digital literacy extends beyond mere usage, becoming crucial in both learning and assessment contexts. This study addresses the need to bridge the gap between traditional assessment practices and the demand for digital literacy skills in 21st-century education contexts, with a focus on secondary school chemistry assessments in Lindi Municipal, Tanzania.The study enlisted a qualitative approach and case study design in which four secondary schools within Lindi municipal were involved. It utilized diverse data collection …

Teachers’ Assessment Practices In An Inclusive Refugee Setting: An Exploration Of How It Influences The Learning Of Learners With Disabilities., Julius Odongo Mireri

Master of Education

Assessments play a pivotal role in determining learning outcomes and educational experiences for refugee learners with disabilities (RLWD). However, their circumstances present unique challenges to traditional assessment practices. This study explored how teachers' assessment approaches influence learning for RLWD enrolled in an inclusive refugee school in Kakuma Kenya. The objectives were to examine how assessments are adapted to meet diverse learner needs, investigate how the refugee context shapes assessment practices, determine how assessments influence learning, and identify challenges faced in assessment. A qualitative case study design was employed. Data collection methods included individual interviews with 8 teachers and the head …

The Song Of Life: Listening To Self, Others, Nature, And God (The Divine), E. James Baesler

Communication & Theatre Arts Faculty Publications

“Listening to the SONG of Life” is a pedagogical framework that conceptualizes listening as a multi-sensory experience in four contexts: Self, Others, Nature, and God/Goddess (the Divine). L-SONG (Listening-SONG) is an instrument developed to measure student learning in four contexts during a listening course.

Student Use Of Anchors And Metacognitive Strategies In Reflection, Anu Singh, Heidi A. Diefes-Dux

Department of Agricultural and Biological Systems Engineering: Faculty Publications

Context: Self-regulation, a skillset involving taking charge of one’s own learning processes, is crucial for workplace success. Learners develop self-regulation skills through reflection where they recognize weaknesses and strengths by employing metacognitive strategies: planning, monitoring, and evaluating. Use of anchors assists learners’ engagement in reflection. Purpose or Goal: The purpose of this work was to gain insight into students’ use of anchors when reflecting on their learning. The two research questions: (1) To what extent do students link their self-evaluation and learning objective (LO) self-ratings to their reflections? and (2) What dimensions and level of metacognitive strategies do students use …

Building Rural Resilience: A Rural And Farm Youth Safety And Well-Being Curriculum, Kelly Mcfarland

Theses and Dissertations--Community & Leadership Development

Mental health is a growing concern in today’s youth (CDC, 2023). The suicide rates in youth have been on a rise, increasing the need for mental health literacy (CDC, 2023). Mental health is often neglected in people’s lives, especially in rural areas (Boyd et al., 2008). This study answers four research questions: 1) Has the Building Rural Resilience: A Rural and Farm Youth Safety and Well-being Curriculum increased students' knowledge to recognize stress factors among rural communities and farmers? 2) Has the Building Rural Resilience: A Rural and Farm Youth Safety and Well-being Curriculum increased students' knowledge to recognize stress …

2023-2024 Ets Proficiency Profile, Southwestern Oklahoma State University

Assessment Center Reports

ETS Proficiency Profile reports produced by the SWOSU Assessment Center.

2023-2024 Annual Student Assessment Report, Southwestern Oklahoma State University

Assessment Center Reports

Annual Student Assessment Report produced by the SWOSU Assessment Center.

Career And Technical Education: Historical Insights, Current Impacts, And Policy Implications, Meleah Ellison, David B. Naff, Phelton Moss, Jenna Lenhardt, Morgan Meadowes, Jonathan Staylor, Latonja Y. Wright, Luke Parker, Andy Bristow, Kelsey Pacer, Samantha Hope, Shelby Garofalo, Singith Nawagamuwage Perera, Georgia Youngquest, Rachel Hale, Sharrie Merritte

MERC Publications

This research and policy brief from the Metropolitan Educational Research Consortium (MERC) summarizes recent peer reviewed literature, publicly available trend data, and policies at the federal, state, and school division level related to Career and Technical Education (CTE) courses. It explores the following questions:

1. What are the purposes of CTE courses?
/="/">2. What are the trends in CTE participation and how does this vary by student and school demographics?
/="/">3. What are the impacts or benefits of CTE?
/="/">4. What are evidence-based practices and innovative programs related to CTE?
/="/">5. What are policies guiding the …

Interviewing K-12 Education Experts And Elites, Jose Eos Trinidad

Interdisciplinary Studies Faculty Publications

Understanding education experts and elites is crucial in the context of their larger influence on education and the public’s greater skepticism and criticism of their work. This paper distinguishes between traditional and expert/elite interviews (EEIs), and highlights strategies for conducting them. Experts and elites have relatively broader influence, more synthesized but less situated knowledge, more embedded professional networks, and less anonymity than the lay public—and interviews need to adjust to these differences. To do so, researchers should consider strategies for (1) access, (2) trust, (3) preparation for interviews, and (4) asking sensitive and awkward questions in contexts of significant power …

Art Teams: Teaching With Arts And Emerging Media Infographic, Elizabeth Valerio-Boster, Guy Trainin

Research and Evaluation in Education, Technology, Art, and Design

Infographic from Art TEAMS at the University of Nebraska-Lincoln about teaching with arts and emerging media.

Spanish Heritage Language Program: A United States, Mexico, And Japan Collaboration To Improve Instruction, Philip H. Swartz, Lilia Lopez Arriaga, Daniel P. Swartz, Kathy Pitchford, Aki Kanebako, Stanley L. Swartz

Journal of Critical Issues in Educational Practice

No abstract provided.

Using Agency Data For Research Development, Lou Hurst

Research Analytics Summit 2024

This session will explore ways to locate, analyze, and present sponsor-provided data to guide research development. Individual investigators, who may be proposing to a funder for the first time, often want to know about funding success rates, as well as more nuanced insight into the kinds of projects agencies tend to favor. They may also benefit from insight into changing workforce demographics and career trajectories in their discipline. At the departmental and institutional level, leadership seeks information about trends in funding availability and mechanisms, and in patterns of grants made, to better position themselves for these opportunities. As a research …

The Balancing Act: Data Analytics And Radical Invention, Andrea Christelle, Baron Wolf

Research Analytics Summit 2024

Metrics and analytics are becoming indispensable tools for guiding decision-making and resource allocation. That’s why we are all at this conference. However, what happens when the path to innovation veers off the beaten track, to such an extent that metrics don’t capture it? This session will delve into the delicate balance between relying on metrics and fostering revolutionary invention by exploring how research administrators can strategically harness analytics while also nurturing the creative space necessary for groundbreaking discovery.

This thought-provoking session will engage participants in a dialog that considers the unanticipated nature of invention, and how it can be fostered, …

From Policy Sources To Research Information Management Sources: Incorporating Multiple Bibliographic Data Sources Into Dashboard Analytics, Rachel Miles

Research Analytics Summit 2024

As the availability of bibliographic data becomes more diverse and unique, so do the complexities of those sources. As a result, it can be challenging and daunting to analyze such data, especially from a single research analytics service request. In this session, the presenter will demonstrate examples of building dashboards to analyze data for research outputs of a college using data from a research information management system, a policy database, and a bibliographic database. Attendees will learn about the advantages of using RIM systems to perform analytics as well as their shortcomings; they’ll also learn how to export data from …

Making The Most Of What You Have: Data To Optimize Space And Achieve Research Goals, Paul Leef

Research Analytics Summit 2024

Every institution has a strategic goal for more research funding and results. The drive for funding is inextricably tied to competition for top researchers, and competition for researchers is directly related to investments in and optimization of research space on university campuses. The case for focusing on space is critical when you expect each lab to produce $1 million or more in expenditures every 4 years. How can you use data analytics to optimize space allocation for research? How can you creatively use under-utilized spaces for short- and long-term research investments? This session will discuss Carnegie R2 and R1 and …

Introducing A ‘Research Impact Roadmap’ In A Young University: Challenges And Opportunities, Roopa Rajashekar

Research Analytics Summit 2024

‘Research Impact’ as a defined concept is expanding and garnering more attention globally. What was once positioned more narrowly and often confused with basic outcomes reporting has since risen to a primary focus for sponsor agencies across all stages of R&D. Hence, building a comprehensive research impact framework provides a critical map for universities to strengthen the R&D ecosystems in which it engages in innumerable ways.

Khalifa University of Science and Technology (KU), located in Abu Dhabi, UAE, is a relatively a young university, by Times Higher Education definition). Even so, KU ranked 238 in the QS World University Rankings …

Introduction To Research Administrations Dashboards Using Tableau, Alex Wagner

Research Analytics Summit 2024

This session will present on how to develop basic research administration dashboards using Tableau. A sample research administration dataset will be provided in Excel for anyone who would like to work along. Using that data set the presenter will show step by step how to import the data into Tableau and how to create basic worksheets and dashboards. Calculations and filters will be shown also. Attendees should download a trial version of Tableau the same week as the conference if they would like to work along the presenter.

Generating Impact Narratives With Ai, Sean Newell, Charity Elifritz

Research Analytics Summit 2024

Senior academic leaders face mounting pressure to communicate academic impact to various stakeholders, including faculty, students, funding bodies, government agencies, and the media. However, assessing impact extends beyond traditional bibliometrics, encompassing influence on policy, culture, environment, and technology, making it complex to define and measure. Moreover, the interpretation of research impact can vary significantly depending on the perspective. In this discussion, we explore how Elsevier leverages AI to integrate quantitative metrics and qualitative narratives, offering a comprehensive approach to addressing the nuanced challenge of understanding and quantifying research impact. Through real-world examples, we demonstrate the efficacy of this approach and …

The Power And Peril Of Program Reviews: The Resource Paradox Of Assessing For Improvement, Justin Rogers-Cooper, Rejitha Nair, Arthur O'Keeffe

Publications and Research

In this essay, we explore program reviews as important sites for the tension Peter Ewell defines at the core of outcomes assessment practices: that is, between assessing for accountability and assessing for improvement. We address this tension through the example of our Industrial Design program on our urban campus in New York City. In exploring Ewell’s tension between accountability and improvement, we develop the concept of the resource paradox. Simply stated, program reviews require institutions to invest time and resources to close the loop on implementing improvements – yet those actions often require resources many institutions lack. Using our case …

Student Assessment In Madhya Pradesh, Acer India

ACER India

ACER will build a student assessment system in Madhya Pradesh as part of Rajya Shiksha Kendra (RSK)’s School Certification Programme. Under this initiative, schools will be certified as gold, silver, and bronze based on their performance. We will develop assessments for students in grades 3, 5, 8, and 10 in schools that meet the qualifying criteria.