Education Commons^™

Evaluating A Pi Policy With Data, Lori Ann M. Schultz

Research Analytics Summit 2024

At our organizations, policies are often implemented then never reviewed again. We often don’t know why the policy existed in the first place. In this session, we will discuss how the data we already collect can be used to evaluate existing policies, proposed policies, and potential changes. We will walk through an example of how a proposed institutional policy was examined through the use of data on research proposals and awards, and answer the question “Do we really need this policy?” Bring your examples to talk through options for policy evaluation!

The Role Of Ai In Research, Robert Pilgrim

Research Analytics Summit 2024

General discussion session about how you at your institution are using or trying to deploy AI within research administration. This will be an informal discussion session.

Introducing A ‘Research Impact Roadmap’ In A Young University: Challenges And Opportunities, Roopa Rajashekar

Research Analytics Summit 2024

‘Research Impact’ as a defined concept is expanding and garnering more attention globally. What was once positioned more narrowly and often confused with basic outcomes reporting has since risen to a primary focus for sponsor agencies across all stages of R&D. Hence, building a comprehensive research impact framework provides a critical map for universities to strengthen the R&D ecosystems in which it engages in innumerable ways.

Khalifa University of Science and Technology (KU), located in Abu Dhabi, UAE, is a relatively a young university, by Times Higher Education definition). Even so, KU ranked 238 in the QS World University Rankings …

Data Governance And Stewardship 101, Lori Ann M. Schultz

Research Analytics Summit 2024

This session will be an introductory conversation to understand the fundamentals of data governance and stewardship. Attendees will be introduced to the core principles of data governance and the role of data stewards. We will talk about strategies for governance and stewardship at your institution, and how to work within roles and frameworks that may already exist at your institution. We’ll also talk about how to build this framework and external considerations you need to consider.

Building Research Collaboration Networks: Leveraging Sponsored Research Data, Robert Pilgrim

Research Analytics Summit 2024

Discover how to transform standard research award/proposal reports into dynamic visualizations of your research collaborations using Microsoft Power BI and custom visuals. This session guides you through creating interactive networks to visualize your research community. While we'll touch on network analysis, detailed statistical discussions are beyond the scope of this session. Participants are encouraged to bring a laptop and their data, although dummy data will be available. We'll cover data loading and transformation in Microsoft Power BI, employing custom visuals for network generation, and we will explore practical applications of research networks. Please download Microsoft Power BI Desktop beforehand if …

Introduction To Research Administrations Dashboards Using Tableau, Alex Wagner

Research Analytics Summit 2024

This session will present on how to develop basic research administration dashboards using Tableau. A sample research administration dataset will be provided in Excel for anyone who would like to work along. Using that data set the presenter will show step by step how to import the data into Tableau and how to create basic worksheets and dashboards. Calculations and filters will be shown also. Attendees should download a trial version of Tableau the same week as the conference if they would like to work along the presenter.

Using Public Policy Citation Data In University Decision Making: Understanding, Sharing And Responsible Use, Euan Adie

Research Analytics Summit 2024

The 2018 Evidence Act has mandated US government departments and agencies to be much clearer about their research agendas and the engagement they want with academic researchers and institutions. Tracking those engagements has become easier as data providers increasingly supply information on policy engagement or policy citations, tracking where academics at an institution have been cited in or mentioned by name in government reports and policy documents at a local, state or federal level. This session covers the processes, policies and best practice you need to put in place to start using policy engagement data responsibly, both to track and …

Successfully Implementing Research Analytics And Dashboards Without Scaring Or Scarring Anyone!, Alex Wagner

Research Analytics Summit 2024

The use of data and analytics in the field of research administration remains in explorations stages for many, if not most, higher education institutions. That is evidenced not only by the great demand and attendance seen for such sessions at NCURA’s Annual Meetings in 2022 and 2023, but also via prior research. This presentation will highlight the efforts implementing data-informed decision making based on research administration metrics, analytics, and dashboard examples. Emphasis will be placed on that you can’t manage what you can’t measure. The data analytics team at Emory supports all visions of our research administration leadership. Challenges, pain …

Radtrials: Clinical Trial Startup Tracker At Radiology, Anna Romanowska-Pawliczek

Research Analytics Summit 2024

Clinical study startup is one of the most time and resource-intensive parts of the clinical trials. Its impacts are long-lasting, as delays can affect the study conduct. For study startups, 85% of the industry still relies on Excel spreadsheets. But spreadsheets are passive – they don’t allow you to proactively manage activities and don’t tell you where to focus your attention. We designed, implemented, and now fully adopted a new comprehensive workflow centered around a Smartsheet-based solution with automated reports and dashboards for clinical research coordinators (CRCs), managers, faculty, and leadership. We seek to standardize the startup process across the …

Open Alex, Kyle Demes

Research Analytics Summit 2024

Research organizations of all shapes and sizes need information on the research activities at their institutions and other institutions around the world to effectively plan, implement, and evaluate their research strategies. Historically, that information was only accessible through closed commercial licenses. This session will introduce OpenAlex, the most comprehensive and only completely open index of the world’s research ecosystem. The presentation will first provide an overview of OpenAlex, highlighting the importance of openness and transparency in research analytics, and will walk-through how to perform common research analyses in OpenAlex.

Data Models, Robert Pilgrim

Research Analytics Summit 2024

This talk addresses the essential role of data models in analytics, especially for lean teams. It caters to a broad audience, from beginners creating reports to those integrating diverse datasets for advanced analytics and KPI development. A robust data model is crucial for rapidly scaling analytics efforts, allowing for the inclusion of varied data sources such as research awards and proposals, HR data (Gender, ranks, titles, ethnicity etc.), teaching loads, and external datasets like the HERD Survey. We will cover data modeling basics, then explore advanced analytics with the Microsoft Analytics Stack, focusing on Power BI Desktop, emphasizing its accessibility …

Bridging The Gap For Research Analytics: Fostering Collaboration Between Research Administration, Institutional Research, Enterprise It, And Research Computing In Higher Education, Ashley Stauffer, Paulina Krys

Research Analytics Summit 2024

Institutions of Higher Education are complex matrixed organizations that require collaboration across silos. Research Administration, Institutional Research, Enterprise IT, and Research Computing are important areas to leverage when building a research analytics program. Across these units, our work can look very different, and we likely have different mental models for how we think about and approach work. This can make cross-functional communication and collaboration difficult. This presentation will provide a mental model for working in higher education research analytics, discuss critical players, and how to get work moving forward. Finally, we will provide a list of key ingredients to consider …

Introduction To Descriptive Research Administration Statistics Using Excel, Alex Wagner

Research Analytics Summit 2024

This session is a basic introduction to descriptive statistics for research administration professionals. No worries! Excel will be used throughout, nothing will be calculated by hand. Averages (means), medians, standard deviations, correlations and other basic statistical concepts will be explained using only research administration data as context. A sample research administration data set will be provided and Excel will be used to analyze the data. Some sample charts and best practices in creating these charts will also be shown. Again using Excel. This is the perfect session for anyone in research administration whose roles include analyzing data using descriptive statistics. …

Unlocking Opportunities: Leveraging Generative Ai In University-Sponsored Programs Operations, Lisa A. Wilson, Tubal Yisrael, Alex Wagner

Research Analytics Summit 2024

Explore the transformative potential of generative AI in university-research administration. As universities strive to enhance research capabilities and support a culture of innovation, the need for efficient and effective management of sponsored programs has become paramount. This presentation will share lessons from deploying a sponsored programs’ Large Language Model Chatbot and how it optimizes research administration operations and unlocks opportunities. By harnessing the power of GenAI, a university office of sponsored programs chatbot can develop training materials, policies and SOPs. It can offer immediate support and guidance by analyzing queries and providing real-time responses, empowering staff members to overcome challenges …

Reaching Beyond Research How A Research Information Management System Can Empower Your Analytics And Energize Your Outreach, Jeff Agnoli, Alexandra Winzeler

Research Analytics Summit 2024

Expertise Finder Systems and Research Information Management System (RIMS) provides administrators and scholars the ability to collect, curate, and highlight their research activity, and the reporting tools to assist with strategic decisions and generate meaningful outreach.

Jeff Agnoli, Senior Liaison for Strategic Partnerships at the Ohio Innovation Exchange, shares his 10+ years of experience using these tools to connect industry partners and researchers across the State of Ohio and beyond. Alexandra Winzeler, Business Development Manager from Digital Science showcases the benefits and efficiencies of using Symplectic Elements to streamline research collection and promote collaboration.

See how built-in integration and automation …

Generating Impact Narratives With Ai, Sean Newell, Charity Elifritz

Research Analytics Summit 2024

Senior academic leaders face mounting pressure to communicate academic impact to various stakeholders, including faculty, students, funding bodies, government agencies, and the media. However, assessing impact extends beyond traditional bibliometrics, encompassing influence on policy, culture, environment, and technology, making it complex to define and measure. Moreover, the interpretation of research impact can vary significantly depending on the perspective. In this discussion, we explore how Elsevier leverages AI to integrate quantitative metrics and qualitative narratives, offering a comprehensive approach to addressing the nuanced challenge of understanding and quantifying research impact. Through real-world examples, we demonstrate the efficacy of this approach and …

Closing The Loop: Student Learning Assessments, Danielle Westmark, Teresa Hartman

Posters and Presentations: Leon S. McGoogan Health Sciences Library

No abstract provided.

Identifying Support Structures Associated With Informal Formative Evaluation In Instructional Design, Suzanne Smith, Tian Luo

STEMPS Faculty Publications

Instructional designers perform informal formative evaluation in design practice. An evaluation may be used to locate errors in alignment of instructional objectives or to increase the quality or effectiveness of a design. An instructional design review is similar to peer reviews in higher education which are often structured, and tools are provided to contribute to the review. A study was performed to identify the support structures and tools that contribute to building a community of feedback within the practice of instructional design reviews. Six instructional designers and design managers were interviewed to gather the processes they use in design reviews …

Exploring Cultural Humility Prevalence And Barriers In Masters Of Science In Athletic Training Education Programs, Nathalie Towchik

Antioch University Dissertations & Theses

The purpose of this study is to understand the prevalence of faculty members’ abilities to incorporate cultural humility into their Masters of Science in Athletic Training (MSAT) program curriculum and barriers they feel they face in implementing this into regular practice. There is a severe lack of focus on issues pertaining to social justice within the athletic training profession, and implementation of cultural humility skills into MSAT programs can help address the systemic injustices within athletic training healthcare delivery. While there has been a focus on cultural competency in athletic training education, there is little to no current research on …

Understanding The Virginia Literacy Act, Candace Bechtold, Kimberly Bridges, David Naff, Joan A. Rhodes, Valerie Robnolt, Tara Davison, Suzanne Alexandre, Michael Crusco, Karli Johansen, Amber Butler, Allison Yandle, Jennifer Askue-Collins, Jean Samuel, Sharrie Merritte, Regina Frazier

MERC Publications

This research and policy brief from the Metropolitan Educational Research Consortium (MERC) offers an overview of the Virginia Literacy Act. It is structured to explore the following questions: 1) What are the recent trends in reading achievement in Virginia? 2) What are the policy implications of the VLA for Virginia school divisions? 3) What does the research say about Science of Reading (SoR)? 4) What core instructional programs are approved to meet the VLA? It concludes with a series of key takeaways and recommendations.

Deep Change Theory: Implications For Educational Development Leaders, Caitlin Martin, Elizabeth Wardle

Publications

While chapters 1 and 2 explore the promise of theoretical frameworks for making conceptual change that leads to innovative action around teaching and learning in higher education, they also point out the challenges to this kind of work as teams of faculty strive to lead change in their programs and departments after completing the program. To summarize our claims thus far: one of the goals for the HCWE Faculty Writing Fellows Program is to empower faculty who participate to return to their departments to make programmatic changes—changes they identify as central to their work and values and program culture. The …

When Leadership Meets A Vision Of Love And Justice: The Art Of Leading For Social Justice, Aaliyah Baker

Educational Leadership Faculty Publications

Art abounds any task that lies ahead of the doer carried out by vision. Thus, the “artist has gradually become a form of identity which … often carries with it as many drawbacks as benefits” (Bayles & Orland, 1993, p. 7).

The concept of leadership for social justice as a form of art warrants more thought and critical inquiry. Leadership can be considered a form of art. Leadership can be both process and product oriented – both process and product lend themselves to becoming material goods by which the art of justice takes form. Leadership style is an art form …

School Improvement Tool Elaborations: Student Engagement And Wellbeing. Background Report And Literature Review, Fabienne Van Der Kleij, Pauline Taylor-Guy, Tanya Vaughan, Marijne Medhurst, Christina Rogers

School and system improvement

This literature review outlines the evidence that underpins the development of a set of evidence-informed elaborations, or specific practices, that support student engagement and wellbeing across the 9 domains of the National School Improvement Tool (NSIT). These observable, measurable practices to support student engagement and wellbeing have been developed from a review of relevant literature in the areas of socio-emotional learning (SEL), health and wellbeing, student engagement and a sense of belonging, and motivations for engagement. They also take account of commissioned research reports by the Queensland Department of Education and the Department's (2018) approach to student learning and wellbeing …

Re-Thinking Education For Sustainable Development: Key Learning Insights From The Sdsn Usa Transformative Education Summit 2023, Radhika Iyengar, Sumie Song, Deepak Sridhar, Wendy M. Purcell, Ann Nielsen, Iveta Silova, Matthew A. Witenstein, Wen-Wen Tung

Educational Leadership Faculty Publications

This paper summarizes key learning insights from the 2023 U.S. Summit on Transformative Education organized by the Sustainable Development Solutions Network USA. Over 400 members from higher education institutions, non-governmental organizations, think tanks, students, and teachers, joined the online event held February 23-25. The Summit created a bridge between social justice issues with an historical lens and sustainable development. Learning insights include those shared by session speakers, dialogue among participants during thematic conversations and regional networking forums, comments made by attendees on session Jamboards and the Zoom Chat function, and post-Summit feedback. A high-level thematic review was undertaken to cluster …

The History And Impact Of Education In Virginia During The Civil War Era, Christopher L. Jones

Doctoral Dissertations and Projects

The following dissertation is a study of the educational history of Virginia during the Civil War era, the resulting struggles that ensued, and how these challenges led to a new period of change and reform throughout the Commonwealth. Numerous issues such as academic quality control, enrollment factors, staff shortages, economic turmoil, the dangers that some school grounds faced, race relations, and the aftermath of reform that presented new educational norms to Virginia are explored. This manuscript examines circumstances in Virginia’s educational system during the decade before the war and then discuss the drastic changes that occurred when the war began …

Evaluating Strategic Leadership Development Programs, Felicia Littlejohn

Instructional Design Capstones Collection

Companies that lack an in-depth understanding of leadership development program evaluation may invest in a program that achieves suboptimal results. However, there is no generally prescribed framework for the evaluation of leadership development programs. Thus, the purpose of this action research paper is to provide the basis for vetting leadership development programs based on their organizational fit and investment value, training methodologies, workplace development approaches, coaching and development support, and targeted business outcomes.

Collective Efficacy Tracking Tool. Development Framework 2023, Kerry Elliott, Hilary Hollingsworth

Educational leadership

Collective efficacy has become a prominent feature in educational policy and practice with growing evidence that a strong sense of collective efficacy amongst educators leads to better outcomes for students. With growing interest in the importance of collective efficacy and how to cultivate it, the Collective Efficacy Tracking Tool was created to address challenges associated with understanding, diagnosing, and developing collective efficacy. This Framework describes the development of the Collective Efficacy Tracking Tool, defining collective efficacy in a way that it can be operationalised to leverage improvement efforts. The Framework and accompanying Collective Efficacy Tracking Tool provide a practical resource …

Pisa In Brief 2022: Student Performance And Equity In Education, Lisa De Bortoli, Catherine Underwood, Sue Thomson

OECD Programme for International Student Assessment (PISA) Australia

The Programme for International Student Assessment (PISA) is an assessment that measures the knowledge and skills of 15-year-old students, an age at which they have nearly completed compulsory schooling. PISA assesses young adults’ ability to apply their knowledge and skills to real-life problems and situations rather than how well they have learned a specific curriculum. This PISA in Brief report provides a summary of student performance in the PISA 2022 assessment and tells us about their capacity to apply knowledge and skills in the domains of reading, mathematical, and scientific literacy.

Pisa 2022. Reporting Australia’S Results. Volume I: Student Performance And Equity In Education, Lisa De Bortoli, Catherine Underwood, Sue Thomson

OECD Programme for International Student Assessment (PISA) Australia

The Programme for International Student Assessment (PISA) is an international comparative study of student performance directed by the Organisation for Economic Co-operation and Development (OECD). PISA measures 3 core domains of reading literacy, mathematical literacy, and scientific literacy. The assessment focuses on young people’s ability to apply their knowledge and skills to real-world problems and situations. The term ‘literacy’ reflects a focus on broader skills. As a concept, literacy is more than simply being able to read and write. Eighty-one countries or economies, involving around 690,000 students, participated in PISA 2022. In Australia, 743 schools and a total of 13,437 …

Is The Declining Birthrate Really An Issue For The Economy?, Harsh Ramesh Pednekar, Theodore Lee, Darrion Chin

Introduction to Research Methods RSCH 202

This study aims to explore the complex implications of declining birth rates on the economy, focusing on GDP per capita as a crucial metric, and aims to uncover both potential opportunities and challenges stemming from this demographic transformation using regression analysis. Using a quantitative methodology and secondary data from OECD.stat, World Population Review, and World Bank, the study explores the relationship between declining birth rates and economic impacts. GDP per capita serves as an essential dependent variable, and it accounts for control variables such as labour force participation, literacy, and education levels, child dependence ratio, and physical capital. Past studies …