Education Commons^™

Answering Big Questions With Big Data: Using Analytics Across The Research Ecosystem, Ann Beynon

Research Analytics Summit 2024

The research landscape continues to shift and evolve. With challenges around research integrity and security growing, research leaders must rely on the highest quality data to make confident decisions. Universities and funders need to understand the societal impact of research investments in addition to the scholarly impact. Has research helped to advance the UN Sustainable Development Goals? What are the emerging research areas that will lead to commercial innovations and sustainability advancements? We will discuss how quantitative data from Web of Science and InCites can help research stakeholders understand these big questions and inform their strategic research decisions.

A Data Driven Approach To Research Enterprise Growth And Infrastructure Design, Marisa Zuskar, Gabby Labayen

Research Analytics Summit 2024

As proposal, subaward, award, and agreement volumes continue to grow at your institution, how can you strategize to support the size of your research infrastructure? How can you justify the expansion of your teams and talent? How do you adjust roles and workload to align with the growing portfolio? What technology considerations should you make to track this?

This session will cover how to leverage data to make effective business decisions regarding resource needs and allocation methodology to meet growing demands, starting with your internal data and then looking externally. We will cover strategies for using data analytics to efficiently …

The Balancing Act: Data Analytics And Radical Invention, Andrea Christelle, Baron Wolf

Research Analytics Summit 2024

Metrics and analytics are becoming indispensable tools for guiding decision-making and resource allocation. That’s why we are all at this conference. However, what happens when the path to innovation veers off the beaten track, to such an extent that metrics don’t capture it? This session will delve into the delicate balance between relying on metrics and fostering revolutionary invention by exploring how research administrators can strategically harness analytics while also nurturing the creative space necessary for groundbreaking discovery.

This thought-provoking session will engage participants in a dialog that considers the unanticipated nature of invention, and how it can be fostered, …

Navigating Faculty Activity Reporting: Maximizing Transparency And Efficiency, Kathy Felts, Michael Katz, Jenny Hulsen

Research Analytics Summit 2024

Join us as we embark on a journey through the intricacies of faculty activity reporting, exploring strategies to maximize transparency and efficiency. This presentation will dive into the essential components of faculty activity reporting, examining the benefits/challenges, and providing best practices. Discover how leveraging Academic Analytics can streamline workflows, enhance data accuracy, and save faculty time and effort.

Finding And Hiring A Research Analyst Unicorn, Hansa Magee, Nick Bilyk

Research Analytics Summit 2024

As more data analytics programs pop up, we see graduates with these degrees and certificates in our applicant pool. However, the analyst that works in higher ed administration is not like a data scientist that looks for biomarkers in genomic data or the programmer that writes in R all day. What are the skills needed for this job? What exactly is this job that we are hiring for? Should managers prioritize applicants with analytics certificates? Or is experience with sponsored projects more important? We (your presenters) don’t have perfect answers but we (the collective conference attendees) can come up with …

Co-Authorship Maps To Support Leadership Selection, Robert Hc Chen

Research Analytics Summit 2024

VOSViewer co-authorship mapping is a powerful tool typically used for analyzing research collaboration. Users provide publication data and VOSViewer produces a map where authors are plotted on a 2-dimensional map based on how often they are in the author lists of the same publication.

In this presentation, I propose a series of tweaks to the input data that can leverage co-authorship maps to support leadership selection based on how often candidates co-author papers with their institutional peers and some of the attributes of these papers. I will suggest how best to interpret the resulting maps and address the major assumptions …

Leveraging Herd Data To Understand Institutions’ Competitive Edge, Growth Potential, And Strategic Collaborations, Hanin Alhaddad, Joshua Roney

Research Analytics Summit 2024

This presentation delves into understanding institutional strengths, weaknesses, and areas of growth potential within the landscape of higher education. Leveraging data from the Higher Education Research (HERD) survey, we analyze research expenditures in ten broad scientific fields and forty sub-detailed research fields across higher educational institutes in the United States. We utilize macro and microeconomics methodologies to analyze and identify research specializations by institution, along with research fields exhibiting high growth potential. This comprehensive approach aims to offer valuable insights for strategic planning, fostering smart collaborations, and guiding investments to nurture growth within an institution.

Exploring Research Metadata Governance With Design Thinking, Scott Woods, Natalie Simonson

Research Analytics Summit 2024

If you want great research analytics, you’re going to need great data governance for your research metadata. That’s a tall order when the best information often spans incompatible systems, departments, policies, and mindsets.

Research metadata governance is a great illustration of how research analytics is not just a technology problem. It happens at the intersection of technology, policy, process, and culture. Do any of us feel like our organization is “nailing” metadata governance? What level of research analytics could you achieve if there could be more alignment and cooperation around this kind of governance?

In this session, you will join …

Evaluating A Pi Policy With Data, Lori Ann M. Schultz

Research Analytics Summit 2024

At our organizations, policies are often implemented then never reviewed again. We often don’t know why the policy existed in the first place. In this session, we will discuss how the data we already collect can be used to evaluate existing policies, proposed policies, and potential changes. We will walk through an example of how a proposed institutional policy was examined through the use of data on research proposals and awards, and answer the question “Do we really need this policy?” Bring your examples to talk through options for policy evaluation!

Introducing A ‘Research Impact Roadmap’ In A Young University: Challenges And Opportunities, Roopa Rajashekar

Research Analytics Summit 2024

‘Research Impact’ as a defined concept is expanding and garnering more attention globally. What was once positioned more narrowly and often confused with basic outcomes reporting has since risen to a primary focus for sponsor agencies across all stages of R&D. Hence, building a comprehensive research impact framework provides a critical map for universities to strengthen the R&D ecosystems in which it engages in innumerable ways.

Khalifa University of Science and Technology (KU), located in Abu Dhabi, UAE, is a relatively a young university, by Times Higher Education definition). Even so, KU ranked 238 in the QS World University Rankings …

Data Governance And Stewardship 101, Lori Ann M. Schultz

Research Analytics Summit 2024

This session will be an introductory conversation to understand the fundamentals of data governance and stewardship. Attendees will be introduced to the core principles of data governance and the role of data stewards. We will talk about strategies for governance and stewardship at your institution, and how to work within roles and frameworks that may already exist at your institution. We’ll also talk about how to build this framework and external considerations you need to consider.

Building Research Collaboration Networks: Leveraging Sponsored Research Data, Robert Pilgrim

Research Analytics Summit 2024

Discover how to transform standard research award/proposal reports into dynamic visualizations of your research collaborations using Microsoft Power BI and custom visuals. This session guides you through creating interactive networks to visualize your research community. While we'll touch on network analysis, detailed statistical discussions are beyond the scope of this session. Participants are encouraged to bring a laptop and their data, although dummy data will be available. We'll cover data loading and transformation in Microsoft Power BI, employing custom visuals for network generation, and we will explore practical applications of research networks. Please download Microsoft Power BI Desktop beforehand if …

Introduction To Research Administrations Dashboards Using Tableau, Alex Wagner

Research Analytics Summit 2024

This session will present on how to develop basic research administration dashboards using Tableau. A sample research administration dataset will be provided in Excel for anyone who would like to work along. Using that data set the presenter will show step by step how to import the data into Tableau and how to create basic worksheets and dashboards. Calculations and filters will be shown also. Attendees should download a trial version of Tableau the same week as the conference if they would like to work along the presenter.

Using Public Policy Citation Data In University Decision Making: Understanding, Sharing And Responsible Use, Euan Adie

Research Analytics Summit 2024

The 2018 Evidence Act has mandated US government departments and agencies to be much clearer about their research agendas and the engagement they want with academic researchers and institutions. Tracking those engagements has become easier as data providers increasingly supply information on policy engagement or policy citations, tracking where academics at an institution have been cited in or mentioned by name in government reports and policy documents at a local, state or federal level. This session covers the processes, policies and best practice you need to put in place to start using policy engagement data responsibly, both to track and …

Successfully Implementing Research Analytics And Dashboards Without Scaring Or Scarring Anyone!, Alex Wagner

Research Analytics Summit 2024

The use of data and analytics in the field of research administration remains in explorations stages for many, if not most, higher education institutions. That is evidenced not only by the great demand and attendance seen for such sessions at NCURA’s Annual Meetings in 2022 and 2023, but also via prior research. This presentation will highlight the efforts implementing data-informed decision making based on research administration metrics, analytics, and dashboard examples. Emphasis will be placed on that you can’t manage what you can’t measure. The data analytics team at Emory supports all visions of our research administration leadership. Challenges, pain …

Radtrials: Clinical Trial Startup Tracker At Radiology, Anna Romanowska-Pawliczek

Research Analytics Summit 2024

Clinical study startup is one of the most time and resource-intensive parts of the clinical trials. Its impacts are long-lasting, as delays can affect the study conduct. For study startups, 85% of the industry still relies on Excel spreadsheets. But spreadsheets are passive – they don’t allow you to proactively manage activities and don’t tell you where to focus your attention. We designed, implemented, and now fully adopted a new comprehensive workflow centered around a Smartsheet-based solution with automated reports and dashboards for clinical research coordinators (CRCs), managers, faculty, and leadership. We seek to standardize the startup process across the …

Open Alex, Kyle Demes

Research Analytics Summit 2024

Research organizations of all shapes and sizes need information on the research activities at their institutions and other institutions around the world to effectively plan, implement, and evaluate their research strategies. Historically, that information was only accessible through closed commercial licenses. This session will introduce OpenAlex, the most comprehensive and only completely open index of the world’s research ecosystem. The presentation will first provide an overview of OpenAlex, highlighting the importance of openness and transparency in research analytics, and will walk-through how to perform common research analyses in OpenAlex.

Data Models, Robert Pilgrim

Research Analytics Summit 2024

This talk addresses the essential role of data models in analytics, especially for lean teams. It caters to a broad audience, from beginners creating reports to those integrating diverse datasets for advanced analytics and KPI development. A robust data model is crucial for rapidly scaling analytics efforts, allowing for the inclusion of varied data sources such as research awards and proposals, HR data (Gender, ranks, titles, ethnicity etc.), teaching loads, and external datasets like the HERD Survey. We will cover data modeling basics, then explore advanced analytics with the Microsoft Analytics Stack, focusing on Power BI Desktop, emphasizing its accessibility …

Bridging The Gap For Research Analytics: Fostering Collaboration Between Research Administration, Institutional Research, Enterprise It, And Research Computing In Higher Education, Ashley Stauffer, Paulina Krys

Research Analytics Summit 2024

Institutions of Higher Education are complex matrixed organizations that require collaboration across silos. Research Administration, Institutional Research, Enterprise IT, and Research Computing are important areas to leverage when building a research analytics program. Across these units, our work can look very different, and we likely have different mental models for how we think about and approach work. This can make cross-functional communication and collaboration difficult. This presentation will provide a mental model for working in higher education research analytics, discuss critical players, and how to get work moving forward. Finally, we will provide a list of key ingredients to consider …

Introduction To Descriptive Research Administration Statistics Using Excel, Alex Wagner

Research Analytics Summit 2024

This session is a basic introduction to descriptive statistics for research administration professionals. No worries! Excel will be used throughout, nothing will be calculated by hand. Averages (means), medians, standard deviations, correlations and other basic statistical concepts will be explained using only research administration data as context. A sample research administration data set will be provided and Excel will be used to analyze the data. Some sample charts and best practices in creating these charts will also be shown. Again using Excel. This is the perfect session for anyone in research administration whose roles include analyzing data using descriptive statistics. …

Unlocking Opportunities: Leveraging Generative Ai In University-Sponsored Programs Operations, Lisa A. Wilson, Tubal Yisrael, Alex Wagner

Research Analytics Summit 2024

Explore the transformative potential of generative AI in university-research administration. As universities strive to enhance research capabilities and support a culture of innovation, the need for efficient and effective management of sponsored programs has become paramount. This presentation will share lessons from deploying a sponsored programs’ Large Language Model Chatbot and how it optimizes research administration operations and unlocks opportunities. By harnessing the power of GenAI, a university office of sponsored programs chatbot can develop training materials, policies and SOPs. It can offer immediate support and guidance by analyzing queries and providing real-time responses, empowering staff members to overcome challenges …

Generating Impact Narratives With Ai, Sean Newell, Charity Elifritz

Research Analytics Summit 2024

Senior academic leaders face mounting pressure to communicate academic impact to various stakeholders, including faculty, students, funding bodies, government agencies, and the media. However, assessing impact extends beyond traditional bibliometrics, encompassing influence on policy, culture, environment, and technology, making it complex to define and measure. Moreover, the interpretation of research impact can vary significantly depending on the perspective. In this discussion, we explore how Elsevier leverages AI to integrate quantitative metrics and qualitative narratives, offering a comprehensive approach to addressing the nuanced challenge of understanding and quantifying research impact. Through real-world examples, we demonstrate the efficacy of this approach and …

Identifying Support Structures Associated With Informal Formative Evaluation In Instructional Design, Suzanne Smith, Tian Luo

STEMPS Faculty Publications

Instructional designers perform informal formative evaluation in design practice. An evaluation may be used to locate errors in alignment of instructional objectives or to increase the quality or effectiveness of a design. An instructional design review is similar to peer reviews in higher education which are often structured, and tools are provided to contribute to the review. A study was performed to identify the support structures and tools that contribute to building a community of feedback within the practice of instructional design reviews. Six instructional designers and design managers were interviewed to gather the processes they use in design reviews …

Needs Assessment – National Repository For Nsf Agep Deliverables, Christie Sahley, Megan Sapp-Nelson, Donna Ferullo, Linda Mason, Hanzi Xie

Libraries Faculty and Staff Scholarship and Research

This white paper proposes the establishment of a National Repository for NSF Alliance for Graduate Education and the Professoriate (AGEP) Deliverables to address the critical need for preserving and sharing a wide array of materials generated from the AGEP program. Recognizing the challenges of ephemeral storage solutions and the absence of a unified collection mechanism, the paper underscores the repository's role in promoting justice, equity, diversity, and inclusion (JEDI) research. It emphasizes the importance of accommodating diverse data types, enhancing discoverability, and ensuring long-term access to educational materials, policy documents, and research outcomes. Through a comprehensive approach, the proposed repository …

Pisa Capacity Needs Assessment: Tajikistan, Dushanbe, Ian Teo

OECD Programme for International Student Assessment (PISA)

This report presents detailed findings of a Capacity Needs Assessment (CNA) for Tajikistan, carried out to gain information about Tajikistan's capacity assets and needs to implement the Programme for International Student Assessment (PISA) 2025 successfully. It focuses on Tajikistan's National Project Manager and key PISA National Centre roles. The capacity assets and needs are structured into three dimensions: the enabling environment, the organisational level, and the individual level. Questionnaires for each level are included.

Pisa Capacity Needs Assessment: Ecuador, Ian Teo

OECD Programme for International Student Assessment (PISA)

This report presents detailed findings of a Capacity Needs Assessment (CNA) for Ecuador, carried out to gain information about Ecuador’s capacity assets and needs to implement the Programme for International Student Assessment (PISA) 2025 successfully. The capacity assets and needs are structured into three dimensions: the enabling environment, the organisational level, and the individual level. Questionnaires for each level are included.

The University Education Model Collection 2024: “A University Way Of Being”, Fionnuala Darby, Shaun Ferns, Barry J. Ryan

Group Reports

The University Education Model (UEM) revolutionises our approach to education; this approach is grounded in transformative learning opportunities and experiences for all. The UEM is central to the TU Dublin Strategic Intent, which itself is informed by the UN Sustainable Development Goals (SDGs), and in the case of the UEM, SDG 4 Quality Education. Embedding the UEM into our practice, processes and culture will empower TU Dublin to cater for the largest number of diverse learners, producing the most sought after, digitally literate, graduates.

The central focus of UEM are our learners, grounded in the three components that comprise the …

Lesson 2: Grade 2 Language And Communication Lesson Video Transcript, Australian Council For Educational Research (Acer)

Education Analytics Service

This video transcript is from a Grade 2 Language and Communication (literacy) lesson in Port Vila, Vanuatu. In this lesson, the teacher works with the students to construct a narrative from a series of pictures from a story. The teacher uses French as the primary language of instruction, and Bislama at times. The video is part of a training package developed by the Australian Council of Educational Research to enable those observing early primary classes to make consistent and reliable observations. It is based on a purpose-built classroom observation tool developed to collect data on changes to teaching practice and …

Students' Preferences For Setting And/Or Mixed-Ability Grouping In Secondary School Physical Education In England, Shaun D. Wilkinson, Dawn Penney

Research outputs 2022 to 2026

There is an extensive international literature on different forms of ability grouping in schools, much of which describes their impact on students' academic achievement, motivation, self-concept and/or attitudes towards learning. Comparatively little research has focused on students' perspectives of these practices, while the research that has been conducted has primarily focused on mathematics, English and science. There is a conspicuous and arguably significant absence of research that explores students' perspectives on different forms of ability grouping in other areas of the school curriculum, including physical education (PE). In contrast to the relative privacy of classroom-based subjects, students' bodies, physical competencies …

Learning Through Play At School: Ukraine, 2019-2024, Rachel Parker, Amy Berry, Kellie Picker, David Jeffries, Prue Anderson, Oksana Zabolotna

Student learning processes

The Learning Through Play at School Research Study Ukraine was a four-year longitudinal intervention study funded by the LEGO Foundation and implemented by the Australian Council for Educational Research (ACER) and the Ukrainian Educational Research Association (UERA). The study was implemented between 2019 and 2024, during COVID-19 and the full-scale invasion of Ukraine by Russian armed forces. Despite, at times, insurmountable challenges, the professional learning intervention was successful in supporting most teachers to progress from a surface level understanding of learning through play to a deep level. In addition, almost all children’s literacy and social-emotional skills grew significantly from start …