Educational Assessment, Evaluation, and Research Commons^™

Introduction To Research Administrations Dashboards Using Tableau, Alex Wagner

Research Analytics Summit 2024

This session will present on how to develop basic research administration dashboards using Tableau. A sample research administration dataset will be provided in Excel for anyone who would like to work along. Using that data set the presenter will show step by step how to import the data into Tableau and how to create basic worksheets and dashboards. Calculations and filters will be shown also. Attendees should download a trial version of Tableau the same week as the conference if they would like to work along the presenter.

Generating Impact Narratives With Ai, Sean Newell, Charity Elifritz

Research Analytics Summit 2024

Senior academic leaders face mounting pressure to communicate academic impact to various stakeholders, including faculty, students, funding bodies, government agencies, and the media. However, assessing impact extends beyond traditional bibliometrics, encompassing influence on policy, culture, environment, and technology, making it complex to define and measure. Moreover, the interpretation of research impact can vary significantly depending on the perspective. In this discussion, we explore how Elsevier leverages AI to integrate quantitative metrics and qualitative narratives, offering a comprehensive approach to addressing the nuanced challenge of understanding and quantifying research impact. Through real-world examples, we demonstrate the efficacy of this approach and …

Using Public Policy Citation Data In University Decision Making: Understanding, Sharing And Responsible Use, Euan Adie

Research Analytics Summit 2024

The 2018 Evidence Act has mandated US government departments and agencies to be much clearer about their research agendas and the engagement they want with academic researchers and institutions. Tracking those engagements has become easier as data providers increasingly supply information on policy engagement or policy citations, tracking where academics at an institution have been cited in or mentioned by name in government reports and policy documents at a local, state or federal level. This session covers the processes, policies and best practice you need to put in place to start using policy engagement data responsibly, both to track and …

Welcome Address, Baron Wolf

Research Analytics Summit 2024

No abstract provided.

Where Do I Start?, Andrea Christelle, Lori Schultz

Research Analytics Summit 2024

In this session, we will start at the beginning and talk about what you need to think about in setting up research analytics capabilities for your organization. There are so many options for tools and other resources to get started, but what if you only have Excel? How do you get reporting off the ground when it hasn’t been done (or done consistently) at your workplace? We’ll talk about ways to get started, including who you need to talk with, what you need to consider, and how to move forward with basic reporting.

Representing Your Institution Through Data, Lou Hurst

Research Analytics Summit 2024

In this session, we will consider how to use place-based data to build your case to sponsors for funding research at your institution, particularly for sponsors who operate on the national or international scale. The setting of your institution—the communities it developed in, the region where it operates, and the people it reaches and serves—is key for conveying its unique capacities and potentials, and for making sponsors eager to bring you into their funding portfolio. How can data help you introduce yourself as an institution and tell your story in geographical and economic context? In this session we will explore …

Answering Big Questions With Big Data: Using Analytics Across The Research Ecosystem, Ann Beynon

Research Analytics Summit 2024

The research landscape continues to shift and evolve. With challenges around research integrity and security growing, research leaders must rely on the highest quality data to make confident decisions. Universities and funders need to understand the societal impact of research investments in addition to the scholarly impact. Has research helped to advance the UN Sustainable Development Goals? What are the emerging research areas that will lead to commercial innovations and sustainability advancements? We will discuss how quantitative data from Web of Science and InCites can help research stakeholders understand these big questions and inform their strategic research decisions.

It’S About Time: Gaining Insights From Turnaround Time Metrics, Julia Zappi, Christopher Perkins

Research Analytics Summit 2024

Rutgers University is a R1 Research Institution with $929M in Sponsored Research funding in FY 2023 and $747M in Research Expenditures in 2022 as per the HERD survey. Since forming in 2019, the Data, Analytics and Business Intelligence team within the Office for Research has grown to three members, all with the mission of providing accurate and timely data about the Rutgers research enterprise for both internal leadership and decision makers across the university.

The Office for Research leadership was receiving complaints from the field about sponsored research awards taking too long to be set up. The Data, Analytics and …

A Data Driven Approach To Research Enterprise Growth And Infrastructure Design, Marisa Zuskar, Gabby Labayen

Research Analytics Summit 2024

As proposal, subaward, award, and agreement volumes continue to grow at your institution, how can you strategize to support the size of your research infrastructure? How can you justify the expansion of your teams and talent? How do you adjust roles and workload to align with the growing portfolio? What technology considerations should you make to track this?

This session will cover how to leverage data to make effective business decisions regarding resource needs and allocation methodology to meet growing demands, starting with your internal data and then looking externally. We will cover strategies for using data analytics to efficiently …

Ramp Research Analytics Mentorship Program, Andrea Christelle, Lou Hurst, Baron Wolf

Research Analytics Summit 2024

No abstract provided.

Research Analytics Maturity Model & Herd: Transforming Tomorrow By Using Data To Drive Decisions, Baron Wolf, Katherine Leung Robershaw

Research Analytics Summit 2024

No abstract provided.

Navigating Faculty Activity Reporting: Maximizing Transparency And Efficiency, Kathy Felts, Michael Katz, Jenny Hulsen

Research Analytics Summit 2024

Join us as we embark on a journey through the intricacies of faculty activity reporting, exploring strategies to maximize transparency and efficiency. This presentation will dive into the essential components of faculty activity reporting, examining the benefits/challenges, and providing best practices. Discover how leveraging Academic Analytics can streamline workflows, enhance data accuracy, and save faculty time and effort.

Leveraging Herd Data To Understand Institutions’ Competitive Edge, Growth Potential, And Strategic Collaborations, Hanin Alhaddad, Joshua Roney

Research Analytics Summit 2024

This presentation delves into understanding institutional strengths, weaknesses, and areas of growth potential within the landscape of higher education. Leveraging data from the Higher Education Research (HERD) survey, we analyze research expenditures in ten broad scientific fields and forty sub-detailed research fields across higher educational institutes in the United States. We utilize macro and microeconomics methodologies to analyze and identify research specializations by institution, along with research fields exhibiting high growth potential. This comprehensive approach aims to offer valuable insights for strategic planning, fostering smart collaborations, and guiding investments to nurture growth within an institution.

Exploring Research Metadata Governance With Design Thinking, Scott Woods, Natalie Simonson

Research Analytics Summit 2024

If you want great research analytics, you’re going to need great data governance for your research metadata. That’s a tall order when the best information often spans incompatible systems, departments, policies, and mindsets.

Research metadata governance is a great illustration of how research analytics is not just a technology problem. It happens at the intersection of technology, policy, process, and culture. Do any of us feel like our organization is “nailing” metadata governance? What level of research analytics could you achieve if there could be more alignment and cooperation around this kind of governance?

In this session, you will join …

Bringing Artificial Intelligence To Research Analytics Research Highlighter-Matchmaker At Suny Ualbany, Tianning Huang, Yuemin Li

Research Analytics Summit 2024

Research analytics has become an indispensable part in today’s higher education institutions’ organizational structure. It not only provides a mechanism or platform to present research awards and expenditures data to internal and external data users, but also serves a superior tool that enables data-driven strategic decision makings with more reliable, valid, and in-depth analysis. The development of Artificial Intelligence techniques could push the boundary of Research Analytics to an even higher level by incorporating the abundance of data scattered across the university. We propose to present one attempt adopted by University at Albany, State University of New York (UAlbany) to …

Collabnext -A Person-Focused Open Knowledge Graph For Collaborations With Emerging Researchers, Lew Lefton

Research Analytics Summit 2024

CollabNext is being developed as part of the NSF ProtoOKN (Prototype Open Knowledge Network) effort. This project originated as a partnership between Georgia Tech and the Atlanta University Center, and is now being developed jointly by Fisk University, Georgia Tech, Morehouse College, Texas Southern University, and University at Buffalo with support from the NSF TIP Directorate.

Our goal is to develop a knowledge graph based on people, organizations, and research topics. We are adopting an intentional design approach which initially prioritizes HBCUs and emerging researchers in a deliberate effort to counterbalance the Matthew effect, a naturally accumulated advantage of well-resourced …

Generating Reliable Collaboration Data: A Proof-Of-Concept Project Using Research Administration Data, Christopher Perkins, Julie Zappi

Research Analytics Summit 2024

Central administration at Rutgers University requested help from the Office for Research to develop a proof-of-concept tool to count collaborations between faculty, departments, schools and chancellor units across the university. This presentation will discuss how the Data, Analytics and Business Intelligence team focused on research administration and research output data to define a “collaboration,” structure available data, create interactive visualizations and allow end users to customize the level of detail displayed.

This presentation will begin by discussing the importance of generating reliable collaboration data in a university setting including use cases for the data. It will then describe the dataset …

Evaluating A Pi Policy With Data, Lori Ann M. Schultz

Research Analytics Summit 2024

At our organizations, policies are often implemented then never reviewed again. We often don’t know why the policy existed in the first place. In this session, we will discuss how the data we already collect can be used to evaluate existing policies, proposed policies, and potential changes. We will walk through an example of how a proposed institutional policy was examined through the use of data on research proposals and awards, and answer the question “Do we really need this policy?” Bring your examples to talk through options for policy evaluation!

The Role Of Ai In Research, Robert Pilgrim

Research Analytics Summit 2024

General discussion session about how you at your institution are using or trying to deploy AI within research administration. This will be an informal discussion session.

Data Governance And Stewardship 101, Lori Ann M. Schultz

Research Analytics Summit 2024

This session will be an introductory conversation to understand the fundamentals of data governance and stewardship. Attendees will be introduced to the core principles of data governance and the role of data stewards. We will talk about strategies for governance and stewardship at your institution, and how to work within roles and frameworks that may already exist at your institution. We’ll also talk about how to build this framework and external considerations you need to consider.

Building Research Collaboration Networks: Leveraging Sponsored Research Data, Robert Pilgrim

Research Analytics Summit 2024

Discover how to transform standard research award/proposal reports into dynamic visualizations of your research collaborations using Microsoft Power BI and custom visuals. This session guides you through creating interactive networks to visualize your research community. While we'll touch on network analysis, detailed statistical discussions are beyond the scope of this session. Participants are encouraged to bring a laptop and their data, although dummy data will be available. We'll cover data loading and transformation in Microsoft Power BI, employing custom visuals for network generation, and we will explore practical applications of research networks. Please download Microsoft Power BI Desktop beforehand if …

Successfully Implementing Research Analytics And Dashboards Without Scaring Or Scarring Anyone!, Alex Wagner

Research Analytics Summit 2024

The use of data and analytics in the field of research administration remains in explorations stages for many, if not most, higher education institutions. That is evidenced not only by the great demand and attendance seen for such sessions at NCURA’s Annual Meetings in 2022 and 2023, but also via prior research. This presentation will highlight the efforts implementing data-informed decision making based on research administration metrics, analytics, and dashboard examples. Emphasis will be placed on that you can’t manage what you can’t measure. The data analytics team at Emory supports all visions of our research administration leadership. Challenges, pain …

Radtrials: Clinical Trial Startup Tracker At Radiology, Anna Romanowska-Pawliczek

Research Analytics Summit 2024

Clinical study startup is one of the most time and resource-intensive parts of the clinical trials. Its impacts are long-lasting, as delays can affect the study conduct. For study startups, 85% of the industry still relies on Excel spreadsheets. But spreadsheets are passive – they don’t allow you to proactively manage activities and don’t tell you where to focus your attention. We designed, implemented, and now fully adopted a new comprehensive workflow centered around a Smartsheet-based solution with automated reports and dashboards for clinical research coordinators (CRCs), managers, faculty, and leadership. We seek to standardize the startup process across the …

Data Models, Robert Pilgrim

Research Analytics Summit 2024

This talk addresses the essential role of data models in analytics, especially for lean teams. It caters to a broad audience, from beginners creating reports to those integrating diverse datasets for advanced analytics and KPI development. A robust data model is crucial for rapidly scaling analytics efforts, allowing for the inclusion of varied data sources such as research awards and proposals, HR data (Gender, ranks, titles, ethnicity etc.), teaching loads, and external datasets like the HERD Survey. We will cover data modeling basics, then explore advanced analytics with the Microsoft Analytics Stack, focusing on Power BI Desktop, emphasizing its accessibility …

Bridging The Gap For Research Analytics: Fostering Collaboration Between Research Administration, Institutional Research, Enterprise It, And Research Computing In Higher Education, Ashley Stauffer, Paulina Krys

Research Analytics Summit 2024

Institutions of Higher Education are complex matrixed organizations that require collaboration across silos. Research Administration, Institutional Research, Enterprise IT, and Research Computing are important areas to leverage when building a research analytics program. Across these units, our work can look very different, and we likely have different mental models for how we think about and approach work. This can make cross-functional communication and collaboration difficult. This presentation will provide a mental model for working in higher education research analytics, discuss critical players, and how to get work moving forward. Finally, we will provide a list of key ingredients to consider …

Introduction To Descriptive Research Administration Statistics Using Excel, Alex Wagner

Research Analytics Summit 2024

This session is a basic introduction to descriptive statistics for research administration professionals. No worries! Excel will be used throughout, nothing will be calculated by hand. Averages (means), medians, standard deviations, correlations and other basic statistical concepts will be explained using only research administration data as context. A sample research administration data set will be provided and Excel will be used to analyze the data. Some sample charts and best practices in creating these charts will also be shown. Again using Excel. This is the perfect session for anyone in research administration whose roles include analyzing data using descriptive statistics. …

Unlocking Opportunities: Leveraging Generative Ai In University-Sponsored Programs Operations, Lisa A. Wilson, Tubal Yisrael, Alex Wagner

Research Analytics Summit 2024

Explore the transformative potential of generative AI in university-research administration. As universities strive to enhance research capabilities and support a culture of innovation, the need for efficient and effective management of sponsored programs has become paramount. This presentation will share lessons from deploying a sponsored programs’ Large Language Model Chatbot and how it optimizes research administration operations and unlocks opportunities. By harnessing the power of GenAI, a university office of sponsored programs chatbot can develop training materials, policies and SOPs. It can offer immediate support and guidance by analyzing queries and providing real-time responses, empowering staff members to overcome challenges …

Reaching Beyond Research How A Research Information Management System Can Empower Your Analytics And Energize Your Outreach, Jeff Agnoli, Alexandra Winzeler

Research Analytics Summit 2024

Expertise Finder Systems and Research Information Management System (RIMS) provides administrators and scholars the ability to collect, curate, and highlight their research activity, and the reporting tools to assist with strategic decisions and generate meaningful outreach.

Jeff Agnoli, Senior Liaison for Strategic Partnerships at the Ohio Innovation Exchange, shares his 10+ years of experience using these tools to connect industry partners and researchers across the State of Ohio and beyond. Alexandra Winzeler, Business Development Manager from Digital Science showcases the benefits and efficiencies of using Symplectic Elements to streamline research collection and promote collaboration.

See how built-in integration and automation …

Co-Authorship Maps To Support Leadership Selection, Robert Hc Chen

Research Analytics Summit 2024

VOSViewer co-authorship mapping is a powerful tool typically used for analyzing research collaboration. Users provide publication data and VOSViewer produces a map where authors are plotted on a 2-dimensional map based on how often they are in the author lists of the same publication.

In this presentation, I propose a series of tweaks to the input data that can leverage co-authorship maps to support leadership selection based on how often candidates co-author papers with their institutional peers and some of the attributes of these papers. I will suggest how best to interpret the resulting maps and address the major assumptions …

The Co-Curriculum Of College Student Employment: Perspectives From Supervising Practitioners, Brittany Begley Wildman

Theses and Dissertations--Educational Policy Studies and Evaluation

College student employees are not only serving the overall mission of their institutions, but also developing career readiness skills through daily interactions while at work. In this study, I explore the perceptions of the supervisors of student employees as both managers and student affairs professionals. Through one-on-one interviews with supervisors, discussing their interactions with students, I explore the implicit and explicit curricula they provide to their students using a curriculum analysis framework. I then compare the resulting learning outcomes against those identified in industry standards. The supervisors described supporting student employees' personal development during the student employment experience as well …