Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 30 of 37

Full-Text Articles in Educational Assessment, Evaluation, and Research

Ramp Research Analytics Mentorship Program, Andrea Christelle, Lou Hurst, Baron Wolf Jan 2024

Ramp Research Analytics Mentorship Program, Andrea Christelle, Lou Hurst, Baron Wolf

Research Analytics Summit 2024

No abstract provided.


It’S About Time: Gaining Insights From Turnaround Time Metrics, Julia Zappi, Christopher Perkins Jan 2024

It’S About Time: Gaining Insights From Turnaround Time Metrics, Julia Zappi, Christopher Perkins

Research Analytics Summit 2024

Rutgers University is a R1 Research Institution with $929M in Sponsored Research funding in FY 2023 and $747M in Research Expenditures in 2022 as per the HERD survey. Since forming in 2019, the Data, Analytics and Business Intelligence team within the Office for Research has grown to three members, all with the mission of providing accurate and timely data about the Rutgers research enterprise for both internal leadership and decision makers across the university.

The Office for Research leadership was receiving complaints from the field about sponsored research awards taking too long to be set up. The Data, Analytics and …


Using Agency Data For Research Development, Lou Hurst Jan 2024

Using Agency Data For Research Development, Lou Hurst

Research Analytics Summit 2024

This session will explore ways to locate, analyze, and present sponsor-provided data to guide research development. Individual investigators, who may be proposing to a funder for the first time, often want to know about funding success rates, as well as more nuanced insight into the kinds of projects agencies tend to favor. They may also benefit from insight into changing workforce demographics and career trajectories in their discipline. At the departmental and institutional level, leadership seeks information about trends in funding availability and mechanisms, and in patterns of grants made, to better position themselves for these opportunities. As a research …


Generating Reliable Collaboration Data: A Proof-Of-Concept Project Using Research Administration Data, Christopher Perkins, Julie Zappi Jan 2024

Generating Reliable Collaboration Data: A Proof-Of-Concept Project Using Research Administration Data, Christopher Perkins, Julie Zappi

Research Analytics Summit 2024

Central administration at Rutgers University requested help from the Office for Research to develop a proof-of-concept tool to count collaborations between faculty, departments, schools and chancellor units across the university. This presentation will discuss how the Data, Analytics and Business Intelligence team focused on research administration and research output data to define a “collaboration,” structure available data, create interactive visualizations and allow end users to customize the level of detail displayed.

This presentation will begin by discussing the importance of generating reliable collaboration data in a university setting including use cases for the data. It will then describe the dataset …


Making The Most Of What You Have: Data To Optimize Space And Achieve Research Goals, Paul Leef Jan 2024

Making The Most Of What You Have: Data To Optimize Space And Achieve Research Goals, Paul Leef

Research Analytics Summit 2024

Every institution has a strategic goal for more research funding and results. The drive for funding is inextricably tied to competition for top researchers, and competition for researchers is directly related to investments in and optimization of research space on university campuses. The case for focusing on space is critical when you expect each lab to produce $1 million or more in expenditures every 4 years. How can you use data analytics to optimize space allocation for research? How can you creatively use under-utilized spaces for short- and long-term research investments? This session will discuss Carnegie R2 and R1 and …


From Policy Sources To Research Information Management Sources: Incorporating Multiple Bibliographic Data Sources Into Dashboard Analytics, Rachel Miles Jan 2024

From Policy Sources To Research Information Management Sources: Incorporating Multiple Bibliographic Data Sources Into Dashboard Analytics, Rachel Miles

Research Analytics Summit 2024

As the availability of bibliographic data becomes more diverse and unique, so do the complexities of those sources. As a result, it can be challenging and daunting to analyze such data, especially from a single research analytics service request. In this session, the presenter will demonstrate examples of building dashboards to analyze data for research outputs of a college using data from a research information management system, a policy database, and a bibliographic database. Attendees will learn about the advantages of using RIM systems to perform analytics as well as their shortcomings; they’ll also learn how to export data from …


Welcome Address, Baron Wolf Jan 2024

Welcome Address, Baron Wolf

Research Analytics Summit 2024

No abstract provided.


Where Do I Start?, Andrea Crystelle, Lori Schultz Jan 2024

Where Do I Start?, Andrea Crystelle, Lori Schultz

Research Analytics Summit 2024

In this session, we will start at the beginning and talk about what you need to think about in setting up research analytics capabilities for your organization. There are so many options for tools and other resources to get started, but what if you only have Excel? How do you get reporting off the ground when it hasn’t been done (or done consistently) at your workplace? We’ll talk about ways to get started, including who you need to talk with, what you need to consider, and how to move forward with basic reporting.


You Are What You Eat ... And Enter Into Data Fields, Hansa Magee, Nick Bilyk Jan 2024

You Are What You Eat ... And Enter Into Data Fields, Hansa Magee, Nick Bilyk

Research Analytics Summit 2024

No abstract provided.


Representing Your Institution Through Data, Lou Hurst Jan 2024

Representing Your Institution Through Data, Lou Hurst

Research Analytics Summit 2024

In this session, we will consider how to use place-based data to build your case to sponsors for funding research at your institution, particularly for sponsors who operate on the national or international scale. The setting of your institution—the communities it developed in, the region where it operates, and the people it reaches and serves—is key for conveying its unique capacities and potentials, and for making sponsors eager to bring you into their funding portfolio. How can data help you introduce yourself as an institution and tell your story in geographical and economic context? In this session we will explore …


Answering Big Questions With Big Data: Using Analytics Across The Research Ecosystem, Ann Beynon Jan 2024

Answering Big Questions With Big Data: Using Analytics Across The Research Ecosystem, Ann Beynon

Research Analytics Summit 2024

The research landscape continues to shift and evolve. With challenges around research integrity and security growing, research leaders must rely on the highest quality data to make confident decisions. Universities and funders need to understand the societal impact of research investments in addition to the scholarly impact. Has research helped to advance the UN Sustainable Development Goals? What are the emerging research areas that will lead to commercial innovations and sustainability advancements? We will discuss how quantitative data from Web of Science and InCites can help research stakeholders understand these big questions and inform their strategic research decisions.


A Data Driven Approach To Research Enterprise Growth And Infrastructure Design, Marisa Zuskar, Gabby Labayen Jan 2024

A Data Driven Approach To Research Enterprise Growth And Infrastructure Design, Marisa Zuskar, Gabby Labayen

Research Analytics Summit 2024

As proposal, subaward, award, and agreement volumes continue to grow at your institution, how can you strategize to support the size of your research infrastructure? How can you justify the expansion of your teams and talent? How do you adjust roles and workload to align with the growing portfolio? What technology considerations should you make to track this?

This session will cover how to leverage data to make effective business decisions regarding resource needs and allocation methodology to meet growing demands, starting with your internal data and then looking externally. We will cover strategies for using data analytics to efficiently …


Research Analytics Maturity Model & Herd: Transforming Tomorrow By Using Data To Drive Decisions, Baron Wolf, Katherine Leung Robershaw Jan 2024

Research Analytics Maturity Model & Herd: Transforming Tomorrow By Using Data To Drive Decisions, Baron Wolf, Katherine Leung Robershaw

Research Analytics Summit 2024

No abstract provided.


The Balancing Act: Data Analytics And Radical Invention, Andrea Christelle, Baron Wolf Jan 2024

The Balancing Act: Data Analytics And Radical Invention, Andrea Christelle, Baron Wolf

Research Analytics Summit 2024

Metrics and analytics are becoming indispensable tools for guiding decision-making and resource allocation. That’s why we are all at this conference. However, what happens when the path to innovation veers off the beaten track, to such an extent that metrics don’t capture it? This session will delve into the delicate balance between relying on metrics and fostering revolutionary invention by exploring how research administrators can strategically harness analytics while also nurturing the creative space necessary for groundbreaking discovery.

This thought-provoking session will engage participants in a dialog that considers the unanticipated nature of invention, and how it can be fostered, …


Navigating Faculty Activity Reporting: Maximizing Transparency And Efficiency, Kathy Felts, Michael Katz, Jenny Hulsen Jan 2024

Navigating Faculty Activity Reporting: Maximizing Transparency And Efficiency, Kathy Felts, Michael Katz, Jenny Hulsen

Research Analytics Summit 2024

Join us as we embark on a journey through the intricacies of faculty activity reporting, exploring strategies to maximize transparency and efficiency. This presentation will dive into the essential components of faculty activity reporting, examining the benefits/challenges, and providing best practices. Discover how leveraging Academic Analytics can streamline workflows, enhance data accuracy, and save faculty time and effort.


Finding And Hiring A Research Analyst Unicorn, Hansa Magee, Nick Bilyk Jan 2024

Finding And Hiring A Research Analyst Unicorn, Hansa Magee, Nick Bilyk

Research Analytics Summit 2024

As more data analytics programs pop up, we see graduates with these degrees and certificates in our applicant pool. However, the analyst that works in higher ed administration is not like a data scientist that looks for biomarkers in genomic data or the programmer that writes in R all day. What are the skills needed for this job? What exactly is this job that we are hiring for? Should managers prioritize applicants with analytics certificates? Or is experience with sponsored projects more important? We (your presenters) don’t have perfect answers but we (the collective conference attendees) can come up with …


Co-Authorship Maps To Support Leadership Selection, Robert Hc Chen Jan 2024

Co-Authorship Maps To Support Leadership Selection, Robert Hc Chen

Research Analytics Summit 2024

VOSViewer co-authorship mapping is a powerful tool typically used for analyzing research collaboration. Users provide publication data and VOSViewer produces a map where authors are plotted on a 2-dimensional map based on how often they are in the author lists of the same publication.

In this presentation, I propose a series of tweaks to the input data that can leverage co-authorship maps to support leadership selection based on how often candidates co-author papers with their institutional peers and some of the attributes of these papers. I will suggest how best to interpret the resulting maps and address the major assumptions …


Leveraging Herd Data To Understand Institutions’ Competitive Edge, Growth Potential, And Strategic Collaborations, Hanin Alhaddad, Joshua Roney Jan 2024

Leveraging Herd Data To Understand Institutions’ Competitive Edge, Growth Potential, And Strategic Collaborations, Hanin Alhaddad, Joshua Roney

Research Analytics Summit 2024

This presentation delves into understanding institutional strengths, weaknesses, and areas of growth potential within the landscape of higher education. Leveraging data from the Higher Education Research (HERD) survey, we analyze research expenditures in ten broad scientific fields and forty sub-detailed research fields across higher educational institutes in the United States. We utilize macro and microeconomics methodologies to analyze and identify research specializations by institution, along with research fields exhibiting high growth potential. This comprehensive approach aims to offer valuable insights for strategic planning, fostering smart collaborations, and guiding investments to nurture growth within an institution.


Exploring Research Metadata Governance With Design Thinking, Scott Woods, Natalie Simonson Jan 2024

Exploring Research Metadata Governance With Design Thinking, Scott Woods, Natalie Simonson

Research Analytics Summit 2024

If you want great research analytics, you’re going to need great data governance for your research metadata. That’s a tall order when the best information often spans incompatible systems, departments, policies, and mindsets.

Research metadata governance is a great illustration of how research analytics is not just a technology problem. It happens at the intersection of technology, policy, process, and culture. Do any of us feel like our organization is “nailing” metadata governance? What level of research analytics could you achieve if there could be more alignment and cooperation around this kind of governance?

In this session, you will join …


Bringing Artificial Intelligence To Research Analytics Research Highlighter-Matchmaker At Suny Ualbany, Tianning Huang, Yuemin Li Jan 2024

Bringing Artificial Intelligence To Research Analytics Research Highlighter-Matchmaker At Suny Ualbany, Tianning Huang, Yuemin Li

Research Analytics Summit 2024

Research analytics has become an indispensable part in today’s higher education institutions’ organizational structure. It not only provides a mechanism or platform to present research awards and expenditures data to internal and external data users, but also serves a superior tool that enables data-driven strategic decision makings with more reliable, valid, and in-depth analysis. The development of Artificial Intelligence techniques could push the boundary of Research Analytics to an even higher level by incorporating the abundance of data scattered across the university. We propose to present one attempt adopted by University at Albany, State University of New York (UAlbany) to …


Collabnext -A Person-Focused Open Knowledge Graph For Collaborations With Emerging Researchers, Lew Lefton Jan 2024

Collabnext -A Person-Focused Open Knowledge Graph For Collaborations With Emerging Researchers, Lew Lefton

Research Analytics Summit 2024

CollabNext is being developed as part of the NSF ProtoOKN (Prototype Open Knowledge Network) effort. This project originated as a partnership between Georgia Tech and the Atlanta University Center, and is now being developed jointly by Fisk University, Georgia Tech, Morehouse College, Texas Southern University, and University at Buffalo with support from the NSF TIP Directorate.

Our goal is to develop a knowledge graph based on people, organizations, and research topics. We are adopting an intentional design approach which initially prioritizes HBCUs and emerging researchers in a deliberate effort to counterbalance the Matthew effect, a naturally accumulated advantage of well-resourced …


Evaluating A Pi Policy With Data, Lori Ann M. Schultz Jan 2024

Evaluating A Pi Policy With Data, Lori Ann M. Schultz

Research Analytics Summit 2024

At our organizations, policies are often implemented then never reviewed again. We often don’t know why the policy existed in the first place. In this session, we will discuss how the data we already collect can be used to evaluate existing policies, proposed policies, and potential changes. We will walk through an example of how a proposed institutional policy was examined through the use of data on research proposals and awards, and answer the question “Do we really need this policy?” Bring your examples to talk through options for policy evaluation!


The Role Of Ai In Research, Robert Pilgrim Jan 2024

The Role Of Ai In Research, Robert Pilgrim

Research Analytics Summit 2024

General discussion session about how you at your institution are using or trying to deploy AI within research administration. This will be an informal discussion session.


Introducing A ‘Research Impact Roadmap’ In A Young University: Challenges And Opportunities, Roopa Rajashekar Jan 2024

Introducing A ‘Research Impact Roadmap’ In A Young University: Challenges And Opportunities, Roopa Rajashekar

Research Analytics Summit 2024

‘Research Impact’ as a defined concept is expanding and garnering more attention globally. What was once positioned more narrowly and often confused with basic outcomes reporting has since risen to a primary focus for sponsor agencies across all stages of R&D. Hence, building a comprehensive research impact framework provides a critical map for universities to strengthen the R&D ecosystems in which it engages in innumerable ways.

Khalifa University of Science and Technology (KU), located in Abu Dhabi, UAE, is a relatively a young university, by Times Higher Education definition). Even so, KU ranked 238 in the QS World University Rankings …


Data Governance And Stewardship 101, Lori Ann M. Schultz Jan 2024

Data Governance And Stewardship 101, Lori Ann M. Schultz

Research Analytics Summit 2024

This session will be an introductory conversation to understand the fundamentals of data governance and stewardship. Attendees will be introduced to the core principles of data governance and the role of data stewards. We will talk about strategies for governance and stewardship at your institution, and how to work within roles and frameworks that may already exist at your institution. We’ll also talk about how to build this framework and external considerations you need to consider.


Building Research Collaboration Networks: Leveraging Sponsored Research Data, Robert Pilgrim Jan 2024

Building Research Collaboration Networks: Leveraging Sponsored Research Data, Robert Pilgrim

Research Analytics Summit 2024

Discover how to transform standard research award/proposal reports into dynamic visualizations of your research collaborations using Microsoft Power BI and custom visuals. This session guides you through creating interactive networks to visualize your research community. While we'll touch on network analysis, detailed statistical discussions are beyond the scope of this session. Participants are encouraged to bring a laptop and their data, although dummy data will be available. We'll cover data loading and transformation in Microsoft Power BI, employing custom visuals for network generation, and we will explore practical applications of research networks. Please download Microsoft Power BI Desktop beforehand if …


Introduction To Research Administrations Dashboards Using Tableau, Alex Wagner Jan 2024

Introduction To Research Administrations Dashboards Using Tableau, Alex Wagner

Research Analytics Summit 2024

This session will present on how to develop basic research administration dashboards using Tableau. A sample research administration dataset will be provided in Excel for anyone who would like to work along. Using that data set the presenter will show step by step how to import the data into Tableau and how to create basic worksheets and dashboards. Calculations and filters will be shown also. Attendees should download a trial version of Tableau the same week as the conference if they would like to work along the presenter.


Using Public Policy Citation Data In University Decision Making: Understanding, Sharing And Responsible Use, Euan Adie Jan 2024

Using Public Policy Citation Data In University Decision Making: Understanding, Sharing And Responsible Use, Euan Adie

Research Analytics Summit 2024

The 2018 Evidence Act has mandated US government departments and agencies to be much clearer about their research agendas and the engagement they want with academic researchers and institutions. Tracking those engagements has become easier as data providers increasingly supply information on policy engagement or policy citations, tracking where academics at an institution have been cited in or mentioned by name in government reports and policy documents at a local, state or federal level. This session covers the processes, policies and best practice you need to put in place to start using policy engagement data responsibly, both to track and …


Successfully Implementing Research Analytics And Dashboards Without Scaring Or Scarring Anyone!, Alex Wagner Jan 2024

Successfully Implementing Research Analytics And Dashboards Without Scaring Or Scarring Anyone!, Alex Wagner

Research Analytics Summit 2024

The use of data and analytics in the field of research administration remains in explorations stages for many, if not most, higher education institutions. That is evidenced not only by the great demand and attendance seen for such sessions at NCURA’s Annual Meetings in 2022 and 2023, but also via prior research. This presentation will highlight the efforts implementing data-informed decision making based on research administration metrics, analytics, and dashboard examples. Emphasis will be placed on that you can’t manage what you can’t measure. The data analytics team at Emory supports all visions of our research administration leadership. Challenges, pain …


Radtrials: Clinical Trial Startup Tracker At Radiology, Anna Romanowska-Pawliczek Jan 2024

Radtrials: Clinical Trial Startup Tracker At Radiology, Anna Romanowska-Pawliczek

Research Analytics Summit 2024

Clinical study startup is one of the most time and resource-intensive parts of the clinical trials. Its impacts are long-lasting, as delays can affect the study conduct. For study startups, 85% of the industry still relies on Excel spreadsheets. But spreadsheets are passive – they don’t allow you to proactively manage activities and don’t tell you where to focus your attention. We designed, implemented, and now fully adopted a new comprehensive workflow centered around a Smartsheet-based solution with automated reports and dashboards for clinical research coordinators (CRCs), managers, faculty, and leadership. We seek to standardize the startup process across the …