Digital Commons Network^™

The university research environment has been undergoing profound change in recent decades. Aiming at international competitiveness and excellence, a variety of polices have been designed and implemented in many countries. However, evidence-based analysis of policy effects is scarce. This paper develops methods for evaluating the effect of university research policy on university system research input-output dynamics. We assume stable dynamics between inputs and outputs, and that effective policy change introduces external interventions and therefore structural changes into the system. Our proposed method involves three steps: modeling system dynamics, detecting structural change, and mapping policy change. Examining the case of the …

This paper proposes a method for classifying true papers of a set of focal scientists and false papers of homonymous authors in bibliometric research processes. It directly addresses the issue of identifying papers that are not associated (“false”) with a given author. The proposed method has four steps: name and affiliation filtering, similarity score construction, author screening, and boosted trees classification. In this methodological paper we calculate error rates for our technique. Therefore, we needed to ascertain the correct attribution of each paper. To do this we constructed a small dataset of 4,253 papers allegedly belonging to a random sample …

Creative use of bibliometric analysis in evaluation offers an unparalleled opportunity to take advantage of the rich information embedded in the written products of scientific work to track the output and influence of funded scholars. Many metrics and techniques have been developed: from publication and citation counts to percentile rankings, h-index, impact factor, maps of the knowledge landscape, maps of geographical distribution, and metrics of interdisciplinarity and specialization. Analysis can demonstrate evolution over long periods of time, and can draw quantitative comparisons among subgroups or with others anywhere in the world. It would be dangerous to consider such data and …