XDMoD Value Analytics: Visualizing the Impact of Internal IT Investments on External Funding, Publications, and Collaboration Networks


Many universities invest substantial resources in the design, deployment, and maintenance of campus-based cyberinfrastructure. To justify the expense, it is important that university administrators and others understand and communicate the value of these internal investments in terms of scholarly impact. This paper introduces two visualizations and their usage in the Value Analytics (VA) module for Open XD Metrics on Demand (XDMoD), which enable analysis of external grant funding income, scholarly publications, and collaboration networks. The VA module was developed by Indiana University’s (IU) Research Technologies division, Pervasive Technology Institute, and the Cyberinfrastructure for Network Science Center (CNS), in conjunction with the University at Buffalo’s Center for Computational Research (CCR). It provides diverse visualizations of measures of information technology (IT) usage, external funding, and publications in support of IT strategic decision making. This paper details the data, analysis workflows, and visual mappings used in two VA visualizations that aim to communicate the value of different IT usage in terms of NSF and NIH funding, resulting publications, and associated research collaborations. To illustrate the feasibility of measuring IT values on research, we measured its financial and academic impact from the period between 2012 and 2017 for IU. The financial return on investment (ROI) is measured in terms of IU funding, totaling $339,013,365 for 885 NIH and NSF projects associated with IT usage, and the academic ROI constitutes 968 publications associated with 83 of these NSF and NIH awards. In addition, the results show that Medical Specialties, Brain Research, and Infectious Diseases are the top three scientific disciplines ranked by the number of publications during the given time period.


Olga Scrivner1, Gagandeep Singh1, Sara E Bouchard1, Scott Hutcheson1, Ben Fulton2, Matthew R. Link2, Katy Börner1

1 Department of Intelligent Systems Engineering, School of Informatics, Computing and Engineering, Indiana University, Bloomington, Indiana, USA

2 Pervasive Technology Institute, Indiana University, Bloomington, Indiana, USA

High-Resolution Figures:

Figure 1: Data sources, data linkage, data preparation for XDMoD VA visualizations

Figure 2: NIH RePORTER online search query

Figure 3: JSON data schema for the Funding and Publication Impact visualization plugin

Figure 4: JSON data schema for the Co-PI Collaboration Network visualization plugin

Figure 5: XDMoD VA Portal, see interactive version at http://demo.cns.iu.edu/xdmod-p/portal.html

Figure 6: XDMoD VA Funding and Publication Impact Visualization, see interactive version at http://demo.cns.iu.edu/xdmod-p/impact.html.

Replicate Using
Sample Data: XDMoD_VA_Co-PI_Network_Visualization_Code.zip
NSF API Retrieval Code: nsfapi.py
Visualization Code: XDMoD_VA_Funding_and_Publication_Impact_Visualization_Code.zip
The UCSD Map of Science http://cns.iu.edu/2012-UCSDMap.html
Visualization: http://demo.cns.iu.edu/xdmod-p/impact.html

Figure 7: XDMoD VA Co-PI Network Visualization, see interactive version at http://demo.cns.iu.edu/xdmod-p/co-pi.html.

Replicate Using
Sample Data: XDMoD_VA_Funding_and_Publication_Impact_Data.zip
NSF API Retrieval Code: nsfapi.py
Visualization Code: XDMoD_VA_Co-PI_Network_Visualization_Code.zip
Visualization: http://demo.cns.iu.edu/xdmod-p/co-pi.html

Thank you to our generous sponsors: