Workshops

Photos:

Check out more photos on our Facebook

Organizers:

Workshop Goals & Agenda:

This 1 ½ day workshop brings together researchers and practitioners interested in the scientific development and proper usage of science metrics, science classifications, and science maps. Demonstration of existing approaches, tools, and techniques will provide a point of departure for a discussion of challenges and opportunities for developing scientifically sound standards for measuring and communicating the structure and dynamics of science and technology (S&T).

Among others, we will discuss:

S&T Metrics

• Strengths, weaknesses, and limitations of existing output and impact indicators.
• Properties that a good indicator of productivity and impact should have.
• What types of normalization should be performed to account for different disciplines?
• Skewness of distributions and scaling effects.
• Coverage of various databases
• Let’s explicitly avoid University Ranking systems (we don’t want the conversation to devolve into this area)

S&T Classifications

• Strengths, weaknesses, and limitations of existing classifications in bibliometric/science mapping context;  
• Properties a good classification should have in a science mapping context.
• Properties a good classification should have in a metrics context. Are classification properties for science mapping and metrics compatible?
• Development new classifications at the paper level that takes into account the nature / methods / objects of disciplines (and history, etc.), but also their citation characteristics;
• Dynamically evolving classifications that can capture data from 1900-today.
• How to classify interdisciplinary papers/journals.

S&T Mapping Standards

• Strengths, weaknesses, and limitations of existing science maps;  
• Properties a good science maps and  existing/emergent standards that help harmonize existing academic/government/industry standards.
• Align S&T classifications/maps with other ontologies, taxonomies to support cross-walks and mapping.

Cross-Cutting

• Discuss setup of an international 'interest group' that reviews and approves new standards as they become available, analogous to what is common in Semantic Web community.
• Write joint publication in major journal that reviews state of the art and promotes desirable futures.

Given the diverse backgrounds of the participants and the goals of the workshop, we will start with brief self-introductions; followed by three 30 min overview talks that set the stage for the workshop; and then brainstorming and discussion sessions in different team sizes and combinations.

If you would like to follow the workshop live, follow us on Twitter with the hashtag: #standards2011

Schedule:

Thursday, August 11, 2011

Friday, August 12, 2011

Participants Attending:

Jonathan Adams

Director, Research Evaluation, Thomson Reuters
PR^2 | Slides

Jeffrey Alexander

Senior Science and Technology Policy Analyst, SRI International
PR^2 | Slides

Gary Berg-Cross

Executive Secretariat of the Spatial Ontology Community of Practice (SOCoP)
PR^2 | Slides

Joseph Biberstine

Software Developer, Cyberinfrastructure for Network Science Center, Indiana University, Bloomington, IN
PR^2 | Slides

Johan Bollen

Associate Professor of Informatics, School of Informatics and Computing, Indiana University, Bloomington, IN
PR^2

Kevin Boyack

President, SciTech Strategies, Inc.
PR^2 | Slides

Margaret Clements

Visiting Faculty, School of Library and Information Science and School of Education, Indiana University, Bloomington
PR^2

Grégoire Côté

Vice-President, Bibliometrics Science-Metrix
PR^2 | Slides

Ying Ding

Assistant Professor, Information Science, SLIS, Indiana University, Bloomington, IN
PR^2 | Slides

Fernando Galindo-Rueda

Senior Economist, OECD
PR^2

Gali Halevi

Director of Government Marketing, Elsevier
PR^2 | Slides

Peter Hook

Doctoral Candidate School of Library and Information Science (SLIS), IU Bloomington
PR^2 | Slides

Loet Leydesdorff

Professor, University of Amsterdam, Amsterdam School of Communications Research (ASCoR)
PR^2 | Slides

Stasa Milojevic

Assistant Professor of Library and Information Science, SLIS, Indiana University, Bloomington, IN
PR^2 | Slides

Henk Moed

Senior Scientific Advisor, Elsevier
PR^2

Abel L. Packer

SciELO Project, Foundation of the Federal University of São Paulo
PR^2

Nigam Shaha

Assistant Professor, Stanford University
PR^2

Andre Skupin

Associate Professor of Geography, San Diego State University
PR^2 | Slides

Cassidy Sugimoto

Assistant Professor of Library and Information Science, SLIS, Indiana University, Bloomington, IN
PR^2 | Slides

Edmund Talley

Program Director, Channels Synapses and Circuits Cluster, National Institute of Neurological Disorders and Stroke
PR^2

Caroline Wagner

Milton & Roslyn Wolf Chair of International Affairs Director, Battelle Center for Science and Technology Policy, Ohio State University
PR^2

Interested But Cannot Attend:

Eric Archambault

President and CEO, Science-Metrix

Lynda Carlson

NCSES Director, National Science Foundation

Yuko Harayama

Deputy Director of the OECD’s Directorate for Science, Technology and Industry (STI)

Jim Hendler

Professor, Computer Science and Cognitive Science, Rensselaer, Polytechnic Institute, Troy, NY and Tetherless World Constellation

Igami Matsatsura

Senior Researcher, National Institute of Science and Technology Policy (NISTEP)

Mark Musen

Professor of Medicine (Biomedical Informatics); Division Head (BMIR); Co-Director, Biomedical Informatics Training Program, Stanford Center for Biomedical Informatics Research

References

Declan Butler, Computing giants launch free science metrics, Nature  476 (2011), accessed August 12, 2011, doi:10.1038/476018a.

Science, Technology, and Innovation Indicators, accessed August 12, 2011, http://sti-indicators.ning.com/.

W. Glänzel, Proceedings of the Workshop on Bibliometric Standards, Scientometrics 35 (1995), doi: 10.1007/BF02018474.

Travel/Housing:

Please contact Samantha Hale (sjhale@iu.edu) to arrange travel.

Directions:

See the contact page for the Cyberinfrastructure for Network Science Center, http://cns.iu.edu/contact.html or contact Samantha Hale (ude.anaidni@elahjs).

Acknowledgments:

This effort is supported by the James S. McDonnell Foundation and Cyberinfrastructure for Network Science Center at Indiana University.