JSMF Workshop on Standards for Science Metrics, Classifications, and Mapping
August 11-12, 2011
Check out more photos on our Facebook
Workshop Goals & Agenda:
This 1 ½ day workshop brings together researchers and practitioners interested in the scientific development and proper usage of science metrics, science classifications, and science maps. Demonstration of existing approaches, tools, and techniques will provide a point of departure for a discussion of challenges and opportunities for developing scientifically sound standards for measuring and communicating the structure and dynamics of science and technology (S&T).
Among others, we will discuss:
- Strengths, weaknesses, and limitations of existing output and impact indicators.
- Properties that a good indicator of productivity and impact should have.
- What types of normalization should be performed to account for different disciplines?
- Skewness of distributions and scaling effects.
- Coverage of various databases
- Letâ€™s explicitly avoid University Ranking systems (we donâ€™t want the conversation to devolve into this area)
- Strengths, weaknesses, and limitations of existing classifications in bibliometric/science mapping context;
- Properties a good classification should have in a science mapping context.
- Properties a good classification should have in a metrics context. Are classification properties for science mapping and metrics compatible?
- Development new classifications at the paper level that takes into account the nature / methods / objects of disciplines (and history, etc.), but also their citation characteristics;
- Dynamically evolving classifications that can capture data from 1900-today.
- How to classify interdisciplinary papers/journals.
S&T Mapping Standards
- Strengths, weaknesses, and limitations of existing science maps;
- Properties a good science maps and existing/emergent standards that help harmonize existing academic/government/industry standards.
- Align S&T classifications/maps with other ontologies, taxonomies to support cross-walks and mapping.
- Discuss setup of an international 'interest group' that reviews and approves new standards as they become available, analogous to what is common in Semantic Web community.
- Write joint publication in major journal that reviews state of the art and promotes desirable futures.
Given the diverse backgrounds of the participants and the goals of the workshop, we will start with brief self-introductions; followed by three 30 min overview talks that set the stage for the workshop; and then brainstorming and discussion sessions in different team sizes and combinations.
If you would like to follow the workshop live, follow us on Twitter with the hashtag: #standards2011
Thursday, August 11, 2011
|12:00pm||Welcome by Organizers (Katy Börner and Vincent Lariviare)|
|12:15pm||Introduction by Participants (7 min per person/organization)|
|3:30pm||Overview Talks (15-20 mins plus 5 mins discussion each
|5:30pm||Discussion of Opportunities and Challenges|
Joint dinner at Farm brainstorm in preparation for Friday
Friday, August 12, 2011
|9:30am||Breakout Session on "Metrics, Classifications and Mapping"
[Session 1 | Session 2 | Session 3]
|10:30am||Breakout Session Reports|
|11:30am||Second Best Ideas|
|12:30pm||Joint Working Lunch|
|1:00pm||Breakout Session on "Evolving Standards"
[Session 1 | Session 2 | Session 3]
|2:30pm||Breakout Session Reports|
|3:30pm||Interactive Timeline Assembly|
Associate Professor of Informatics, School of Informatics and Computing, Indiana University, Bloomington, IN
Senior Economist, OECD
Senior Scientific Advisor, Elsevier
Abel L. Packer
SciELO Project, Foundation of the Federal University of SÃ£o Paulo
Assistant Professor, Stanford University
Program Director, Channels Synapses and Circuits Cluster, National Institute of Neurological Disorders and Stroke
Milton & Roslyn Wolf Chair of International Affairs Director, Battelle Center for Science and Technology Policy, Ohio State University
Interested But Cannot Attend:
President and CEO, Science-Metrix
NCSES Director, National Science Foundation
Deputy Director of the OECDâ€™s Directorate for Science, Technology and Industry (STI)
Professor, Computer Science and Cognitive Science, Rensselaer, Polytechnic Institute, Troy, NY and Tetherless World Constellation
Senior Researcher, National Institute of Science and Technology Policy (NISTEP)
Professor of Medicine (Biomedical Informatics); Division Head (BMIR); Co-Director, Biomedical Informatics Training Program, Stanford Center for Biomedical Informatics Research
Please contact Samantha Hale (firstname.lastname@example.org) to arrange travel.
This effort is supported by the James S. McDonnell Foundation and Cyberinfrastructure for Network Science Center at Indiana University.