Workshop: "Semantic analysis for innovation policy"

Introduction

12-13 March 2018

Paris - OECD Conference Centre

 

 

 

 

The digital transformation offers new tools for innovation policy analysis. With software developments and increased computing capacities, the possibility to systematically exploit textual information, as illustrated by the analysis of the OECD TIP working party reports that were conducted in the context of the TIP@50 event, has grown enormously. The types of data that can be usefully analysed to support STI policy are broad, ranging from official policy papers and evaluations, to administrative data held in government databases, to social media. Such analysis can help identify emerging trends and monitor policy progress over time. However, while semantic analysis holds enormous promise, careful data preparation and exploitation are needed, otherwise results may be misleading. The objective of the workshop is to shed further light of the potential of semantic analysis, highlighting the caveats and challenges on the way. The workshop will also focus on the specific semantic analysis that was conducted of TIP documents. 

 

DRAFT AGENDA (Version: 21 February 2018) (PDF)

 

Shortcut URL: www.innovationpolicyplatform.org/semantics

Organisation

The workshop is a joint workshop of the CSTP (the DSIP and REITER projects), and the TIP working party, relating to its ongoing projects on open and digital innovation and on assessing the impacts of knowledge transfer and policy.

The workshop is organised back-to-back with the CSTP-TIP workshop on 14 March that will explore new models and business perspectives on knowledge transfer between industry and science.

There is also a workshop on 13 March organised by the CSTP and GSF on open data.

The workshop is organised around two related but separate topics. Delegates who would like to participate in on either one of the two days can do so:

DAY 1: Semantic analysis of TIP documents & best practice in semantic analysis (12 March)

DAY 2: Semantic analysis to investigate knowledge transfer and innovation policy (13 March)

Objectives of the workshop

 

  • Explore the potential of semantic analysis to exploit qualitative information for innovation policy analysis on knowledge transfer between industry and science in particular
  • Learn about existing national initiatives that semantically exploit large datasets to inform policy making and analysis
  • Get a hands on experience of the possibilities of text-mining (and its limitations)
  • Learn more about the evolution of innovation policy from text-mining of the TIP corpus

Draft agenda

DAY 1: Monday, 12 March 2018 - Semantic analysis of TIP documents & best practice in semantic analysis

9h00 - 9h15: Coffee

9h15-9h30: Welcoming and introduction to the workshop

  • Dominique Guellec, Head of Division, Directorate for Science, Technology and Innovation, OECD
  • Michael Keenan (Senior Policy Analyst, OECD) and Caroline Paunov (Senior Economist, OECD) 

9h30-11h00: Session 1 - Potential, best practice and caveats in issuing semantic analysis

The session will introduce the basics of semantic analysis (methods, software tools, principles and challenges) to establish a common ground for discussion between experts and non-experts alike and focus notably on the following issues:

  • What can be done using semantics analysis in the field of innovation policy? What are some illustrative examples?
  • What are the steps that need to be undertaken to undertake such an analysis?
  • What are the strengths and caveats involved in such an analysis compared to more traditional types of analyses? 

Chair: Dominique Guellec, Head of Division, Directorate for Science, Technology and Innovation, OECD

Speakers :

Roundtable discussion involving Mary-Ann Grosset, Digital Practice Team Manager at OECD; Philippe Laredo, Research Director at Université Paris-Est and Professor at Manchester University; Juan Mateos, Head of Innovation Mapping, NESTA, United Kingdom; and Margherita Russo, Professor at University of Modena and Reggio Emilia, Italy. 

11h00 - 11h30: Coffee break

11h30-13h00: Session 2 - In-depth exploration of the semantic analysis of TIP documents

The session will allow for an in-depth discussion of the semantic analysis that was conducted in support of the TIP@50 event and focus in particular on the following questions:

  • How has innovation policy thinking changed in what is reflected in 25 years of TIP policy discussions?
  • What trends can be identified over the period?
  • What lessons can be taken from the work for the future of the TIP?

 

Chair: Caroline Paunov, Senior Economist, Directorate for Science, Technology and Innovation, OECD

Speakers : 

  • Michael Keenan, Senior Policy Analyst, Directorate for Science, Technology and Innovation, OECD
  • Margherita Russo, Professor, University of Modena and Reggio Emilia, Italy; and Pasquale Pavone, Researcher, Research Centre for the Analysis of Public Policies (CAPP), University of Modena and Reggio Emilia, Italy
  • Dirk Meissner, Professor,  National Research University - Higher School of Economics, Russian Federation
  • Philippe Laredo, Research Director at Université Paris-Est and Professor at Manchester University; and Antoine Schoen, Professor, ESIEE Paris, France

13h00 - 14h30: Lunch break

14h30 - 16h00: Session 3 - The making of the TIP@50 analyses

The session will focus on what lays behind producing the TIP@50 analyses and will offer interested participants an opportunity to do a simple analysis:

  • What material was used and how did the choices of how the material was organised and analysed affect the analysis?
  • What software decisions were made? What are the costs involved in using such software? What is freely available and what is proprietary?
  • How can these analyses be applied to other types of analysis of innovation policy?  

Chair: Michael Keenan, Senior Policy Analyst, Directorate for Science, Technology and Innovation, OECD

Speakers : 

  • Jan-Anno Schuur, Information Systems Specialist, OECD; Andrés Barreneche, Policy Analyst, OECD
  • Margherita Russo, Professor, University of Modena and Reggio Emilia, Italy; and Pasquale Pavone, Researcher, Research Centre for the Analysis of Public Policies (CAPP), University of Modena and Reggio Emilia, Italy
  • Dirk Meissner, Professor,  National Research University - Higher School of Economics, Russian Federation
  • Philippe Laredo, Research Director at Université Paris-Est and Professor at Manchester University; and Antoine Schoen, Professor, ESIEE Paris, France

16h00 - 16h30: Coffee break

16h30 - 18h00: Session 4 - Hands-on exercise

The session will allow participants to produce a simple semantic analysis with the support of those involved in the TIP@50 analysis. This will require bringing a laptop. Instructions for any installation will be sent prior to the workshop. More details will be provided. 

  • Antoine SchoenReplicating results from TIP@50 analysis using Cortext

DAY 2: Tuesday, 13 March 2018 - Semantic analysis to investigate knowledge transfer and innovation policy

9h00 - 9h15: Coffee

9h15 - 9h45: Brief summary of main conclusions of 13 March regarding semantic analysis

9h45 - 11h15: Session 5a - Examples of semantic analysis conducted to study knowledge transfer

This session will present different national initiatives that use semantic analysis to shed light on innovation policy and in particular on knowledge transfer between industry and science.

  • What new questions can be addressed using semantic analysis?
  • What information are they semantically analysing and how is this accessed?
  • What infrastructure requirements were needed to set them up?
  • What new answers have these studies identified, with a special focus on knowledge transfer? 

 

Chair: Frédérique Sachwald, Director, Observatoire des Sciences et des Techniques, HCERES, France (tbc)

Speakers: 

  • Antoine Schoen, Professor, ESIEE Paris, France: KNOWMAK
  • Sam Arts, Assistant Professor, KU Leuven, Belgium
  • Cinzia Daraio, Associate Professor, University of Rome La Sapienza, Italy 
  • Francesco Osborne, Research Fellow, Knowledge Media Institute, The Open University, UK

11h15 - 11h45: Coffee break

11h45 - 13h00: Session 5b - Examples of state-of-the art semantic analysis from business

The session will present business examples that while they do not directly apply innovation policy provide interesting tools for analysis.

 

Chair: András Hlács, Counsellor, Permanent Delegation of Hungary to the OECD

Speakers: 

  • Andrés Barreneche, Policy Analyst, Directorate for Science, Technology and Innovation, OECD
  • Juan Mateos, Head of Innovation Mapping, NESTA, United Kingdom 
  • Frédérique Sachwald, Director, Observatoire des Sciences et des Techniques, HCERES, France (tbc)

13h00 - 14h30: Lunch break

14h30 - 16h00: Session 6 - Hands-on exercise

  • Andrés Barreneche: Using REITER
  • Juan Mateos (tbc)

16h00 - 16h30: Coffee break

16h30 - 17h50: Session 8 - Concluding panel and next steps

  • What do you think is the potential and feasibility for semantic analysis in your own context?
  • What could be useful next steps to facilitate exchange on best practice?
  • How can CSTP and TIP provide support to help exploit the potential of these tools?
  • What other tools should be part of the basket to consider? 

 

Chair: Göran Marklund, Deputy Director General for External Matters, VINNOVA, Sweden

Speakers:

  • Cinzia Daraio. Associate Professor, University of Rome La Sapienza, Italy 
  • Frédérique Sachwald, Director, Observatoire des Sciences et des Techniques, HCERES, France (tbc)
  • Marnix Surgeon, Deputy Head of Unit, European Commission
  • Tiago Pereira, Head, Studies and Strategy Office, Foundation for Science and Technology (FCT), Portugal (tbc)

17h50 - 18h00: Wrap up

Michael Keenan and Caroline Paunov, OECD

Practical information

The OECD website provides practical information about how to get to the OECD Conference Centre where the event will be held.  

Content Visibility

Public

There is no content in this space.