www.uis.unesco.org measuring innovation: main definitions & indicators regional workshop on...

www.uis.unesco.org

Measuring innovation:Main definitions & indicators

Regional Workshop on Science, Technology and Innovation (STI) Indicators for Gulf countriesDoha, Qatar

15 to 17 October 2012

www.uis.unesco.org

Measuring Innovation

Oslo Manual: Guidelines for collecting

and interpreting innovation data

UIS - Annex (OM, 2005): Innovation Surveys in Developing Countries

www.uis.unesco.org

WhyWhy measure innovation?

Innovation and economic development;

Innovation is more than R&D;

Innovation policy should be evidence-based;

Innovation data…

• Understanding of innovation and its relation to economic growth;

• Indicators for benchmarking national performance.

www.uis.unesco.org

WhatWhat is innovation?

Innovation is the implementation of:

• New or significantly improved product or process;

• New marketing or organisational method.

Implementation:

A new or improved product is implemented when it is introduced on the market;

New processes, marketing methods or organisational methods are implemented when they are brought into actual use in the firm’s operations.

www.uis.unesco.org

The innovation measurement framework

www.uis.unesco.org

Types of innovation - Product (1)

Product Innovation:

• Introduction of a good or service that is new or significantly improved with respect to its characteristics or intended uses;

• New products: different characteristics or intended uses from previous products;

• Significantly improvements: changes in materials, components, and other characteristics that enhance performance.

www.uis.unesco.org

Types of innovation - Product (2)

Product Innovation - examples:• New products:

» The first microprocessors;

» The first digital cameras;

» The first portable MP3 player;

• Significantly improvements: » Introduction of ABS braking, GPS navigational systems, or

other subsystem improvements in cars;

» The use of breathable fabrics in clothing;

» Improvements in internet banking services, such as greatly improved speed and ease of use.

www.uis.unesco.org

Types of innovation - Process (1)

Process Innovation:

• Implementation of a new or significantly improved production or delivery method (changes in techniques, equipment and/or software);

• Intended to: decrease unit costs of production or delivery, increase quality, or produce or deliver new or significantly improved products.

www.uis.unesco.org

Types of innovation - Process (2)

Process Innovation - examples:

» Introduction of a bar-coded goods-tracking system;

» Introduction of GPS tracking devices for transport services;

» Implementation of computer-assisted design for product development;

» Implementation of a new reservation system in a travel agency.

www.uis.unesco.org

Types of innovation - Marketing (1)

Marketing Innovation:

• Implementation of a new marketing method involving significant changes in product design or packaging, product placement, product promotion or pricing;

• Better addressing customer needs, opening up new markets, or newly positioning a firm’s product on the market increasing firm’s sales;

• Marketing method NOT previously used - part of a new marketing concept or strategy;

• For both new and existing products.

www.uis.unesco.org


Marketing Innovation:

• Product design or packaging: changes in form and appearance that do not alter products’ functional or user characteristics + changes in the packaging;

• Product placement: new sales channels;

• Product promotion: new concepts for promoting a firm’s goods and services;

• Pricing: new pricing strategies to market the firm’s goods or services.

www.uis.unesco.org


Marketing Innovation - examples:

» Development and introduction of a fundamentally new brand symbol;

» First use of a significantly different media - product placement in a television programme;

» Introduction for the first time of a franchising system.

www.uis.unesco.org

Types of innovation - Organisational (1)

Organisational Innovation:

• Implementation of a new organisational method in the firm’s business practices, workplace organisation or external relations;

• Increase firm’s performance by reducing administrative/transaction costs, improving workplace satisfaction, accessing non-tradable assets, or reducing costs of supplies;

• Organisational method NOT used before - result of strategic decisions taken by management.

www.uis.unesco.org

Organisational Innovation:

• Business practices: implementation of new methods for organising routines and procedures for the conduct of work;

• Workplace organisation: new methods for distributing responsibilities and decision making among employees for the division of work within and between firm activities + new concepts for the structuring of activities;

• External relations: new ways of organising relations with other firms or public institutions.


www.uis.unesco.org

Organisational Innovation - examples:

» First implementation of a database of best practices;

» Establishment of new types of collaborations with research organisations;

» First implementation of an organisational model that gives the firm’s employees greater autonomy in decision making and encourages them to contribute their ideas.


www.uis.unesco.org

Diffusion and degree of novelty

Degree of novelty: • Firm;

• Market;

• World;

Radical innovations:• Significant impact on a market;

• Impact of innovations (as opposed to their novelty);

• May become apparent only long after introduction.

www.uis.unesco.org

Types of innovation - example

Innovation in a restaurant: • Product innovation: Product innovation: delivery (new service);

• Process innovation: Process innovation: new type of oven (new equipment used in the production process);

• Organisational innovation:Organisational innovation: new delivery unit (new organisational unit/model);

• Marketing innovation: Marketing innovation: billposting (new media for promoting the delivery service).

Note. Source: Adapted from Heinlo, A. (2011). Measuring R&D&I in Estonia. Almaty, Kazakhstan S&T Indicators Workshop. (PowerPoint Presentation)

www.uis.unesco.org

Innovation activities (1)

Innovation activities: all scientific, technological, organisational, financial and commercial steps which (intended to) lead to the implementation of innovations;

Some innovation activities are themselves innovative, others are not novel but necessary;

R&D not directly related to the development of a specific innovation.

www.uis.unesco.org


For product and process innovations:

• Intramural (in-house) R&D;

• Acquisition of (extramural) R&D;

• Acquisition of other external knowledge;

• Acquisition of machinery, equipment and other capital goods;

• Other preparations for product and process innovations;

• Market preparations for product innovations;

• Training.

www.uis.unesco.org


Preparations for marketing innovations:

• Activities related to the development and implementation of new marketing methods;

• It includes acquisition of other external knowledge and of machinery, equipment, and other capital goods and training;

• Expenditures for using these methods in daily business are NOT included.

www.uis.unesco.org


Preparations for organisational innovations:

• Activities undertaken for the planning and implementation of new organisation methods;

• It includes acquisition of other external knowledge and of machinery, equipment, and other capital goods and training.

www.uis.unesco.org

Kinds of innovation activities

Successful - resulted in the implementation of a new innovation (not necessarily commercially successful);

Ongoing - work in progress, which has not yet resulted in the implementation of an innovation;

Abandoned - before the implementation of an innovation.

www.uis.unesco.org

Classifying firms by degree of innovativeness

Innovative firm:• Implemented an innovation;

• Not necessarily a commercial success;

Innovation-active firm:• Had innovation activities - ongoing and/or abandoned;

• Regardless of implementation;

Potentially innovative firm:• Innovation efforts but no achieved results;

• Key element for innovation policy;

• (Annex).

www.uis.unesco.org

Factors influencing innovation

Objectives: Motives for innovating;

Effects: Observed outcomes of innovations (Table

9);• Impacts on firm performance;

• Time lag;

Hampering factors:• Reasons for not starting innovation activities at all;

• Factors that slow innovation activity or have a negative effect on expected results (Table 10).

www.uis.unesco.org

Linkages

Linkages: connections with other agents;

Source, cost, level of interaction;

Types of external linkages:

• Open information sources;

• Acquisition of knowledge and technology;

• Innovation co-operation.

www.uis.unesco.org

Sources for transfers of knowledge and technology

Open information

sources

Sources for purchases of knowledge

& technology

Co-operation partners

Internal sources within the enterprise: R&D / Production / Marketing / Distribution *

Other enterprises within the enterprise group * * *

External market and commercial sources:Competitors Other enterprises in the industry Clients or customersConsultants / consultancy firms SuppliersCommercial laboratories

***

**

**

***

******

Public sector sources:Universities and other higher education institutionsGovernment / public research institutesPrivate non profit research institutesSpecialised (semi) public innovation support services

****

****

****

General information sources:Patent disclosures / Professional conferences, meetings, literature and journals / Fairs and exhibitions / Professional associations, trade unions / Other local associations / Informal contacts or networks / Standards or standardisation agencies / Public regulations

*

www.uis.unesco.org

Appropriability

Ability of enterprises to appropriate gains from innovation activities:

• Formal methods: patents, registration of design, trademarks, copyrights, confidentiality agreements, trade secrecy;

• Informal methods: secrecy that is not covered by legal agreements, complexity of product design, lead time advantage over competitors.

www.uis.unesco.org

Developing countries

Developing countries 3rd ed. OM standards, adaptations;

LA: the Bogota Manual (RICYT, 2001);

UIS: Annex (A) to 3rd ed. OM;

Innovation Surveys in Developing Countries.

www.uis.unesco.org

Characteristics of innovation in developing countries

Size and structure;

Instability;

Informality;

Particular economic and innovation environments;

Reduced innovation decision-making powers;

Weak innovation systems;

Characteristics of innovation.

www.uis.unesco.org

Characteristics of innovation in developing countries

Potentially innovative firm;

Measurement priorities - why / what / how:

• Innovation capabilities (HR, Linkages, ICTs);

• Expenditure on innovation activities;

• Organisational innovation.

www.uis.unesco.org

Adaptations

ICTs in innovation surveys;

Linkages:• Agents + Types + Location;

Innovation Activities:• Hardware purchase and Software purchase (split);• Industrial design and Engineering activities (split);• Lease or rental of machinery, equipment and other capital goods;• In-house software system development;• Reverse engineering;

Human resources and training.

www.uis.unesco.org

Methodological issues for developing country contexts

Weakness of statistical systems;

Questionnaire design;

Survey application;

Frequency;

Publication;

Difficulties…• Lack of appreciation of the importance of innovation;• Managers are secretive about finance;• Lack of adequate legislative base.

Will be discussed later

www.uis.unesco.org

HowHow do we measure innovation? (1)

Indicators - definition:

• Statistics and data, often gathered through specialised surveys, are the building blocks from which indicators are constructed;

• An indicator can be defined as something that helps us understand where we are, where we are going and how far we are from a specific goal. Therefore it can be a sign, a number, a graphic;

• An indicator quantifies and simplifies phenomena and helps us understand complex realities.

Source: International Institute for Sustainable Development / Adapted from Blakley, W. (2012). Providing and calculating innovation

indicators. Cape Town, South Africa. ASTII/HSRC/UIS Workshop.(PowerPoint Presentation)

www.uis.unesco.org

HowHow do we measure innovation? (2)

Indicators - definition:

• Basic indicators: based on “one question”;

• Composite indicators: combine answers to several questions in order to examine a number of policy-relevant factors and better capture the diversity of innovative firms.

www.uis.unesco.org

Innovation indicators - examples (1)

Product or process innovation:

1. % of firms that implemented product innovation

2. % of firms that implemented process innovation

3. % of firms that implemented product or process innovation (innovative firms)

4. % of firms that developed in-house product or process innovation

5. % of firms that implemented new-to-market product innovation

www.uis.unesco.org


Product or process innovation:

1. % of firms that implemented product innovation

(N) =Number of firms that implemented product innovation (in each economic activity)

*100

(D) = Total number of firms (in each economic activity)

(N) =Number of Manufacturing firms that implemented product innovation

*100

(D) = Total number of Manufacturing firms

www.uis.unesco.org


Product or process innovation:Source: 2011 UIS Pilot Data Collection of Innovation Statistics

15

30

45

60

75

Brazil China Colombia Egypt Israel Malaysia Philippines RussianFederation

SouthAfrica

Uruguay

Product innovation Process innovation

www.uis.unesco.org


Marketing or organisational innovation:

1. % of firms that implemented marketing innovation

2. % of firms that implemented organisational innovation

3. % of firms that implemented marketing or organisational innovation

www.uis.unesco.org


Marketing or organisational innovation:

3. % of firms that implemented marketing or organisational innovation

(N) =Number of firms that implemented marketing or organisational innovation (in each economic activity)

*100

(D) = Total number of firms (in each economic activity)

(N) =Number of firms in the Electrical machinery industry that implemented marketing or organisational innovation

*100

(D) = Total number of firms in the Electrical machinery industry

www.uis.unesco.org


Inputs:

1. Total expenditures on innovation (as a % of total turnover)

2. Expenditure on innovation by type of expenditure (as a % of total expenditure on innovation)

3. % of firms that performed R&D

4. % of firms that performed R&D on a continuous basis

www.uis.unesco.org


Inputs:

3. % of firms that performed R&D

(N) =Number of product or process innovation-active firms that performed R&D (in each economic activity)

*100

(D) =Total number of product or process innovation-active firms (in each economic activity)

(N) =Number of Services product or process innovation-active firms that performed R&D

*100

(D) =Total number of Services product or process innovation-active firms

www.uis.unesco.org


Outputs:

1. % of turnover from product innovations (as a % of turnover)

2. % of turnover from new-to-market product innovations (as a % of turnover)

www.uis.unesco.org


Outputs:

1. % of turnover from product innovations (as a % of turnover)

(N) = Turnover from product innovations (in each size class)

*100

(D) = Total turnover

(N) = Turnover of Small firms from product innovations

*100

(D) = Total turnover of Small firms

www.uis.unesco.org


Key policy-relevant characteristics:

1. % of firms that were active on international markets

2. % of firms that co-operated with foreign partners on innovations

3. % of firms that co-operated with universities or other higher education institutions

4. % of firms that received public financial support for innovation

5. % of firms that applied for one or more patents

6. % of R&D-performing firms that co-operated with other institutions

www.uis.unesco.org



3. % of firms that co-operated with universities or other higher education institutions

(N) =Number of product or process innovation-active firms that co-operated with a specific partner

*100

(D) = Total number of product or process innovation-active firms

(N) =Number of product or process innovation-active firms that co-operated with universities or other higher education institutions *100

(D) = Total number of product or process innovation-active firms

www.uis.unesco.org


Key policy-relevant characteristics:Source: 2011 UIS Pilot Data Collection of Innovation Statistics

Any type ofco-operation

partner

Other enterprises within your

enterprise group

Suppliers of equipment, materials,

components, or software

Clients or customers

Competitors or other

enterprises in your sector

Consultants, commercial

labs, or private R&D institutes

Universities or other higher education institutions

Government or public research

institutes

Brazil 9.7 1.1 5.0 3.5 1.0 1.9 1.9 n.a.

China n.a. n.a. n.a. n.a. n.a. n.a. n.a. n.a.

Colombia 47.8 18.3 31.8 24.9 5.8 20.7 14.9 n.a.

Egypt 7.5 n.a. n.a. n.a. n.a. n.a. n.a. n.a.

Ghana n.a. 28.1 21.1 31.6 17.5 22.8 12.3 8.8

Indonesia n.a. 37.8 66.3 n.a. 18.4 24.5 19.4 11.2

Israel 33.4 8.3 19.6 21.3 14.4 17.3 12.6 8.2

Malaysia n.a. 65.5 55.1 56.1 30.0 84.0 45.0 37.0

Philippines n.a. 91.2 92.6 94.1 67.6 64.7 47.1 50.0

Russian Federation 37.3 12.6 16.9 10.9 3.9 5.1 9.1 15.6

South Africa 33.0 14.2 30.3 31.7 18.6 21.1 16.2 16.2

Uruguay n.a. n.a. n.a. n.a. n.a. n.a. n.a. n.a.

EU-27 n.a. n.a. n.a. n.a. n.a. n.a. n.a. n.a.

Eurostat min 12.9 2.4 7.1 4.2 2.7 4.4 4.3 1.1

Eurostat max 56.2 23.0 41.5 36.0 30.8 33.9 30.8 26.3

Co-operation partner

www.uis.unesco.org



3. % of R&D-performing firms that co-operated with other institutions

(N) =Number of R&D-performing firms that co-operated with other institutions

*100

(D) = Total number of R&D-performing firms

(N) =Number of R&D-performing firms that co-operated with other institutions

*100

(D) = Total number of R&D-performing firms

www.uis.unesco.org

Final remarks

Data collected with innovation surveys are a important component of comparative studies about countries’ competitive performance;

Strategically important for policy-makers;

Data confidentiality;

Data reliability.

www.uis.unesco.org

Thank you!Thank you!

http://www.uis.unesco.org

[email protected]

www.uis.unesco.org measuring innovation: main definitions & indicators regional workshop on...

Documents

types of innovation

product innovation examples

innovation surveys

measure innovation

new products

process innovation examples

new marketing method

process new marketing