embrapa´s success measurement methodology

Embrapa-Agroenergy - CNPAE August 2009

Embrapa’s success measurement methodology

José Dilcio Rocha

Mission Statement

“To seek and implement sustainabledevelopment solutions for the rural space,focusing on Brazilian agribusiness, through thegeneration, adaptation and transfer ofknowledge and technology, in order to benefitthe entire Brazilian society”

• Established in 1973

• Linked to the Ministry of Agriculture, Livestock and Food Supply

• Headquarters: Brasilia, FD

• ANNUAL BUDGETUS$ ~ 500 millions

• FUNDING Federal Government - 88%Own Funding - 12%

EMBRAPA: Brazilian Agricultural Research Corporation

• HUMAN RESOURCES (1)

Total: 8,3752,198 Researchers

68% PhD(12% Post-Doc)

30% MS2% BS

1,270 Support Analysts5% PhD21% MS8% BS Specialist66% BS

4,907 Others Categories

Embrapa Network

• 40 Research Centers

- 11 National Thematic Centers

- 15 National Commodity Centers

- 14 Ecorregional /Agroforestry Centers

• 4 Special Services

• 2 VIRTUAL LABORATORIES OVERSEASLabex: USA – USDA/ARS

Europe: France, The Netherlands

• Embrapa Africa – Accra, Ghana and Venezuela

Embrapa’s RD&I NetworkEmbrapa AcreEmbrapa AmapaEmbrapa Western AmazoniaEmbrapa Eastern AmazoniaEmbrapa RondoniaEmbrapa Roraima

Embrapa Mid-NorthEmbrapa Tropical Semi-AridEmbrapa Coastal TablelandsEmbrapa GoatsEmbrapa Cassava & Tropical FruitsEmbrapa CottonEmbrapa Tropical Agroindustry

Embrapa Western Region AgricultureEmbrapa Rice & BeansEmbrapa CoffeeEmbrapa CerradosEmbrapa Beef CattleEmbrapa VegetablesEmbrapa PantanalEmbrapa AgroenergyEmbrapa Genetic Resources & BiotechnologyEmbrapa Tecnological Information

North

Northeast

Center-west

Embrapa AgrobiologyEmbrapa Food TechnologyEmbrapa Dairy CattleEmbrapa Agriculture InformaticsEmbrapa Agricultural InstrumentationEmbrapa EnvironmentEmbrapa Maize & SorghumEmbrapa Satellite MonitoringEmbrapa Cattle-SoutheastEmbrapa Soils

Southeast

Embrapa Temperate AgricultureEmbrapa ForestryEmbrapa South Animal Husbandry & SheepEmbrapa SoybeanEmbrapa Swine & PoultryEmbrapa WheatEmbrapa Grape & Wine

South

Embrapa Africa Labex USA Labex Europe

(06)

(07)

(10)

(10)

(07)

Strategic Manager Committee - CGEEDPGeneral & specific objectives,Strategic Guidelines

R&D Technology Transfer Institutional Development Communication

Manager Committee of the Program – CGP

MP 1 Big challenges

MP 2 SectorialComp.& Sust.

MP 3 IncrementalTech. Dev.

MP 4 Tech Transfer Communication

MP 5 InstitutionalDevelopment

MP 6 Familiar Agriculture

ECs & PartnersECDPs (PDUs)

The Embrapa’s Management System - SEG

Institutional AgendaOperational guidelines

Tactic

Strategic

Ope

ratio

nal

EMBRAPA’S RD&I AGROENERGY PLATFORMS

EMBRAPA´S RD&I PROGRAM: Platforms

Embrapa-Agroenergy– National Agroenergy Research CenterMay 24th, 2006, startup Jan, 2007• Central point of coordination of several Embrapa’s Research Centers;• Research in strategic themes and products:

– Not carried out by other Brazilian research institutions,– With specificity, – Complementary approaches;

• New expertise not yet worked;• Embrapa’s reference in R,D&I nets and consortium in the country and

abroad;• Support to Consortium and Agroenergy Funds.

http://www.cnpae.embrapa.br

Brasília, DF, Brazil +55 61 3447 4022


Embrapa’s research impact evaluation

Objectives: Communicate the company’s R&D results to the society; Provide information for actions to minimize social imbalances, environmental and economic risks; Consolidate indicators to help in getting grants targeting the development of research at Embrapa.


Embrapa’s research impact evaluationMethodology:1) – Economic impacts

Economic surplus2) – Social impacts

Employment/ New jobsAmbitec Social

3) – Environmental impactsAmbitec Agro (Agriculture) Ambitec Agroindústria (Agro-industry)Ambitec Produção animal (Animal production)

4)- Knowledge, training, and politic-institutional impactsESAC (developed by GEOPI/Unicamp)



Economic Impact Evaluation


Measurement of the social benefits aggregated to a research project.

Economic impact evaluation – Economic Surplus Method


Embrapa’s research impact evaluationMethod (continuing) – important information:

Variation in the production due innovation; Increasing in productivity; Drop in production costs; Price of the target product; Adoption rates; Adoption costs; Magnitude of the supply curve displacement resulting from the adoption of technological innovations.



Method (continuing) - Types of Impacts

Increment in the productivity - Ex: new cultivars.Obs. Attention to the additional production costs;Cost reduction - Ex: pest integrated managementand biologic control;Production expansion in new areas - Ex: use ofnew technologies that allow the production ininappropriate areas before its use;Value aggregation - Ex: processing technologies.



Economic Impact – Considerations:

As the impact evaluation is ex post, it is stronglysuggested to evaluate the technology after some years ofadoption;Evaluated technology should be compared to the bestavailable option to producers;Yields, costs, and income in the tables are consideringvariables due variation in labor, inputs such as fertilizers,agrochemicals, etc., and climate variation and otherfactors;The unit price can also change in different years.



Observations:

“Embrapa’s Participation” is estimated in the benefitafter the following considerations:

* The technology pedigree;* The partner involvement to develop the technology;* The technology transfer costs.

Embrapa’s participation is not higher than 70%.



Technology Costs

Personnel Costs

Research Costs

Capital Depreciation

Administration Costs

Technology Transfer Costs


Embrapa’s research impact evaluationOBS:The capital depreciation is calculated annually to each researchcenter in the context of the Center Evaluation System (SAU) andthe Awards and Evaluation System for Results (SAPRE).Costs must be considered from the beginning of the projectconception and not from its startup or adoption.All costs have annual variation.After calculating all benefits and all research costs it is possibleto calculate the Net Present Value (NPV), the Internal Rate ofReturn (IRR) or the benefit/cost ratio (B/C) of the technologies.This calculus can be done by the end of each Center DirectivePlan PDU (each four year).


Environment Impact Evaluation


Methodology: Environment Impact Evaluation of Agricultural and Livestock Innovation Technologies in the R&D context – AMBITEC-AGRO

Ecologic Dimension – consider indicators related to rural entrepreneur: Upstream - natural resources and inputs uses; Downstream – residues production, environment changes, and

ecosystem and habitat changes and recovering


The AMBITECsystem is based on a set of indicators to R&D project impact assessment.


Agricultural Technologies -AMBITEC-Agro;Agro-industrial Technologies -

AMBITEC-AgroindústriaLivestock Technologies -

AMBITEC-Produção Animal


Ambitec-Agro aspects:

Technology scope;Technology efficiency;Environment conservation andEnvironment recovering.


Ambitec-Agroindústria aspects:

Technology scope;Technology efficiency; Environment conservation; Product quality and Social capital.


Ambitec-Produção Animal aspects:

Technology scope; Technology efficiency; Environment conservation; Environment recovering; Product quality and Animal comfort and health.


Social Impact Evaluation


Methodology: - AMBITEC-Social

The AMBITEC-Social assesses agricultureinnovation technology social impacts. It analysesthe aspects of the basic needs satisfaction and thequality of life changes due the new technologyadoption.


O Ambitec Social aspects:

Employment;Income;Health; andManagement and Administration

3.

HealthEmployment Income Management & Administration

8. Personnel and Environment Health

9. Occupational security and health

2. New qualified local jobs

4. Job quality

5. Income generation of the property

6. Diversity of income sources

7. Property value

11. Manager profile and dedication

12. Commercialization conditions

13. Residue recycling

14. Institutional relationship

1. Training

Job availability and worker conditions 10. Food security



Social Impact Evaluation -

New job Assessment

Embrapa’s research social impact evaluation

All productive chain is considering for job generation.


Impact Evaluation in Knowledge, Training,

and Politic-Institutional

Embrapa’s research knowledge, training, and politic-institutional impact evaluation

Objectives: Impact evaluation in knowledge (basic

research),

Impact evaluation in training and e learning,

Impact evaluation in politic-institutional.

Evaluation mainly to evaluate the thematic centers like Agroenergy; The methodology was adapted from ESAC

(developed by Geopi/Unicamp). It is similar to Ambitec and Ambitec-Social; It analyses 21 indicators and their quality

aspects in a -3 to +3 scale.

Embrapa’s research knowledge, training, and politic-institutional impact evaluation


Integrated Analysis


Embrapa’s research impact evaluationThe integrated analysis has three steps:

1. Select 3 technologies for each Center withappropriated description,

2. Analysis of each technology following the procedureabove and compared each other considering theresults for the analyzed year and the previous ones,

3. Finaly, a short report with all conclusions concerningthe impact analysis must be presented by eachCenter.


Integrated analysis

Embrapa’s success measurement methodology

THANK YOU

Embrapa [email protected]

http://www.cnpae.embrapa.br/�

mailto:[email protected]�

embrapa´s success measurement methodology

Technology

embrapa network

embrapas reference

embrapas rdi program

embrapas rdi networknorth

agroenergy funds

new areas ex

ministry of agriculture

productivity ex