Wallace Beversdorf (Team Leader) Sylvie Brouder Paramjit (Pammi) Sachdeva Rasheed Sulaiman Deborah Templeton
Evaluation of the CGIAR Research Program
on Wheat
Volume 2 – Annexes
April 2015
This evaluation has been commissioned by the Independent Evaluation Arrangement (IEA) of the CGIAR.
The Independent Evaluation Arrangement (IEA) of CGIAR encourages fair use of this material provided proper citation is made.
Correct citation: CGIAR‐IEA (2015). Annexes to the Evaluation of CGIAR Research Program on Wheat. Volune 2. Rome, Italy: Independent Evaluation Arrangement (IEA) of CGIAR iea.cgiar.org
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
Table of contents
ANNEX A. - Evaluation Team Members – Short Bios .................................... 1 ANNEX B. - Country visits .......................................................................... 2 ANNEX C. - List of people met .................................................................... 4 ANNEX D. - List of sample projects .......................................................... 17 ANNEX E. - Assessment of publications ................................................... 20 ANNEX F. - WHEAT researcher survey ...................................................... 25 ANNEX G. - Sample project assessment - TEMPLATE ................................ 49 ANNEX H. - Peer review scoring of a random sample of publications – ..... 54
1
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
ANNEX A. ‐ Evaluation Team Members – Short Bios
Wallace (Wally) Beversdorf ‐ Evaluation Team Leader. Since 2005 Wally has been an independent consultant, involved in several reviews of research, including CSIRO Flagship program reviews and 2007 mid‐term review of the Generation Challenge Program. Before 2005 he worked over 10 years in the private seed sector, including positions as Head of Novartis world‐wide R&D, Head of Syngenta Plant Science and Vice President for Syngenta Biotechnology. He has also worked in the academia, holding positions at the Guelph University. He has a PhD in plant breeding and genetics.
Sylvie Brouder ‐ Evaluation Team Member. Since 2005 Sylvie has served as Professor of Agronomy at Purdue University where she has been working for nearly 20 years. She is also Director of the Purdue University Water Quality Field Station. Her research interests include crop nutrient use efficiency, agroecosystem viability and sustainability and ecophysiology linked to abiotic stress tolerance. Through her teaching, outreach and consultancy activities she has been involved in international agricultural research and science agenda development. She has PhD in ecology.
Deborah (Debbie) Templeton ‐ Evaluation Team Member. Until September 2013 Debbie worked for ACIAR for over 10 years primarily managing the Impact Assessment program. Between ACIAR employment, Debbie also worked for 3 years as social scientist (impact assessment specialist) at IRRI. She has experience in capacity building in research evaluation and impact assessment and in managing and conducting impact assessments. She has PhD in economics.
Rasheed Sulaiman ‐ Evaluation Team Member. Rasheed is the Director of the Centre for Research on Innovation and Science Policy in India (since 2006). Prior to that, he worked as senior scientist at the National Centre for Agricultural Economics and Policy Research at ICAR. He has expertise in agricultural extension systems and policy, and agricultural innovation system. His research also covers the role of private sector and public‐private partnerships, developing new approaches to reaching rural women and evaluation of ICTs in agriculture. He has a PhD in agricultural extension.
Paramjit (Pammi) Sachdeva ‐ Evaluation Team Member. Pammi is specialized in program and institutional assessment and HR management with expertise also in capacity development, systems analysis and organizational design. Since 2001 he has worked as an independent consultant and been involved in a number of external reviews of CGIAR Centers and programs, and in international development project and human resource management consultancies. Previously he worked at the World Bank as senior management specialist and advisor and earlier in his career at ISNAR as senior research officer. He has a PhD in social systems sciences.
2
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
ANNEX B. ‐ Country visits
Date Country Team
members Main schedule
21‐24 Sep Turkey WB, DT Ankara visit CIMMYT/ICARDA office Visit research institutes
Izmir Visit Regional Cereal Rust Research Center in the Aegean Agricultural Research Institute
24‐26 Sep Lebanon WB, DT Beirut Terbol, AREC, Kfardan LARI ICARDA offices in Beirut
26 Sep – 1 Oct
Ethiopia WB, DT Addis Ababa Meeting with ICARDA & CIMMYT staff and presentation on Collaborative Activities with Ethiopian NARS
WB, DT Debre Zeit Debre Zeit ARC, Green house, single race & international nurseries, breeding activities, seed producers & farmers seed producers, on farm trials and Gonde seed farm
WB, DT Asella KARC, irrigation facility, international and single race nurseries, seed labs, Breeding and Seed Activities
WB, DT Addis Ababa EIAR Quality Lab and Meeting with EIAR management
1‐4 Oct Morocco WB, DT Casablanca INRA campus (greenhouse, biotech of INRA, quality lab and future building of ICARDA) Meeting with ICARDA staff Bread wheat presentation, Durum wheat presentation
3
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
Date Country Team members
Main schedule
Marchouch Marchouch station (all wheat personnel attending)
Annoceur Annoceur station, visit of durum off‐season. Focus on RWA screening.
Gigu Arrival to farmers communities in Gigu together with professor Boulif (ENA Meknes), presentation of farmers school (ICARDA's contribution) and of IFAD activities on‐farm in Meknes area, visit of the farm and lunch with farmers
8—13 Nov Bangladesh RS WRC Dinajpur meet with WRC Scientists and DAE (Department of Agricultural Extension) and BADC (Bangladesh Agriculture Development Corporation
RS Rangpur Discuss with CSISA‐CIMMYT, SRFSI staff and OFRD/BARI Scientists NGO partners (RDRS, etc.)
RS Dhaka Discuss with BARI authorities/Seed Certification Agency
14‐17 Nov India RS SB
Arra and Patna
Zero tillage wheat sowing, interaction with service providers, farmers , KVK and other partners
RS SB
Samatipur, Pusa
Visit fields with bed planting, zero tillage intercropping of maize and interaction with women farmers in Bandra Visit to BISA farm‐Pusa Interaction with Head, IARI Research Station of RAU officials Interaction with ICAR and other partners in ICAR complex‐Patna
4
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
ANNEX C. ‐ List of people met SURNAME, Name Position Organization Country visit
Abeyo, Bekele Wheat Breeder, Global Wheat Program CIMMYT Ethiopia
Abinasa, Mohammed Wheat Breeder ICARDA Ethiopia
Adhikari, Mani Krishna ADO CIMMYT Bangladesh
Afram, Michel Antoine President – Director General Lebanese Agricultural Research Institute Lebanon
Aliy, Sheriff Research Extension Specialist – Technology Promotion Debre Zeit Agricultural Research Center EIAR Ethiopia
Amil, Rola PhD Student ICARDA Lebanon
Amri, Ahmed Head, Genetic Resources Section ICARDA Morocco
Andaloussi, Abbad Head , Plant Protection Department INRA Morocco
Asaad, Siham Head, ICARDA’s Seed Health Laboratories ICARDA Lebanon
Atilaw, Abebe Director, Technology Multiplication Directorate and Coordinator, Deployment of Rust Resistant Wheat Varieties in Ethiopia EIAR Ethiopia
Austin, Nick Chief Executive Officer of ACIAR, Pacific Countries representative on the CGIAR Fund Council ACIAR Australia
Badstue, Lone Gender Specialist, SEP CIMMYT Mexico
Bakshi, Elahi Applied Ag Economist CIMMYT Bangladesh
Bandyopadhyay, Ranajit Pathologist ICARDA Mexico
Bänziger, Marianne Deputy Director General Research & Partnership CIMMYT Mexico
5
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Barma, Naresh Ch Deb Chief Scientific Officer BARI, Gazipur Bangladesh
Bassi, Fillipo Durum Wheat Breeder ICARDA Morocco
Baum, Michael Director ‐ BIGMP CIMMYT Mexico
Bennani, Sahar INRA Morocco
Bhatt, B. P Director ICAR Research Complex for Eastern Region India
Bishaw, Zewdie Head, Seed Section ICARDA Ethiopia
Bodruzzaman, Md Principal Scientific Officer (Soils) Wheat Research Center, Dinakpur Bangladesh
Braun, Hans Program Director Global Wheat Program CIMMYT Mexico
Briones, Ernesto Senior Systems Developer CIMMYT Mexico
Chand, Ramesh Professor‐cum‐Plant Pathologist Banaras Hindu University Mexico
Chanyalew, Solomon Center Director, Debre Zeit Agricultural Research Center EIAR Ethiopia
Chatrath, R Principal Scientist Directorate of Wheat Research (DWR), Karnal, ICAR India
Chikoye, David R4D Director, IITA‐Southern Africa IITA Mexico
Chowdhury, S. Consultant Borlaug Institute for South Asia India
6
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Coffman, Ronnie Principal Investigator, Durable Rust Resistance Prog Cornell University Obrégon
Dababat, Amer Plant Pathologist and NematologistGlobal Wheat Program
CIMMYT Turkey
Datta, Swapan K Deputy Director General (Crop Science) Indian Council of Ag Research Obrégon
De la O Elizagaray, Marisa Manager, Risk Management & International Policy CIMMYT Mexico
Debele, Tolessa SARD‐SC Coordinator for ESA ICARDA Ethiopia
Degite, Gemechu Chair Ethiopian Seed Enterprise (ESE)Gonde‐Iteya Basic Seed Farm Ethiopia
Dessalegn, Tadesse
Technical Coordinator, East African Agricultural Productivity Project Wheat Regional Center of Excellence Kulumsa Agricultural Research Center EIAR Ethiopia
Dixon, John Principal Adviser Research and Cropping Systems and Economics (CSE) program manager.
ACIAR Australia
Duveiller, Etienne Director of Research for South Asia CIMMYT Obrégon
Dwivedi, P K Programme Coordinator Krishi Vigyan Kendra, Buxar India
El Bouhssini, Mustapha Entomologist ICARDA Morocco
El Hassouni , Khaoula sponsored by GRDC Morocco
Erenstein, Olaf Program Director, Socioeconomics Program CIMMYT Mexico
Figueroa, Pedro Plant Pathologist in National Wheat Program INIFAP Obrégon
Firke, Asnake Director, Crop Research EIAR Ethiopia
Fisher, Tony Honorary Research Fellow at CSIRO, Member of WHEAT Stakeholder Committee CSIRO Australia
7
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Freymond, Jean Secretary SASAKAWA Africa Association Obrégon
Fulss, Richard Head, Knowledge Management CIMMYT Mexico
Gathala, Mahesh Cropping System Agronomist, Leader SRFSI CIMMYT Bangladesh
Gérard, Bruno Program Director, Global Conservation Agriculture CIMMYT Mexico
Ghosh, Anup Kumar Senior Agricultural officer
Resilient Farming Systems Intensification (SRFSI) Project, RDRS Bangladesh
Girma, Bedada Durable Rust Resistant Program, Kulumsa Agricultural Research Center EIAR Ethiopia
Govaerts, Bram Associate Director, Global Conservation Agriculture CIMMYT Mexico (Texcoco and Obrégon)
Guertin, Michelle Senior Monitoring, Evaluation & Learning Specialist CIMMYT Skype
Gupta, Pryianka sponsored Borlaug Scholarship Individual Morocco
Gupta, R K Principal Scientist Directorate of Wheat Research (DWR), Karnal, ICAR India
Gutterson, Neal President, CEO Mendel Biotechnology Obrégon
Haddad, Nicolas Manager, Agricultural Research and Education Center (AREC) American University of Beirut Lebanon
Hannan, Abdul Deputy Director Department of Agricultural Extension Bangladesh
Haque, Anarul Extension Agronomist, CSISA, Hub Manager, Rangpur CIMMYT Bangladesh
Harris, Abdul Principal Scientists Agronomy ICAR Research Complex for Eastern Region India
8
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Hassen, Haloma Consultant in small ruminant research ICARDA Morocco
Hearne, Sara Senior Scientist, Maize Molecular Geneticist/Pre‐breeder CIMMYT Mexico
Herremans, Anna (former) Director, International Finance CIMMYT Mexico
Hassan, Selima Sr Scientific Officer BARI, On Farm Research Division, Rangpur Bangladesh
Hobbs, Huntington Leader, Strategic Planning and Research Coordination, MasAgro CIMMYT Mexico
Hodson, David GIS and Decision Support SystemsSEP CIMMYT Ethiopia
Homma, Shitaye Durum Wheat Breeder, Debre Zeit Agricultural Research Center EIAR Ethiopia
Hossain, Akbar Senior Agronomist Wheat Research Center, Dinakpur Bangladesh
Hossain, Mofazzul Deputy Director Seed Marketing Bangladesh Agricultural Development Corporation Bangladesh
Hossain, Monwar Scientific Officer (Plant Breeding) Wheat Research Center, Dinakpur Bangladesh
Hossain, Zakir Scientific Officer (Agricultral Engineer) Wheat Research Center, Dinakpur Bangladesh
Hundie, Bekele Plant Pathologist, Kulumsa Agricultural Research Center EIAR Ethiopia
Huttner, Eric Research Program Manager, Crop Improvement & Management ACIAR Obrégon and Australia
Idris, Mohammad Principal Scientist (Entomology) ICAR Research Complex for Eastern Region India
9
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Iraqi, Driss Coordinator, Biotechnology Unit INRA Morocco
Jahan (Belal), Abu Hena Sorwar Principal Scientific Officer BARI, Gazipur Bangladesh
Jakobi, Nina WHEAT Program Assistant CRP Mexico
Jaleta, Moti Agricultural EconomistSEP CIMMYT Ethiopia
Jat, H S Cropping Systems Agronomist, CSISA Central Soil Salinity Research Institute India
Jat, M L Senior Cropping Systems Agronomicst & CIMMYT‐CCAFS South Asia Coordinator, CIMMYT CIMMYT India
Jat, Raj Kumar Cropping Systems Agronomist Borlaug Institute for South Asia India
Kaan, Kathy Program Manager BMGF Obrégon
Kan, Mustafa Agricultural Economist, Department of Economy, Statistic and Extension Bahri Dagdas International Agricultural Research Institute
Turkey
Karim, Rezaul Upzilla Agricultural Officer Department of Agricultural Extension Bangladesh
Kassie, Grima T Agricultural Economist, SEPRP ICARDA Morocco
Keil, Alwin Senior Agricultural Economist CIMMYT India
Kemal, Seid Ahmad Pathologist ICARDA Ethiopia
10
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Keser, Mesut IWWIP, Coordinator for ICARDA ICARDA Turkey
Kircalioğlu, Gün Research Coordinator Aegean Agricultural Research Institute
Turkey
Kiwan, Pierre Assistant Researcher , Terbol Research Station ICARDA Lebanon
Kommerell, Victor WHEAT Program Manager CIMMYT Mexico
Kumar, Mithilesh Director of Research Rajendra Agricultural University, Pusa, Samastipur India
Kumar, Virender Cropping Systems Agronomist CIMMYT India
Legesse, Wasihun Wheat Breeder , Debre Zeit Agricultural Research Center EIAR Ethiopia
Listman, Michael G. Senior Science Writer, Corporate Communications CIMMYT Mexico
Lopez Saavedra, Victor Manager of Institutional Relations TTF‐MasAgro CIMMYT Mexico
Lopez, Diana Project Management Unit CIMMYT Mexico
Lumpkin, Thomas DG CIMMYT Mexico
Machlab, Hassan Country Manager/Lebanon ICARDA Lebanon
Malaker, Paritosh Kumar Director Wheat Research Center, Dinakpur Bangladesh
Mallari, Sally MAIZE Program Assistant CIMMYT Mexico
Mallik, R. S. Senior Agronomist And Csisa Objective 1 Leader CIMMYT India
Mamo, Beditu Chair
Memher Agera Seed Multiplication and Marketing Cooperative Ethiopia
11
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Medina, Richard Director, Internal Audit CIMMYT Mexico
Members of the Mahila Kisan Sakhi CSISA ‐ Bihar, Mahila Samaykhya, Muzaffarpur n/a India
Mendoza, Fernando P Senior Internal Auditor IITA Mexico
Menkir, Abebe Team leader for maize improvement research at IITA, Focal Point for CRP at IITA IITA Mexico
Mert, Zafer Phytopathologist / Plant pathologist, Department of Crop Diseases and Resistance Breeding
The Central Research Institute for Field Crops (TARM), Ministry of Food, Agriculture and Livestock (MFAL)
Turkey
Mir, Patricia V Risk Management Analyst CIMMYT Mexico
Mishra, Satya Prakash Officer VST Tillers Tractors Ltd India
Mishra, V.K. Professor, Dept. of Genetics and Plant Breeding Banaras Hindu University Obrégon
Mitiku, Demessie Seed Agronomist, Supporting Seed Demonstration for Private Seed Growers AMUARI High Yield Varieties and Agricultural Products PLC Ethiopia
Mittal, Surabhi Economist CIMMYT India
Miyamoto, Masaaki Chief Executive Officer SASAKAWA Africa Association Obrégon
Momin, Abdul Cropping Systems Agronomist, Manager‐CSISA Jessore Hub CIMMYT Bangladesh
Nachit, Miloudi Former Durum Wheat Breeder and now Consultant with focus on pre‐breeding and on farm trials ICARDA Morocco
Nasserlehaq, Nsarellah Durum Wheat Breeder INRA Morocco
Nawar, Fawzy Senior documentation specialist, Genetic Resources Section ICARDA Morocco
12
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Nazari, Kumarse Plant Pathologist, Cereal Rust Regional Center ICARDA Turkey
Ortiz Monasterio, Ivan Agronomist, Wheat Harvest Coordinator CIMMYT Mexico
Ozdemir, Fatih Director, Bahri Dagdas International Agricultural Research Institute, IWWIP Coordinator for Turkey
BDIARI Turkey
Ozkan, Isa Head, Field Crops Research Department MFAL Turkey
Pandit, D B Cropping Systems Agronomist, Manager‐CSISA Mymensingh CIMMYT Bangladesh
Payne, Thomas S. CIMMYT Board Secretary CIMMYT Mexico
Peksuslu, Ali Director, AEGEAN Agricultural Research Institute Turkey
Pfeiffer, Wolfgang H Deputy Director, Operations HarvestPlus Obrégon
Pixley, Kevin Program Director, Genetic Resources Program CIMMYT Mexico
Powell, Wayne Chief Science Officer CGIAR Obrégon
Rahman, Ataur Specialist Conservation Agriculture BARI, Gazipur Bangladesh
Rajasekharan, Nellooli P. Director, International Human Resources CIMMYT Mexico
Rashid, Mamunur A&E Coordinator
Resilient Farming Systems Intensification (SRFSI) Project, RDRS Bangladesh
Renard, Geneviève MAIZE and WHEAT Communication Specialis GCP Mexico
Reynolds, Mathew Head Wheat Physiology CIMMYT Obrégon
Reza, Mustafa Alir Senior Scientific Officer, (Wheat Pathology) Wheat Research Center, Dinakpur Bangladesh
13
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Ribaut, Jean‐Marcel Director, Generation Challenge Program CIMMYT Mexico
Riis‐Jacobsen, Jens Director of Int. Systems and Information Technology CIMMYT Mexico
Rodriguez, Horacio MasAgro Extension Coordinator CIMMYT Mexico
Rorisa, Bejiqa Cooperative Farmer
Guchi Habe Badosa Bread Wheat and Seed Multiplication and Value Chain Cooperative Ethiopia
Rossi, Frederik Agricultural Economist, Manager‐CSISA Faridpur Hub CIMMYT Bangladesh
Rugema, Hilary Coordinator, Crop Productivity Improvement SASAKAWA Africa Association Obrégon
Saidi, Seddik Head, Plant Breeding Department INRA Morocco
Saint Pierre, Carolina Scientist, Wheat Phenotyping Coordinator SeeD CIMMYT Obrégon
Sanchez –Garcia, Miguel Spring Wheat Breeder ICARDA Morocco
SanVicente, Felix Breeding lead for the tropics in Mexico CIMMYT Mexico
Sarker, Abu Zaman Princial Scientific Officer (Agronomy) Wheat Research Center, Dinakpur Bangladesh
Sayem, Abu Regional Director Agricultural Information Service (Ministry of Agriculture) Bangladesh
Schulthess, Urs Crop modeler, Global Conservation Agricultural program CIMMYT Mexico
Sefera, Tadessa Center Director, Kulumsa Agricultural Research Center EIAR Ethiopia
Segovia, Vanessa Post Doctorial Fellow ICARDA Turkey
Senthil, R. Principal Scientist Directorate of Wheat Research (DWR), Karnal, ICAR India
14
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Shahjahan, Md Croping Systems Agronomist, , Manager‐CSISA Khulna Hub CIMMYT Bangladesh
Sharma, Indu Director and Member, Wheat Management Committee (CRP‐Wheat) Directorate of Wheat Research (DWR), Karnal, ICAR India
Sharma, P C Head, Crop Improvement Central Soil Salinity Research Institute India
Sharma, R K Principal Scientist Directorate of Wheat Research (DWR), Karnal, ICAR India
Short, Thomas W. DDG Support Services CIMMYT Mexico
Silim, Said Nahdy Country Manager ICARDA Ethiopia and Coordinator Sub‐Saharan Africa Regional Program ICARDA Ethiopia
Sim, Graham Director, International Finance CIMMYT Mexico
Singh, Ravi P Head, Bread Wheat Improvement & Rust Res CIMMYT Obrégon
Singh, Satyavir Principal Scientist Directorate of Wheat Research (DWR), Karnal, ICAR India
Sohail, Quahir Spring Wheat Breeder ICARDA Morocco
Solanki, I S Head Indian Agricultural Research Institute India
Solh, Mahmoud DG ICARDA Lebanon
Souihka, Allah Manager, Marchouch Station ICARDA Morocco
Sugandhi, ? Gender Cordinator, CSISA CIMMYT India
Tadessa, Zerihun National Coordinator, Wheat Program EIAR Ethiopia
Tadesse, Wuletaw Bread Wheat Breeder ICARDA Morocco
15
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Tafesse, Mekasha Driver and Logistical Assistant ICARDA Ethiopia
Tanwir, Niayer Secretary Creation Welfacer Society India
Tawkaz, Sawsan Head, ICARDA’s Double Haploid Laboratory ICARDA Lebanon
Teklu, Kifle Participating Farmer
Memher Agera Seed Multiplication and Marketing Cooperative Ethiopia
Tesfaye, Bezabih Seed Specialist AMUARI High Yield Varieties and Agricultural Products PLC Ethiopia
Tessema, Alemu Chair Denkaka Megertu Cooperative Ethiopia
Thornton, Matthew Hub Coordinator CIMMYT Mexico
Tiwari, Ratan Principal Scientist Directorate of Wheat Research (DWR), Karnal, ICAR India
Tiwari, T. P. Cropping System Agronomist & Country Representative CIMMYT Bangladesh
Tovar Mondragon, Jose Ramiro Manager, Financial Planning CIMMYT Mexico
Trachsel, Sam Scientist, Global Maize Program CIMMYT Mexico
Tsivelikas, Athanasios Genebank Manager ICARDA Morocco
Uddin, Mohdi Cropping System Agronomist, Manager‐CSISA Faridpur Hub CIMMYT Bangladesh
Udupa, Sripada Senior Scientist, Biotechnology, ICARDA Morocco
van Ginkel, Maarten DDGR ICARDA Lebanon
Wakjira, Adunga Deputy Director General EIAR Ethiopia
16
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
SURNAME, Name Position Organization Country visit
Ward, Rick Principal Scientist, Global Wheat Program CIMMYT Obrégon
Watson, David MAIZE Program Manager CIMMYT Mexico
Willcox, Martha Senior Scientist working with the Seeds Discovery (SeeD) project CIMMYT Mexico
Worku, Zewuditu Woman Farmer n/a Ethiopia
Yai, Kebede Cooperative Farmer
Guchi Habe Badosa Bread Wheat and Seed Multiplication and Value Chain Cooperative Ethiopia
Yasmin, Samina Cropping Systems Agronomist, Manager‐CSISA Barisal Hub CIMMYT Bangladesh
Yazbek, Mariana Post Doc Fellow, Genetic Resources ICARDA Lebanon
Zaim, Meryem sponsored by GRDC n/a Morocco
Zehr, Usha Barwale Chief Technology Officer, Maharashtra Hybrid Seeds Co. Ltd. MAHYCO Obrégon
17
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
ANNEX D. ‐ List of sample projects A total of 40 projects were selected from the project database. These included the 10 largest projects (according to the budget allocated to WHEAT) as well as 30 projects which were randomly selected by Flagship. Projects had to be replaced from the initial selection and some projects utlimately could not be reviewed because information was found insufficient or was only available in Spanish, or treated as confidential. The evaluation team looked at a total of 34 projects listed below:
No Title FP Lead
A4031.09.19 Accelerating adoption of yellow rust resistance winter varieties in Central Asia 4 Other
A4031.09.24 The Potential for Wheat Production in Sub‐Saharan Africa: Analysis of Biophysical Suitability and Economic Profitability 1 CIMMYT
A4031.0918 Enhanced quality and healthy seed testing system for International Winter Wheat Improvement Program (IWWIP) 3 Other
B 1198 Enhancing cotton germplasm, improving resistance to cotton leaf curl virus and supporting cotton best management practices for small farmers. 4 ICARDA
B1146 Joint ICARDA‐ARC Wheat Improvement Program 2 ICARDA
B1202 Pakistan Wheat production enhancement 3+4+5 ICARDA
B1202 Pakistan Wheat Production Enhancement Initiative 2+3+5 ICARDA
B1287 Support to Agricultural Research for Development of Strategic Crops in Africa (SARD‐SC)‘ 5 ICARDA
B1313 Wheat Productivity Improvement towards Food Self‐sufficiency 5 ICARDA
B1355 and 1356
Mobilizing Novel Genes from Wheat 2 CIMMYT/ICARDA
C0035 Cereal Systems Initiative for South Asia (CSISA)‐Phase II 4 CIMMYT
18
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
No Title FP Lead
C0037 Cereal Systems Initiative for South Asia (CSISA)‐India 4 CIMMYT
C0040 MASAGRO‐Desarrollo sustentable con el agricultor 4 CIMMYT
C0064 Africa Rising: Research in Sustainable Intensification for the next generation 4 CIMMYT
n/a
Wheat Addressing the challenge of climate change for sustainable food security in Turkey, Iran, Pakistan, Uzbekistan, Morocco and Spain through the exploitation of wheat Genetic Resources, adoption of resilient improved varieties on farmers fields and their socio‐economic impact. 2 CIMMYT
R0148 MASAGRO‐Descubriendo la diversidad genética de las semillas 4 CIMMYT
T0083 Expansion of the Cereal Systems Initiative for South Asia (CSISA) in Bangladesh 4 CIMMYT
W 0286 Development of Heat Tolerant Wheat for South Asia 3 CIMMYT
W0101 Desarrollo de nuevas variedades de trigo duro, trigo harinero y triticale a partir de germoplasma procedente del CIMMYT‐Phase III 3 CIMMYT
W0204 Identification and utilization of novel sources of resistance against soil borne pathogens in wheat (CIM00014) 3 CIMMYT
W0205 Enhanced Delivery of CIMMYT Germplasm to Australia 3 CIMMYT
W0212 Development of Cereal Germplasm and the Screening for Disease Resistance and End‐Use Quality: CIMMYT ‐ Triticale Improvement Component 3 CIMMYT
W0235 Identifying new genetic sources and evaluating United States wheat germplasm for resistance to stem rust in Eastern Africa (25856) 3 CIMMYT
W0239 Pakistan Wheat production enhancement 3+4+5 CIMMYT
19
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
No Title FP Lead
W0250 Durable Rust Resistance in Wheat (Phase II 3 CIMMYT
W0252 Genetics and Physiology of Wheat Development to Flowering: Tool to breed for improved adaptation and yield potential: 2 CIMMYT
W0265 Sustainable Wheat & Maize Production in Afghanistan ( 5 CIMMYT
W0266 Agricultural Innovation Programme 4 CIMMYT
W0269 KAI‐Agricultural Technologies in Kazakhstan 3 CIMMYT
W0273 Joint Development of Korean Winter Bread Wheat Lines with heat tolerance and high protein n/a CIMMYT
W0276 Russia‐Omsk Institute 3 CIMMYT
W0281 Field evaluation of Genetically Modified Wheat 2 CIMMYT
W0289 Rapid Development of Climate Resilient Wheat Varieties for South Asia using Genomic Selection 2+3 CIMMYT
W1/2 activity Socioeconomics & policies for wheat futures, 1 CIMMYT
20
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
ANNEX E. ‐ Assessment of publications
Selection of individual publications for assessment The team intended to assess 37 publications in total. The publications were categorized according to the Center that issued them (CIMMYT and ICARDA) and to discipline (i.e. whether they related to agronomy, breeding or socio‐economics). Target numbers were then developed based on how many publications each Center had published in the 3 disciplines (see Table 1 below). Publications for assessment were then selected randomly from the database according to these target numbers.
Table 1 - Criteria for selection of sample publications SAMPLE ACTUAL
CIMMYT ICARDA TOTAL CIMMYT ICARDA CIMMYT ICARDA
Agronomy 85% 15% 10 9 1 6 1
Socio‐economics 71% 29% 6 4 2 5 2
Breeding 75% 25% 21 17 4 19 3
Number of Publications 30 7 30 6 After all publications had been identified, an assessor was assigned for each one, bearing in mind the areas of competence, expertise and experience of the assessors. Some of the publications were re‐classified (especially some of the agronomy publications which related more to breeding). One publications by ICARDA was not assessed, as it could not be accessed (Genome-wide association mapping for five major pest resistances in wheat, Molecular Breed). The total of 36 publications assessed by the evaluation team are shown in the table below.
21
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
Team member
YEAR Title JOURNAL CENTER
Type
SB 2012 Achieving yield gains in wheat Plant, Cell & Environment (5.14 in 2012, year of publication
CIMMYT Breeding
DT 2012 Agricultural Extension, Collective Action and Innovation Systems: Lessons on Network Brokering from Peru and Mexico
The Journal of Agricultural Education and Extension
CIMMYT Socio econ
RS 2012 Analysis of genotypic variation for NDVI (normalized difference vegetation index) and its relationship with grain yield in winter wheat under terminal heat stress
Plant Breeding 131(2012) ICARDA
Breeding
WB 2012 Analysis of leaf and stripe rust severities reveals pathotype changes and multiple minor QTLs associated with resistance in an Avocet × Pastor wheat population
TAG 2012 CIMMYT
Breeding
RS 2012 Breeding progress for yield in winter wheat genotypes targeted to irrigated environments of the CWANA region
Euphytica (2013) ICARDA
Breeding
RS 2012 Conservation Agriculture in Maize‐ and Wheat‐Based Systems in the (Sub)tropics: Lessons from Adaptation Initiatives in South Asia, Mexico, and Southern Africa
Journal of Sustainable Agriculture (2012)
CIMMYT Socio econ
RS 2012 Conservation agriculture, increased organic carbon in the top‐soil macro‐aggregates and reduced soil CO 2 emissions
Plant Soil (2012) CIMMYT
Agronomy
DT 2012 Food sovereignty or the human right to adequate food: which concept serves better as international development policy for global hunger and poverty reduction?
Agric Hum Values (2012) CIMMYT
Socio econ
22
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
Team member
YEAR Title JOURNAL CENTER
Type
WB 2012 From genotype × environment interaction to gene × environment interaction by Crossa, J Current Genomics
Current Genomics 2012 CIMMYT
Breeding
RS 2012 Genetic structures of the CIMMYT international yield trial targeted to irrigated environments
Mol Breeding CIMMYT
Breeding
WB 2012 Genetic yield gains and changes in associated traits of CIMMYT spring bread wheat in a "Historic" set representing 30 years of Breeding
Crop Science, 2012 CIMMYT
Breeding
WB 2012 Genetic yield gains of the CIMMYT International semi‐arid wheat yield Crop Science (2012) CIMMYT Breeding
SB 2012 Global Crop Improvement Networks to Bridge Technology Gaps J. of Exp. Botany (5.242 for 2012 – year of publication)
CIMMYT Agronomy
RS 2012 Global incidence of wheat rusts and powdery mildew during 1969‐2010 and durability of resistance of winter wheat variety Bezostaya 1
Eur J Plant Pathol
Breeding
WB 2012 Lr68: A new gene conferring slow rusting resistance to leaf rust in wheat Theoretical and Applied Genetics CIMMYT Breeding
WB 2012 Multi‐trait and multi‐environment QTL analyses for resistance to wheat diseases Open Access PLOS‐One (2012) CIMMYT Breeding
DT 2012 Performance of biofortified spring wheat genotypes in target environments for grain zinc and iron concentrations
Field Crops Research 137 (2012) CIMMYT
Breeding
WB 2012 Phenotyping transgenic wheat for drought resistance (2012) Journal of Experimental Botany CIMMYT Breeding
SB 2012 Physiological Traits for Improving Heat Tolerance in Wheat Plant Physiology (6.56 in year of publication, 2012)
CIMMYT Breeding
23
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
Team member
YEAR Title JOURNAL CENTER
Type
SB 2012 Quantifying how winter wheat crops accumulate and use nitrogen reserves during growth
Field Crops Research (2.47 in year of publication, 2012)
CIMMYT Agronomy
SB 2012 Stay‐green in spring wheat can be determined by spectral reflectance measurements (normalized difference vegetation index) independently from phenology
J. of Experimental Botany (5.242 for 2012 – year of publication)
CIMMYT Breeding
DT 2012 The Production Functions of Wheat Production in Turkey Bulgarian Journal of Agricultural Science, 18 (No 2) 2012
ICARDA Socio econ
SB 2012 The yield correlations of selectable physiological traits in populations of advanced spring wheat lines grown in warm and drought environments
Field Crops Research; CIMMYT
Breeding
WB 2012 Virulence of Beauveria bassiana against Sunn pest, Eurygaster integriceps Puton (Hemiptera: Scutelleridae) at different time periods of application
Journal of Entomology and Nematology (2012)
ICARDA Agronomy
RS 2013 Assessing the impacts of GAFTA on selected members’ bilateral agricultural trade: an application of the Gravity Model.
Am‐Euras. J. Agric. & Environ. Science (2013)
ICARDA Socio econ
DT 2013 Crops that feed the world 10. Past successes and future challenges to the role played by wheat in global food security
Food Sec. (2013) CIMMYT
Socio econ
RS 2013 Earliness in wheat: A key to adaptation under terminal and continual high temperature stress in South Asia
Field Crops Research (2013) CIMMYT
Agronomy
WB 2013 Genetic analysis of adult plant resistance to yellow rust and leaf rust in common spring wheat
Plant Disease (2013) CIMMYT
Breeding
24
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
Team member
YEAR Title JOURNAL CENTER
Type
SB 2013 Historical changes in grain yield and quality of spring wheat varieties cultivated in Siberia from 1900 to 2010
Canadian Journal of Plant Science CIMMYT
Breeding
SB 2013 Identification and characterization of international Fusarium head blight screening nurseries of wheat at CIMMYT, Mexico
J. Plant Pathology (1.71 in 2013, year of publication)
CIMMYT Breeding
RS 2013 Meta: A suite of sas programs to analyze multienvironment Breed trials Agronomy Journal Volume 105, Issue 1, 2013
CIMMYT Agronomy
SB 2013 Mineral nitrogen dynamics in irrigated rice‐wheat system under different irrigation and establishment methods and residue levels in arid drylands of Central Asia
European Journal of Agronomy (2.92)
CIMMYT Agronomy
WB 2013 QTL mapping of slow‐rusting, adult plant resistance to race Ug99 of stem rust fungus in PBW343/Muu RIL population
TAG 2013 CIMMYT
Breeding
WB 2014 Association Mapping of Resistance to Yellow Rust in Winter Wheat Cultivars and Elite Genotypes
Crop Science (2014) ICARDA
Breeding
DT 2014 From adoption claims to understanding farmers and contexts: A literature review of Conservation Agriculture (CA) adoption among smallholder farmers in southern Africa
Agriculture, Ecosystems and Environment 187 (2014) 116–132
CIMMYT Socio econ
DT 2014 Meeting demands for increased cereal production in China Journal of Cereal Science 59 (2014) 235e244
CIMMYT Breeding
25
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
ANNEX F. ‐ WHEAT researcher survey Sent out: 13 Nov 2014 Reminder sent by CIMMYT: 2 Dec 2014 Closed: 11 Dec 2014
Total CIMMYT ICARDA Other (competitive partner grants)
Survey sent to 109 58 32 19 Responses 66 43 15 9 Response rate 61% 74% 47% 47% Complete Reponses 43 28 9 6 Completed response rate 39% 48% 28% 32%
26
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
Survey population
MALE 81.8%
FEMALE 18.2%
Gender (Q2)
Program/FP leader/theme leader , 12.1%
Principle Investigator/Senior scientist
45.5%
Associate scientist/Post doctoral fellow
, 22.7%
Research Fellow , 0.0%
Other (please specify) 19.7% Position (Q3)
27
Wheat Evaluation, Annexes, April 2015
cgiar.iea.org
since 2012, 20, 30%
2008‐2011, 21, 32%
pre 2008, 25, 38%
Working with org since (Q5)
Crop sciences 77.3%
Natural resource
sciences 4.5%
Social sciences , 7.6%
Informatics 1.5%
Other (please specify) 9.1%
Research area (Q4)
Afghanistan , 1.5%Bangladesh , 4.5% China 3.0%
Ethiopia , 3.0%
Germany, 1.5%
India , 9.1%
Jordan 1.5%
Lebanon , 3.0%
Mexico 33.3%
Morocco 10.6%
Nepal 4.5%
Pakistan , 3.0%
South Africa , 3.0%
Syria, 3.0%
Tunisia 1.5%
Turkey 10.6%
Uzbekistan 3.0%
Duty station (Q6)
28
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
CRP engagement
11
42
17
14
25
810
3
0
5
10
15
20
25
30
less than 30% 40‐70% More than 80%
For which CRP(s) do you currently work? (Q7)
MAIZE
WHEAT
Other CRPs
29
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
less than 30%, 17, 30%
40‐70%, 14, 25%
More than 80%, 25, 45%
Working for WHEAT..... (Q7)
15 17
10
34
2621
94
9
18
8
0510152025303540 SI mentioned in top 3 (Q8)
30
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
13
29
39
28
18
11
05
1015202530354045
FP1 MaximizingBenefits forPoor Women,Children, and
Men
FP2 NovelDiversity andTools to Adaptto Climatic and
ResourceConstraints
FP3 GlobalBreeding
Partnerships toMeet FutureFood Demands
FP4 SustainableIntensificationof Wheat‐
based system
FP 5 Engagingand
strengthening
DON'T KNOW
FP mentioned in top 3 (Q8)
31
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
My home organization 73.7%
WHEAT, 24.6%
Other (please specify) 1.8%
What entity/organization do you primarily identify with? (Q10)
29
6
0
13
8
1
0
5
10
15
20
25
30
35
My home organization WHEAT Other (please specify)
What entity/organization do you primarily identify with? (Q10)
before 2011
after 2011
32
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
13
17
6 6
8
2
5
0
2
4
6
8
10
12
14
16
18
1 2 3 4 5 6 more than 7
How many different projects in WHEAT are you currently working on? (Q11)
33
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
20
17
11
8
1
0
5
10
15
20
25
I have participated
in designing WHEA
Tincluding its program
structure,
objectives, m
ain theo
ries of change and
Interm
ediate Developmen
t outcomes
(IDOs).
I have not participated
in designing the
WHEA
T but have read
key program
documen
ts and know the program
structure, objectives, m
ain theo
ries of
change, IDOs and key organizations
involved
.
I have some knowledge of the program
structure, objectives, m
ain theo
ries of
change, IDOs and key organizations
involved
.
I have some knowledge of the WHEA
T,but know only the SIs/FPs that m
y work
contributes to.
I know very little of nothing about
WHEA
T
How well do you know WHEAT? (Q13)
34
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
RESEARCH Q 14. What is your perception of the factors influencing the choice of research topics in the WHEAT Flagship you mostly contribute to?
3
0
1
1
0
1
2
4
3
1
1
4
2
1
5
7
8
3
5
12
8
9
13
11
12
11
13
14
10
20
24
20
15
13
10
7
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Expressed needs of clients or beneficiaries
Funding availability
Donor priorities
WHEAT strategy
Scientific interest/knowledge gap
Center strategy
1 ‐ No influence at all
2
3
4
5
6 ‐ Primary influence
35
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Q 15. According to you, which are currently the three most important research activities within WHEAT and where you think the emphasis should be?
26
12
7
3
1
0
0
0 5 10 15 20 25 30
Strategic research to produce International Public Goods
Adaptive research
Local research to produce feed‐back and synthesis for global…
Scaling‐out of research results
“Blue sky”, high risk research
Technical assistance
Other
Current most important research activities (top rated)
36
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
32
5
4
4
3
1
0
0 5 10 15 20 25 30 35
Strategic research to produce International Public Goods
“Blue sky”, high risk research
Local research to produce feed‐back and synthesis for…
Adaptive research
Scaling‐out of research results
Technical assistance
Other
Where emphasis should be (top rated)
37
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Q 16. The CRP receives funding from different sources where the Windows 1 and 2 are of least restricted type. What is your view of how W1/2 funds are used in WHEAT?
0
0
2
4
1
3
4
1
1
4
1
5
4
4
7
4
7
5
4
8
9
8
6
7
9
6
8
10
11
2
10
8
9
7
10
10
11
7
8
6
8
9
11
12
6
10
1
2
2
3
9
12
9
5
7
2
8
4
3
4
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Leverage bilateral funding
Fill gaps in research funding
Increase integration between different areas of research
Enhance desirable partnerships through competitive grants
Enhance research quality through competitive grants
Increase gender relevant research
Provide opportunities for long‐term, high risk research
Provide accountability through ex post studies
Provide relevance through ex ante studies
Cover overhead costs
1‐ Not at all
2
3
4
5
6‐ Main Purpose
38
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Q 17. In your view, how well are the following aspects for enhancing the effectiveness of WHEAT managed? Please score using a scale of 1-6 where 1=not well at all and 6=very well.
0
0
0
1
0
1
1
2
1
3
4
4
6
5
8
6
8
7
9
10
11
10
15
15
16
19
15
16
13
5
10
10
7
8
2
1
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Development of impact pathway
Engagement with partners
Annual progress monitoring
Capacity building
Analysis of target groups
Feed‐back between W1/W2 and bilateral projects
1‐ Not well at all
2
3
4
5
6‐ Very well managed
39
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Q 18. In your view, what are important pathways through which research in WHEAT aims to have impact? Please score using a scale of 1-6 where 1=not an impact pathway at all and 6=primary impact pathway.
0
0
0
0
1
1
1
1
0
0
1
2
3
2
0
3
4
5
4
5
6
6
8
6
9
12
8
12
10
14
20
17
13
16
10
31
21
17
14
12
10
12
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Influencing food security through global germplasmdevelopment
Influencing rural livelihoods through enhanced productivity
Enhancing varietal use through better seed dissemination
Enhancing environmental sustainability through improvedfarming practices
Enabling equitable benefits from research
Influencing funding of cereal research
Influencing partner research agendas in developingcountries
1‐Not an impact pathway at all
2
3
4
5
6‐Primary impact pathway
40
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Q 19. In your view, how effectively are the measures listed below managed in your Center/CRP for assuring and enhancing high quality of research? Please score using a scale of 6 where 1=no attention at all and 6=very effectively.
2
1
0
0
1
2
1
3
2
2
5
2
2
4
4
4
5
4
7
5
5
9
6
9
9
9
10
9
10
9
9
10
10
8
10
15
11
10
12
19
9
13
8
13
15
14
9
6
15
12
13
6
15
10
12
8
8
6
10
8
5
7
4
6
4
5
5
6
4
5
3
2
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Infrastructure needed for high quality science
Strategic use of grants
Availability and quality of technical facilities/ equipment
Learning and knowledge management
Availability and quality of research support
Acceptance and encouragement of innovative thinking
Researcher performance assessment
Research data management
Quality assurance processes such as internal peer feed‐back
Allocation of competences and appropriate skill mix to researchteams
Personal incentives for high research quality
Encouragement for learning from “ failure”
1 ‐ No attention
2
3
4
5
6 ‐ Very effectively
41
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
PARTNERSHIPS
20
5
5
4
3
2
2
1
1
0
0
0
0
0
0 5 10 15 20 25
National research institutions
Other CGIAR centers
National governments
Universities in developing countries
Universities in developed countries
Other CRPs
Other
Farmer organizations
Civil society organizations
National agricultural extension systems
Donor implementation agencies
International NGOs
Local NGOs
Ultimate beneficiaries
Most involved partners (top rated)
42
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
0 10 20 30 40
Other CRPs
Other CGIAR centers
National governments
Universities in developing countries
Universities in developed countries
National research institutions
National agricultural extension systems
Donor implementation agencies
International NGOs
Local NGOs
Farmer organizations
Civil society organizations
Ultimate beneficiaries
Other
Top 3 most involved partners (Q21)
43
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Q 22. In your view, to what extent do the current partnerships increase the likely effectiveness of your WHEAT-related research in areas listed below? Please score in scale of 6 where 1 -= not at all; and 6 = very much
0
1
0
1
1
3
1
2
4
4
6
5
10
7
6
9
8
12
15
17
16
12
13
10
17
16
16
16
13
13
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Help in outreach of the research results
Increase the relevance of your research
Help scale out your research results
Build on synergies which result in more streamlined researchimplementation
Increase the state‐of‐art in research
Help in attracting funding
1 ‐ Not at all
2
3
4
5
6 ‐ Very much
44
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Q 24: In your view, to what extent are the partners in WHEAT involved in Program activities as listed below? (Please score in scale of 6 where 1 -= not at all; and 6 = very much involved)
1
3
3
3
6
6
7
8
8
6
5
5
8
9
10
15
12
13
9
12
12
11
7
8
5
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Research prioritization
Planning of projects
Publishing research result
Receiving mentoring in research
Feed‐back from clients/users back to research
1‐ Not at all
2
3
4
5
6‐ Very much involved
45
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
GENDER Q 25. Please indicate your agreement with the following statements that relate to mainstreaming of gender issues in your work and WHEAT.
0
1
1
0
1
1
2
2
7
9
4
4
3
6
4
5
5
4
12
16
10
10
13
12
12
10
16
6
7
7
3
4
2
7
3
1
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Gender disaggregated data on results are collected when everappropriate.
The WHEAT gender strategy has been well communicated toteams and researchers.
The WHEAT gender strategy influences the way my team plansand conducts its work.
There is too much emphasis in gender even in research wheregender does not matter.
There is sufficient funding to implement the gender‐relatedactivities
The WHEAT gender strategy influences the way most teams inthe CRP plan and conduct their work.
Strongly disagree
Disagree
Somewhat disagree
Somewhat agree
Agree
Strongly Agree
46
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Capacity development Q 26. Please indicate your agreement your agreement with the following statements that related to capacity development (CD) in your work and WHEAT. Please score in a scale of 6 where 1=very dissatisfied and 6=very satisfied.
0
0
0
0
0
1
0
2
0
2
2
2
2
5
6
8
8
5
5
5
4
5
3
14
4
5
9
7
11
12
10
8
20
14
14
16
14
10
10
1
7
9
10
8
9
8
6
2
0% 20% 40% 60% 80% 100%
My Center is addressing institutional andorganizational CD needs in developing
countries very well,WHEAT is addressing well institutional andorganizational CD needs in developing
countries very well.
Training and mentoring are equitablytargeting men and women.
CD activities are designed so as to enhanceuptake of research results and likely
effectiveness.
CD activities are well integrated to research
My Center is addressing CD capacity needsof individuals very well.
WHEAT is addressing CD needs ofindividuals very well.
There is sufficient funding available for CDactivities
Stronglydisagree
Disagree
Somewhatdisagree
Somewhatagree
Agree
Strongly Agree
47
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Satisfaction/value added
Q 27. Please indicate how satisfied you are with the following working conditions for your work. Please score in a scale of 6 where 1=very dissatisfied and 6=very
0
0
0
0
2
1
2
0
6
3
2
6
7
6
7
3
9
7
9
8
9
12
10
11
14
12
9
7
14
12
9
11
10
8
10
8
14
13
10
10
7
12
9
7
7
4
3
4
3
5
1
2
1
0
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%100%
Share of time required for training andmentoring
Share of time required for coordinating amongpartners
Share of time required for travel and meetings(whether for Center or CRP)
Incentives for cooperating with non‐CGIARpartners
Share of time allocated to research (compared totime for administration and reporting; whether…
Reliability and predictability of bilateral projectfunding
Incentives for working across themes anddisciplines in the CRP
Incentives for cooperating with other CGIARCenters or CRPs
Reliability and predictability of CGIAR fundingthrough Window1/Window2
1‐ Very dissatisfied
2
3
4
5
6 ‐ Very satisfied
48
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
Q 28. Please indicate your agreement with the following statements related to the value WHEAT has had or is likely to have influencing the success of your research compared to past Center-based implementation of the research. Please score in a scale of 6 where 1=very dissatisfied and 6=very satisfied.
0
0
0
0
0
0
0
0
0
0
1
2
1
1
1
0
1
2
3
1
2
5
2
1
6
6
10
9
8
7
11
8
11
10
9
11
9
8
8
11
12
8
7
13
12
9
11
11
18
17
15
17
12
13
14
13
9
14
9
7
4
3
7
4
3
2
5
1
3
2
0
1
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
WHEAT is enabling research to be better aligned to beneficiary needs.
The results framework in WHEAT will improve the value‐added fromresearch.
Research is becoming strategically better focused on developmentoutcomes.
WHEAT provides a better framework for guiding and focusingresearch planning.
Due to WHEAT, capacity development is now addressed morestrategically to improve research effectiveness
WHEAT has improved the way in which gender issues are integratedto research
My research is better rationalized in the broader context of programobjectives.
WHEAT encourages accountability for development outcomes (notjust research outputs)
WHEAT is creating or enhancing synergies between participatingCenters.
Research is becoming better integrated across disciplines and teamstowards results.
WHEAT has good potential to help streamline administrativeprocedures
WHEAT has good potential to help streamline monitoring andreporting
1 ‐ Very dissatisfied
2
3
4
5
6 ‐ Very satisfied
49
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
ANNEX G. ‐ Sample project assessment ‐ TEMPLATE
PROJECT NUMBER: (if applicable) PROJECT TITLE: FLAGSHIP PROJECT NUMBER: TYPE OF PROJECT: RESEARCH <‐> more downstream DEVELOPMENT ORIENTED – please explain briefly LEAD: CIMMYT/ICARDA/other Filled out by: Date: Documentation used for assessment:
RELEVANCE AND COHERENCE:
Alignment with WHEAT objectives Project alignment means that project objectives and activities to achieve those objectives are clearly defined and match with those of the SI/FP
Is the project presented as part of WHEAT CRP?
To what extent is the project/activity aligned to the FP (or specific SI) objectives and WHEAT IDOs? ‐ Very well
‐ Moderately
‐ Poorly
Comments:
1. Relevance of project
Are the main target beneficiaries of the project clearly defined?
Does the project reflect needs and priorities of target group?
Does the project address globally/regionally important issues where CGIAR has comparative advantage?
2.
50
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
SCIENCE QUALITY
Is the research addressing researchable issues?
3.
Are research hypothesis clearly formulated and testable?
4.
Does the project use state of the art methodology?
5.
6. To what extent do the choices of research topics and research designs reflect a high quality of scientific thinking, state‐of‐the‐art knowledge of the scientific literature and complements research done elsewhere?
7.
To what extent does the research reflect an iterative process between downstream and upstream research? Has feedback from
downstream work been incorporated in research design?
LIKELY EFFECTIVENESS:
Is there an impact pathway described and is it realistic?
8.
How has progress been in terms of research results and outputs?
9.
Are limitations and delays explained?
51
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
10.
How does the project design address the scaling‐up and out of research outputs?
11.
Does the project include an implementation modality (partnerships, management) which reflects an appropriate role for CIMMYT/IITA?
12.
What has been the main success so far? (MENTION ONE MAJOR ACHIEVEMENT) Assess its significance.
13. Are constraints to research outputs as well as uptake/impact and challenges mentioned and addressed?
14.
Is the reference to when impact (adoption) is expected and in what scale? How likely do you see this realizing?
PARTNERSHIPS
What types of partners are included in the project?
Are the partners’ roles clearly defined?
15.
How is the work divided between CIMMYT/ICARDA and the partners?
To what extent are these partners relevant and likely effective in relation to the project's objectives and design ‐‐ at the project's
conceptual stage? ‐ High
‐ Substantial
‐ Modest
52
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
‐ Low
‐ Not mentioned
GENDER
16.
Does the project/research strategy address gender specific issues?
17.
Does the project report on gender disaggregated results?
From the point of view of achieving the objectives of the project, has there been an under‐emphasis, appropriate emphasis, or over‐
emphasis on gender analysis and gender‐specific research in terms of achieving the Flagship IDO? ‐ Under‐emphasis
‐ Appropriate emphasis
‐ Over‐emphasis
‐ Not mentioned
CAPACITY DEVELOPMENT
18.
Are there any capacity building measures mentioned and who do they target?
What capacity building activities have been implemented?
53
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
From the point of view of achieving the objectives of the project, has there been an under‐emphasis, appropriate emphasis, or over‐
emphasis on capacity development in terms of achieving the Flagship IDO? ‐ Under‐emphasis
‐ Appropriate emphasis
‐ Over‐emphasis
‐ Not mentioned
CONCLUSION/OBSERVATIONS
please briefly explain any qualifiers to the above questions (issues that could not be reflected) as well as briefly state the main strengths as well as issues relating to this project
54
Wheat Evaluation, Annexes, April 2015
ANNEX H. ‐ Peer review scoring of a random sample of publications – TEMPLATE
Number of publication (according to our list and file name): Name of publication: Journal name: Center: CIMMYT/ICARDA Area: Agronomy/Breeding/Socio econ Team member to review publication
Team members shall assess each publication according to the following standardized criteria and approach:
Criterion Assessment approach methodological rigor and coherence of data analysis
Scale1
comprehensiveness of research narrative Scale
innovativeness; novelty Observation: would novelty be expected, if yes what kind of novelty was observed
quality (and appropriateness) of publication venue
Observation of low‐quality or inappropriate venue relative to subject and quality of paper
collaboration (especially co‐authorship) evident Observation of extent of authorship and with whom
“fit” with CRP objectives Observation of outliers
overall quality of publication (including additional criteria at evaluator discretion)
Brief narrative
19. When there are other outputs than published work – such as germplasm ‐ systematic assessment of quality may be difficult and assessment of quality can be based on project reports, volume of output, extent of use/uptake and user perceptions.
1 Scale of 4 (1=poor; 2=mediocre; 3=good; 4=excellent) or 6 (1=poor; 2=quite poor; 3=adequate; 4=quite good; 5=good; 6=excellent). Eventually evaluation findings should not have too many scales.