Evaluation of the
CGIAR Research Program
on Wheat
Volume 2 – Annexes
April 2015
Wallace Beversdorf (Team Leader) Sylvie Brouder Paramjit (Pammi) Sachdeva Rasheed Sulaiman Deborah Templeton This evaluation has been commissioned by the Independent Evaluation Arrangement (IEA) of the CGIAR. The Independent Evaluation Arrangement (IEA) of CGIAR encourages fair use of this material provided proper citation is made. Correct citation: CGIAR‐IEA (2015). Annexes to the Evaluation of CGIAR Research Program on Wheat. Volune 2. Rome, Italy: Independent Evaluation Arrangement (IEA) of CGIAR iea.cgiar.org Wheat Evaluation, Annexes, April 2015 Table of contents ANNEX A. - Evaluation Team Members – Short Bios .................................... 1 ANNEX B. - Country visits .......................................................................... 2 ANNEX C. - List of people met .................................................................... 4 ANNEX D. - List of sample projects .......................................................... 17 ANNEX E. - Assessment of publications ................................................... 20 ANNEX F. - WHEAT researcher survey ...................................................... 25 ANNEX G. - Sample project assessment - TEMPLATE ................................ 49 ANNEX H. - Peer review scoring of a random sample of publications – ..... 54 cgiar.iea.org
Wheat Evaluation, Annexes, April 2015 ANNEX A. ‐ Evaluation Team Members – Short Bios Wallace (Wally) Beversdorf ‐ Evaluation Team Leader. Since 2005 Wally has been an independent consultant, involved in several reviews of research, including CSIRO Flagship program reviews and 2007 mid‐term review of the Generation Challenge Program. Before 2005 he worked over 10 years in the private seed sector, including positions as Head of Novartis world‐wide R&D, Head of Syngenta Plant Science and Vice President for Syngenta Biotechnology. He has also worked in the academia, holding positions at the Guelph University. He has a PhD in plant breeding and genetics. Sylvie Brouder ‐ Evaluation Team Member. Since 2005 Sylvie has served as Professor of Agronomy at Purdue University where she has been working for nearly 20 years. She is also Director of the Purdue University Water Quality Field Station. Her research interests include crop nutrient use efficiency, agroecosystem viability and sustainability and ecophysiology linked to abiotic stress tolerance. Through her teaching, outreach and consultancy activities she has been involved in international agricultural research and science agenda development. She has PhD in ecology. Deborah (Debbie) Templeton ‐ Evaluation Team Member. Until September 2013 Debbie worked for ACIAR for over 10 years primarily managing the Impact Assessment program. Between ACIAR employment, Debbie also worked for 3 years as social scientist (impact assessment specialist) at IRRI. She has experience in capacity building in research evaluation and impact assessment and in managing and conducting impact assessments. She has PhD in economics. Rasheed Sulaiman ‐ Evaluation Team Member. Rasheed is the Director of the Centre for Research on Innovation and Science Policy in India (since 2006). Prior to that, he worked as senior scientist at the National Centre for Agricultural Economics and Policy Research at ICAR. He has expertise in agricultural extension systems and policy, and agricultural innovation system. His research also covers the role of private sector and public‐private partnerships, developing new approaches to reaching rural women and evaluation of ICTs in agriculture. He has a PhD in agricultural extension. Paramjit (Pammi) Sachdeva ‐ Evaluation Team Member. Pammi is specialized in program and institutional assessment and HR management with expertise also in capacity development, systems analysis and organizational design. Since 2001 he has worked as an independent consultant and been involved in a number of external reviews of CGIAR Centers and programs, and in international development project and human resource management consultancies. Previously he worked at the World Bank as senior management specialist and advisor and earlier in his career at ISNAR as senior research officer. He has a PhD in social systems sciences. 1
cgiar.iea.org
Wheat Evaluation, Annexes, April 2015
ANNEX B. ‐ Country visits Date Country Main schedule Turkey Team members WB, DT 21‐24 Sep Ankara Izmir 24‐26 Sep Lebanon WB, DT Beirut 26 Sep – 1 Oct Ethiopia WB, DT Addis Ababa WB, DT Debre Zeit WB, DT Asella 1‐4 Oct Morocco WB, DT WB, DT Addis Ababa Casablanca visit CIMMYT/ICARDA office Visit research institutes Visit Regional Cereal Rust Research Center in the Aegean Agricultural Research Institute Terbol, AREC, Kfardan LARI ICARDA offices in Beirut Meeting with ICARDA & CIMMYT staff and presentation on Collaborative Activities with Ethiopian NARS Debre Zeit ARC, Green house, single race & international nurseries, breeding activities, seed producers & farmers seed producers, on farm trials and Gonde seed farm KARC, irrigation facility, international and single race nurseries, seed labs, Breeding and Seed Activities EIAR Quality Lab and Meeting with EIAR management INRA campus (greenhouse, biotech of INRA, quality lab and future building of ICARDA) Meeting with ICARDA staff Bread wheat presentation, Durum wheat presentation 2
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
Date Country Team members 8—13 Nov Bangladesh RS RS 14‐17 Nov India RS RS SB RS SB Main schedule Marchouch Annoceur Marchouch station (all wheat personnel attending) Annoceur station, visit of durum off‐season. Focus on RWA screening. Gigu Arrival to farmers communities in Gigu together with professor Boulif (ENA Meknes), presentation of farmers school (ICARDA's contribution) and of IFAD activities on‐farm in Meknes area, visit of the farm and lunch with farmers WRC Dinajpur meet with WRC Scientists and DAE (Department of Agricultural Extension) and BADC (Bangladesh Agriculture Development Corporation Rangpur Discuss with CSISA‐CIMMYT, SRFSI staff and OFRD/BARI Scientists NGO partners (RDRS, etc.) Dhaka Discuss with BARI authorities/Seed Certification Agency Arra and Zero tillage wheat sowing, interaction with service providers, farmers , KVK and other Patna partners Samatipur, Visit fields with bed planting, zero tillage intercropping of maize and interaction with Pusa women farmers in Bandra Visit to BISA farm‐Pusa Interaction with Head, IARI Research Station of RAU officials Interaction with ICAR and other partners in ICAR complex‐Patna 3
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
ANNEX C. ‐ SURNAME, Name Position Organization Country visit Abeyo, Bekele Wheat Breeder, Global Wheat Program CIMMYT Ethiopia Abinasa, Mohammed Wheat Breeder ICARDA Ethiopia Adhikari, Mani Krishna ADO Bangladesh Afram, Michel Antoine Aliy, Sheriff President – Director General Research Extension Specialist – Technology Promotion Debre Zeit Agricultural Research Center CIMMYT Lebanese Agricultural Research Institute EIAR Ethiopia Amil, Rola PhD Student ICARDA Lebanon Amri, Ahmed Head, Genetic Resources Section ICARDA Morocco Andaloussi, Abbad Head , Plant Protection Department INRA Morocco Asaad, Siham Lebanon Austin, Nick Head, ICARDA’s Seed Health Laboratories ICARDA Director, Technology Multiplication Directorate and Coordinator, Deployment of Rust Resistant Wheat Varieties in Ethiopia EIAR Chief Executive Officer of ACIAR, Pacific Countries representative on the CGIAR Fund Council ACIAR Badstue, Lone Gender Specialist, SEP CIMMYT Mexico Bakshi, Elahi Applied Ag Economist CIMMYT Bangladesh Bandyopadhyay, Ranajit Pathologist ICARDA Mexico Bänziger, Marianne Deputy Director General Research & Partnership CIMMYT Mexico Atilaw, Abebe List of people met Lebanon Ethiopia Australia 4
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Barma, Naresh Ch Deb Chief Scientific Officer BARI, Gazipur Bangladesh Bassi, Fillipo Durum Wheat Breeder ICARDA Morocco Baum, Michael Director ‐ BIGMP CIMMYT Mexico Morocco Bhatt, B. P Director INRA ICAR Research Complex for Eastern Region Bishaw, Zewdie Head, Seed Section Ethiopia Bodruzzaman, Md Principal Scientific Officer (Soils) ICARDA Wheat Research Center, Dinakpur Braun, Hans Program Director Global Wheat Program CIMMYT Mexico Briones, Ernesto Senior Systems Developer CIMMYT Mexico Chand, Ramesh Professor‐cum‐Plant Pathologist Banaras Hindu University Mexico Chanyalew, Solomon Center Director, Debre Zeit Agricultural Research Center Ethiopia Chatrath, R Principal Scientist EIAR Directorate of Wheat Research (DWR), Karnal, ICAR India Chikoye, David R4D Director, IITA‐Southern Africa IITA Mexico Chowdhury, S. Consultant Borlaug Institute for South Asia India Bennani, Sahar India Bangladesh 5
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Coffman, Ronnie
Position Principal Investigator, Durable Rust Resistance Prog
Organization Cornell University
Country visit Obrégon
Dababat, Amer Plant Pathologist and Nematologist
Global Wheat Program CIMMYT
Turkey
Datta, Swapan K De la O Elizagaray, Marisa Deputy Director General (Crop Science) Indian Council of Ag Research Obrégon Manager, Risk Management & International Policy CIMMYT Mexico Debele, Tolessa SARD‐SC Coordinator for ESA Ethiopia Degite, Gemechu Chair Technical Coordinator, East African Agricultural Productivity Project Wheat Regional Center of Excellence Kulumsa Agricultural Research Center Principal Adviser Research and Cropping Systems and Economics (CSE) program manager. ICARDA Ethiopian Seed Enterprise (ESE)
Gonde‐Iteya Basic Seed Farm EIAR ACIAR
Ethiopia Australia
Dessalegn, Tadesse Dixon, John
Ethiopia Duveiller, Etienne Director of Research for South Asia CIMMYT Obrégon Dwivedi, P K Programme Coordinator Krishi Vigyan Kendra, Buxar India El Bouhssini, Mustapha Entomologist ICARDA Morocco El Hassouni , Khaoula sponsored by GRDC Erenstein, Olaf Program Director, Socioeconomics Program CIMMYT Mexico Figueroa, Pedro Plant Pathologist in National Wheat Program INIFAP Obrégon Firke, Asnake Director, Crop Research EIAR Ethiopia Fisher, Tony Honorary Research Fellow at CSIRO, Member of WHEAT Stakeholder Committee CSIRO Australia Morocco 6
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Freymond, Jean Secretary SASAKAWA Africa Association Obrégon Fulss, Richard Head, Knowledge Management CIMMYT Mexico Gathala, Mahesh Cropping System Agronomist, Leader SRFSI CIMMYT Bangladesh Gérard, Bruno Program Director, Global Conservation Agriculture Mexico Ghosh, Anup Kumar Senior Agricultural officer CIMMYT Resilient Farming Systems Intensification (SRFSI) Project, RDRS Girma, Bedada Durable Rust Resistant Program, Kulumsa Agricultural Research Center EIAR Govaerts, Bram Associate Director, Global Conservation Agriculture CIMMYT Ethiopia Mexico (Texcoco and Obrégon) Guertin, Michelle Senior Monitoring, Evaluation & Learning Specialist CIMMYT Skype Gupta, Pryianka sponsored Borlaug Scholarship Morocco Gupta, R K Principal Scientist Individual Directorate of Wheat Research (DWR), Karnal, ICAR Gutterson, Neal President, CEO Obrégon Haddad, Nicolas Manager, Agricultural Research and Education Center (AREC) Mendel Biotechnology American University of Beirut Hannan, Abdul Deputy Director Department of Agricultural Extension Haque, Anarul Extension Agronomist, CSISA, Hub Manager, Rangpur Harris, Abdul Principal Scientists Agronomy CIMMYT ICAR Research Complex for Eastern Region Bangladesh India Lebanon Bangladesh Bangladesh India 7
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Hassen, Haloma Consultant in small ruminant research ICARDA Morocco Hearne, Sara Senior Scientist, Maize Molecular Geneticist/Pre‐breeder CIMMYT Mexico Herremans, Anna (former) Director, International Finance Mexico Hassan, Selima Sr Scientific Officer CIMMYT BARI, On Farm Research Division, Rangpur Hobbs, Huntington CIMMYT Mexico Hodson, David Leader, Strategic Planning and Research Coordination, MasAgro GIS and Decision Support Systems
SEP CIMMYT Ethiopia Homma, Shitaye Durum Wheat Breeder, Debre Zeit Agricultural Research Center Ethiopia Hossain, Akbar Senior Agronomist Hossain, Mofazzul Deputy Director Seed Marketing Hossain, Monwar Scientific Officer (Plant Breeding) Hossain, Zakir Scientific Officer (Agricultral Engineer) EIAR Wheat Research Center, Dinakpur Bangladesh Agricultural Development Corporation Wheat Research Center, Dinakpur Wheat Research Center, Dinakpur Hundie, Bekele Plant Pathologist, Kulumsa Agricultural Research Center EIAR Huttner, Eric Research Program Manager, Crop Improvement & Management Idris, Mohammad Principal Scientist (Entomology) ACIAR ICAR Research Complex for Eastern Region Bangladesh Bangladesh Bangladesh Bangladesh Bangladesh Ethiopia Obrégon and Australia India 8
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Iraqi, Driss Jahan (Belal), Abu Hena Sorwar Coordinator, Biotechnology Unit INRA Morocco Principal Scientific Officer BARI, Gazipur Bangladesh Jakobi, Nina WHEAT Program Assistant Agricultural Economist
SEP CRP Mexico CIMMYT Central Soil Salinity Research Institute Ethiopia CIMMYT India Jaleta, Moti Jat, H S Jat, M L Cropping Systems Agronomist, CSISA Senior Cropping Systems Agronomicst & CIMMYT‐CCAFS South Asia Coordinator, CIMMYT India Jat, Raj Kumar Cropping Systems Agronomist Borlaug Institute for South Asia India Kaan, Kathy Kan, Mustafa Program Manager Agricultural Economist, Department of Economy, Statistic and Extension Obrégon Turkey
Karim, Rezaul Upzilla Agricultural Officer BMGF Bahri Dagdas International Agricultural Research Institute Department of Agricultural Extension Kassie, Grima T Agricultural Economist, SEPRP ICARDA Morocco Keil, Alwin Senior Agricultural Economist CIMMYT India Kemal, Seid Ahmad Pathologist ICARDA Ethiopia Bangladesh 9
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Keser, Mesut Kircalioğlu, Gün
IWWIP, Coordinator for ICARDA Research Coordinator
ICARDA Aegean Agricultural Research Institute Turkey Turkey
Kiwan, Pierre Assistant Researcher , Terbol Research Station ICARDA Lebanon Kommerell, Victor WHEAT Program Manager Mexico Kumar, Mithilesh Director of Research CIMMYT Rajendra Agricultural University, Pusa, Samastipur Kumar, Virender Cropping Systems Agronomist CIMMYT India Legesse, Wasihun Wheat Breeder , Debre Zeit Agricultural Research Center EIAR Ethiopia Listman, Michael G. Senior Science Writer, Corporate Communications CIMMYT Mexico Lopez Saavedra, Victor Manager of Institutional Relations TTF‐MasAgro CIMMYT Mexico Lopez, Diana Project Management Unit CIMMYT Mexico Lumpkin, Thomas DG CIMMYT Mexico Machlab, Hassan Country Manager/Lebanon Lebanon Malaker, Paritosh Kumar Director ICARDA Wheat Research Center, Dinakpur Mallari, Sally MAIZE Program Assistant CIMMYT Mexico Mallik, R. S. Senior Agronomist And Csisa Objective 1 Leader India Mamo, Beditu Chair CIMMYT Memher Agera Seed Multiplication and Marketing Cooperative India Bangladesh Ethiopia 10
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Medina, Richard Members of the Mahila Kisan Sakhi Director, Internal Audit CIMMYT Mexico CSISA ‐ Bihar, Mahila Samaykhya, Muzaffarpur n/a India Mendoza, Fernando P Senior Internal Auditor IITA Mexico Menkir, Abebe Mert, Zafer Team leader for maize improvement research at IITA, Focal Point for CRP at IITA Phytopathologist / Plant pathologist, Department of Crop Diseases and Resistance Breeding IITA Mexico The Central Research Institute Turkey
for Field Crops (TARM), Ministry of Food, Agriculture and Livestock (MFAL) Mir, Patricia V Risk Management Analyst CIMMYT Mexico Mishra, Satya Prakash Officer VST Tillers Tractors Ltd India Mishra, V.K. Professor, Dept. of Genetics and Plant Breeding Obrégon Mitiku, Demessie Seed Agronomist, Supporting Seed Demonstration for Private Seed Growers Banaras Hindu University AMUARI High Yield Varieties and Agricultural Products PLC Mittal, Surabhi Economist CIMMYT India Miyamoto, Masaaki Chief Executive Officer SASAKAWA Africa Association Obrégon Momin, Abdul CIMMYT Bangladesh Nachit, Miloudi Cropping Systems Agronomist, Manager‐CSISA Jessore Hub Former Durum Wheat Breeder and now Consultant with focus on pre‐breeding and on farm trials ICARDA Morocco Nasserlehaq, Nsarellah Durum Wheat Breeder INRA Morocco Nawar, Fawzy Senior documentation specialist, Genetic Resources Section ICARDA Morocco Ethiopia 11
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Nazari, Kumarse Position Plant Pathologist, Cereal Rust Regional Center
Organization ICARDA
Country visit Turkey
Ortiz Monasterio, Ivan Agronomist, Wheat Harvest Coordinator
CIMMYT
Mexico
Ozdemir, Fatih BDIARI
Turkey
Ozkan, Isa Director, Bahri Dagdas International Agricultural Research Institute, IWWIP Coordinator for Turkey Head, Field Crops Research Department MFAL Turkey
Pandit, D B Cropping Systems Agronomist, Manager‐CSISA Mymensingh CIMMYT Bangladesh Payne, Thomas S. CIMMYT Board Secretary Mexico Peksuslu, Ali Director, CIMMYT AEGEAN Agricultural Research Institute Turkey Pfeiffer, Wolfgang H Deputy Director, Operations HarvestPlus Obrégon Pixley, Kevin Program Director, Genetic Resources Program CIMMYT Mexico Powell, Wayne Chief Science Officer CGIAR Obrégon Rahman, Ataur Specialist Conservation Agriculture BARI, Gazipur Bangladesh Mexico Bangladesh Rajasekharan, Nellooli P. Director, International Human Resources Rashid, Mamunur A&E Coordinator CIMMYT Resilient Farming Systems Intensification (SRFSI) Project, RDRS Renard, Geneviève MAIZE and WHEAT Communication Specialis GCP Mexico Reynolds, Mathew Head Wheat Physiology Obrégon Reza, Mustafa Alir Senior Scientific Officer, (Wheat Pathology) CIMMYT Wheat Research Center, Dinakpur Bangladesh 12
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Ribaut, Jean‐Marcel Director, Generation Challenge Program CIMMYT Mexico Riis‐Jacobsen, Jens Director of Int. Systems and Information Technology CIMMYT Mexico Rodriguez, Horacio MasAgro Extension Coordinator Mexico Rorisa, Bejiqa Cooperative Farmer CIMMYT Guchi Habe Badosa Bread Wheat and Seed Multiplication and Value Chain Cooperative Rossi, Frederik Agricultural Economist, Manager‐CSISA Faridpur Hub CIMMYT Bangladesh Rugema, Hilary Coordinator, Crop Productivity Improvement SASAKAWA Africa Association Obrégon Saidi, Seddik Head, Plant Breeding Department INRA Morocco Saint Pierre, Carolina Scientist, Wheat Phenotyping Coordinator SeeD CIMMYT Obrégon Sanchez –Garcia, Miguel Spring Wheat Breeder ICARDA Morocco SanVicente, Felix Breeding lead for the tropics in Mexico Mexico Sarker, Abu Zaman Princial Scientific Officer (Agronomy) Bangladesh Sayem, Abu Regional Director CIMMYT Wheat Research Center, Dinakpur Agricultural Information Service (Ministry of Agriculture) Schulthess, Urs Crop modeler, Global Conservation Agricultural program CIMMYT Mexico Sefera, Tadessa Center Director, Kulumsa Agricultural Research Center EIAR Ethiopia Segovia, Vanessa Post Doctorial Fellow Turkey Senthil, R. Principal Scientist ICARDA Directorate of Wheat Research (DWR), Karnal, ICAR Ethiopia Bangladesh India 13
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Shahjahan, Md Croping Systems Agronomist, , Manager‐CSISA Khulna Hub Bangladesh Sharma, Indu Director and Member, Wheat Management Committee (CRP‐Wheat) Sharma, P C Head, Crop Improvement Sharma, R K Short, Thomas W. Principal Scientist DDG Support Services
CIMMYT Directorate of Wheat Research (DWR), Karnal, ICAR Central Soil Salinity Research Institute Directorate of Wheat Research (DWR), Karnal, ICAR CIMMYT
India Mexico
Silim, Said Nahdy Country Manager ICARDA Ethiopia and Coordinator Sub‐Saharan Africa Regional Program ICARDA Ethiopia Sim, Graham Director, International Finance CIMMYT Mexico Singh, Ravi P Head, Bread Wheat Improvement & Rust Res Obrégon Singh, Satyavir Principal Scientist CIMMYT Directorate of Wheat Research (DWR), Karnal, ICAR Sohail, Quahir Spring Wheat Breeder Solanki, I S India India India Morocco Head ICARDA Indian Agricultural Research Institute Solh, Mahmoud DG ICARDA Lebanon Souihka, Allah Manager, Marchouch Station ICARDA Morocco Sugandhi, ? Gender Cordinator, CSISA CIMMYT India Tadessa, Zerihun National Coordinator, Wheat Program EIAR Ethiopia Tadesse, Wuletaw Bread Wheat Breeder ICARDA Morocco India 14
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Tafesse, Mekasha Driver and Logistical Assistant ICARDA Ethiopia Tanwir, Niayer Secretary Creation Welfacer Society India Tawkaz, Sawsan Head, ICARDA’s Double Haploid Laboratory Lebanon Teklu, Kifle Participating Farmer Tesfaye, Bezabih Seed Specialist ICARDA Memher Agera Seed Multiplication and Marketing Cooperative AMUARI High Yield Varieties and Agricultural Products PLC Ethiopia Tessema, Alemu Chair Denkaka Megertu Cooperative Ethiopia Thornton, Matthew Hub Coordinator Mexico Tiwari, Ratan Principal Scientist CIMMYT Directorate of Wheat Research (DWR), Karnal, ICAR Tiwari, T. P. Tovar Mondragon, Jose Ramiro Cropping System Agronomist & Country Representative CIMMYT Bangladesh Manager, Financial Planning CIMMYT Mexico Trachsel, Sam Scientist, Global Maize Program CIMMYT Mexico Tsivelikas, Athanasios Genebank Manager ICARDA Morocco Uddin, Mohdi Cropping System Agronomist, Manager‐CSISA Faridpur Hub CIMMYT Bangladesh Udupa, Sripada Senior Scientist, Biotechnology, ICARDA Morocco van Ginkel, Maarten DDGR ICARDA Lebanon Wakjira, Adunga Deputy Director General EIAR Ethiopia Ethiopia India 15
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
SURNAME, Name Position Organization Country visit Ward, Rick Principal Scientist, Global Wheat Program CIMMYT Obrégon Watson, David MAIZE Program Manager CIMMYT Mexico Willcox, Martha Senior Scientist working with the Seeds Discovery (SeeD) project CIMMYT Mexico Worku, Zewuditu Woman Farmer Ethiopia Yai, Kebede Cooperative Farmer n/a Guchi Habe Badosa Bread Wheat and Seed Multiplication and Value Chain Cooperative Yasmin, Samina Cropping Systems Agronomist, Manager‐CSISA Barisal Hub CIMMYT Bangladesh Yazbek, Mariana Post Doc Fellow, Genetic Resources ICARDA Lebanon Zaim, Meryem sponsored by GRDC n/a Morocco Zehr, Usha Barwale Chief Technology Officer, Maharashtra Hybrid Seeds Co. Ltd. MAHYCO Obrégon Ethiopia 16
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
ANNEX D. ‐ List of sample projects A total of 40 projects were selected from the project database. These included the 10 largest projects (according to the budget allocated to WHEAT) as well as 30 projects which were randomly selected by Flagship. Projects had to be replaced from the initial selection and some projects utlimately could not be reviewed because information was found insufficient or was only available in Spanish, or treated as confidential. The evaluation team looked at a total of 34 projects listed below: No Title FP Lead A4031.09.19 Accelerating adoption of yellow rust resistance winter varieties in Central Asia 4 Other The Potential for Wheat Production in Sub‐Saharan Africa: Analysis of Biophysical Suitability and A4031.09.24 Economic Profitability 1 CIMMYT Enhanced quality and healthy seed testing system for International Winter Wheat Improvement A4031.0918 Program (IWWIP) 3 Other Enhancing cotton germplasm, improving resistance to cotton leaf curl virus and supporting cotton B 1198 best management practices for small farmers. 4 ICARDA B1146 Joint ICARDA‐ARC Wheat Improvement Program 2 ICARDA B1202 Pakistan Wheat production enhancement 3+4+5 ICARDA B1202 B1287 B1313 B1355 and 1356 C0035 Pakistan Wheat Production Enhancement Initiative Support to Agricultural Research for Development of Strategic Crops in Africa (SARD‐SC)‘ Wheat Productivity Improvement towards Food Self‐sufficiency 2+3+5 ICARDA 5 ICARDA 5 ICARDA Mobilizing Novel Genes from Wheat 2 CIMMYT/ICARDA Cereal Systems Initiative for South Asia (CSISA)‐Phase II 4 CIMMYT 17
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
No C0037 C0040 C0064 n/a R0148 T0083 W 0286 W0101 W0204 W0205 W0212 W0235 W0239 Title Cereal Systems Initiative for South Asia (CSISA)‐India MASAGRO‐Desarrollo sustentable con el agricultor Africa Rising: Research in Sustainable Intensification for the next generation Wheat Addressing the challenge of climate change for sustainable food security in Turkey, Iran, Pakistan, Uzbekistan, Morocco and Spain through the exploitation of wheat Genetic Resources, adoption of resilient improved varieties on farmers fields and their socio‐economic impact. MASAGRO‐Descubriendo la diversidad genética de las semillas Expansion of the Cereal Systems Initiative for South Asia (CSISA) in Bangladesh Development of Heat Tolerant Wheat for South Asia Desarrollo de nuevas variedades de trigo duro, trigo harinero y triticale a partir de germoplasma procedente del CIMMYT‐Phase III Identification and utilization of novel sources of resistance against soil borne pathogens in wheat (CIM00014) Enhanced Delivery of CIMMYT Germplasm to Australia Development of Cereal Germplasm and the Screening for Disease Resistance and End‐Use Quality: CIMMYT ‐ Triticale Improvement Component Identifying new genetic sources and evaluating United States wheat germplasm for resistance to stem rust in Eastern Africa (25856) Pakistan Wheat production enhancement FP 4 4 4 Lead CIMMYT CIMMYT CIMMYT 2 4 4 3 CIMMYT CIMMYT CIMMYT CIMMYT 3 CIMMYT 3 3 CIMMYT CIMMYT 3 CIMMYT 3 CIMMYT 3+4+5 CIMMYT 18
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
No W0250 Title Durable Rust Resistance in Wheat (Phase II Genetics and Physiology of Wheat Development to Flowering: Tool to breed for improved W0252 adaptation and yield potential: W0265 Sustainable Wheat & Maize Production in Afghanistan ( W0266 Agricultural Innovation Programme W0269 KAI‐Agricultural Technologies in Kazakhstan W0273 Joint Development of Korean Winter Bread Wheat Lines with heat tolerance and high protein W0276 Russia‐Omsk Institute W0281 Field evaluation of Genetically Modified Wheat W0289 Rapid Development of Climate Resilient Wheat Varieties for South Asia using Genomic Selection W1/2 activity Socioeconomics & policies for wheat futures, FP 3 Lead CIMMYT 2 5 4 3 n/a 3 2 2+3 1 CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT 19
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
ANNEX E. ‐ Assessment of publications Selection of individual publications for assessment The team intended to assess 37 publications in total. The publications were categorized according to the Center that issued them (CIMMYT and ICARDA) and to discipline (i.e. whether they related to agronomy, breeding or socio‐economics). Target numbers were then developed based on how many publications each Center had published in the 3 disciplines (see Table 1 below). Publications for assessment were then selected randomly from the database according to these target numbers. Table 1 - Criteria for selection of sample publications
CIMMYT Agronomy 85% Socio‐
economics 71% Breeding 75% Number of Publications ICARDA 15% SAMPLE ACTUAL TOTAL CIMMYT ICARDA CIMMYT ICARDA 10 9 1 6 1 29% 25% 6 21 4 17 30 2 4 7 5 19 30 2 3 6 After all publications had been identified, an assessor was assigned for each one, bearing in mind the areas of competence, expertise and experience of the assessors. Some of the publications were re‐classified (especially some of the agronomy publications which related more to breeding). One publications by ICARDA was not assessed, as it could not be accessed (Genome-wide association mapping for five major pest resistances in wheat, Molecular
Breed). The total of 36 publications assessed by the evaluation team are shown in the table below. 20
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
Team YEAR Title member SB 2012 Achieving yield gains in wheat DT 2012 RS 2012 WB 2012 RS 2012 RS 2012 RS 2012 DT 2012 Agricultural Extension, Collective Action and Innovation Systems: Lessons on Network Brokering from Peru and Mexico Analysis of genotypic variation for NDVI (normalized difference vegetation index) and its relationship with grain yield in winter wheat under terminal heat stress Analysis of leaf and stripe rust severities reveals pathotype changes and multiple minor QTLs associated with resistance in an Avocet × Pastor wheat population Breeding progress for yield in winter wheat genotypes targeted to irrigated environments of the CWANA region Conservation Agriculture in Maize‐ and Wheat‐Based Systems in the (Sub)tropics: Lessons from Adaptation Initiatives in South Asia, Mexico, and Southern Africa Conservation agriculture, increased organic carbon in the top‐soil macro‐
aggregates and reduced soil CO 2 emissions Food sovereignty or the human right to adequate food: which concept serves better as international development policy for global hunger and poverty reduction? JOURNAL CENTER Plant, Cell & Environment (5.14 in CIMMYT 2012, year of publication The Journal of Agricultural CIMMYT Education and Extension ICARDA Plant Breeding 131(2012) TAG 2012 Euphytica (2013) CIMMYT ICARDA Journal of Sustainable Agriculture CIMMYT (2012) CIMMYT Plant Soil (2012) Type Breeding Socio econ Breeding Breeding Breeding Socio econ Agronomy CIMMYT Agric Hum Values (2012) Socio econ 21
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
Team YEAR Title member From genotype × environment interaction to gene × environment interaction by WB 2012 Crossa, J Current Genomics Genetic structures of the CIMMYT international yield trial targeted to irrigated RS 2012 environments Genetic yield gains and changes in associated traits of CIMMYT spring bread WB 2012 wheat in a "Historic" set representing 30 years of Breeding WB 2012 Genetic yield gains of the CIMMYT International semi‐arid wheat yield SB 2012 Global Crop Improvement Networks to Bridge Technology Gaps RS 2012 WB WB 2012 2012 DT 2012 WB 2012 SB 2012 Physiological Traits for Improving Heat Tolerance in Wheat Global incidence of wheat rusts and powdery mildew during 1969‐2010 and durability of resistance of winter wheat variety Bezostaya 1 Lr68: A new gene conferring slow rusting resistance to leaf rust in wheat Multi‐trait and multi‐environment QTL analyses for resistance to wheat diseases Performance of biofortified spring wheat genotypes in target environments for grain zinc and iron concentrations Phenotyping transgenic wheat for drought resistance (2012) JOURNAL Current Genomics 2012 Mol Breeding Crop Science, 2012 Crop Science (2012) J. of Exp. Botany (5.242 for 2012 – year of publication) Eur J Plant Pathol Theoretical and Applied Genetics Open Access PLOS‐One (2012) Field Crops Research 137 (2012) Journal of Experimental Botany Plant Physiology (6.56 in year of publication, 2012) CENTER CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT Type Breeding Breeding Breeding Breeding Agronomy Breeding CIMMYT CIMMYT CIMMYT Breeding Breeding CIMMYT CIMMYT Breeding Breeding Breeding 22
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
Team YEAR Title member Quantifying how winter wheat crops accumulate and use nitrogen reserves during SB 2012 growth Stay‐green in spring wheat can be determined by spectral reflectance SB 2012 measurements (normalized difference vegetation index) independently from phenology DT 2012 The Production Functions of Wheat Production in Turkey SB 2012 WB 2012 RS 2013 DT 2013 RS 2013 WB 2013 The yield correlations of selectable physiological traits in populations of advanced spring wheat lines grown in warm and drought environments Virulence of Beauveria bassiana against Sunn pest, Eurygaster integriceps Puton (Hemiptera: Scutelleridae) at different time periods of application Assessing the impacts of GAFTA on selected members’ bilateral agricultural trade: an application of the Gravity Model. Crops that feed the world 10. Past successes and future challenges to the role played by wheat in global food security Earliness in wheat: A key to adaptation under terminal and continual high temperature stress in South Asia Genetic analysis of adult plant resistance to yellow rust and leaf rust in common spring wheat JOURNAL CENTER Field Crops Research (2.47 in year CIMMYT of publication, 2012) CIMMYT J. of Experimental Botany (5.242 for 2012 – year of publication) Bulgarian Journal of Agricultural Science, 18 (No 2) 2012 Field Crops Research; Journal of Entomology and Nematology (2012) Am‐Euras. J. Agric. & Environ. Science (2013) Food Sec. (2013) Field Crops Research (2013) Plant Disease (2013) ICARDA CIMMYT ICARDA ICARDA CIMMYT CIMMYT CIMMYT Type Agronomy Breeding Socio econ Breeding Agronomy Socio econ Socio econ Agronomy Breeding 23
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
Team YEAR Title member Historical changes in grain yield and quality of spring wheat varieties cultivated in SB 2013 Siberia from 1900 to 2010 Identification and characterization of international Fusarium head blight SB 2013 screening nurseries of wheat at CIMMYT, Mexico RS SB WB WB DT DT 2013 Meta: A suite of sas programs to analyze multienvironment Breed trials Mineral nitrogen dynamics in irrigated rice‐wheat system under different 2013 irrigation and establishment methods and residue levels in arid drylands of Central Asia QTL mapping of slow‐rusting, adult plant resistance to race Ug99 of stem rust 2013 fungus in PBW343/Muu RIL population Association Mapping of Resistance to Yellow Rust in Winter Wheat Cultivars and 2014 Elite Genotypes From adoption claims to understanding farmers and contexts: A literature review 2014 of Conservation Agriculture (CA) adoption among smallholder farmers in southern Africa 2014 Meeting demands for increased cereal production in China JOURNAL Canadian Journal of Plant Science J. Plant Pathology (1.71 in 2013, year of publication) Agronomy Journal Volume 105, Issue 1, 2013 European Journal of Agronomy (2.92) TAG 2013 Crop Science (2014) Agriculture, Ecosystems and Environment 187 (2014) 116–132 Journal of Cereal Science 59 (2014) 235e244 CENTER CIMMYT CIMMYT CIMMYT Type Breeding Breeding Agronomy CIMMYT Agronomy CIMMYT ICARDA Breeding Breeding CIMMYT Socio econ CIMMYT Breeding 24
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
ANNEX F. ‐ WHEAT researcher survey Sent out: 13 Nov 2014 Reminder sent by CIMMYT: 2 Dec 2014 Closed: 11 Dec 2014 Survey sent to Responses Response rate Complete Reponses Completed response rate Total CIMMYT ICARDA 109 66 61% 43 39% 58 43 74% 28 48% 32 15 47% 9 28% Other (competitive partner grants) 19 9 47% 6 32% 25
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
Survey population Other (please specify) 19.7%
FEMALE 18.2%
Gender (Q2)
Program/FP Position (Q3) leader/theme leader , 12.1%
Research Fellow , 0.0%
Associate scientist/Post doctoral fellow , 22.7%
Principle Investigator/Se
nior scientist 45.5%
MALE 81.8%
26
cgiar.iea.org Wheat Evaluation, Annexes, April 2015
Working with org since (Q5)
Other (please specify) 9.1%
since 2012, 20, 30%
Research area (Q4)
pre 2008, 25, 38%
Informatics 1.5%
Social sciences , 7.6%
Natural resource sciences 4.5%
Crop sciences 77.3%
Afghanistan , 1.5%
Uzbekistan 3.0%
Turkey 10.6%
Tunisia 1.5%
Syria, 3.0%
South Africa , 3.0%
Pakistan , 3.0%
Nepal 4.5%
Morocco 10.6%
2008‐2011, 21, 32%
Bangladesh , 4.5%
China 3.0%
Ethiopia , 3.0%
Germany, 1.5%
India , 9.1%
Jordan 1.5%
Lebanon , 3.0%
Duty station (Q6)
Mexico 33.3%
27
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 CRP engagement 30
25
For which CRP(s) do you currently 25
work? (Q7)
20
17
WHEAT
11
10
MAIZE
14
15
10
Other CRPs
8
4
5
2
3
0
less than 30%
40‐70%
More than 80%
28
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Working for WHEAT..... (Q7)
less than 30%, 17, 30%
More than 80%, 25, 45%
40‐70%, 14, 25%
40
35
30
25
20
15
10
5
0
SI mentioned in top 3 (Q8)
34
26
15
21
17
10
18
9
9
4
8
29
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 FP mentioned in top 3 (Q8)
45
40
35
30
25
20
15
10
5
0
39
29
28
18
13
11
FP1 Maximizing FP2 Novel
FP3 Global FP4 Sustainable FP 5 Engaging DON'T KNOW
Benefits for Diversity and
Breeding
Intensification
and
Poor Women, Tools to Adapt Partnerships to of Wheat‐
strengthening
Children, and to Climatic and Meet Future based system
Men
Resource
Food Demands
Constraints
30
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 What entity/organization do you primarily identify with? (Q10)
Other (please specify) 1.8%
WHEAT, 24.6%
My home organization 73.7%
35
30
What entity/organization do you primarily identify 29
with? (Q10)
25
20
15
before 2011
13
after 2011
10
6
8
5
0
1
0
My home organization
WHEAT
Other (please specify)
31
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 How many different projects in WHEAT are you currently working on? (Q11)
18
17
16
14
13
12
10
8
8
6
6
6
5
4
2
2
0
1
2
3
4
5
6
more than 7
32
cgiar.iea.org I know very little of nothing about
WHEAT
10
I have some knowledge of the WHEAT,
but know only the SIs/FPs that my work
contributes to.
20
I have some knowledge of the program
structure, objectives, main theories of
change, IDOs and key organizations
involved.
25
I have not participated in designing the
WHEAT but have read key program
documents and know the program
structure, objectives, main theories of
change, IDOs and key organizations
involved.
I have participated in designing WHEAT
including its program structure,
objectives, main theories of change and
Intermediate Development outcomes
(IDOs).
Wheat Evaluation, Annexes, April 2015 20
How well do you know WHEAT? (Q13)
17
15
11
8
5
1
0
33
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 RESEARCH Q 14. What is your perception of the factors influencing the choice of research topics in the WHEAT Flagship you mostly
contribute to?
0%
Expressed needs of clients or beneficiaries
3
Funding availability 0 4
10%
20%
2 2
5
30%
40%
60%
70%
80%
90%
100%
24
12
20
11
12
1
50%
1 ‐ No influence at all
2
Donor priorities
5
1 3
15
13
8
3
4
WHEAT strategy
5
13
14
9
7
11
6 ‐ Primary influence
Scientific interest/knowledge gap 01
Center strategy
1
13
8
4
3
11
10
20
10
7
34
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 15. According to you, which are currently the three most important research activities within WHEAT and where you
think the emphasis should be? Current most important research activities (top rated)
0
5
10
15
Strategic research to produce International Public Goods
25
30
26
Adaptive research
12
Local research to produce feed‐back and synthesis for global…
7
Scaling‐out of research results
3
“Blue sky”, high risk research
20
1
Technical assistance
0
Other
0
35
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Where emphasis should be (top rated)
0
5
10
15
20
Strategic research to produce International Public Goods
4
Adaptive research
4
Scaling‐out of research results
3
Technical assistance
35
5
Local research to produce feed‐back and synthesis for…
30
32
“Blue sky”, high risk research
Other
25
1
0
36
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 16. The CRP receives funding from different sources where the Windows 1 and 2 are of least restricted type. What is
your view of how W1/2 funds are used in WHEAT? 0%
10%
Leverage bilateral funding 01
Fill gaps in research funding 0
Increase integration between different areas of research
20%
30%
40%
60%
5
4
8
8
6
9
70%
80%
90% 100%
9
8
10
9
2
50%
12
9
9
11
1‐ Not at all
Enhance desirable partnerships through competitive grants
Enhance research quality through competitive grants
2
3
7
6
10
9
7
1
5
12
7
7
4
4
4
Increase gender relevant research
3
Provide opportunities for long‐term, high risk research
4
Provide accountability through ex post studies
1
Provide relevance through ex ante studies
1
Cover overhead costs
4
8
2
6
3
2
8
11
4
4
2
7
10
5
3
5
6‐ Main Purpose
8
1
11
8
7
2
10
10
6
4
4
37
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 17. In your view, how well are the following aspects for enhancing the effectiveness of WHEAT managed? Please
score using a scale of 1-6 where 1=not well at all and 6=very well. 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Development of impact pathway 01
6
9
16
10
Engagement with partners 02
5
10
19
10
1‐ Not well at all
2
Annual progress monitoring 01
7
15
11
8
3
4
Capacity building 1 3
5
8
16
10
6
6‐ Very well managed
Analysis of target groups 0 4
Feed‐back between W1/W2 and bilateral projects
1
4
7
2
13
15
8
15
5
1
38
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 18. In your view, what are important pathways through which research in WHEAT aims to have impact? Please
score using a scale of 1-6 where 1=not an impact pathway at all and 6=primary impact pathway.
0%
10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Influencing food security through global germplasm
010
development
6
10
Influencing rural livelihoods through enhanced productivity 0 3
31
8
14
21
1‐Not an impact pathway at all
Enhancing varietal use through better seed dissemination 0 4
Enhancing environmental sustainability through improved
01
farming practices
6
20
17
2
3
5
9
17
14
4
5
Enabling equitable benefits from research 1 2
4
Influencing funding of cereal research 1 3
5
Influencing partner research agendas in developing
12
countries
6
12
13
8
16
12
10
12
6‐Primary impact pathway
10
12
39
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 19. In your view, how effectively are the measures listed below managed in your Center/CRP for assuring and
enhancing high quality of research? Please score using a scale of 6 where 1=no attention at all and 6=very effectively. 0%
Infrastructure needed for high quality science
10%
20%
Availability and quality of technical facilities/ equipment 0 4
70%
80%
5
7
12
6
6
19
2
4
15
9
1 ‐ No attention
4
13
12
10
90% 100%
15
9
5
60%
10
10
Learning and knowledge management 0 4
50%
11
9
4
Availability and quality of research support 1
40%
9
2 2
Strategic use of grants 1
30%
3
Acceptance and encouragement of innovative thinking
Researcher performance assessment
Research data management
3
Quality assurance processes such as internal peer feed‐back
2
Allocation of competences and appropriate skill mix to research
teams
2
Personal incentives for high research quality
Encouragement for learning from “ failure”
6
5
2
8
9
9
10
15
14
6
9
10
6
5
4
8
15
10
5
6
8
13
10
5
4
5
12
8
9
7
1
5
10
13
9
4
2
6 ‐ Very effectively
5
3
8
2
40
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 PARTNERSHIPS Most involved partners (top rated)
0
5
10
National research institutions
20
25
20
Other CGIAR centers
5
National governments
5
Universities in developing countries
4
Universities in developed countries
15
3
Other CRPs
2
Other
2
Farmer organizations
1
Civil society organizations
1
National agricultural extension systems
0
Donor implementation agencies
0
International NGOs
0
Local NGOs
0
Ultimate beneficiaries
0
41
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 0
Top 3 most involved partners (Q21)
10
20
30
40
Other CRPs
Other CGIAR centers
National governments
Universities in developing countries
Universities in developed countries
National research institutions
National agricultural extension systems
Donor implementation agencies
International NGOs
Local NGOs
Farmer organizations
Civil society organizations
Ultimate beneficiaries
Other
42
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 22. In your view, to what extent do the current partnerships increase the likely effectiveness of your WHEAT-related
research in areas listed below? Please score in scale of 6 where 1 -= not at all; and 6 = very much
0%
10%
Help in outreach of the research results 01
20%
30%
40%
50%
60%
70%
80%
10
15
7
17
16
16
16
Increase the relevance of your research 1 2
90% 100%
17
1 ‐ Not at all
2
Help scale out your research results 0 4
6
3
4
Build on synergies which result in more streamlined research
1
implementation
4
9
12
5
16
6 ‐ Very much
Increase the state‐of‐art in research
Help in attracting funding
1
6
3
8
5
13
12
13
10
13
43
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 24: In your view, to what extent are the partners in WHEAT involved in Program activities as listed below? (Please
score in scale of 6 where 1 -= not at all; and 6 = very much involved) 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Research prioritization 1
Planning of projects
6
3
5
7
15
5
12
12
1‐ Not at all
11
2
3
Publishing research result
3
8
8
13
7
4
5
Receiving mentoring in research
Feed‐back from clients/users back to research
3
8
6
9
6
10
9
6‐ Very much involved
8
12
5
44
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 GENDER Q 25. Please indicate your agreement with the following statements that relate to mainstreaming of gender issues in
your work and WHEAT. 0%
10%
Gender disaggregated data on results are collected when ever
02
appropriate.
The WHEAT gender strategy has been well communicated to
teams and researchers.
The WHEAT gender strategy influences the way my team plans
and conducts its work.
20%
30%
50%
60%
70%
90% 100%
3
4
10
16
6
80%
12
12
3
1 2
40%
Strongly disagree
Disagree
2
16
10
4
7
1
Somewhat disagree
Somewhat agree
There is too much emphasis in gender even in research where
0
gender does not matter.
5
9
10
Agree
7
6
Strongly Agree
There is sufficient funding to implement the gender‐related
activities
1
The WHEAT gender strategy influences the way most teams in
the CRP plan and conduct their work.
1
4
5
4
4
13
12
3
7
7
1
45
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Capacity development Q 26. Please indicate your agreement your agreement with the following statements that related to capacity
development (CD) in your work and WHEAT. Please score in a scale of 6 where 1=very dissatisfied and 6=very
satisfied. 0%
20%
My Center is addressing institutional and
organizational CD needs in developing 0 8
countries very well,
WHEAT is addressing well institutional and
organizational CD needs in developing
02 5
countries very well.
Training and mentoring are equitably
02
targeting men and women.
9
Strongly
disagree
Disagree
10
14
Somewhat
disagree
8
16
7
Somewhat
agree
6
9
14
11
My Center is addressing CD capacity needs
1 5
of individuals very well.
2
100%
7
14
9
5
80%
20
5
CD activities are well integrated to research 02 4
There is sufficient funding available for CD
activities
60%
4
5
CD activities are designed so as to enhance
uptake of research results and likely
02
effectiveness.
WHEAT is addressing CD needs of
0
individuals very well.
40%
Agree
5
12
10
8
3
10
10
6
14
8
8
Strongly Agree
12
46
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Satisfaction/value added Q 27. Please indicate how satisfied you are with the following working conditions for your work. Please score in a
scale of 6 where 1=very dissatisfied and 6=very 0% 10% 20% 30% 40% 50% 60% 70% 80% 90%100%
Share of time required for training and
03
mentoring
Share of time required for coordinating among
02
partners
Share of time required for travel and meetings
0 6
(whether for Center or CRP)
Incentives for cooperating with non‐CGIAR
0
partners
6
10
11
Reliability and predictability of bilateral project
1
funding
7
11
10
2 3
14
Incentives for cooperating with other CGIAR
0
Centers or CRPs
Reliability and predictability of CGIAR funding
through Window1/Window2
2
3
Share of time allocated to research (compared to
2
time for administration and reporting; whether…
Incentives for working across themes and
disciplines in the CRP
1‐ Very dissatisfied
3
10
9
12
4
10
12
9
7
3
13
14
8
4
14
7
9
8
10
12
9
7
6
9
5
7
8
4
12
1
9
2
7
7
5
6 ‐ Very satisfied
1
0
47
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 28. Please indicate your agreement with the following statements related to the value WHEAT has had or is likely to have
influencing the success of your research compared to past Center-based implementation of the research. Please score in a scale
of 6 where 1=very dissatisfied and 6=very satisfied. 0%
10%
WHEAT is enabling research to be better aligned to beneficiary needs. 01
The results framework in WHEAT will improve the value‐added from
research.
Research is becoming strategically better focused on development
outcomes.
WHEAT provides a better framework for guiding and focusing
research planning.
Due to WHEAT, capacity development is now addressed more
strategically to improve research effectiveness
WHEAT has improved the way in which gender issues are integrated
to research
My research is better rationalized in the broader context of program
objectives.
WHEAT encourages accountability for development outcomes (not
just research outputs)
WHEAT is creating or enhancing synergies between participating
Centers.
Research is becoming better integrated across disciplines and teams
towards results.
WHEAT has good potential to help streamline administrative
procedures
WHEAT has good potential to help streamline monitoring and
reporting
20%
30%
6
01
60%
80%
90% 100%
4
17
8
9
70%
18
8
10
0
50%
9
6
01
40%
3
15
11
7
17
4
1 ‐ Very dissatisfied
01
8
02
12
7
12
8
3
13
2
3
2
4
0 3
11
01
8
02
0
7
13
11
5
9
2 1
11
5
5
13
12
10
1 2
14
1
9
9
3
14
11
2
9
11
6 ‐ Very satisfied
7
0
1
48
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX G. ‐ Sample project assessment ‐ TEMPLATE PROJECT NUMBER: (if applicable) PROJECT TITLE: FLAGSHIP PROJECT NUMBER: TYPE OF PROJECT: RESEARCH <‐> more downstream DEVELOPMENT ORIENTED – please explain briefly LEAD: CIMMYT/ICARDA/other Filled out by: Date: Documentation used for assessment: RELEVANCE AND COHERENCE: Alignment with WHEAT objectives Project alignment means that project objectives and activities to achieve those objectives are clearly defined and match with those of the SI/FP  Is the project presented as part of WHEAT CRP?  To what extent is the project/activity aligned to the FP (or specific SI) objectives and WHEAT IDOs? ‐
‐
‐
Very well Moderately Poorly Comments: 1.
Relevance of project  Are the main target beneficiaries of the project clearly defined?  Does the project reflect needs and priorities of target group?  Does the project address globally/regionally important issues where CGIAR has comparative advantage? 2.
49
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SCIENCE QUALITY  Is the research addressing researchable issues? 3.

Are research hypothesis clearly formulated and testable? 
Does the project use state of the art methodology? 4.
5.
6.
To what extent do the choices of research topics and research designs reflect a high quality of scientific thinking, state‐of‐the‐art knowledge of the scientific literature and complements research done elsewhere? 7.

To what extent does the research reflect an iterative process between downstream and upstream research? Has feedback from downstream work been incorporated in research design? LIKELY EFFECTIVENESS:  Is there an impact pathway described and is it realistic? 8.

How has progress been in terms of research results and outputs? 
Are limitations and delays explained? 9.
50
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 10.

How does the project design address the scaling‐up and out of research outputs? 
Does the project include an implementation modality (partnerships, management) which reflects an appropriate role for CIMMYT/IITA? 
What has been the main success so far? (MENTION ONE MAJOR ACHIEVEMENT) Assess its significance. 11.
12.
13.
Are constraints to research outputs as well as uptake/impact and challenges mentioned and addressed? 14.

Is the reference to when impact (adoption) is expected and in what scale? How likely do you see this realizing? PARTNERSHIPS  What types of partners are included in the project? 
Are the partners’ roles clearly defined? 
How is the work divided between CIMMYT/ICARDA and the partners? 15.

To what extent are these partners relevant and likely effective in relation to the project's objectives and design ‐‐ at the project's conceptual stage? ‐
‐
‐
High Substantial Modest 51
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ‐
‐
Low Not mentioned GENDER 16.

Does the project/research strategy address gender specific issues? 
Does the project report on gender disaggregated results? 17.

From the point of view of achieving the objectives of the project, has there been an under‐emphasis, appropriate emphasis, or over‐
emphasis on gender analysis and gender‐specific research in terms of achieving the Flagship IDO? ‐
‐
‐
‐
Under‐emphasis Appropriate emphasis Over‐emphasis Not mentioned CAPACITY DEVELOPMENT 18.

Are there any capacity building measures mentioned and who do they target? 
What capacity building activities have been implemented? 52
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 
From the point of view of achieving the objectives of the project, has there been an under‐emphasis, appropriate emphasis, or over‐
emphasis on capacity development in terms of achieving the Flagship IDO? ‐
‐
‐
‐
Under‐emphasis Appropriate emphasis Over‐emphasis Not mentioned CONCLUSION/OBSERVATIONS please briefly explain any qualifiers to the above questions (issues that could not be reflected) as well as briefly state the main strengths as well as issues relating to this project 53
cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX H. ‐ Peer review scoring of a random sample of publications – TEMPLATE Number of publication (according to our list and file name): Name of publication: Journal name: Center: CIMMYT/ICARDA Area: Agronomy/Breeding/Socio econ Team member to review publication Team members shall assess each publication according to the following standardized criteria and approach: Criterion Assessment approach methodological rigor and coherence of data Scale1 analysis comprehensiveness of research narrative Scale innovativeness; novelty Observation: would novelty be expected, if yes what kind of novelty was observed quality (and appropriateness) of publication Observation of low‐quality or inappropriate venue venue relative to subject and quality of paper collaboration (especially co‐authorship) evident Observation of extent of authorship and with whom “fit” with CRP objectives Observation of outliers overall quality of publication (including Brief narrative additional criteria at evaluator discretion) 19. When there are other outputs than published work – such as germplasm ‐ systematic assessment of quality may be difficult and assessment of quality can be based on project reports, volume of output, extent of use/uptake and user perceptions. 1
Scale of 4 (1=poor; 2=mediocre; 3=good; 4=excellent) or 6 (1=poor; 2=quite poor; 3=adequate; 4=quite good; 5=good; 6=excellent). Eventually evaluation findings should not have too many scales. 54