Evaluation of the CGIAR Research Program on Wheat Volume 2 – Annexes April 2015 Wallace Beversdorf (Team Leader) Sylvie Brouder Paramjit (Pammi) Sachdeva Rasheed Sulaiman Deborah Templeton This evaluation has been commissioned by the Independent Evaluation Arrangement (IEA) of the CGIAR. The Independent Evaluation Arrangement (IEA) of CGIAR encourages fair use of this material provided proper citation is made. Correct citation: CGIAR‐IEA (2015). Annexes to the Evaluation of CGIAR Research Program on Wheat. Volune 2. Rome, Italy: Independent Evaluation Arrangement (IEA) of CGIAR iea.cgiar.org Wheat Evaluation, Annexes, April 2015 Table of contents ANNEX A. - Evaluation Team Members – Short Bios .................................... 1 ANNEX B. - Country visits .......................................................................... 2 ANNEX C. - List of people met .................................................................... 4 ANNEX D. - List of sample projects .......................................................... 17 ANNEX E. - Assessment of publications ................................................... 20 ANNEX F. - WHEAT researcher survey ...................................................... 25 ANNEX G. - Sample project assessment - TEMPLATE ................................ 49 ANNEX H. - Peer review scoring of a random sample of publications – ..... 54 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX A. ‐ Evaluation Team Members – Short Bios Wallace (Wally) Beversdorf ‐ Evaluation Team Leader. Since 2005 Wally has been an independent consultant, involved in several reviews of research, including CSIRO Flagship program reviews and 2007 mid‐term review of the Generation Challenge Program. Before 2005 he worked over 10 years in the private seed sector, including positions as Head of Novartis world‐wide R&D, Head of Syngenta Plant Science and Vice President for Syngenta Biotechnology. He has also worked in the academia, holding positions at the Guelph University. He has a PhD in plant breeding and genetics. Sylvie Brouder ‐ Evaluation Team Member. Since 2005 Sylvie has served as Professor of Agronomy at Purdue University where she has been working for nearly 20 years. She is also Director of the Purdue University Water Quality Field Station. Her research interests include crop nutrient use efficiency, agroecosystem viability and sustainability and ecophysiology linked to abiotic stress tolerance. Through her teaching, outreach and consultancy activities she has been involved in international agricultural research and science agenda development. She has PhD in ecology. Deborah (Debbie) Templeton ‐ Evaluation Team Member. Until September 2013 Debbie worked for ACIAR for over 10 years primarily managing the Impact Assessment program. Between ACIAR employment, Debbie also worked for 3 years as social scientist (impact assessment specialist) at IRRI. She has experience in capacity building in research evaluation and impact assessment and in managing and conducting impact assessments. She has PhD in economics. Rasheed Sulaiman ‐ Evaluation Team Member. Rasheed is the Director of the Centre for Research on Innovation and Science Policy in India (since 2006). Prior to that, he worked as senior scientist at the National Centre for Agricultural Economics and Policy Research at ICAR. He has expertise in agricultural extension systems and policy, and agricultural innovation system. His research also covers the role of private sector and public‐private partnerships, developing new approaches to reaching rural women and evaluation of ICTs in agriculture. He has a PhD in agricultural extension. Paramjit (Pammi) Sachdeva ‐ Evaluation Team Member. Pammi is specialized in program and institutional assessment and HR management with expertise also in capacity development, systems analysis and organizational design. Since 2001 he has worked as an independent consultant and been involved in a number of external reviews of CGIAR Centers and programs, and in international development project and human resource management consultancies. Previously he worked at the World Bank as senior management specialist and advisor and earlier in his career at ISNAR as senior research officer. He has a PhD in social systems sciences. 1 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX B. ‐ Country visits Date Country Main schedule Turkey Team members WB, DT 21‐24 Sep Ankara Izmir 24‐26 Sep Lebanon WB, DT Beirut 26 Sep – 1 Oct Ethiopia WB, DT Addis Ababa WB, DT Debre Zeit WB, DT Asella 1‐4 Oct Morocco WB, DT WB, DT Addis Ababa Casablanca visit CIMMYT/ICARDA office Visit research institutes Visit Regional Cereal Rust Research Center in the Aegean Agricultural Research Institute Terbol, AREC, Kfardan LARI ICARDA offices in Beirut Meeting with ICARDA & CIMMYT staff and presentation on Collaborative Activities with Ethiopian NARS Debre Zeit ARC, Green house, single race & international nurseries, breeding activities, seed producers & farmers seed producers, on farm trials and Gonde seed farm KARC, irrigation facility, international and single race nurseries, seed labs, Breeding and Seed Activities EIAR Quality Lab and Meeting with EIAR management INRA campus (greenhouse, biotech of INRA, quality lab and future building of ICARDA) Meeting with ICARDA staff Bread wheat presentation, Durum wheat presentation 2 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Date Country Team members 8—13 Nov Bangladesh RS RS 14‐17 Nov India RS RS SB RS SB Main schedule Marchouch Annoceur Marchouch station (all wheat personnel attending) Annoceur station, visit of durum off‐season. Focus on RWA screening. Gigu Arrival to farmers communities in Gigu together with professor Boulif (ENA Meknes), presentation of farmers school (ICARDA's contribution) and of IFAD activities on‐farm in Meknes area, visit of the farm and lunch with farmers WRC Dinajpur meet with WRC Scientists and DAE (Department of Agricultural Extension) and BADC (Bangladesh Agriculture Development Corporation Rangpur Discuss with CSISA‐CIMMYT, SRFSI staff and OFRD/BARI Scientists NGO partners (RDRS, etc.) Dhaka Discuss with BARI authorities/Seed Certification Agency Arra and Zero tillage wheat sowing, interaction with service providers, farmers , KVK and other Patna partners Samatipur, Visit fields with bed planting, zero tillage intercropping of maize and interaction with Pusa women farmers in Bandra Visit to BISA farm‐Pusa Interaction with Head, IARI Research Station of RAU officials Interaction with ICAR and other partners in ICAR complex‐Patna 3 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX C. ‐ SURNAME, Name Position Organization Country visit Abeyo, Bekele Wheat Breeder, Global Wheat Program CIMMYT Ethiopia Abinasa, Mohammed Wheat Breeder ICARDA Ethiopia Adhikari, Mani Krishna ADO Bangladesh Afram, Michel Antoine Aliy, Sheriff President – Director General Research Extension Specialist – Technology Promotion Debre Zeit Agricultural Research Center CIMMYT Lebanese Agricultural Research Institute EIAR Ethiopia Amil, Rola PhD Student ICARDA Lebanon Amri, Ahmed Head, Genetic Resources Section ICARDA Morocco Andaloussi, Abbad Head , Plant Protection Department INRA Morocco Asaad, Siham Lebanon Austin, Nick Head, ICARDA’s Seed Health Laboratories ICARDA Director, Technology Multiplication Directorate and Coordinator, Deployment of Rust Resistant Wheat Varieties in Ethiopia EIAR Chief Executive Officer of ACIAR, Pacific Countries representative on the CGIAR Fund Council ACIAR Badstue, Lone Gender Specialist, SEP CIMMYT Mexico Bakshi, Elahi Applied Ag Economist CIMMYT Bangladesh Bandyopadhyay, Ranajit Pathologist ICARDA Mexico Bänziger, Marianne Deputy Director General Research & Partnership CIMMYT Mexico Atilaw, Abebe List of people met Lebanon Ethiopia Australia 4 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Barma, Naresh Ch Deb Chief Scientific Officer BARI, Gazipur Bangladesh Bassi, Fillipo Durum Wheat Breeder ICARDA Morocco Baum, Michael Director ‐ BIGMP CIMMYT Mexico Morocco Bhatt, B. P Director INRA ICAR Research Complex for Eastern Region Bishaw, Zewdie Head, Seed Section Ethiopia Bodruzzaman, Md Principal Scientific Officer (Soils) ICARDA Wheat Research Center, Dinakpur Braun, Hans Program Director Global Wheat Program CIMMYT Mexico Briones, Ernesto Senior Systems Developer CIMMYT Mexico Chand, Ramesh Professor‐cum‐Plant Pathologist Banaras Hindu University Mexico Chanyalew, Solomon Center Director, Debre Zeit Agricultural Research Center Ethiopia Chatrath, R Principal Scientist EIAR Directorate of Wheat Research (DWR), Karnal, ICAR India Chikoye, David R4D Director, IITA‐Southern Africa IITA Mexico Chowdhury, S. Consultant Borlaug Institute for South Asia India Bennani, Sahar India Bangladesh 5 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Coffman, Ronnie Position Principal Investigator, Durable Rust Resistance Prog Organization Cornell University Country visit Obrégon Dababat, Amer Plant Pathologist and Nematologist Global Wheat Program CIMMYT Turkey Datta, Swapan K De la O Elizagaray, Marisa Deputy Director General (Crop Science) Indian Council of Ag Research Obrégon Manager, Risk Management & International Policy CIMMYT Mexico Debele, Tolessa SARD‐SC Coordinator for ESA Ethiopia Degite, Gemechu Chair Technical Coordinator, East African Agricultural Productivity Project Wheat Regional Center of Excellence Kulumsa Agricultural Research Center Principal Adviser Research and Cropping Systems and Economics (CSE) program manager. ICARDA Ethiopian Seed Enterprise (ESE) Gonde‐Iteya Basic Seed Farm EIAR ACIAR Ethiopia Australia Dessalegn, Tadesse Dixon, John Ethiopia Duveiller, Etienne Director of Research for South Asia CIMMYT Obrégon Dwivedi, P K Programme Coordinator Krishi Vigyan Kendra, Buxar India El Bouhssini, Mustapha Entomologist ICARDA Morocco El Hassouni , Khaoula sponsored by GRDC Erenstein, Olaf Program Director, Socioeconomics Program CIMMYT Mexico Figueroa, Pedro Plant Pathologist in National Wheat Program INIFAP Obrégon Firke, Asnake Director, Crop Research EIAR Ethiopia Fisher, Tony Honorary Research Fellow at CSIRO, Member of WHEAT Stakeholder Committee CSIRO Australia Morocco 6 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Freymond, Jean Secretary SASAKAWA Africa Association Obrégon Fulss, Richard Head, Knowledge Management CIMMYT Mexico Gathala, Mahesh Cropping System Agronomist, Leader SRFSI CIMMYT Bangladesh Gérard, Bruno Program Director, Global Conservation Agriculture Mexico Ghosh, Anup Kumar Senior Agricultural officer CIMMYT Resilient Farming Systems Intensification (SRFSI) Project, RDRS Girma, Bedada Durable Rust Resistant Program, Kulumsa Agricultural Research Center EIAR Govaerts, Bram Associate Director, Global Conservation Agriculture CIMMYT Ethiopia Mexico (Texcoco and Obrégon) Guertin, Michelle Senior Monitoring, Evaluation & Learning Specialist CIMMYT Skype Gupta, Pryianka sponsored Borlaug Scholarship Morocco Gupta, R K Principal Scientist Individual Directorate of Wheat Research (DWR), Karnal, ICAR Gutterson, Neal President, CEO Obrégon Haddad, Nicolas Manager, Agricultural Research and Education Center (AREC) Mendel Biotechnology American University of Beirut Hannan, Abdul Deputy Director Department of Agricultural Extension Haque, Anarul Extension Agronomist, CSISA, Hub Manager, Rangpur Harris, Abdul Principal Scientists Agronomy CIMMYT ICAR Research Complex for Eastern Region Bangladesh India Lebanon Bangladesh Bangladesh India 7 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Hassen, Haloma Consultant in small ruminant research ICARDA Morocco Hearne, Sara Senior Scientist, Maize Molecular Geneticist/Pre‐breeder CIMMYT Mexico Herremans, Anna (former) Director, International Finance Mexico Hassan, Selima Sr Scientific Officer CIMMYT BARI, On Farm Research Division, Rangpur Hobbs, Huntington CIMMYT Mexico Hodson, David Leader, Strategic Planning and Research Coordination, MasAgro GIS and Decision Support Systems SEP CIMMYT Ethiopia Homma, Shitaye Durum Wheat Breeder, Debre Zeit Agricultural Research Center Ethiopia Hossain, Akbar Senior Agronomist Hossain, Mofazzul Deputy Director Seed Marketing Hossain, Monwar Scientific Officer (Plant Breeding) Hossain, Zakir Scientific Officer (Agricultral Engineer) EIAR Wheat Research Center, Dinakpur Bangladesh Agricultural Development Corporation Wheat Research Center, Dinakpur Wheat Research Center, Dinakpur Hundie, Bekele Plant Pathologist, Kulumsa Agricultural Research Center EIAR Huttner, Eric Research Program Manager, Crop Improvement & Management Idris, Mohammad Principal Scientist (Entomology) ACIAR ICAR Research Complex for Eastern Region Bangladesh Bangladesh Bangladesh Bangladesh Bangladesh Ethiopia Obrégon and Australia India 8 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Iraqi, Driss Jahan (Belal), Abu Hena Sorwar Coordinator, Biotechnology Unit INRA Morocco Principal Scientific Officer BARI, Gazipur Bangladesh Jakobi, Nina WHEAT Program Assistant Agricultural Economist SEP CRP Mexico CIMMYT Central Soil Salinity Research Institute Ethiopia CIMMYT India Jaleta, Moti Jat, H S Jat, M L Cropping Systems Agronomist, CSISA Senior Cropping Systems Agronomicst & CIMMYT‐CCAFS South Asia Coordinator, CIMMYT India Jat, Raj Kumar Cropping Systems Agronomist Borlaug Institute for South Asia India Kaan, Kathy Kan, Mustafa Program Manager Agricultural Economist, Department of Economy, Statistic and Extension Obrégon Turkey Karim, Rezaul Upzilla Agricultural Officer BMGF Bahri Dagdas International Agricultural Research Institute Department of Agricultural Extension Kassie, Grima T Agricultural Economist, SEPRP ICARDA Morocco Keil, Alwin Senior Agricultural Economist CIMMYT India Kemal, Seid Ahmad Pathologist ICARDA Ethiopia Bangladesh 9 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Keser, Mesut Kircalioğlu, Gün IWWIP, Coordinator for ICARDA Research Coordinator ICARDA Aegean Agricultural Research Institute Turkey Turkey Kiwan, Pierre Assistant Researcher , Terbol Research Station ICARDA Lebanon Kommerell, Victor WHEAT Program Manager Mexico Kumar, Mithilesh Director of Research CIMMYT Rajendra Agricultural University, Pusa, Samastipur Kumar, Virender Cropping Systems Agronomist CIMMYT India Legesse, Wasihun Wheat Breeder , Debre Zeit Agricultural Research Center EIAR Ethiopia Listman, Michael G. Senior Science Writer, Corporate Communications CIMMYT Mexico Lopez Saavedra, Victor Manager of Institutional Relations TTF‐MasAgro CIMMYT Mexico Lopez, Diana Project Management Unit CIMMYT Mexico Lumpkin, Thomas DG CIMMYT Mexico Machlab, Hassan Country Manager/Lebanon Lebanon Malaker, Paritosh Kumar Director ICARDA Wheat Research Center, Dinakpur Mallari, Sally MAIZE Program Assistant CIMMYT Mexico Mallik, R. S. Senior Agronomist And Csisa Objective 1 Leader India Mamo, Beditu Chair CIMMYT Memher Agera Seed Multiplication and Marketing Cooperative India Bangladesh Ethiopia 10 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Medina, Richard Members of the Mahila Kisan Sakhi Director, Internal Audit CIMMYT Mexico CSISA ‐ Bihar, Mahila Samaykhya, Muzaffarpur n/a India Mendoza, Fernando P Senior Internal Auditor IITA Mexico Menkir, Abebe Mert, Zafer Team leader for maize improvement research at IITA, Focal Point for CRP at IITA Phytopathologist / Plant pathologist, Department of Crop Diseases and Resistance Breeding IITA Mexico The Central Research Institute Turkey for Field Crops (TARM), Ministry of Food, Agriculture and Livestock (MFAL) Mir, Patricia V Risk Management Analyst CIMMYT Mexico Mishra, Satya Prakash Officer VST Tillers Tractors Ltd India Mishra, V.K. Professor, Dept. of Genetics and Plant Breeding Obrégon Mitiku, Demessie Seed Agronomist, Supporting Seed Demonstration for Private Seed Growers Banaras Hindu University AMUARI High Yield Varieties and Agricultural Products PLC Mittal, Surabhi Economist CIMMYT India Miyamoto, Masaaki Chief Executive Officer SASAKAWA Africa Association Obrégon Momin, Abdul CIMMYT Bangladesh Nachit, Miloudi Cropping Systems Agronomist, Manager‐CSISA Jessore Hub Former Durum Wheat Breeder and now Consultant with focus on pre‐breeding and on farm trials ICARDA Morocco Nasserlehaq, Nsarellah Durum Wheat Breeder INRA Morocco Nawar, Fawzy Senior documentation specialist, Genetic Resources Section ICARDA Morocco Ethiopia 11 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Nazari, Kumarse Position Plant Pathologist, Cereal Rust Regional Center Organization ICARDA Country visit Turkey Ortiz Monasterio, Ivan Agronomist, Wheat Harvest Coordinator CIMMYT Mexico Ozdemir, Fatih BDIARI Turkey Ozkan, Isa Director, Bahri Dagdas International Agricultural Research Institute, IWWIP Coordinator for Turkey Head, Field Crops Research Department MFAL Turkey Pandit, D B Cropping Systems Agronomist, Manager‐CSISA Mymensingh CIMMYT Bangladesh Payne, Thomas S. CIMMYT Board Secretary Mexico Peksuslu, Ali Director, CIMMYT AEGEAN Agricultural Research Institute Turkey Pfeiffer, Wolfgang H Deputy Director, Operations HarvestPlus Obrégon Pixley, Kevin Program Director, Genetic Resources Program CIMMYT Mexico Powell, Wayne Chief Science Officer CGIAR Obrégon Rahman, Ataur Specialist Conservation Agriculture BARI, Gazipur Bangladesh Mexico Bangladesh Rajasekharan, Nellooli P. Director, International Human Resources Rashid, Mamunur A&E Coordinator CIMMYT Resilient Farming Systems Intensification (SRFSI) Project, RDRS Renard, Geneviève MAIZE and WHEAT Communication Specialis GCP Mexico Reynolds, Mathew Head Wheat Physiology Obrégon Reza, Mustafa Alir Senior Scientific Officer, (Wheat Pathology) CIMMYT Wheat Research Center, Dinakpur Bangladesh 12 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Ribaut, Jean‐Marcel Director, Generation Challenge Program CIMMYT Mexico Riis‐Jacobsen, Jens Director of Int. Systems and Information Technology CIMMYT Mexico Rodriguez, Horacio MasAgro Extension Coordinator Mexico Rorisa, Bejiqa Cooperative Farmer CIMMYT Guchi Habe Badosa Bread Wheat and Seed Multiplication and Value Chain Cooperative Rossi, Frederik Agricultural Economist, Manager‐CSISA Faridpur Hub CIMMYT Bangladesh Rugema, Hilary Coordinator, Crop Productivity Improvement SASAKAWA Africa Association Obrégon Saidi, Seddik Head, Plant Breeding Department INRA Morocco Saint Pierre, Carolina Scientist, Wheat Phenotyping Coordinator SeeD CIMMYT Obrégon Sanchez –Garcia, Miguel Spring Wheat Breeder ICARDA Morocco SanVicente, Felix Breeding lead for the tropics in Mexico Mexico Sarker, Abu Zaman Princial Scientific Officer (Agronomy) Bangladesh Sayem, Abu Regional Director CIMMYT Wheat Research Center, Dinakpur Agricultural Information Service (Ministry of Agriculture) Schulthess, Urs Crop modeler, Global Conservation Agricultural program CIMMYT Mexico Sefera, Tadessa Center Director, Kulumsa Agricultural Research Center EIAR Ethiopia Segovia, Vanessa Post Doctorial Fellow Turkey Senthil, R. Principal Scientist ICARDA Directorate of Wheat Research (DWR), Karnal, ICAR Ethiopia Bangladesh India 13 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Shahjahan, Md Croping Systems Agronomist, , Manager‐CSISA Khulna Hub Bangladesh Sharma, Indu Director and Member, Wheat Management Committee (CRP‐Wheat) Sharma, P C Head, Crop Improvement Sharma, R K Short, Thomas W. Principal Scientist DDG Support Services CIMMYT Directorate of Wheat Research (DWR), Karnal, ICAR Central Soil Salinity Research Institute Directorate of Wheat Research (DWR), Karnal, ICAR CIMMYT India Mexico Silim, Said Nahdy Country Manager ICARDA Ethiopia and Coordinator Sub‐Saharan Africa Regional Program ICARDA Ethiopia Sim, Graham Director, International Finance CIMMYT Mexico Singh, Ravi P Head, Bread Wheat Improvement & Rust Res Obrégon Singh, Satyavir Principal Scientist CIMMYT Directorate of Wheat Research (DWR), Karnal, ICAR Sohail, Quahir Spring Wheat Breeder Solanki, I S India India India Morocco Head ICARDA Indian Agricultural Research Institute Solh, Mahmoud DG ICARDA Lebanon Souihka, Allah Manager, Marchouch Station ICARDA Morocco Sugandhi, ? Gender Cordinator, CSISA CIMMYT India Tadessa, Zerihun National Coordinator, Wheat Program EIAR Ethiopia Tadesse, Wuletaw Bread Wheat Breeder ICARDA Morocco India 14 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Tafesse, Mekasha Driver and Logistical Assistant ICARDA Ethiopia Tanwir, Niayer Secretary Creation Welfacer Society India Tawkaz, Sawsan Head, ICARDA’s Double Haploid Laboratory Lebanon Teklu, Kifle Participating Farmer Tesfaye, Bezabih Seed Specialist ICARDA Memher Agera Seed Multiplication and Marketing Cooperative AMUARI High Yield Varieties and Agricultural Products PLC Ethiopia Tessema, Alemu Chair Denkaka Megertu Cooperative Ethiopia Thornton, Matthew Hub Coordinator Mexico Tiwari, Ratan Principal Scientist CIMMYT Directorate of Wheat Research (DWR), Karnal, ICAR Tiwari, T. P. Tovar Mondragon, Jose Ramiro Cropping System Agronomist & Country Representative CIMMYT Bangladesh Manager, Financial Planning CIMMYT Mexico Trachsel, Sam Scientist, Global Maize Program CIMMYT Mexico Tsivelikas, Athanasios Genebank Manager ICARDA Morocco Uddin, Mohdi Cropping System Agronomist, Manager‐CSISA Faridpur Hub CIMMYT Bangladesh Udupa, Sripada Senior Scientist, Biotechnology, ICARDA Morocco van Ginkel, Maarten DDGR ICARDA Lebanon Wakjira, Adunga Deputy Director General EIAR Ethiopia Ethiopia India 15 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SURNAME, Name Position Organization Country visit Ward, Rick Principal Scientist, Global Wheat Program CIMMYT Obrégon Watson, David MAIZE Program Manager CIMMYT Mexico Willcox, Martha Senior Scientist working with the Seeds Discovery (SeeD) project CIMMYT Mexico Worku, Zewuditu Woman Farmer Ethiopia Yai, Kebede Cooperative Farmer n/a Guchi Habe Badosa Bread Wheat and Seed Multiplication and Value Chain Cooperative Yasmin, Samina Cropping Systems Agronomist, Manager‐CSISA Barisal Hub CIMMYT Bangladesh Yazbek, Mariana Post Doc Fellow, Genetic Resources ICARDA Lebanon Zaim, Meryem sponsored by GRDC n/a Morocco Zehr, Usha Barwale Chief Technology Officer, Maharashtra Hybrid Seeds Co. Ltd. MAHYCO Obrégon Ethiopia 16 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX D. ‐ List of sample projects A total of 40 projects were selected from the project database. These included the 10 largest projects (according to the budget allocated to WHEAT) as well as 30 projects which were randomly selected by Flagship. Projects had to be replaced from the initial selection and some projects utlimately could not be reviewed because information was found insufficient or was only available in Spanish, or treated as confidential. The evaluation team looked at a total of 34 projects listed below: No Title FP Lead A4031.09.19 Accelerating adoption of yellow rust resistance winter varieties in Central Asia 4 Other The Potential for Wheat Production in Sub‐Saharan Africa: Analysis of Biophysical Suitability and A4031.09.24 Economic Profitability 1 CIMMYT Enhanced quality and healthy seed testing system for International Winter Wheat Improvement A4031.0918 Program (IWWIP) 3 Other Enhancing cotton germplasm, improving resistance to cotton leaf curl virus and supporting cotton B 1198 best management practices for small farmers. 4 ICARDA B1146 Joint ICARDA‐ARC Wheat Improvement Program 2 ICARDA B1202 Pakistan Wheat production enhancement 3+4+5 ICARDA B1202 B1287 B1313 B1355 and 1356 C0035 Pakistan Wheat Production Enhancement Initiative Support to Agricultural Research for Development of Strategic Crops in Africa (SARD‐SC)‘ Wheat Productivity Improvement towards Food Self‐sufficiency 2+3+5 ICARDA 5 ICARDA 5 ICARDA Mobilizing Novel Genes from Wheat 2 CIMMYT/ICARDA Cereal Systems Initiative for South Asia (CSISA)‐Phase II 4 CIMMYT 17 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 No C0037 C0040 C0064 n/a R0148 T0083 W 0286 W0101 W0204 W0205 W0212 W0235 W0239 Title Cereal Systems Initiative for South Asia (CSISA)‐India MASAGRO‐Desarrollo sustentable con el agricultor Africa Rising: Research in Sustainable Intensification for the next generation Wheat Addressing the challenge of climate change for sustainable food security in Turkey, Iran, Pakistan, Uzbekistan, Morocco and Spain through the exploitation of wheat Genetic Resources, adoption of resilient improved varieties on farmers fields and their socio‐economic impact. MASAGRO‐Descubriendo la diversidad genética de las semillas Expansion of the Cereal Systems Initiative for South Asia (CSISA) in Bangladesh Development of Heat Tolerant Wheat for South Asia Desarrollo de nuevas variedades de trigo duro, trigo harinero y triticale a partir de germoplasma procedente del CIMMYT‐Phase III Identification and utilization of novel sources of resistance against soil borne pathogens in wheat (CIM00014) Enhanced Delivery of CIMMYT Germplasm to Australia Development of Cereal Germplasm and the Screening for Disease Resistance and End‐Use Quality: CIMMYT ‐ Triticale Improvement Component Identifying new genetic sources and evaluating United States wheat germplasm for resistance to stem rust in Eastern Africa (25856) Pakistan Wheat production enhancement FP 4 4 4 Lead CIMMYT CIMMYT CIMMYT 2 4 4 3 CIMMYT CIMMYT CIMMYT CIMMYT 3 CIMMYT 3 3 CIMMYT CIMMYT 3 CIMMYT 3 CIMMYT 3+4+5 CIMMYT 18 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 No W0250 Title Durable Rust Resistance in Wheat (Phase II Genetics and Physiology of Wheat Development to Flowering: Tool to breed for improved W0252 adaptation and yield potential: W0265 Sustainable Wheat & Maize Production in Afghanistan ( W0266 Agricultural Innovation Programme W0269 KAI‐Agricultural Technologies in Kazakhstan W0273 Joint Development of Korean Winter Bread Wheat Lines with heat tolerance and high protein W0276 Russia‐Omsk Institute W0281 Field evaluation of Genetically Modified Wheat W0289 Rapid Development of Climate Resilient Wheat Varieties for South Asia using Genomic Selection W1/2 activity Socioeconomics & policies for wheat futures, FP 3 Lead CIMMYT 2 5 4 3 n/a 3 2 2+3 1 CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT 19 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX E. ‐ Assessment of publications Selection of individual publications for assessment The team intended to assess 37 publications in total. The publications were categorized according to the Center that issued them (CIMMYT and ICARDA) and to discipline (i.e. whether they related to agronomy, breeding or socio‐economics). Target numbers were then developed based on how many publications each Center had published in the 3 disciplines (see Table 1 below). Publications for assessment were then selected randomly from the database according to these target numbers. Table 1 - Criteria for selection of sample publications CIMMYT Agronomy 85% Socio‐ economics 71% Breeding 75% Number of Publications ICARDA 15% SAMPLE ACTUAL TOTAL CIMMYT ICARDA CIMMYT ICARDA 10 9 1 6 1 29% 25% 6 21 4 17 30 2 4 7 5 19 30 2 3 6 After all publications had been identified, an assessor was assigned for each one, bearing in mind the areas of competence, expertise and experience of the assessors. Some of the publications were re‐classified (especially some of the agronomy publications which related more to breeding). One publications by ICARDA was not assessed, as it could not be accessed (Genome-wide association mapping for five major pest resistances in wheat, Molecular Breed). The total of 36 publications assessed by the evaluation team are shown in the table below. 20 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Team YEAR Title member SB 2012 Achieving yield gains in wheat DT 2012 RS 2012 WB 2012 RS 2012 RS 2012 RS 2012 DT 2012 Agricultural Extension, Collective Action and Innovation Systems: Lessons on Network Brokering from Peru and Mexico Analysis of genotypic variation for NDVI (normalized difference vegetation index) and its relationship with grain yield in winter wheat under terminal heat stress Analysis of leaf and stripe rust severities reveals pathotype changes and multiple minor QTLs associated with resistance in an Avocet × Pastor wheat population Breeding progress for yield in winter wheat genotypes targeted to irrigated environments of the CWANA region Conservation Agriculture in Maize‐ and Wheat‐Based Systems in the (Sub)tropics: Lessons from Adaptation Initiatives in South Asia, Mexico, and Southern Africa Conservation agriculture, increased organic carbon in the top‐soil macro‐ aggregates and reduced soil CO 2 emissions Food sovereignty or the human right to adequate food: which concept serves better as international development policy for global hunger and poverty reduction? JOURNAL CENTER Plant, Cell & Environment (5.14 in CIMMYT 2012, year of publication The Journal of Agricultural CIMMYT Education and Extension ICARDA Plant Breeding 131(2012) TAG 2012 Euphytica (2013) CIMMYT ICARDA Journal of Sustainable Agriculture CIMMYT (2012) CIMMYT Plant Soil (2012) Type Breeding Socio econ Breeding Breeding Breeding Socio econ Agronomy CIMMYT Agric Hum Values (2012) Socio econ 21 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Team YEAR Title member From genotype × environment interaction to gene × environment interaction by WB 2012 Crossa, J Current Genomics Genetic structures of the CIMMYT international yield trial targeted to irrigated RS 2012 environments Genetic yield gains and changes in associated traits of CIMMYT spring bread WB 2012 wheat in a "Historic" set representing 30 years of Breeding WB 2012 Genetic yield gains of the CIMMYT International semi‐arid wheat yield SB 2012 Global Crop Improvement Networks to Bridge Technology Gaps RS 2012 WB WB 2012 2012 DT 2012 WB 2012 SB 2012 Physiological Traits for Improving Heat Tolerance in Wheat Global incidence of wheat rusts and powdery mildew during 1969‐2010 and durability of resistance of winter wheat variety Bezostaya 1 Lr68: A new gene conferring slow rusting resistance to leaf rust in wheat Multi‐trait and multi‐environment QTL analyses for resistance to wheat diseases Performance of biofortified spring wheat genotypes in target environments for grain zinc and iron concentrations Phenotyping transgenic wheat for drought resistance (2012) JOURNAL Current Genomics 2012 Mol Breeding Crop Science, 2012 Crop Science (2012) J. of Exp. Botany (5.242 for 2012 – year of publication) Eur J Plant Pathol Theoretical and Applied Genetics Open Access PLOS‐One (2012) Field Crops Research 137 (2012) Journal of Experimental Botany Plant Physiology (6.56 in year of publication, 2012) CENTER CIMMYT CIMMYT CIMMYT CIMMYT CIMMYT Type Breeding Breeding Breeding Breeding Agronomy Breeding CIMMYT CIMMYT CIMMYT Breeding Breeding CIMMYT CIMMYT Breeding Breeding Breeding 22 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Team YEAR Title member Quantifying how winter wheat crops accumulate and use nitrogen reserves during SB 2012 growth Stay‐green in spring wheat can be determined by spectral reflectance SB 2012 measurements (normalized difference vegetation index) independently from phenology DT 2012 The Production Functions of Wheat Production in Turkey SB 2012 WB 2012 RS 2013 DT 2013 RS 2013 WB 2013 The yield correlations of selectable physiological traits in populations of advanced spring wheat lines grown in warm and drought environments Virulence of Beauveria bassiana against Sunn pest, Eurygaster integriceps Puton (Hemiptera: Scutelleridae) at different time periods of application Assessing the impacts of GAFTA on selected members’ bilateral agricultural trade: an application of the Gravity Model. Crops that feed the world 10. Past successes and future challenges to the role played by wheat in global food security Earliness in wheat: A key to adaptation under terminal and continual high temperature stress in South Asia Genetic analysis of adult plant resistance to yellow rust and leaf rust in common spring wheat JOURNAL CENTER Field Crops Research (2.47 in year CIMMYT of publication, 2012) CIMMYT J. of Experimental Botany (5.242 for 2012 – year of publication) Bulgarian Journal of Agricultural Science, 18 (No 2) 2012 Field Crops Research; Journal of Entomology and Nematology (2012) Am‐Euras. J. Agric. & Environ. Science (2013) Food Sec. (2013) Field Crops Research (2013) Plant Disease (2013) ICARDA CIMMYT ICARDA ICARDA CIMMYT CIMMYT CIMMYT Type Agronomy Breeding Socio econ Breeding Agronomy Socio econ Socio econ Agronomy Breeding 23 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Team YEAR Title member Historical changes in grain yield and quality of spring wheat varieties cultivated in SB 2013 Siberia from 1900 to 2010 Identification and characterization of international Fusarium head blight SB 2013 screening nurseries of wheat at CIMMYT, Mexico RS SB WB WB DT DT 2013 Meta: A suite of sas programs to analyze multienvironment Breed trials Mineral nitrogen dynamics in irrigated rice‐wheat system under different 2013 irrigation and establishment methods and residue levels in arid drylands of Central Asia QTL mapping of slow‐rusting, adult plant resistance to race Ug99 of stem rust 2013 fungus in PBW343/Muu RIL population Association Mapping of Resistance to Yellow Rust in Winter Wheat Cultivars and 2014 Elite Genotypes From adoption claims to understanding farmers and contexts: A literature review 2014 of Conservation Agriculture (CA) adoption among smallholder farmers in southern Africa 2014 Meeting demands for increased cereal production in China JOURNAL Canadian Journal of Plant Science J. Plant Pathology (1.71 in 2013, year of publication) Agronomy Journal Volume 105, Issue 1, 2013 European Journal of Agronomy (2.92) TAG 2013 Crop Science (2014) Agriculture, Ecosystems and Environment 187 (2014) 116–132 Journal of Cereal Science 59 (2014) 235e244 CENTER CIMMYT CIMMYT CIMMYT Type Breeding Breeding Agronomy CIMMYT Agronomy CIMMYT ICARDA Breeding Breeding CIMMYT Socio econ CIMMYT Breeding 24 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX F. ‐ WHEAT researcher survey Sent out: 13 Nov 2014 Reminder sent by CIMMYT: 2 Dec 2014 Closed: 11 Dec 2014 Survey sent to Responses Response rate Complete Reponses Completed response rate Total CIMMYT ICARDA 109 66 61% 43 39% 58 43 74% 28 48% 32 15 47% 9 28% Other (competitive partner grants) 19 9 47% 6 32% 25 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Survey population Other (please specify) 19.7% FEMALE 18.2% Gender (Q2) Program/FP Position (Q3) leader/theme leader , 12.1% Research Fellow , 0.0% Associate scientist/Post doctoral fellow , 22.7% Principle Investigator/Se nior scientist 45.5% MALE 81.8% 26 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Working with org since (Q5) Other (please specify) 9.1% since 2012, 20, 30% Research area (Q4) pre 2008, 25, 38% Informatics 1.5% Social sciences , 7.6% Natural resource sciences 4.5% Crop sciences 77.3% Afghanistan , 1.5% Uzbekistan 3.0% Turkey 10.6% Tunisia 1.5% Syria, 3.0% South Africa , 3.0% Pakistan , 3.0% Nepal 4.5% Morocco 10.6% 2008‐2011, 21, 32% Bangladesh , 4.5% China 3.0% Ethiopia , 3.0% Germany, 1.5% India , 9.1% Jordan 1.5% Lebanon , 3.0% Duty station (Q6) Mexico 33.3% 27 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 CRP engagement 30 25 For which CRP(s) do you currently 25 work? (Q7) 20 17 WHEAT 11 10 MAIZE 14 15 10 Other CRPs 8 4 5 2 3 0 less than 30% 40‐70% More than 80% 28 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Working for WHEAT..... (Q7) less than 30%, 17, 30% More than 80%, 25, 45% 40‐70%, 14, 25% 40 35 30 25 20 15 10 5 0 SI mentioned in top 3 (Q8) 34 26 15 21 17 10 18 9 9 4 8 29 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 FP mentioned in top 3 (Q8) 45 40 35 30 25 20 15 10 5 0 39 29 28 18 13 11 FP1 Maximizing FP2 Novel FP3 Global FP4 Sustainable FP 5 Engaging DON'T KNOW Benefits for Diversity and Breeding Intensification and Poor Women, Tools to Adapt Partnerships to of Wheat‐ strengthening Children, and to Climatic and Meet Future based system Men Resource Food Demands Constraints 30 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 What entity/organization do you primarily identify with? (Q10) Other (please specify) 1.8% WHEAT, 24.6% My home organization 73.7% 35 30 What entity/organization do you primarily identify 29 with? (Q10) 25 20 15 before 2011 13 after 2011 10 6 8 5 0 1 0 My home organization WHEAT Other (please specify) 31 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 How many different projects in WHEAT are you currently working on? (Q11) 18 17 16 14 13 12 10 8 8 6 6 6 5 4 2 2 0 1 2 3 4 5 6 more than 7 32 cgiar.iea.org I know very little of nothing about WHEAT 10 I have some knowledge of the WHEAT, but know only the SIs/FPs that my work contributes to. 20 I have some knowledge of the program structure, objectives, main theories of change, IDOs and key organizations involved. 25 I have not participated in designing the WHEAT but have read key program documents and know the program structure, objectives, main theories of change, IDOs and key organizations involved. I have participated in designing WHEAT including its program structure, objectives, main theories of change and Intermediate Development outcomes (IDOs). Wheat Evaluation, Annexes, April 2015 20 How well do you know WHEAT? (Q13) 17 15 11 8 5 1 0 33 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 RESEARCH Q 14. What is your perception of the factors influencing the choice of research topics in the WHEAT Flagship you mostly contribute to? 0% Expressed needs of clients or beneficiaries 3 Funding availability 0 4 10% 20% 2 2 5 30% 40% 60% 70% 80% 90% 100% 24 12 20 11 12 1 50% 1 ‐ No influence at all 2 Donor priorities 5 1 3 15 13 8 3 4 WHEAT strategy 5 13 14 9 7 11 6 ‐ Primary influence Scientific interest/knowledge gap 01 Center strategy 1 13 8 4 3 11 10 20 10 7 34 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 15. According to you, which are currently the three most important research activities within WHEAT and where you think the emphasis should be? Current most important research activities (top rated) 0 5 10 15 Strategic research to produce International Public Goods 25 30 26 Adaptive research 12 Local research to produce feed‐back and synthesis for global… 7 Scaling‐out of research results 3 “Blue sky”, high risk research 20 1 Technical assistance 0 Other 0 35 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Where emphasis should be (top rated) 0 5 10 15 20 Strategic research to produce International Public Goods 4 Adaptive research 4 Scaling‐out of research results 3 Technical assistance 35 5 Local research to produce feed‐back and synthesis for… 30 32 “Blue sky”, high risk research Other 25 1 0 36 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 16. The CRP receives funding from different sources where the Windows 1 and 2 are of least restricted type. What is your view of how W1/2 funds are used in WHEAT? 0% 10% Leverage bilateral funding 01 Fill gaps in research funding 0 Increase integration between different areas of research 20% 30% 40% 60% 5 4 8 8 6 9 70% 80% 90% 100% 9 8 10 9 2 50% 12 9 9 11 1‐ Not at all Enhance desirable partnerships through competitive grants Enhance research quality through competitive grants 2 3 7 6 10 9 7 1 5 12 7 7 4 4 4 Increase gender relevant research 3 Provide opportunities for long‐term, high risk research 4 Provide accountability through ex post studies 1 Provide relevance through ex ante studies 1 Cover overhead costs 4 8 2 6 3 2 8 11 4 4 2 7 10 5 3 5 6‐ Main Purpose 8 1 11 8 7 2 10 10 6 4 4 37 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 17. In your view, how well are the following aspects for enhancing the effectiveness of WHEAT managed? Please score using a scale of 1-6 where 1=not well at all and 6=very well. 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Development of impact pathway 01 6 9 16 10 Engagement with partners 02 5 10 19 10 1‐ Not well at all 2 Annual progress monitoring 01 7 15 11 8 3 4 Capacity building 1 3 5 8 16 10 6 6‐ Very well managed Analysis of target groups 0 4 Feed‐back between W1/W2 and bilateral projects 1 4 7 2 13 15 8 15 5 1 38 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 18. In your view, what are important pathways through which research in WHEAT aims to have impact? Please score using a scale of 1-6 where 1=not an impact pathway at all and 6=primary impact pathway. 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Influencing food security through global germplasm 010 development 6 10 Influencing rural livelihoods through enhanced productivity 0 3 31 8 14 21 1‐Not an impact pathway at all Enhancing varietal use through better seed dissemination 0 4 Enhancing environmental sustainability through improved 01 farming practices 6 20 17 2 3 5 9 17 14 4 5 Enabling equitable benefits from research 1 2 4 Influencing funding of cereal research 1 3 5 Influencing partner research agendas in developing 12 countries 6 12 13 8 16 12 10 12 6‐Primary impact pathway 10 12 39 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 19. In your view, how effectively are the measures listed below managed in your Center/CRP for assuring and enhancing high quality of research? Please score using a scale of 6 where 1=no attention at all and 6=very effectively. 0% Infrastructure needed for high quality science 10% 20% Availability and quality of technical facilities/ equipment 0 4 70% 80% 5 7 12 6 6 19 2 4 15 9 1 ‐ No attention 4 13 12 10 90% 100% 15 9 5 60% 10 10 Learning and knowledge management 0 4 50% 11 9 4 Availability and quality of research support 1 40% 9 2 2 Strategic use of grants 1 30% 3 Acceptance and encouragement of innovative thinking Researcher performance assessment Research data management 3 Quality assurance processes such as internal peer feed‐back 2 Allocation of competences and appropriate skill mix to research teams 2 Personal incentives for high research quality Encouragement for learning from “ failure” 6 5 2 8 9 9 10 15 14 6 9 10 6 5 4 8 15 10 5 6 8 13 10 5 4 5 12 8 9 7 1 5 10 13 9 4 2 6 ‐ Very effectively 5 3 8 2 40 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 PARTNERSHIPS Most involved partners (top rated) 0 5 10 National research institutions 20 25 20 Other CGIAR centers 5 National governments 5 Universities in developing countries 4 Universities in developed countries 15 3 Other CRPs 2 Other 2 Farmer organizations 1 Civil society organizations 1 National agricultural extension systems 0 Donor implementation agencies 0 International NGOs 0 Local NGOs 0 Ultimate beneficiaries 0 41 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 0 Top 3 most involved partners (Q21) 10 20 30 40 Other CRPs Other CGIAR centers National governments Universities in developing countries Universities in developed countries National research institutions National agricultural extension systems Donor implementation agencies International NGOs Local NGOs Farmer organizations Civil society organizations Ultimate beneficiaries Other 42 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 22. In your view, to what extent do the current partnerships increase the likely effectiveness of your WHEAT-related research in areas listed below? Please score in scale of 6 where 1 -= not at all; and 6 = very much 0% 10% Help in outreach of the research results 01 20% 30% 40% 50% 60% 70% 80% 10 15 7 17 16 16 16 Increase the relevance of your research 1 2 90% 100% 17 1 ‐ Not at all 2 Help scale out your research results 0 4 6 3 4 Build on synergies which result in more streamlined research 1 implementation 4 9 12 5 16 6 ‐ Very much Increase the state‐of‐art in research Help in attracting funding 1 6 3 8 5 13 12 13 10 13 43 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 24: In your view, to what extent are the partners in WHEAT involved in Program activities as listed below? (Please score in scale of 6 where 1 -= not at all; and 6 = very much involved) 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Research prioritization 1 Planning of projects 6 3 5 7 15 5 12 12 1‐ Not at all 11 2 3 Publishing research result 3 8 8 13 7 4 5 Receiving mentoring in research Feed‐back from clients/users back to research 3 8 6 9 6 10 9 6‐ Very much involved 8 12 5 44 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 GENDER Q 25. Please indicate your agreement with the following statements that relate to mainstreaming of gender issues in your work and WHEAT. 0% 10% Gender disaggregated data on results are collected when ever 02 appropriate. The WHEAT gender strategy has been well communicated to teams and researchers. The WHEAT gender strategy influences the way my team plans and conducts its work. 20% 30% 50% 60% 70% 90% 100% 3 4 10 16 6 80% 12 12 3 1 2 40% Strongly disagree Disagree 2 16 10 4 7 1 Somewhat disagree Somewhat agree There is too much emphasis in gender even in research where 0 gender does not matter. 5 9 10 Agree 7 6 Strongly Agree There is sufficient funding to implement the gender‐related activities 1 The WHEAT gender strategy influences the way most teams in the CRP plan and conduct their work. 1 4 5 4 4 13 12 3 7 7 1 45 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Capacity development Q 26. Please indicate your agreement your agreement with the following statements that related to capacity development (CD) in your work and WHEAT. Please score in a scale of 6 where 1=very dissatisfied and 6=very satisfied. 0% 20% My Center is addressing institutional and organizational CD needs in developing 0 8 countries very well, WHEAT is addressing well institutional and organizational CD needs in developing 02 5 countries very well. Training and mentoring are equitably 02 targeting men and women. 9 Strongly disagree Disagree 10 14 Somewhat disagree 8 16 7 Somewhat agree 6 9 14 11 My Center is addressing CD capacity needs 1 5 of individuals very well. 2 100% 7 14 9 5 80% 20 5 CD activities are well integrated to research 02 4 There is sufficient funding available for CD activities 60% 4 5 CD activities are designed so as to enhance uptake of research results and likely 02 effectiveness. WHEAT is addressing CD needs of 0 individuals very well. 40% Agree 5 12 10 8 3 10 10 6 14 8 8 Strongly Agree 12 46 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Satisfaction/value added Q 27. Please indicate how satisfied you are with the following working conditions for your work. Please score in a scale of 6 where 1=very dissatisfied and 6=very 0% 10% 20% 30% 40% 50% 60% 70% 80% 90%100% Share of time required for training and 03 mentoring Share of time required for coordinating among 02 partners Share of time required for travel and meetings 0 6 (whether for Center or CRP) Incentives for cooperating with non‐CGIAR 0 partners 6 10 11 Reliability and predictability of bilateral project 1 funding 7 11 10 2 3 14 Incentives for cooperating with other CGIAR 0 Centers or CRPs Reliability and predictability of CGIAR funding through Window1/Window2 2 3 Share of time allocated to research (compared to 2 time for administration and reporting; whether… Incentives for working across themes and disciplines in the CRP 1‐ Very dissatisfied 3 10 9 12 4 10 12 9 7 3 13 14 8 4 14 7 9 8 10 12 9 7 6 9 5 7 8 4 12 1 9 2 7 7 5 6 ‐ Very satisfied 1 0 47 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 Q 28. Please indicate your agreement with the following statements related to the value WHEAT has had or is likely to have influencing the success of your research compared to past Center-based implementation of the research. Please score in a scale of 6 where 1=very dissatisfied and 6=very satisfied. 0% 10% WHEAT is enabling research to be better aligned to beneficiary needs. 01 The results framework in WHEAT will improve the value‐added from research. Research is becoming strategically better focused on development outcomes. WHEAT provides a better framework for guiding and focusing research planning. Due to WHEAT, capacity development is now addressed more strategically to improve research effectiveness WHEAT has improved the way in which gender issues are integrated to research My research is better rationalized in the broader context of program objectives. WHEAT encourages accountability for development outcomes (not just research outputs) WHEAT is creating or enhancing synergies between participating Centers. Research is becoming better integrated across disciplines and teams towards results. WHEAT has good potential to help streamline administrative procedures WHEAT has good potential to help streamline monitoring and reporting 20% 30% 6 01 60% 80% 90% 100% 4 17 8 9 70% 18 8 10 0 50% 9 6 01 40% 3 15 11 7 17 4 1 ‐ Very dissatisfied 01 8 02 12 7 12 8 3 13 2 3 2 4 0 3 11 01 8 02 0 7 13 11 5 9 2 1 11 5 5 13 12 10 1 2 14 1 9 9 3 14 11 2 9 11 6 ‐ Very satisfied 7 0 1 48 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX G. ‐ Sample project assessment ‐ TEMPLATE PROJECT NUMBER: (if applicable) PROJECT TITLE: FLAGSHIP PROJECT NUMBER: TYPE OF PROJECT: RESEARCH <‐> more downstream DEVELOPMENT ORIENTED – please explain briefly LEAD: CIMMYT/ICARDA/other Filled out by: Date: Documentation used for assessment: RELEVANCE AND COHERENCE: Alignment with WHEAT objectives Project alignment means that project objectives and activities to achieve those objectives are clearly defined and match with those of the SI/FP Is the project presented as part of WHEAT CRP? To what extent is the project/activity aligned to the FP (or specific SI) objectives and WHEAT IDOs? ‐ ‐ ‐ Very well Moderately Poorly Comments: 1. Relevance of project Are the main target beneficiaries of the project clearly defined? Does the project reflect needs and priorities of target group? Does the project address globally/regionally important issues where CGIAR has comparative advantage? 2. 49 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 SCIENCE QUALITY Is the research addressing researchable issues? 3. Are research hypothesis clearly formulated and testable? Does the project use state of the art methodology? 4. 5. 6. To what extent do the choices of research topics and research designs reflect a high quality of scientific thinking, state‐of‐the‐art knowledge of the scientific literature and complements research done elsewhere? 7. To what extent does the research reflect an iterative process between downstream and upstream research? Has feedback from downstream work been incorporated in research design? LIKELY EFFECTIVENESS: Is there an impact pathway described and is it realistic? 8. How has progress been in terms of research results and outputs? Are limitations and delays explained? 9. 50 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 10. How does the project design address the scaling‐up and out of research outputs? Does the project include an implementation modality (partnerships, management) which reflects an appropriate role for CIMMYT/IITA? What has been the main success so far? (MENTION ONE MAJOR ACHIEVEMENT) Assess its significance. 11. 12. 13. Are constraints to research outputs as well as uptake/impact and challenges mentioned and addressed? 14. Is the reference to when impact (adoption) is expected and in what scale? How likely do you see this realizing? PARTNERSHIPS What types of partners are included in the project? Are the partners’ roles clearly defined? How is the work divided between CIMMYT/ICARDA and the partners? 15. To what extent are these partners relevant and likely effective in relation to the project's objectives and design ‐‐ at the project's conceptual stage? ‐ ‐ ‐ High Substantial Modest 51 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ‐ ‐ Low Not mentioned GENDER 16. Does the project/research strategy address gender specific issues? Does the project report on gender disaggregated results? 17. From the point of view of achieving the objectives of the project, has there been an under‐emphasis, appropriate emphasis, or over‐ emphasis on gender analysis and gender‐specific research in terms of achieving the Flagship IDO? ‐ ‐ ‐ ‐ Under‐emphasis Appropriate emphasis Over‐emphasis Not mentioned CAPACITY DEVELOPMENT 18. Are there any capacity building measures mentioned and who do they target? What capacity building activities have been implemented? 52 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 From the point of view of achieving the objectives of the project, has there been an under‐emphasis, appropriate emphasis, or over‐ emphasis on capacity development in terms of achieving the Flagship IDO? ‐ ‐ ‐ ‐ Under‐emphasis Appropriate emphasis Over‐emphasis Not mentioned CONCLUSION/OBSERVATIONS please briefly explain any qualifiers to the above questions (issues that could not be reflected) as well as briefly state the main strengths as well as issues relating to this project 53 cgiar.iea.org Wheat Evaluation, Annexes, April 2015 ANNEX H. ‐ Peer review scoring of a random sample of publications – TEMPLATE Number of publication (according to our list and file name): Name of publication: Journal name: Center: CIMMYT/ICARDA Area: Agronomy/Breeding/Socio econ Team member to review publication Team members shall assess each publication according to the following standardized criteria and approach: Criterion Assessment approach methodological rigor and coherence of data Scale1 analysis comprehensiveness of research narrative Scale innovativeness; novelty Observation: would novelty be expected, if yes what kind of novelty was observed quality (and appropriateness) of publication Observation of low‐quality or inappropriate venue venue relative to subject and quality of paper collaboration (especially co‐authorship) evident Observation of extent of authorship and with whom “fit” with CRP objectives Observation of outliers overall quality of publication (including Brief narrative additional criteria at evaluator discretion) 19. When there are other outputs than published work – such as germplasm ‐ systematic assessment of quality may be difficult and assessment of quality can be based on project reports, volume of output, extent of use/uptake and user perceptions. 1 Scale of 4 (1=poor; 2=mediocre; 3=good; 4=excellent) or 6 (1=poor; 2=quite poor; 3=adequate; 4=quite good; 5=good; 6=excellent). Eventually evaluation findings should not have too many scales. 54
© Copyright 2024