Case Study: Can scholarships help keep kids in school? Impact Evaluation Workshop Debre Zeit, Ethiopia Donald Baum December 9 – 12, 2014 What is the intervention about? A. Providing cash transfers to build toilets B. Providing subsidies to buy bicycles C. Providing scholarships D. Providing scholarships with conditionality of school attendance and 0% 0% 0% 0% 1 Pr ov id in g in g i.. sw sc ho l sc ho l ar sh ip ar sh ip bu ... o st Pr ov id in g Pr ov id Pr ov id in g ca s h su bs id ie tra ns fe r s. . s health check ups What is the research question? Rank Responses 1 2 3 4 5 6 2 0% 0% 1 2 0% 3 0% 4 0% 5 0% 6 What is the counterfactual (control group)? A. Children scoring very high in the dropout risk B. Children scoring very low in the dropout risk 0% us tb el .. in gj n ld re n ld re Ch i sc or in gj in gv sc or ld re n Ch i 0% bo .. ow . .. yl er er y in gv sc or n ld re Ch i 3 Ch i Children scoring just below the cut-off 0% us ta 0% hi g. .. D. Children scoring just above the cut-off sc or C. What is the methodology? C. Regression Discontinuity D. Matching 0% 4 Di sc n ra sio gr es Re Ph as e- in Ra nd o m nd om iza iza tio tio n n 0% 0% 0% in g Phase-in randomization M at ch B. ty Randomization on t in ui A. Which one of the following is an output of the program? C. Children are wearing uniform D. Children are using bicycles 0% 5 gu n. .. 0% rin ea ld re Ch i n ld re n ar ar e e w at te Ch i Ch i ld re n ar e Sc ho la rs hi nd i ps a ng re to ... pa i d 0% 0% s Children are attending to the school c le B. icy Scholarships are paid us in gb A. Which one of the following is an intermediate outcome of the program? A. Children are attending to the school B. Children are performing better in the school e Ch i ld re n ar ar ld re n Ch i 0% id 0% pa re sa he r g. .. in e pe r m or e nd i at te e ar n ld re Ch i 6 0% fo rm ng to ... 0% ... Teachers are paid ac D. Te Children are more exposed to illness ex po se C. What behavioral changes are required for the success of the program? A. Children work more hours on economic activity B. Siblings work more hours on economic activity C. Children attend to the school and allocate more time to study 0% 0% e. .. . te n d sr at he r ac Te tim ed uc e to th e th e s.. . ho ur .. n ld re bl in Si Ch i ld re n gs w w or k or m km or e or e ho u. . to prepare the class 7 0% Teachers reduce the time spent Ch i D. 0% Which one is an outcome of the program? A. Children did not perform better in the school B. Children are more likely to work in economic activities Scholarships are not paid 0% 0% se d re sa no t re ps a c lo pa id . y. lik el rs hi n ld re Ch i Sc ho la ar e m or e er fo rm no tp d di n ld re Ch i 8 0% Schools are closed .. . D. 0% Sc ho ol C. Are the results of the program valid for other areas of the country or other countries? B. Sometimes C. Never 0% 9 im et So m Al w ay s es 0% 0% ve r Always Ne A.