In Years 4-6 of the initiative, the evaluation will focus on DYCD’s efforts to improve OST program quality through the following activities:

• An initiative-wide participation study describing the patterns of enrollment, participation, and retention of youth in OST programs throughout the course of the initiative.
  
  
• A longitudinal follow-up study of program quality, implementation, and youth experiences, in a small sample of OST programs studied in-depth since the start of the initiative.
  
  
• The development of a program-quality measurement tool to be used by DYCD staff in monitoring the quality of OST programs, and an analysis of data collected using this tool.
  
  
• An evaluation of the High School Transition Programs launched as part of the OST initiative in September 2009 to facilitate a successful transition into high school for students entering the ninth-grade.
  
  
• An evaluation of a pilot initiative to build the capacity of OST provider organizations through intensive technical assistance focused on fiscal management, human resources management, and program quality.
  
  

Evaluation data for these projects are collected from OST programs through surveys and interviews of program directors and staff, the staff of sponsoring organizations, and participating youth and their parents. Evaluators also visit a sample of OST programs. In addition, the evaluation examines program participation data and data from the New York City Department of Education.

Report on the Third Year

This final report on the first three years of implementation of the OST initiative focuses on assessing program quality, particularly the presence of varied and engaging program content, the promotion of positive interpersonal relationships, and the establishment of effective staffing patterns and partnerships with schools and families. Evaluators also examined youth engagement in OST programs and the social and educational development of OST participants. Evaluators found that youth felt more strongly connected to their OST programs and reported stronger academic benefits when the program offered a variety of new experiences and fostered stronger relationships with staff and other youth.

                                Year 3 Report

                                Executive Summary

Report on the Second Year

In the second year, the evaluation examined recent evidence of programs’ efforts to improve program quality and scale. In particular, evaluators looked for evidence that programs had established structures to support high-quality staffing and effective partnerships, were delivering rich program content through activities that fostered positive interpersonal relationships, and were engaging youth in activities to develop their skills in both social and content-based areas. Evaluators also examined the extent to which programs increased the number of youth served and their level of program attendance.

                                Year 2 Report

                                Executive Summary

                                DYCD Update

Report on Patterns of Youth Retention

The report uses program participation data to examine the extent to which 2005-06 youth participants continued to attend OST programs in 2006-07. It also reviews the characteristics of OST programs that achieved high, medium, and low levels of participant retention. In addition, it summarizes the self-reported reactions to OST programs by youth in programs that achieved varying levels of participant retention. These findings point to program characteristics that satisfy consumers and meet quality criteria.

                                Year 2 Interim Report

Report on the First Year and DYCD Response

This report presents data on the first year of program implementation and baseline findings on participant engagement in OST programs and associated academic and social development outcomes. It describes the characteristics of OST programs, including staffing structures and activities for youth. In addition, the report examines patterns of youth enrollment and participation in OST programs.

                                Year 1 Report

                                DYCD Response