chevrons-alone.png

Evaluation of Technical Assistance

Projects

 

U.S. Department of Education

NATIONAL EVALUATION OF THE COMPREHENSIVE TECHNICAL ASSISTANCE CENTERS, 2011

A multi-year national evaluation of the Comprehensive Technical Assistance Centers determined the extent to which Centers enhanced state capacity to support district and school improvement. A federally funded technical assistance initiative authorized under the Elementary and Secondary Education Act, as reauthorized by the No Child Left Behind (NCLB) Act of 2001, the Centers help states use research knowledge and promising practices to direct and support their districts and schools in closing achievement gaps, particularly districts and schools where achievement continues to fall short. PSA, Branch Associates, Inc., and Decision Information Resources, Inc. conducted the evaluation for the Institute of Education Sciences in the U.S. Department of Education (ED).

National Evaluation of the Comprehensive Technical Assistance Centers—Final Report
National Evaluation of the Comprehensive Technical Assistance Centers--Executive Summary

National Evaluation of the Regional Educational Laboratories

PSA served as partner to Westat on the National Evaluation of the Regional Educational Laboratories (RELs), funded by the Institute of Education Sciences (IES) at the U.S. Department of Education. The study assessed the technical quality of the REL products and determined their relevance and usefulness to states, local practitioners, and policymakers in their regions. PSA conducted semi-structured interviews with REL staff to identify REL activities under each of the 10 statutory missions. PSA was also responsible for identifying and recruiting expert panelists to rate the technical quality and relevance of REL fast response projects and impact studies. PSA was also involved in developing a survey of REL customers that was administered to a range of practitioners and policymakers to determine whether REL research products were useful and usable.

national evaluation of the COMPREHENSIVE REGIONAL ASSISTANCE CENTERS, 1999

The evaluation concluded that the Comprehensive Centers had succeeded in developing a portfolio of services that met the charge set out in their authorizing legislation. In addition, customer reports on the usefulness of the centers validated principles of high-quality technical assistance and professional development. But the evaluation found that the centers’ lack of sufficient funding prevented them from working with the intensity necessary to produce major effects on educational change and improvement.

Comprehensive Regional Assistance Centers Program: Final Report on the Evaluation: Volume 1
Comprehensive Regional Assistance Centers Program: Final Report on the Evaluation: Volume 2
Comprehensive Regional Assistance Centers Program: Final Report on the Evaluation: Volume 3

National Science Foundation

For the National Science Foundation (NSF), PSA was a partner in the Community Advancing Discovery Research in Education (CADRE), a resource network led by Education Development Center that builds and shares knowledge relevant to NSF’s largest R&D grant program in K-12 STEM education, the Discovery Research K-12 program (DR K-12). PSA analyzed the approximately 400 NSF-funded DR K-12 projects that worked to translate prominent national goals for STEM education into practice in schools and other agencies. The PSA team worked with DR K-12 project leaders on a range of tasks, including those involving work groups, collaborative development of briefs, and conference presentations. For national program convenings, PSA assisted in planning and in the synthesis of proceedings as well as convened and facilitated work groups to develop briefs that highlight innovative R&D that were intended to have practical use in the STEM education field. The work groups included researchers, developers, and practitioners from schools and districts, and the groups followed a process that involved strategic recruitment, problem clarification, knowledge building, and collaborative reporting. Topics of PSA briefs included R&D partnerships with practitioners, the use of research knowledge, national priorities for STEM education, and supports of early career R&D professionals.

Early Career Researchers and Developers in the DR K-12 Program: Needs, Supports, and Recommendations
Education R&D Partnership Tool
Practice-Engaged R&D in Education
R&D Partnership Brief
CADRE White Paper

REL West

the Regional Education Laboratory West (REL West)

PSA is a formative evaluator and thought partner for the Regional Education Laboratory West (REL West) at WestEd as it supports the school-level implementation of an elementary literacy curriculum and improvement science methods in the Washoe County (UT) School District. PSA provided feedback to WestEd and the Salt Lake United Way on how community school directors used an early warning tool and offered recommendations for improving the integration of the early-warning tool with schools’ systems and operations. PSA partnered with United Way Worldwide to evaluate collective impact initiatives focused on improving the capacity of local United Ways to collaborate with school districts and community organizations.

YMCA

YMCA of the USA Afterschool Upgrade Pilot

PSA conducted an evaluation of the YMCA of the USA Afterschool Upgrade Pilot, targeted at building staff capacity through professional development and implementation of evidence-based strategies to support positive youth development outcomes. The evaluation explored the implementation and effectiveness of the Afterschool Upgrade Pilot with three foci: (1) the operation of afterschool program sites at local Ys; (2) organizational practices of Ys; and (3) supports, guidance, and refinements to consider in scale-up.

DYCD

NEW YORK CITY DEPARTMENT OF YOUTH AND COMMUNITY DEVELOPMENT (DYCD)

PSA evaluated Strengthening our Core, an initiative of the New York City Department of Youth and Community Development (DYCD)designed to build the capacity of nonprofit provider organizations to support staff in implementing high-quality programs. Through this initiative, DYCD offered a year of intensive, high-quality capacity-building services to selected providers to enhance the organizational capacity and sustainability of provider organizations through improvements in fiscal management, organizational leadership, and programmatic planning.

National Governors Association

Early Care and Education (ECE) Project

For the National Governors Association, PSA conducted a two-year study to assess and support the NGA’s Comprehensive Strategy for Early Care and Education (ECE) Project, which targeted technical assistance and support to a select group of states, including governors and their staff, to refine and implement an ECE policy agenda that expands access and quality in opportunities for young children. PSA conducted surveys and interviews of state staff, reviewed state documents, and tracked of performance indicators to evaluate the extent to which the technical assistance led to desired state outcomes. PSA also assisted states in developing a Theory of Change (TOC) to help them assess their progress toward realizing their respective ECE policy agendas. PSA identified, clarified, and recommended specific ways in which NGA staff could provide targeted technical assistance to support specific state efforts to achieve their short- and longer-term ECE policy agendas. In addition, each state’s TOC mapped out a plan for sustaining project activities.