FAQs

The Clearinghouse has developed a working list of the next programs and services planned for systematic review. The programs and services were identified and prioritized using the Clearinghouse’s Handbook of Standards and Procedures. Particular consideration was given to programs and services recommended by State or local government administrators; rated by other clearinghouses (such as CEBC or HomVEE); recommended by federal partners; and/or evaluated as part of grants supported by the Children’s Bureau (such as the Title IV-E Child Welfare Demonstrations or Regional Partnership Grants).

This working list, presented in alphabetical order within each program or service area, may be changed in accordance with the Clearinghouse’s Handbook of Standards and Procedures and as needed to support implementation of ACYF-CB-PI-19-06, Transitional Payments for the Title IV-E Prevention and Family Services and Programs.

Mental Health:
Attachment and Biobehavioral Catch-Up [also listed under in-home parent skill-based]
Brief Strategic Family Therapy [also listed under substance abuse and in-home parent-skill based]
Child Parent Psychotherapy
Incredible Years
Interpersonal Psychotherapy
Multidimensional Family Therapy [also listed under substance abuse and in-home parent-skill based]
Triple P – Positive Parenting Program

Substance Abuse:
Brief Strategic Family Therapy [also listed under mental health and in-home parent skill-based]
Family Behavior Therapy
Multidimensional Family Therapy [also listed under mental health and in-home parent skill-based]
Seeking Safety
The Seven Challenges

In-home Parent Skill-based:
Attachment and Biobehavioral Catch-Up [also listed under mental health]
Brief Strategic Family Therapy [also listed under mental health and substance abuse]
Homebuilders
Multidimensional Family Therapy [also listed under mental health and substance abuse]
Nurturing Parenting
SafeCare
Solution Based Casework

Kinship Navigator:
Ohio's Kinship Supports Intervention/ProtectOHIO
YMCA Kinship Support Services, YMCA Youth and Family Services of San Diego County

NOTE: If there are multiple formal adaptations of a program or service, the Clearinghouse may select one adaptation for review. This is intended to maximize the number of different programs and services reviewed. The Clearinghouse aims to review and rate as many programs and services as quickly as possible and will continue to release ratings for programs and services on a rolling basis.

Our goal is to review and rate as many programs and services as quickly as possible to support states’ efforts to improve outcomes for children and families through implementation of the Family First Prevention Services Act (FFPSA).

The Prevention Services Clearinghouse will continue to select additional programs and services for review on a rolling basis starting in summer 2019. Join our email list to be notified of updates!

In identifying the initial group of programs and services for review, the Children’s Bureau and the Office of Planning, Research, and Evaluation (OPRE) at the Administration for Children and Families considered comments and recommendations from more than 360 unique responses to the Federal Register Notice (83 FR 29122) issued June 22, 2018.

The initial programs and services selected for review met at least two of the following conditions: (1) recommendation from State or local government administrators in response to the Notice; (2) rated by the California Evidence-Based Clearinghouse for Child Welfare; (3) evaluated by Title IV-E Child Welfare Waiver Demonstrations; (4) recipient of a Family Connection Discretionary Grant; and (5) recommendation solicited from federal partners in the Administration for Children and Families, Health Resources and Services Administration, the National Institutes of Health, the Centers for Disease Control and Prevention, the Office of the Assistant Secretary for Planning and Evaluation, and the Substance Abuse and Mental Health Services Administration.

The Prevention Services Clearinghouse will continue to select programs and services for review using an inclusive process. Programs and services will be identified from the following sources:

  • A public call for recommendations on at least an annual basis. The first public call occurred in the fall of 2019 and is now closed.
  • Recommendations received in response to the 2018 FRN, federal partners, and other key stakeholders; and
  • An environmental scan and an inventory of the literature.

Particular consideration will be given to programs and services recommended by State or local government administrators in response to the 2018 FRN or the public calls; rated by other clearinghouses (such as CEBC or HomVEE); recommended by federal partners; and/or evaluated as part of any grants supported by the Children’s Bureau (such as the Title IV-E Child Welfare Demonstrations or Regional Partnership Grants).

Join our email list to be notified of updates!

The Prevention Services Clearinghouse uses unique standards and procedures developed in accordance with the statutory requirements detailed in the Family First Prevention Services Act (FFPSA) of 2018. For example, though the California Evidence-Based Clearinghouse for Child Welfare (CEBC) uses a peer-review process to review and rate studies of programs and services, the Prevention Services Clearinghouse is required to conduct an independent, systematic evidence review. In addition, different from CEBC, the Title IV-E Prevention Services Clearinghouse allows programs or services with rigorous quasi-experimental evidence to achieve a well-supported or supported rating. The Prevention Services Clearinghouse also includes review of publicly available research studies including those that do not appear in peer-reviewed journals.

Similarly, different from Home Visiting Evidence of Effectiveness (HomVEE) review, the rating criteria and outcome domains identified in FFPSA do not directly align with the criteria established by HHS for evidence-based home visiting models. For example, in accordance with the statutory requirement of FFPSA, the Prevention Services Clearinghouse criteria for sustained effects are based on length of time after the end of treatment, whereas HomVEE criteria for sustained effects are based on length of time after enrollment.

A downloadable copy of the Prevention Services Clearinghouse Handbook of Standards and Procedures can be found here.

Yes. As noted within section 7.4.1 of the Handbook of Standards and Procedures, programs and services reviewed for the Prevention Services Clearinghouse may be considered for re-review due to missing information or errors in the original review, or due to the emergence of substantial new evidence that has the potential to change program or service ratings. Prevention Services Clearinghouse staff keep track of the dates that programs and services are reviewed and periodically assess the extent of new evidence available. Periodically, content experts may be consulted to determine if new research is available and if the available research has the potential to change the rating of the program or service. Stakeholders may request a re-review of the program or service rating by emailing PreventionServices@abtassoc.com. To help facilitate the re-review, stakeholders may specify the rationale for the request and provide any supporting documentation.

As noted within section 7.4.2 of the Handbook of Standards and Procedures, individual studies reviewed by the Prevention Services Clearinghouse may be considered for re-review due to missing information or errors in the original review. If errors or missing information are identified, the Prevention Services Clearinghouse follows standard procedures for re-review. This includes assigning different, blinded reviewers to conduct any re-reviews. If the re-review determines the original review to be in error, the error is corrected on the website. All correspondence regarding re-reviews is logged and maintained by Prevention Services Clearinghouse staff. Stakeholders may request a re-review of an individual study by emailing PreventionServices@abtassoc.com. To help facilitate the re-review, stakeholders may specify the rationale for the request and provide any supporting documentation.

The following procedures apply when the Prevention Services Clearinghouse identifies more than 15 eligible studies for a program or service under review. As noted in Section 4.2. Study Review Prioritization Criteria of the Handbook, the Prevention Services Clearinghouse reviews all eligible studies.

If a program or service has 15 or fewer eligible studies, all studies are reviewed using the design and execution standards described and assessed for risk of harm.

If a program or service has more than 15 eligible studies, all eligible studies are assessed for risk of harm. Study review prioritization criteria are used to determine the order of eligible studies reviewed using the design and execution standards. Once ordered, the first 15 eligible studies will be reviewed using the design and execution standards. If, after review of 15 eligible studies, a program or service has not achieved a rating of well-supported, additional studies will continue to be reviewed in order until the program or service has achieved a rating of well-supported or all eligible studies have been reviewed.

Many programs and services have been adapted (e.g., modified to address particular issues or populations). The Prevention Services Clearinghouse reviews each adaptation to determine if the program or service has been substantially modified or adapted from the version that has been selected for review. The Prevention Services Clearinghouse reviews eligible studies only of the version selected for review.

Exhibit 4.1. within the Handbook of Standards and Procedures (shown below) provides examples of ‘eligible’ adaptations (i.e., adaptations that have not substantially modified or adapted the program or service from the one selected for review). For example, if a program modestly changes the session frequency or duration, this may be reviewed as part of the version that was selected for review. Exhibit 4.1 below also provides examples of adaptations that would be considered substantial and result in a different version of the program or service than the one selected for review. For example, substantial changes to a program or service’s enrollment or eligibility criteria.

Eligible Adaptations Adaptations that Result in Different Program or Service
  • Modestly changing session frequency or duration
  • Delivering the intervention in the home compared to office-based delivery
  • Making small changes to increase the cultural relevancy of the intervention (e.g., changing examples to match the cultural background of subjects; providing the intervention in a different language) without changing program components
  • Delivering the program by slightly different types of professionals than described in the manual or original research on the program or service (e.g., using social workers instead of counselors to deliver the program)
  • Changing from individual to group therapy
  • Adding any new modules or session content
  • Subtracting any modules or session content that was part of the original intervention
  • Radically changing content for different cultural groups, such as to reflect particular issues experienced by those groups
  • Delivery of the program by substantially different providers than described in the manual (e.g., using para-professionals instead of nurses to deliver the program)

When there are multiple versions of a program or service, the Prevention Services Clearinghouse may select just one version as indicated by a specific book/manual/other documentation to review at a particular time. Other versions of the program or service may be reviewed by the Prevention Services Clearinghouse in the same round of review or in later rounds of review.

For additional information see section 4.1.6 of the Handbook of Standards and Procedures.

The Prevention Services Clearinghouse website includes the working list of programs and services that are currently under review. This can be found on the FAQ page of the website under the question: “What are the next programs and services planned for systematic review?”

It is difficult to predict the timeline for review of an individual program and service. Review timelines are influenced by a number of factors including, but not limited to:

  • The number of eligible studies examining a particular program or service;
  • Whether eligible studies have all the information necessary to complete the review or whether author queries will be needed to obtain additional information;
  • If author queries are needed, the timeline for authors to respond to the queries and the information they provide; and,
  • Whether any questions come up during the course of the review of studies that require internal or external expert consultation.

Our goal is to review and rate as many programs and services as quickly as possible to support states’ efforts to improve outcomes for children and families through implementation of the Family First Prevention Services Act. We encourage stakeholders to sign up for email updates on the Clearinghouse website to receive notifications about changes to the working list of programs and services planned for systematic review and the release of new program or service ratings.

The Prevention Services Clearinghouse has received a high volume of program and service recommendations to date. This includes more than 360 comments received in response 2018 FRN as well as nearly 400 emails received in response to the 2019 public call for program and service recommendations. Many of these recommendations identify multiple programs and services. The Prevention Services Clearinghouse staff log and review all program and service recommendations and respond to stakeholders noting that their recommendations have been received. Given the high volume of recommendations, it is not currently feasible within resource and time constraints, for staff to send individualized responses to stakeholders indicating why a program or service recommended has not yet been selected for review. The Clearinghouse’s systematic prioritization process is outlined in the Handbook of Standards and Procedures (Section 2). The Prevention Services Clearinghouse is working to review and rate as many services and programs as quickly as possible.

As described in Section 4.1.4 of the Handbook of Standards and Procedures, eligible studies must use a randomized or quasi-experimental group design with at least one intervention condition and at least one comparison condition. Intervention and comparison conditions may be formed through either randomized or non-randomized procedures and the unit of assignment to conditions may be either individuals or groups of individuals (e.g., families, providers, centers). Comparison groups may be formed using a variety of methodologies, including, for example, both propensity score matching and weighting strategies. Designs in which the same group of individuals is evaluated before and after receiving an intervention are not eligible (i.e., single group pretest posttest designs). This includes interrupted time series designs without comparison groups. The Prevention Services Clearinghouse does not currently review studies that use regression discontinuity designs.