168
SOUTHERN REGION GAP ANALYSIS: FINAL EVALUATION REPORT RESEARCH TEAM MELISSA J OHNSON J OHN ROBST AREANA C RUZ CATHY S OWELL AMY VARGO RENE ANDERSON YARITZA CARMONA S OPHIE J AMES Submitted to Florida Department of Children and Families on June 26, 2020

Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

SOUTHERN REGION GAP ANALYSIS: FINAL EVALUATION REPORT

RESEARCH TEAM MELISSA JOHNSON

JOHN ROBST AREANA CRUZ CATHY SOWELL

AMY VARGO RENE ANDERSON

YARITZA CARMONA SOPHIE JAMES

Submitted to Florida Department of Children and Families on June 26, 2020

Page 2: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

1

FINAL EVALUATION REPORT | Contract LHZ68

Table of Contents

Introduction ....................................................................................................................................5

Background ..................................................................................................................................5

Purpose and Objectives ................................................................................................................7

Phase I: Service Utilization and Patterns ..................................................................................8

Phase II: Children’s Behavioral Health Service Needs ............................................................9

Phase III: Service Access, Capacity, and Coordination of Care ..............................................9

Phase IV: Determination of Gaps ...........................................................................................10

Study Context .........................................................................................................................10

Methods .........................................................................................................................................12

Administrative Data Analysis ....................................................................................................12

Florida Safe Families Network (FSFN)..................................................................................13

Lead Agency (Our Kids) ........................................................................................................14

Substance Abuse and Mental Health Information System (SAMHIS) ..................................15

Financial and Services Accountability Management System (FASAMS) .............................16

Medicaid Recipient, Claims, and Encounter Data ..................................................................17

All Funding Sources ...............................................................................................................19

Deriving the Final Sample ......................................................................................................20

Analysis ..................................................................................................................................21

Case Record Reviews ................................................................................................................22

Document Review ......................................................................................................................23

Interviews ...................................................................................................................................24

Focus Groups ..............................................................................................................................25

Surveys .......................................................................................................................................26

Provider Survey ......................................................................................................................26

Case Management Survey ......................................................................................................27

Results ...........................................................................................................................................28

Processes and Procedures for Identifying Children’s Behavioral Health Needs .......................28

Assessment Processes .............................................................................................................29

Care Coordination...................................................................................................................32

Documentation .......................................................................................................................38

Page 3: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

2

FINAL EVALUATION REPORT | Contract LHZ68

Mental and Behavioral Health Needs of Children in Licensed Care .........................................39

Child Characteristics...............................................................................................................40

Child Mental Health Assessments ..........................................................................................42

Child Welfare Assessments of Child Needs ...........................................................................44

Child Mental Health Diagnoses and Treatment Needs ..........................................................48

Mental Health and Behavioral Health Service Needs ............................................................51

Estimate of Overall Child Welfare Population Needs ............................................................53

Stakeholder Perceptions of Mental and Behavioral Health Needs .........................................55

Children’s Behavioral Health Service Array .............................................................................57

Description of Provider Network and Service Array .............................................................58

Stakeholder Perceptions of Service Availability and Accessibility .......................................64

Service utilization Patterns for Children in Licensed Care ........................................................74

Child Characteristics...............................................................................................................74

Behavioral Health Services .....................................................................................................79

Regression Results ................................................................................................................. 89

Medicaid Plan Enrollment and Service Utilization ................................................................91

Service Utilization based on Children’s Needs ......................................................................96

Discussion....................................................................................................................................100

Recommendations ......................................................................................................................106

References ....................................................................................................................................110

Appendix A: Data Collection Protocols ......................................................................................114

Appendix B: Mental health Assessments used by Behavioral Health providers .........................142

Appendix C: Evidence-Based Practices and Treatment Modalities ............................................146

Appendix D: Behavioral Health Provider Survey Results ...........................................................148

Appendix E: Case Manager Survey Results ................................................................................151

Appendix F: Definitions for Administrative Data Analysis ........................................................154

Page 4: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

3

FINAL EVALUATION REPORT | Contract LHZ68

List of Tables

Table 1. Descriptive Statistics for Initial FSFN Sample (n=4,855) ..............................................13

Table 2. Services Paid by Our Kids for Children in Out-of-Home Care ......................................15

Table 3. Behavioral Health Services Paid by DCF Substance Abuse and Mental Health Funds,

January 2016-September 2018 .......................................................................................................15

Table 4. Behavioral Health Services Paid by DCF Substance Abuse and Mental Health Funds,

October 2018-December 2018 .......................................................................................................17

Table 5. Behavioral Health Services Paid by Medicaid Program, 01/2016-09/2018 ...................18

Table 6. Behavioral Health Services Paid by All Funding Sources, January 2016-December

2018................................................................................................................................................19

Table 7. Child Characteristics by Age Group ...............................................................................41

Table 8. Most Frequently Completed Mental/Behavioral Health Assessments by Age Group ...43

Table 9. Child Welfare Assessments Completed by Age Group ..................................................45

Table 10. Child Welfare Needs Assessment Ratings by Age Group ............................................47

Table 11. Children’s Mental Health Diagnoses by Age Group ....................................................48

Table 12. Children’s Service Needs Identified by Behavioral Health Providers .........................52

Table 13. Estimate of Child Mental and Behavioral Health Needs ..............................................54

Table 14. Outpatient Services Provided in the Southern Region ..................................................59

Table 15. Therapeutic Placement Services Provided in the Southern Region ..............................61

Table 16. Inpatient Services Provided in the Southern Region ....................................................62

Table 17. Final Sample Characteristics ........................................................................................74

Table 18. Diagnostic profile for children in sample .....................................................................76

Table 19. Final Sample Characteristics by County .......................................................................77

Table 20. Diagnostic Profile by County .......................................................................................78

Table 21. Number of Children Receiving Behavioral Health Services and Number of Encounters

by Service.......................................................................................................................................80

Table 22. Expenditures per user of service and per child .............................................................81

Table 23. Average Expenditures by Child Characteristics ...........................................................83

Table 24. Average Expenditures by Child Characteristics – Non-Residential Services ..............84

Table 25. Behavioral Health Expenditures by Diagnosis .............................................................86

Table 26. Behavioral Health Expenditures by Year of Child Welfare .........................................88

Page 5: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

4

FINAL EVALUATION REPORT | Contract LHZ68

Table 27. Behavioral Health Expenditures by Placement Type ...................................................88

Table 28. Regression Results: Determinants of Behavioral Health Expenditures ........................90

Table 29. Service Penetration and Utilization by Month and Medicaid Plan ...............................93

Table 30. Non-residential Service Penetration and Utilization by Month and Medicaid Plan ....94

Table 31. Inpatient/Residential Service Penetration and Utilization by Month and

Medicaid Plan ................................................................................................................................95

Table 32. Percentage of children that received any behavioral health service and average

expenditures ...................................................................................................................................96

Table 33. Service utilization by level of service need ..................................................................97

Table 34. Number of days until assessment..................................................................................98

Table 35. Number of days until first non-assessment service ..................................................... 98

Table 36. Number of days between services ................................................................................99

Page 6: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

5

FINAL EVALUATION REPORT | Contract LHZ68

Introduction

The following report presents the findings from a study of behavioral health services for

children in licensed foster care in Florida’s Southern Region, including Miami-Dade and Monroe

Counties. This study was carried out by a team of researchers at the University of South Florida

in response to a request from the Florida Department of Children and Families (DCF). The

overarching purpose of the study was to identify gaps in service capacity and provision and

inform the state of areas where there are critical needs or concerns requiring attention. The

report concludes with a set of recommendations to improve services for children in Florida’s

child welfare system.

Background

Children entering foster care have high rates of mental and behavioral health needs

compared to children not involved in the child welfare system (Kerns, et al., 2014). Studies have

found that 35 to 45 percent of children entering foster care had chronic or untreated physical

health conditions (Hillen & Gafson, 2015), and 40 to 80 percent of children in foster care exhibit

signs of mental health problems (Lehmann, Havik, Havik, & Heiervang, 2013; Sullivan & van

Zyl, 2008). This reflects a combination of factors including the physical and emotional effects of

maltreatment, the lack of preventative care, and in many cases, exposure to poverty. Many

children in foster care have experienced multiple, repeated traumatic events over a period of

time, commonly referred to as complex trauma, which may manifest in a wide array of emotional

and behavioral reactions among affected children, but are often poorly assessed or understood by

child welfare systems (Deutsch, Lynch, Zlotnik, Matone, Kreider, & Noonan, 2015; Oswald,

Fegert, & Goldbeck, 2010).

While the high rate of behavioral health needs among the foster care population is well

documented, considerable gaps persist in connecting these children to adequate and appropriate

Page 7: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

6

FINAL EVALUATION REPORT | Contract LHZ68

services to meet their needs (Simms, Madelyn, Battistelli, & Kaufman, 2018; Kerns, et al., 2014;

Sullivan & van Zyl, 2008). Assessment is one critical factor in linking children to needed

services. Both the Child Welfare League of America and the American Academy of Pediatrics

(AAP) recommend that all children entering foster care should receive a comprehensive mental

health evaluation (Barbel, 2020; Szilagyi, Rosen, Rubin, & Zlotnik, 2015; AAP, 2005). A

number of challenges, however, have been identified with regard to the implementation of these

recommendations. These include lack of systematic screening for trauma exposure, associated

symptoms, and other mental and behavioral health problems among children entering foster care

(Simms, Madelyn, Battistelli, & Kaufman, 2018; Briggs, et al., 2012; Greeson, et al., 2011), lack

of knowledge and experience with the child welfare population among community mental health

providers (Kerns, et al., 2014; Kerker & Dore, 2006), lack of specific guidance on behavioral

health screening procedures and assessment tools (Simms, Madelyn, Battistelli, & Kaufman,

2018; Jee, et al., 2010), and lack of training among caseworkers on identifying mental health

needs or how to apply screening and assessment results to case planning (Kerns, et al., 2014).

Additionally, children in foster care often face barriers in accessing behavioral health

services. Challenges documented in the literature include eligibility criteria that preclude

children from receiving services without a diagnosed disorder, restrictions set by Medicaid on

the number of sessions they will reimburse, limited number of providers who accept Medicaid,

multiple placement changes that disrupt continuity of care, and lack of training and expertise

among caseworkers to identify appropriate services, facilitate access to services and coordinate

children’s care (Lohr, et al., 2019; Kerns, et al., 2014; Inkelas & Halfon, 2002).

Studies on the relationship between mental health status and child welfare outcomes have

found that mental health problems play an important role in successful placement in foster care

Page 8: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

7

FINAL EVALUATION REPORT | Contract LHZ68

and the likelihood of reunification. For example, children with a mental health diagnosis spend a

longer time in out-of-home care (Tarren-Sweeney, 2017). Given the importance of mental health

problems in determining child welfare outcomes, it is crucial to examine the health care services

received by children and determine where gaps in services exist.

A number of studies have examined Medicaid-funded health care services received by

children in the foster care system. Medicaid-funded services are appropriate for analysis because

the majority of children in the foster care system are enrolled in the Medicaid program. Children

in the foster care system tend to use much higher levels of both physical and mental health

services than other children (Szilagyi, Rosen, Rubin, & Zlotnik, 2015; CMHS & CSAT, 2013;

Gen, Sommers, & Cohen, 2005). Landsverk (2017) and Harman, et al., (2000) found that

children in the foster care system have expenditures similar to children eligible for Medicaid due

to disability and much greater than children eligible due to Temporary Assistance for Needy

Families (TANF).

Purpose and Objectives

The body of research described points to several areas of potential unmet need and gaps

in mental and behavioral health services for children in the foster care system. These include the

need for clear policies and procedures, including the use of evidence-based practices, around the

assessment of need, coordination of care, and provision of behavioral health services for children

in foster care, as well as processes for monitoring the receipt of services and child outcomes.

Along these lines, the purpose of the current study was to assess current processes for identifying

children’s behavioral health needs and coordinating care, the existing behavioral health service

array and capacity, and behavioral health care service utilization among children who received

out-of-home care in the Southern Region of Florida to determine where gaps in services exist.

Page 9: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

8

FINAL EVALUATION REPORT | Contract LHZ68

The study specifically examines service provision and utilization during calendar years 2016 to

2018 and was carried out in four phases.

Phase I: Service Utilization and Patterns. The first phase of the study developed an

analysis of behavioral health services utilization and service patterns among children placed in

licensed foster care in Florida’s Southern Region. This study phase built upon previous research

described above, incorporating additional funding sources beyond Medicaid to provide a

comprehensive assessment of behavioral health service utilization. Specific research questions

for Phase I included the following:

1. What are the demographic and diagnostic characteristics of children and adolescents in

licensed foster care who used behavioral health services in Calendar Years 2016, 2017,

and 2018?

2. What are the mental health and substance use service utilization and service patterns?

For each child in the sample, we examined the behavioral health services received across

all sources [Substance Abuse and Mental Health Information System (SAMHIS),

Financial and Services Accountability Management System (FASAMS), Medicaid, and

the Community Based Care Lead Agency (CBC)].

3. What entities paid for what services? While services received across all sources is

important to the overall care received by a child, it is important to understand how the

provision of services varies across payers.

4. What are the specific utilization and service patterns for certain subgroups of children

that will be mutually identified by DCF and USF? For example, subgroups based on age

(0-5, 6-12, 13-18) have been identified by the Department as an area of interest.

Page 10: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

9

FINAL EVALUATION REPORT | Contract LHZ68

Phase II: Children’s Behavioral Health Service Needs. The purpose of this study

phase was to identify, describe, and understand children’s behavioral health service needs as

documented by behavioral health care service providers and child welfare service providers, and

assess the degree of consistency or discrepancy between the needs documented by behavioral

health and child welfare providers. The policies and processes established and used by

providers, the managed care organizations, and DCF to identify and document children’s

behavioral health service needs were also examined, as well as the perceptions of behavioral

health care providers regarding care coordination. Specific research questions that guided data

collection for this phase were as follows:

1. What are the behavioral health service needs of children in licensed foster care in the

Southern Region?

2. What assessment processes and tools are used to determine and document the behavioral

health care needs of children in licensed foster care in the Southern Region?

3. To what degree is there consistency between the behavioral health care service needs of

children in licensed foster as documented by behavioral health care service providers and

documented by child welfare?

Phase III: Services Access, Capacity, and Coordination of Care. The purpose of this

study phase was to determine the array of behavioral health services available to children in

licensed foster care, the capacity of local service providers, and the processes in place for

connecting children in care to these services. Specific research questions that guided this phase

of the study were as follows:

1. What behavioral health services are currently available in the Southern Region for

children in foster care?

Page 11: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

10

FINAL EVALUATION REPORT | Contract LHZ68

2. How many providers offer each identified service, and what is their service capacity?

(E.g. How many children can be served per year)?

3. What service delivery models are used? (E.g., Where and how are services provided?

What is the typical service intensity/dosage? What is the typical service duration?)

4. To what extent are services readily available and accessible to children in need? (E.g. Do

providers carry a waitlist, and if so, how long on average do children wait to initiate

services? What barriers may limit access to the service?)

5. What are the policies, procedures, and practices of the CBC Lead Agency and its

contracted case management agencies related to the coordination of care for children who

require behavioral health services?

Phase IV: Determination of Gaps. The final phase of the evaluation built upon the

previous study findings to assess the gaps in behavioral health services for children in licensed

foster care in the Southern Region. This phase of the study compared existing services and use

of psychotropic medications, evidence-based practices, program models, funders, and care

coordination to the estimates of what is needed in each of these areas. The purpose of the final

analysis was to identify gaps in behavioral health service delivery and capacity. Based on the

findings, a set of recommendations is offered at the conclusion of the report regarding how to fill

the gaps in behavioral health services including evidence-based practices, models of service

delivery that are community based, and care coordination strategies. The recommendations also

address capacity building requirements for the Southern Region, including training and technical

assistance, monitoring of service provision, and quality assurance strategies.

Study context. Florida’s Southern Region is large and diverse, comprised of Miami-

Dade and Monroe Counties. Miami-Dade County is geographically the third largest county in

Page 12: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

11

FINAL EVALUATION REPORT | Contract LHZ68

Florida in terms of land area, as well as the most populous county, with a population of roughly

2,761,581 (U.S. Census Bureau, 2018). It is racially and ethnically diverse, with approximately

65% of the population identified as Hispanic/Latino, and 18.9% identified as Black.

Additionally, about 51% of the population is foreign-born, the majority of whom are of Cuban or

other Latin American origins. The county suffers from higher-than-average poverty rates, with

approximately 17.2% of the overall population, and 22% of children under the age of 18, living

below the poverty line.

In contrast, Monroe County is quite rural and sparsely populated, with a population of

approximately 75,027 primarily residing in the Florida Keys (U.S. Census Bureau, 2018b). The

ethnic make-up of the county is primarily non-Hispanic White (65.8%), with approximately

24.9% of the population identified as Hispanic/Latino and 6.9% identified as Black. The county

is considerably wealthier compared to Miami-Dade, with roughly 12% of the population living in

poverty.

As might be expected given the size of its overall population, the Southern Region has a

considerable child welfare population, particularly in Miami-Dade County. Data from DCF

indicate that from 2016 to 2018, there were 5,291 children with 5,480 out-of-home care episodes

in the Southern Region. Child protective investigations are conducted by the Department of

Children and Families (DCF), but the remainder of child welfare services, including foster care

and case management services, are managed by the local Community-based Care (CBC) Lead

Agency, which was Our Kids of Miami-Dade/Monroe, Inc. during the focal period of 2016 to

2018, but recently transitioned to Citrus Family Care Network (CFCN). Given the size of the

foster care population and what is known about the high rates of mental health needs among

children in foster care, child welfare and mental health systems can easily become overwhelmed

Page 13: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

12

FINAL EVALUATION REPORT | Contract LHZ68

if they do not have adequate capacity or coordination to handle the level of need, resulting in

fragmented services and unmet needs for children in care.

Methods

To provide a comprehensive assessment of children’s behavioral health needs, service

array, coordination of care, and service utilization, a mixed-method approach was used,

triangulating data from a variety of primary and secondary sources. Prior to beginning data

collection, the study protocol was submitted for review by the Institutional Review Board (IRB)

at USF and received exempt status due to the nature of work being classified as evaluation.

Regardless, all procedures were carried out in accordance with the ethical standards of the

University’s IRB and with the 1964 Helsinki declaration and its later amendments or comparable

ethical standards for the protection of human subjects. The protection and confidentiality of

study subjects was prioritized throughout the conduct of the study, including compliance with all

HIPPA requirements. The methods for data collection and analysis are laid out below. Copies

of data collection protocols are contained in Appendix A.

Administrative Data Analysis

Behavioral health care utilization and patterns of services were examined through

analysis of administrative data. The study included children in Miami-Dade and Monroe

Counties who received licensed child welfare out-of-home care at any point in calendar years

2016 to 2018 and received at least one publicly-funded behavioral health service while in out-of-

home care. Several data sources were used to identify children for the sample, which include

DCF’s automated child welfare information system – Florida Safe Families Network (FSFN), the

CBC Lead Agency, Substance Abuse and Mental Health Information System, Financial and

Services Accountability Management System, and Medicaid.

Page 14: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

13

FINAL EVALUATION REPORT | Contract LHZ68

Florida Safe Families Network (FSFN). FSFN data was used to identify youth who

received out-of-home child welfare services in Calendar Year (CY) 2016-2018 in the Southern

Region (n=5,291 children with 5,480 out-of-home episodes). Records with missing Social

Security Numbers were excluded (n=250). We also excluded out-of-home care episodes that

were less than 30 days in length (n=190). The remaining 5,022 out-of-home care episodes

comprised the initial sample for the analysis (4,855 children with 167 having multiple out-of-

home care stays).

Sample descriptive statistics are provided in Table 1. The sample averages 7.3 years old

and is almost equally divided between boys and girls. Over half the sample is Black and comes

from a single parent family. Sexual or physical abuse is reported for 17.9% of children, while

absence of care is the most common reason for child welfare services. Absence of care can

include a parent (or parents) being sent to prison, the death of a parent, or the parent

relinquishing custody. Ninety-five percent of the sample lives in Miami-Dade County.

Table 1. Descriptive Statistics for Initial FSFN Sample (n=4,855) Number of children % of sample/Mean

Age 4,855 7.34 Child gender Female 2,468 50.8 Male 2,387 49.2 Child race Black 2,633 54.2 White 2,007 41.3 Other 215 4.5 Family Structure Married Couple 488 10.0 Single Female 2,591 53.4 Single Male 214 4.4 Unmarried Couple 1,120 23.1 Unable to determine 442 9.1

Page 15: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

14

FINAL EVALUATION REPORT | Contract LHZ68

Type of Maltreatment Sexual abuse 202 4.2 Physical abuse 605 12.5 Neglect 1,702 35.1 Absence of care 2,069 42.6 Domestic violence 720 14.8 Substance abuse problems 1,508 31.1 County Miami-Dade 4,604 94.8 Monroe 251 5.2

Behavioral health service data was extracted from lead agency data, DCF Substance

Abuse and Mental Health funding data, and Medicaid data. Almost all youth entering out-of-

home child welfare services were Medicaid eligible, and the Medicaid program provided most

behavioral health services used by children. However, DCF Substance Abuse and Mental Health

funds and lead agency funds covered services not covered by Medicaid or not approved by

Medicaid managed care plans.

Lead Agency (Our Kids). The lead agency for the Southern Region, Our Kids, paid for a

portion of services needed by children. Of the 4,109 records for services paid by Our Kids

during CY 2016-2018, 3,418 were provided to 607 children in our sample1. Table 2 contains a

summary of the services paid by Our Kids included in this analysis. The most frequently

provided service was Certified Behavior Analysis, while expenditures were highest for in-home

respite services. The lead agency was the primary funder for alternative therapies such as

Motivational Edge (an arts-based educational program), dance therapy, martial arts and

summer/winter camps.

1 Data provided by Our Kids were aggregated into monthly records for each type of service provided to a child. Thus, the child may have received the service numerous times in the month, and the number of records is not equivalent to the number of services received by a child. Available data cannot be used to examine the cost per unit of service.

Page 16: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

15

FINAL EVALUATION REPORT | Contract LHZ68

Table 2. Services Paid by Our Kids for Children in Out-of-Home Care Services Number of children Number of Records for

Services Provided Total

expenditures In-home Respite Services 163 504 1,930,812 Certified Behavior Analysis 242 1,477 722,212 WRAP 45 108 449,205 Motivational Edge 44 338 293,532 STFC Clinical Services 21 81 177,836 Extracurricular/Incidentals/Miscellaneous 51 155 141,120 SIPP Clinical Services <10 19 123,400 Therapeutic Visitation 119 326 90,932 Functional Behavior Assessment 133 141 66,270 Individual Therapy 10 42 22,019 Other (e.g., CBHA, dance, martial arts, therapeutic service items, tutoring) 122 227 125,136

Total 607 3,418 4,142,474 Note. Sample sizes less than 10 are suppressed to maintain child confidentiality.

Substance Abuse and Mental Health Information System (SAMHIS). Behavioral

health service data from January 2016 – September 2018 was extracted for the sample (n=15,583

service encounters). Behavioral health services were limited to those provided during out-of-

home services (n=8,725 service encounters for 439 children). As reported in Table 3, total

expenditures were $541,794. The cost center with the most encounters and highest expenditures

was in-home and on-site services overlay (3,067 service encounters totaling $155,158).2

Table 3. Behavioral Health Services Paid by DCF Substance Abuse and Mental Health Funds,

January 2016-September 2018 Cost Center Description Number of children Number of encounters Total Expenditures Assessment 342 736 42,708 Case Management 37 589 21,953 Crisis Stabilization 40 197 57,507 Crisis Support/Emergency 24 69 1,952

2 See Appendix 1 for a full description of each cost center.

Page 17: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

16

FINAL EVALUATION REPORT | Contract LHZ68

In-Home and On-Site Services Overlay 91 3,067 155,158 Inpatient <10 <10 3,145 Intensive Case Management <10 <10 54 Intervention 69 1,102 40,548 Medical 10 18 1,727 Outpatient-Individual 39 746 34,765 Residential Level 1 <10 12 2,749 Residential Level 2 <10 420 65,302 Residential Level 4 <10 279 13,459 Substance Abuse Detoxification 31 199 43,769 TASC <10 41 1,383 Incidental Expenses <10 <10 1,149 Aftercare/Follow-up <10 68 3,267 Outpatient-Group <10 <10 57 Room & Board Level 2 <10 147 16,309 Intervention-Group 10 309 6,336 MH Comprehensive-Individual 25 647 25,445 SA Recovery Support-Individual <10 <10 211 SA Recovery Support-Group <10 <10 45 Total 439 8,725 541,794 Note. Sample sizes less than 10 are suppressed to maintain child confidentiality.

Financial and Services Accountability Management System (FASAMS)3. Behavioral

health service data from October 2018 through December 2018 was extracted for the sample.

Behavioral health services were limited to those provided during out-of-home services. The

evaluation team compared SAMHIS and FASAMS service data to remove duplicate services

(some children had service encounters with the same date of service and same procedure code in

both data systems). Duplicate services were excluded from the SAMHIS data. There were 2,201

encounters from FASAMS for 148 children. Table 4 contains the services from FASAMS.

3 The SAMHIS platform was ‘closed’ and the FASAMS system ‘opened’ on October 1, 2018. The date of service on some services in FASAMS was prior to October 1, 2018. Thus, the date ranges do not necessarily reflect the date of service. There were also some encounters reported in both SAMHIS and FASAMS; duplicate encounters were excluded.

Page 18: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

17

FINAL EVALUATION REPORT | Contract LHZ68

Similar to SAMHIS, the most frequently provided service was in-home and on-site services

overlay (n=942). However, expenditures were highest for crisis stabilization services ($75,898).

Table 4. Behavioral Health Services Paid by DCF Substance Abuse and Mental Health Funds, October 2018-December 2018

Cost Center Description Number of children Number of encounters Total Expenditures Assessment 81 130 4,841 Case Management <10 39 1,467 Crisis Stabilization 31 260 75,898 Crisis Support/Emergency <10 10 283 In-Home and On-Site Services Overlay 26 942 47,342 Intervention 21 212 8,656 Medical <10 11 1,055 Outpatient-Individual 10 147 6,853 Residential Level 2 <10 164 25,504 Substance Abuse Detoxification <10 22 4,839 MH Comprehensive-Individual <10 264 10,276 Total 148 2,201 187,014 Note. Sample sizes less than 10 are suppressed to maintain child confidentiality.

Medicaid recipient, claims, and encounter data. Florida Medicaid claims and encounter

data were extracted for all children in the sample.4 For inpatient and outpatient services,

behavioral health services were defined based on the primary ICD-10 diagnosis code for the

claim/encounter (F00-F99). For pharmacy services, behavioral health services were identified

based on the therapeutic class for the medication (AHFS therapeutic class codes 281 and 282).

To provide a consistent method for reporting data, each service was assigned a cost

center comparable to the SAMHIS and FASAMS data. Using SAMHIS data, we determined the

most frequent cost center assigned to each procedure code. This cost center was assigned to each

4 Some services may be reported in both SAMHIS/FASAMS and Medicaid data. We excluded all encounters from SAMHIS/FASAMS with Medicaid listed as the funder of services. Thus, the degree of overlap should be minimal.

Page 19: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

18

FINAL EVALUATION REPORT | Contract LHZ68

Medicaid-funded service based on the procedure code reported on the claim or encounter.5

Table 5 contains a summary of the data from the Medicaid files. Assessment services were

received by 3,573 children.6 The most frequently provided services and highest expenditure

services were in-home and on-site services (76,194 service encounters) and residential services

(53,618 service encounters7).

Table 5. Behavioral Health Services Paid by Medicaid Program, January 2016-December 2018 Cost Center Description Number of children Number of claims/encounters Total Expenditures

Assessment 3,573 12,796 2,040,700 Case Management 804 22,207 1,273,995 Crisis Stabilization 193 392 36,898 Day-Night Services/Skills Training 35 1,539 217,890 In-Home/ On-Site Services Overlay 2,224 76,194 8,247,708 Inpatient 401 2,839 2,816,953 Intervention 240 4,529 196,660 Medical 1,402 7,811 380,938 Outpatient-Individual 2,341 40,732 3,292,158 Residential Level 2 238 53,618 13,070,903 Outpatient-Group 234 23,660 861,340 MH Comprehensive-Individual 42 112 13,550 Medicaid Pharmacy 908 13,345 477,337 Other 1,272 21,252 1,115,214 Total 4,064 281,026 34,042,244

5 While providing a simple method for comparison across data sources, it is important to note that the assignment of cost centers to Medicaid services is an approximation. In SAMHIS, a procedure code often maps to multiple cost centers. The use of the modal cost center will inevitably lead to some services in the Medicaid data being assigned to an incorrect cost center. 6 The average number of assessments per child, 3.58, may seem large. Thus, we took a closer look at the claims/encounters; 89% had a procedure code of H0031: mental health assessment –non-physician and 8% had a procedure code of H2000: comprehensive multidisciplinary evaluation. The remaining 3% had procedure codes denoting a psychiatric diagnostic evaluation or alcohol/drug assessment. 7 A Medicaid claim or encounter may or may not represent a single service. While an outpatient claim tends to represent a single service, an inpatient or residential claim or encounter typically represents services provided over a period a time (e.g., a day, week, or month). There may also be one or multiple claims per inpatient or residential stay. As a result, the number of claims or encounters does not represent the number of inpatient or residential stays or the number of service days, and the data in Table 5 cannot be used to compute the cost per unit of service.

Page 20: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

19

FINAL EVALUATION REPORT | Contract LHZ68

Note. Residential Level 2 includes Statewide Inpatient Psychiatric Program, Specialized Therapeutic Group Home, and Specialized Therapeutic Foster Care services. The Other category includes services that did not quite fit any of the established cost centers (e.g., transportation, DME, laboratory services). Service encounters represent the number of claims/encounters for the service in the data. In some cases (e.g., residential), there may be numerous encounters for a single residential treatment stay.

All Funding Sources. Table 6 contains a summary of the data from all funding sources.

Assessment services were received by 3,635 children. The most frequently provided services

and highest expenditure services were in-home and on-site services (80,537 service encounters)

and residential services (54,221 service encounters). The two cost centers accounted for over

$21.8 million of the $38.9 million in total expenditures.

Table 6. Behavioral Health Services Paid by All Funding Sources, January 2016-December 2018

Cost Center Description Number of children Number of encounters Total Expenditures

Assessment 3,635 13,834 2,177,459

Case Management 827 22,835 1,297,416

Crisis Stabilization 230 848 170,254

Crisis Support/Emergency 33 80 2,285

Day-Night Services/Skills Training 35 1,539 217,890

In-Home/ On-Site Services Overlay 2,292 80,537 8,569,757

Inpatient 401 2,846 2,820,099

Intensive Case Management <10 <10 54

Intervention 311 5,843 245,865

Medical 1,402 7,841 383,794

Outpatient-Individual 2,405 43,146 4,084,087

Prevention 59 138 30,955

Residential Level 1 <10 12 2,750

Residential Level 2 245 54,221 13,285,109

Residential Level 3 20 79 168,296

Residential Level 4 <10 279 13,460

Respite Services 164 535 1,932,351

Substance Abuse Detoxification 34 221 48,608

Supported Housing <10 16 753

Page 21: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

20

FINAL EVALUATION REPORT | Contract LHZ68

TASC <10 41 1,383

Incidental Expenses 56 164 142,269

Aftercare/Follow-up <10 68 3,267

Behavioral Health Overlay Services' <10 <10 3,398

Outpatient-Group 235 23,662 861,397

Room & Board Level 2 <10 147 16,309

Intervention-Group 10 309 6,336

MH Comprehensive-Individual 113 1,131 498,476

SA Recovery Support-Individual <10 <10 211

SA Recovery Support-Group <10 <10 45

Medicaid Pharmacy 909 13,346 477,541

Other 1,337 21,628 1,433,287

Total 295,364 38,895,158

Deriving the final sample. There were 5,022 out-of-home care episodes for 4,855

children in the initial sample. From this initial sample, the final sample included all children that

received at least one behavioral health service. All services identified in Our Kids, SAMHIS,

FASAMS, and Medicaid data were used to identify children who received at least one behavioral

health service in 2016, 2017, and 2018 with some exceptions.8

There are several types of services that may or may not have a behavioral health

component. Thus, after consultation with DCF staff, it was decided to exclude some services

when identifying the final sample. Thus, a child was excluded from the sample if they only

received the following services:

1. Alternative services paid by Our Kids (e.g., Motivational Edge, dance therapy, martial

arts, tutoring),

8 While the following services were excluded when considering whether to include the child in the sample, all services will be included when reporting the services received by children in the sample. For example, tutoring services may not prove the presence of a behavioral condition, but may be very important for children that have a behavioral health condition.

Page 22: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

21

FINAL EVALUATION REPORT | Contract LHZ68

2. Cost centers that are not treatment related (respite services, supported housing, supported

employment, incidental expenses),

3. Medicaid claims and encounters with a primary ICD-10 codes denoting a behavioral

health condition, but procedure codes denoting services that may not have a behavioral

health component (e.g., surgery, radiology, laboratory services, transportation, supplies)9,

4. Services with primary ICD-10 codes denoting mental retardation (F70-F79) or disorders

of physiological development (F80-F89), and

5. Pharmacy services (some behavioral health medications are also used for physical health

conditions).

After excluding these services, the final sample contained 3,257 children that received at least

one mental health or substance abuse treatment service while receiving out-of-home child

welfare services. All services were included in the report, including those excluded above, for

children in the final sample.

Analysis. The descriptive analysis examined how services and expenditures vary with

child characteristics, diagnoses, time in child welfare, and placements. In general, results were

reported separately for Miami-Dade County and Monroe County, although in some cases results

were aggregated in Monroe County due to the smaller sample size.

One challenge with interpretation of simple descriptive findings is that child

characteristics, diagnoses, time in child welfare, and placements are often highly correlated.

Thus, it can be challenging to conclude that any single characteristic is associated with

behavioral health expenditures because that characteristic may also be correlated with other

9 While some of these services will have a behavioral health component, a review of services found numerous lab tests for comprehensive metabolic panels and radiology claims for EKGs that were less likely to have a behavioral health component.

Page 23: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

22

FINAL EVALUATION REPORT | Contract LHZ68

factors associated with expenditures. The research team estimated a simple regression where

behavioral health expenditures were regressed on child characteristics, diagnoses, time in child

welfare, and placements. The results provided a clearer picture of which characteristics are most

strongly associated with expenditures.

Case Record Reviews

Utilizing Florida Safe Families Network (FSFN) data, community-based care lead agency

data, DCF Substance Abuse and Mental Health funding data (Substance Abuse and Mental

Health Information System [SAMHIS] and Financial and Services Accountability Management

System [FASAMS]), and Medicaid data, a sample of 3,257 children were identified in Miami-

Dade or Monroe counties who were receiving out-of-home child welfare services in calendar

years 2016, 2017, and 2018 and received at least one mental health or substance abuse treatment

service during this time (see Southern Region Gap Analysis Utilization Pattern and Service

Usage Report; Johnson et al., 2019). From this sample, a sub-sample of 165 children was

randomly selected for case file review. The sample was stratified by age into three groups: birth

to age five, ages 6-12, and age 13 and older.10

To document and assess the behavioral health service needs of the sample of children in

out-of-home foster care placement, the study team developed a case record review protocol that

included child demographic information, maltreatment type(s), mental health diagnoses, child

welfare and mental health assessments, child mental health needs, services, evidence of service

receipt, and case planning and communication to meet the child’s identified mental health needs.

The study team used the record review protocol to document the relevant information contained

10 The age groups and sample sizes were determined by DCF. The goal was to have sufficient sample sizes to have 80% power to detect medium effect size differences between the age groups. The software package G*Power indicates 81% power to detect medium effect size differences between the three groups suggesting that the sample sizes were sufficient.

Page 24: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

23

FINAL EVALUATION REPORT | Contract LHZ68

in FSFN and ASK, the cloud-based file record system managed by Citrus Health Network. The

team reviewed all available records including case manager chronological notes, Family

Functioning Assessments, legal documents, staffing notes, supervisory reviews, the child’s

medical and mental health conditions and disability sections of FSFN, and mental health

assessments and reports from providers.

Data collected through the record review protocol were entered into a spreadsheet and

analyzed using SPSS statistical software to explore patterns in children’s behavioral health needs

and service recommendations. Descriptive statistics were calculated by age group for all study

variables. Pearson’s chi-square was used to analyze differences by age group for categorical

variables, such as distribution of specific maltreatments, diagnoses, behavioral health

assessments, and service recommendations. Analysis of variance (ANOVA) was used to analyze

differences by age group for quantitative variables, including the number of maltreatments,

diagnoses, and service recommendations a child received.

Analysis also examined the level of consistency between children’s service needs as

determined by the behavioral health care provider assessments and child welfare assessments

documented in FSFN and ASK. Pearson’s correlation analysis was used to examine associations

among child welfare mental and behavioral health needs assessment ratings, number of

maltreatment allegations, number of diagnoses a child received, and number of service

recommendations that were made. A contingency table was also produced to further examine

relationships among child welfare and behavioral health provider assessments of need.

Document Review

The study team obtained copies of Sunshine Health’s provider manual, DCF’s

operational procedures, and the full case management services contracts between the CBC Lead

Page 25: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

24

FINAL EVALUATION REPORT | Contract LHZ68

Agency (CFCN) and the Case Management Agencies for the Southern Region. Sunshine Health

is the Medicaid managed care organization that operates Florida’s Child Welfare Specialty Plan

(CWSP). Although the CWSP is not the only Managed Medical Assistance (MMA) plan

available to children entering out-of-home care, we were unable to obtain copies of all the MMA

plans for the Southern Region. Furthermore, the CWSP is the only plan that is explicitly

contracted to serve the child welfare population, and Medicaid data indicate that the majority of

children in out-of-home care do ultimately enroll in the CSWP. For these reasons, our policy

analysis focused on the Sunshine CWSP. The Sunshine Health Provider Manual includes a

small section detailing policies and procedures specific to the CWSP.

DCF’s policies and procedures pertaining to children’s behavioral health assessment and

care are laid out in CF Operating Procedure 170-10: Providing Services and Support for

Children in Care and for Caregivers. Both sets of policies were reviewed and analyzed by a

member of the study team to identify specific requirements established for behavioral health

providers and child welfare staff. Review of the case management contracts focused on

identifying and assessing what policies and procedures were established between CFCN and the

case management agencies regarding the provision and coordination of care for children who

require behavioral health services.

Interviews

The study team completed 16 interviews with clinical leadership from children’s

behavioral health care service providers and the managed care organization in the Southern

Region. Interviews were typically done individually, but the option was given to include a

second interviewee to provide input. To identify potential participants, the study team requested

contact information from the CBC Lead Agency and case management agencies for providers

Page 26: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

25

FINAL EVALUATION REPORT | Contract LHZ68

they use most frequently, and reviewed providers listed in the Sunshine Health Child Welfare

Specialty Plan directory. This resulted in a list of approximately 65 provider agencies.

Potential interviewees were initially contacted via email by the research team to explain

the purpose of the interview. Scheduling was then done by phone. Of the 65 providers, 19

responded that they did not serve children, and were excluded from study. Thirty providers

could not be reached or did not respond to the request to schedule an interview. For those who

agreed to participate, the interview questions and informed consent documents were shared prior

to the actual telephone interview.

Interviewees were asked to share information about the procedures used to assess the

behavioral health needs of children in licensed foster care, their perception of the service needs

of children in the region, their perception of the level of care coordination, and their perception

of the service capacity and accessibility compared to the needs of the children in care. The

interviews were audio-recorded with the permission of participants. Recordings were

professionally transcribed and then coded by a member of the study team using a grounded

theory approach to identify emergent themes.

Focus Groups

A set of focus groups was conducted with case managers from each of the contracted

case management agencies serving the Southern Region. The purpose of the focus groups was to

explore the role of case managers in facilitating and coordinating behavioral health care services

for children in licensed foster care. Four focus groups were convened, one with each case

management agency. A semi-structured interview guide was used to facilitate the focus group

sessions. Topics discussed during the focus groups included the role of case managers in

assessing children’s behavioral health needs and coordinating care for children in licensed care,

Page 27: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

26

FINAL EVALUATION REPORT | Contract LHZ68

specific policies and procedures that pertain to these aspects of their job, perceptions of the

behavioral health service array, and any challenges or barriers to meeting the behavioral health

care needs of children in licensed care. Focus groups ranged in size from three to seven

participants, with a total of 20 participants across the four groups. The focus groups were audio-

recorded and transcribed. Transcripts were coded to identify emergent themes and concepts

from the data.

Surveys

Surveys for behavioral health providers and case management staff were created in

Qualtrics, a web-based survey program. Two distinct surveys were developed; one for

children’s behavioral health provider agencies, and one for case management agencies. The

surveys were designed to gather data related to the availability and accessibility of behavioral

health services for children in licensed foster care. Potential respondents were sent an email with

a link to participate in the survey. To maximize participation, a multi-wave mailing strategy was

used, whereby non-responders were sent a reminder email every 10 to 15 days. Ten weeks after

the initial survey invitation went out, the study team also attempted to contact non-responding

agencies by phone.

Provider survey. The provider survey was designed to identify the array of behavioral

health services available to foster care children in the Southern Region and service capacity of

providers. Specifically, the survey solicited the following information: specific types of

behavioral health services provided to children in foster care (including names of specific

practices/models and evidence-based practices), any specific eligibility criteria for the service,

number of staff trained/certified to provide each specific service/practice, number of children

each trained staff can carry on their caseload, how the service is provided (e.g. in the office, in

Page 28: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

27

FINAL EVALUATION REPORT | Contract LHZ68

the client’s home, etc.), what role the provider plays in service coordination, the typical service

duration and dosage, the number of children served in the past year, and what the typical wait

time is to initiate services.

A total of 51 distinct behavioral health provider agencies were identified and targeted for

administration of the survey. Agencies were identified through several methods. First, the study

team asked the current CBC Lead Agency (CFCN) to identify major providers with whom they

work. Second, the Sunshine Plan Provider Directory was consulted for additional agencies.

Third, Medicaid claims data was used to identify the most frequently used providers. For each

identified agency, one or two administrative level employees, such as Directors or Operations

Managers, were identified and asked to respond to the survey; this resulted in distribution of the

survey to 96 individuals, with the instruction that only one individual per agency needed to

complete the survey. Of these, 15 agencies reported that they do not serve the target population

(children in licensed foster care) and were subsequently removed from the distribution list. This

left a total of 36 eligible agencies, of which 20 agencies (55.6%) completed the survey. Survey

responses were exported to SPSS, a statistical software program, and descriptive analyses were

performed. After the survey results were finalized, additional internet research was conducted to

gather further information on service availability for providers who did not complete the survey.

Case management survey. The case manager survey was designed to assess case

manager awareness and perceptions regarding the availability of necessary behavioral health

services for the children they service. This survey solicited the following information in relation

to distinct types of behavioral health needs: the extent to which services are available to meet the

need, the extent to which services are accessible, the extent to which services are effective, and

Page 29: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

28

FINAL EVALUATION REPORT | Contract LHZ68

the adequacy of the current service capacity. The survey also included questions about perceived

gaps or service needs, and questions about the respondent’s role in care coordination.

The survey was distributed to case management agency staff by the agency directors.

Distribution was targeted to all case management staff, including direct case managers,

supervisors, program managers, and other support staff who assist with the coordination of care.

A total of 59 responses were received. Of these, 21 respondents (36%) only answered initial

background questions (e.g. agency, position, number of years worked) but did not complete the

questions pertaining to the service array, and therefore were eliminated from the analysis. This

left 38 valid responses, which were included in the analysis. The survey responses were

exported to SPSS and descriptive analyses were performed.

Results

Study findings are organized in four sections. First, we present findings related to the

processes in place to identify and assess the behavioral health needs of children in licensed care

and coordinate services to address those needs. The next section details findings pertaining to

children’s documented behavioral health needs, as identified through case record reviews, as

well as stakeholder perceptions of unmet needs. The third section describes the behavioral

health service array and service capacity for children in licensed care. The final section provides

an analysis of behavioral health service utilization and service patterns for children in licensed

care.

Processes and Procedures for Identifying Children’s Behavioral Health Needs

This section provides results for the processes among child welfare and behavioral health

providers for determining the behavioral health needs of children in licensed care. Findings are

organized around three domains: assessment processes, care coordination, and documentation.

Page 30: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

29

FINAL EVALUATION REPORT | Contract LHZ68

Data relating to policies and procedures for identifying children’s behavioral health needs were

derived from behavioral health provider interviews, case manager focus groups, case file

reviews, and review of DCF, CBC, and managed care policies.

Assessment processes. Policies for the assessment of children’s behavioral health needs

are established by the MCO (Sunshine Health) and DCF. The Sunshine Health Provider Manual

specifies requirements of the Child Welfare Specialty Plan (CWSP) providers for behavioral

health assessments of children in licensed care. In particular, providers are expected to prioritize

the scheduling of these appointments within 72 hours of the request, and provide assessment

results to DCF or the CBC within two business days. There is no further specification provided

in the manual as to the type(s) of behavioral health assessment to be performed or procedures for

completing the behavioral health assessment.

DCF policy lays out several requirements regarding behavioral health assessment and

service provision for children in licensed care. The policy specifies that a Comprehensive

Behavioral Health Assessment (CBHA) must be completed for all children entering out-of-home

care, and the referral for the CBHA must be made within seven business days of the child’s

removal. Furthermore, the policy states that the assigned caseworker must document the

assessment of current and historical child functioning in the Family Functioning Assessment

(FFA), including screening for emotional health needs, trauma, behavior issues, and any needs

identified through the CBHA. There are no specific screening or assessment tools identified in

the operating procedures for caseworkers to use, other than the FFA, in assessing children’s

behavioral health needs. In addition, the family case plan is expected to include a description of

the child’s identified behavioral health needs and the services to be provided to address those

needs. The assigned caseworker is required to document the child’s behavioral health condition

Page 31: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

30

FINAL EVALUATION REPORT | Contract LHZ68

in the Medical/Mental Health section of FSFN, and upload the completed CBHA and any other

professional evaluations that have been received. If the child has been clinically diagnosed with

a specific disability, it should be recorded in the FSFN Disability tab, and if the diagnosis

changes or is determined by a clinical professional to no longer exist, it should be end-dated in

FSFN.

Findings from behavioral health provider interviews, behavioral health provider surveys,

case file reviews, and case manager focus groups contributed to a descriptive analysis of what

assessment tools were currently in use. Behavioral health providers identified several

standardized assessment tools that are used. A complete list of the tools that were mentioned is

provided in Appendix B. The tools used varied by provider. Respondents also stressed that

these were commonly used examples, but that there was an array of assessment tools based on

symptoms a child presents with that could be used for a more in-depth look. Case file reviews

found that assessments commonly completed as part of the CBHA included the Child and

Adolescent Needs and Strengths (CANS), the Child Behavior Checklist (CBCL), the Trauma

Symptoms Checklist (TSC), and the Ages and Stages Questionnaire (ASQ). Treatment planning

traditionally followed the assessment process.

Regarding assessment processes on the case management side, respondents across the

case manager focus groups reported that initial provider assessments (e.g. the CBHA) as well as

observations from home visits with children were the main sources for assessing children’s

needs. They were particularly dependent upon the CBHA, as most respondents expressed that

they did not receive training on children’s behavioral health issues and were not qualified to

assess those needs.

Page 32: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

31

FINAL EVALUATION REPORT | Contract LHZ68

All behavioral health provider interview respondents indicated that the assessment tools

used were adequate, with a few qualifications. One respondent discussed how the assessment

process could at times be so in-depth or lengthy, depending on all that is involved, that the

provider runs the risk of losing the child’s attention or not building the initial level of rapport that

is helpful to begin services in the midst of trauma. This respondent felt that tools focusing more

on the current traumatic event were most helpful. In addition, respondents mentioned that

getting an adequate history for the child during an assessment was challenging at times if the

case manager brought them in and they had been placed in foster care, such that contact with the

biological parent or previous foster care placements might not be immediate or possible.

Another respondent wished for better assessment tools for Autism Spectrum Disorders.

In contrast to provider perspectives, case manager focus group participants expressed a

variety of concerns pertaining to the behavioral health assessment process. One concern was

with the timeliness of the CBHA; case managers reported that sometimes there were delays or

wait lists to get those assessments completed. This was confirmed by respondents on the

provider survey, who reported wait times of up to 21 days for the CBHA. These wait times are

in conflict with the MCO policy that assessments be conducted within 72 hours of the referral.

Another concern expressed by case managers was with regard to the quality of the assessments.

Many case managers were skeptical about the ability of assessors to adequately and accurately

assess a child’s needs given the minimal amount of time they spend with the children. Some also

expressed the perception that CBHA reports were “cookie cutter” and assessors were in the habit

of “cutting and pasting” their reports.

Respondents further felt that the recommendations provided in the CBHA were often

generic. Case managers claimed that recommended services usually fell into two categories of

Page 33: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

32

FINAL EVALUATION REPORT | Contract LHZ68

clinical services: talk therapy/counseling and psychiatry. Respondents made it clear that they

were not discounting the benefits of those services, but felt concerned that there was too much of

a “one size fits all” approach with regard to service recommendations. Additionally, at times

they observed what they perceived to be the misdiagnosing of children and/or over-reliance on

medications to handle, for example, ADHD (noted as a common diagnosis for behavioral

problems); the sentiment expressed was that sometimes underlying issues and mitigating factors

were not addressed but simply placated to work within the timelines of cases. Across sites, there

were critiques of “best practices” that confound the challenges these front-line workers

experienced daily. Differing perspectives of what is best for a client created power dynamics

and distrust from case workers on the reliability and effectiveness of assessments that informed

referrals to providers. One respondent fleshed this out as follows:

I had a two-year-old get referred for speech therapy, occupational therapy, emotional individual therapy, every service and it was only an evaluation completed for two hours. How could you gather all of that just off a two-hour session? When I see her, she’s talking fine, she’s walking, she’s running, she’s jumping [and] climbing on my neck. I don't see why she needs these services. Neither does the PCP [primary care provider]. But because you have this assessment that recommends these services, now I have to go to every service provider, just for them to say, ‘oh no, she doesn’t need it.’ And then you have those service providers who’s like, well Medicaid’s paying, I’m going to get all the money I can, so she’s going to do the services.

As this narrative illustrates, there were considerable concerns about the validity of the assessments

provided and the possibility of misdiagnosis when assessments were rushed or conducted with

incomplete information.

Care coordination. The Sunshine Health Provider Manual specifies requirements for the

coordination of care between the CWSP providers and the child welfare system and training for

providers. The manual notes that Sunshine Health offers training for providers on the unique

needs of child welfare involved children, but does not specify whether participation in such

Page 34: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

33

FINAL EVALUATION REPORT | Contract LHZ68

training is a requirement for CWSP providers. The manual also indicates that Sunshine Health

funds CBC coordinators to support communication and information sharing between the

Medicaid and child welfare systems. With regard to the coordination of care with DCF and CBC

Lead Agencies, the manual states that providers are required to assist in scheduling

appointments, provide periodic written updates on the child’s treatment status as requested, and

participate in training provided by Sunshine Health about coordination with the child welfare

system.

Review of the case management agency contracts concluded that there were contractually

established policies and procedures between the CBC (CFCN) and the case management

agencies regarding the coordination of care for children with behavioral health needs. There are

two sections of the full case management service contracts that detail most of the policies and

procedures relating to how case management services should be provided. These are Attachment

I: Scope of Work and Exhibit A: Service Tasks. The Scope of Work in Attachment I detailed

program goals related to safety, permanency, and well-being; however, the specified goals

focused more on permanency/placement, adoption, and education goals. The Service Tasks

listed in Exhibit A provided a more detailed account of the required activities that related to

behavioral health services.

The Comprehensive Behavioral Health Assessment (CBHA) was mentioned in the

Service Tasks as the assessment that should guide case planning and service referrals. The

contracts stated that the case managers were to “utilize the results and recommendations of the

CBHA in developing the dependency case plan, including addressing the child’s and family’s

mental health needs. If the case plan is developed prior to the completion of the CBHA, the use

of the assessment in developing, accessing, and referring for behavioral health services will be

Page 35: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

34

FINAL EVALUATION REPORT | Contract LHZ68

documented in the child’s case file.” The contracts also stated that children should be connected

to the recommended services from the CBHA no later than 30 days from the assessment.

The contractual agreements identified the case managers as the primary coordinators of

services: “The case manager will coordinate and track services for all family members and obtain

reports from all service providers for quality decision-making and compliance.” The contracts

also required participation in multidisciplinary and/or permanency planning staffings and

required that the appropriate CFCN staff be notified to participate in those staffings. In addition,

the contracts stated that the case management agencies must comply with the Department of

Children and Families Operating Procedures, which include a specific set of operating

procedures for the integration of mental health, substance abuse, and developmental disabilities

services for children in out-of-home care.

Behavioral health providers offered input on their role in and perceptions of care

coordination through the provider survey and interviews. Most survey respondents indicated that

providers at their agency developed individualized treatment plans for the children they served

(86.7%) and that treatment plans were developed jointly with the child and their caregiver(s)

(80%). Examples of how clients were engaged in treatment planning included identifying their

own goals and strengths, writing treatment plans using the client’s own words and language they

understand, and having clients review and sign their treatment plan. Slightly fewer respondents,

but still a majority, reported that the child’s case manager was also involved with treatment

planning. Respondents generally stated that they worked closely with case managers to

coordinate services and ensure children’s needs were met and provided reports to the case

management agency and court on the child’s treatment progress. For the most part, they reported

that treatment plans were reviewed and updated every six months; 80 percent reported that this

Page 36: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

35

FINAL EVALUATION REPORT | Contract LHZ68

always occurred, 10.5 percent reported that this usually occurred, and only 5.3 percent reported

that it rarely or never occurred.

Behavioral health providers’ perceptions of the level of care coordination in the region

varied greatly. Several interview respondents expressed the perception that there was a very

high level of coordination. These individuals described having close relationships with

community partners and good communication across agencies, including with DCF, the CBC,

and the case management agencies. One provider also identified care coordination as a priority

of the managing entity, and reported that they convene monthly meetings of the network

providers to ensure that each agency is aware of one another, what each offers, and how they can

work together to ensure children’s needs are met.

Other behavioral health provider respondents were less optimistic about the degree of

care coordination that was occurring, although they acknowledged and emphasized the

importance of coordination. A common consensus among these respondents was that there was

room for improvement. One respondent noted that there was a lot of great effort around

coordination, but these efforts were not necessarily as effective as they needed to be. Another

respondent expressed that while some providers were trying, it seemed that not all providers

were “fully cooperative” when it came to cross-system coordination and collaboration. Other

descriptions of the service system and coordination efforts included “fragmented,” and

“unorganized,” with one respondent expressing concern that “kids fall through the cracks,”

particularly when they are transferred from one provider to another.

A need for greater communication and information sharing was one of the most

commonly identified challenges by behavioral health providers. It was reported that providers

were not always aware of one another or what other services a particular child was receiving, and

Page 37: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

36

FINAL EVALUATION REPORT | Contract LHZ68

that providers did not always receive pertinent information about changes in a case (e.g. a child’s

placement change or reunification). As one respondent characterized this disjunction: “It seems

like sometimes, though, the right hand doesn’t know what the left hand is doing.” One

suggestion provided was for the incorporation of multi-disciplinary staffings at regular intervals

to ensure that all providers working with a particular child and/or family were aware of the

various services being provided and the current status of the case plan.

It was further noted by behavioral health providers that coordination with case

management varies and was often dependent on the particular case manager assigned to a case.

High staff turnover and high caseloads among case management agencies were perceived to be

the primary factors contributing to poor coordination on the case management side. The impact

of these factors was that case managers may not know the children on their caseload very well,

and as a result may not be knowledgeable enough about the children’s needs to identify the most

appropriate services for them. Furthermore, high caseloads impact the amount of time that case

managers have available to spend on coordinating services for their clients.

Child welfare case managers contributed additional insights on care coordination. Case

management survey respondents generally described their role in care coordination as providing

service referrals, following up on referrals to ensure that children have been linked to services,

and ensuring the overall safety and well-being of the children under their care. Some

respondents also identified monitoring children’s outcomes and quality assurance as part of their

role. Focus group participants offered similar descriptions. Perhaps the largest portion of their

job, case managers reported that they are responsible for coordinating care through referrals to

clinical providers and linking clients to community resources or services that fall outside of the

formal scope of the job. After they received the CBHA results, they sent referrals out to

Page 38: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

37

FINAL EVALUATION REPORT | Contract LHZ68

providers who deliver the recommended resources. Case managers reported that the CBHA

typically did not identify or provide recommendations about specific providers or treatment

modalities to meet the child’s particular needs, which meant that case managers were left with

the task of identifying appropriate providers. At each of the case management agencies, they had

an established network of preferred providers with whom they worked, and case managers

expressed that there were personnel at their agencies who provided assistance with identifying

service providers.

Notably, neither the case managers nor the behavioral health provider respondents

mentioned the care coordinators provided by Sunshine. Although Sunshine’s policies indicate

that these care coordinators participate in multi-disciplinary team meetings to assist in providing

clinical expertise and identify appropriate services for children’s identified needs, the extent to

which this was integrated into routine practice was unclear. Frontline workers did not appear to

be aware of the availability or role of Sunshine care coordinators, giving the impression that their

contribution to care coordination was limited and far less hands-on than the role child welfare

case managers play in coordinating care.

Case manager focus group participants expressed that their role in care coordination did

not end with the service referrals. Subsequently, they were responsible for ensuring that

appointments were made and following up to ensure the child actually received the services.

Additionally, they requested regular updates from providers to monitor the child’s progress,

reviewed progress reports, and routinely assessed whether the services were meeting the child’s

needs or whether they needed to reassess the treatment plan. One challenge many case managers

experienced was limited or complete lack of communication from providers. In some instances,

it was reported that providers failed to inform case managers when children missed appointments

Page 39: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

38

FINAL EVALUATION REPORT | Contract LHZ68

or even that a child had been discharged from services. Delays in receiving progress reports

from providers, the need to make multiple requests to receive reports, and poor-quality reports,

were common challenges.

The other main challenge case managers described in relation to coordinating care was a

lack of cooperation from foster parents. Across the focus groups, respondents expressed

frustration that many foster parents did not view it as their responsibility to take children to their

appointments. Numerous examples were provided of how case managers had to renegotiate their

schedules to transport clients to court, school, and a plethora of various appointments because

foster parents refused to do so. When asked how common this was, respondents in one focus

group expressed that it was the majority of foster parents. Not only does this create additional

burden for already over-burdened case managers, but lack of engagement from foster parents

may also hinder a child’s treatment progress if caregivers do not actively participate in the

child’s treatment or communicate with the child’s provider about how the child is doing at home.

Documentation. This final area of inquiry has to do with the requirements for

documentation set forth by policy, and adherence to stated guidelines in terms of what is entered

into FSFN. Data to answer this question was gathered via contract/policy review and case file

review. An important aspect of the contracts reviewed were requirements to document all

mandatory activities. The Child Resource Record (CRR), the CFCN client case file, and the

Florida Safe Families Network (FSFN) were indicated as areas where the case management

agencies should document information that correspond with the required activities. The

contracts stated that the CRR should be initially developed and monitored by the case manager,

however, the CRR should be maintained by the caregiver of the home where the child resides

and should be provided to the physician at each physical health or behavioral health

Page 40: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

39

FINAL EVALUATION REPORT | Contract LHZ68

appointment. The CFCN client file and the FSFN data system should contain case notes,

treatment plans, and progress notes regarding the physical health and behavioral health services

that each child received. Furthermore, DCF policy dictates that the CBHA should be uploaded

to FSFN, and the results should be incorporated in the FFA.

Accordingly, as part of the case file reviews completed for the study, FSFN and ASK

were reviewed for documentation of completed mental health assessments, particularly the

CBHA, which is required for every child who enters out-of-home care. Most children (84.8%,

n=140) had a CBHA documented in their file, however, these were not uploaded to FSFN as

required per DCF policy, but were located in the ASK case management data system. Review of

these assessments found that they were typically very detailed and comprehensive, however, the

recommendations they provided were often for generic service categories (e.g. individual

counseling) as opposed to recommendations for specific treatment modalities or evidence-based

treatments in accordance with the child’s particular needs. Furthermore, review of the FFAs

contained in the case files found that these were not a reliable source to identify a child’s

behavioral health service needs. While some FFAs were comprehensive with detailed narrative

that reflected the current emotional and behavioral functioning and needs as outlined in the

mental health assessments and other case documents, this was not typical. Thus, while the

majority of case files contained the required FFAs, the assessments completed did not

necessarily address the child’s functioning or behavioral health needs and often did not

incorporate findings from the CBHA as specified in DCF policy.

Mental and Behavioral Health Needs of Children in Licensed Care

This section examines the mental and behavioral health needs, and unmet needs, of

children receiving out-of-home foster care services in the Southern Region. Analysis of child

Page 41: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

40

FINAL EVALUATION REPORT | Contract LHZ68

needs draws largely on case record reviews completed on a sample of 165 children in licensed

care between 2016 and 2018. Findings from the case record review analysis were then used to

produce estimates of child needs for the entire Southern Region child welfare population.

Finally, perspectives of behavioral health providers and case management staff on the mental

health needs and unmet needs of children in licensed care, solicited through interviews, focus

groups, and surveys, are incorporated and provide additional context.

Child characteristics. Demographic and case characteristics of the 165 children

randomly selected for detailed record review are summarized in Table 7. There were 55 children

in each of the three pre-determined age groups. Ninety-seven percent of the children (n = 160)

lived in Miami-Dade County. There were slightly more females than males in the sample, and a

slight majority of children were identified as Black/African American and came from single

parent homes. Domestic violence, substance abuse, and inadequate supervision were the most

common forms of maltreatment identified in the case files. Many children experienced more

than one type of maltreatment. The number of maltreatment allegations per child ranged from

one to five, M = 1.68 (SD = 0.87). There were 17 children in the sample for whom maltreatment

allegations could not be found in the case file.

Approximately 31.5% (n=52) were placed in a licensed foster home and 47% (n=77)

were living with a relative or non-relative (e.g. family friend, godparent) caregiver. The

remaining children (21.2%) were either in a group home, shelter, court-ordered supervision,

independent living, pre-adoptive placement, or a higher level of care placement, which included

medical foster homes, specialized therapeutic foster care (STFC), specialized therapeutic group

homes (STGH), and the Statewide Inpatient Psychiatric Program (SIPP). Most of the children in

the sample (72.1%) entered child welfare during the period under review (2016-2018). The

Page 42: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

41

FINAL EVALUATION REPORT | Contract LHZ68

remaining children in the sample entered care between 2011-2015, with the exception of one

child who entered care in 2003 and one in 2006.

Table 7. Child Characteristics by Age Group

Child Characteristics Ages 0-5 (N = 55)

Ages 6-12 (N = 55)

Ages 13-17 (N = 55)

Total (N=165)

n % n % n % n % Gender Male 23 41.8 25 45.5 25 45.5 73 44.2 Female 32 58.2 30 54.5 30 54.5 92 55.8 Race/ethnicity Black/African American 32 58.2 27 49.1 29 52.7 88 53.3 Hispanic/Latino 17 30.9 22 40.0 20 36.4 59 35.8 White (non-Hispanic) 2 3.6 3 5.5 3 5.5 8 4.8 Other/multi-racial 4 7.3 3 5.5 3 5.5 10 6.1 Family Structure

Married couple 7 12.7 6 10.9 10 18.2 23 13.9 Unmarried couple 16 29.1 11 20.0 9 16.4 36 21.8 Single female 24 43.6 31 56.4 31 56.4 86 52.1 Single male 2 3.6 3 5.5 2 3.6 7 4.2 Unable to determine 6 10.9 4 7.3 3 5.5 13 7.9

Placement*** Licensed foster care 29 52.7 9 16.4 14 25.5 52 31.5 Relative/non-relative care 21 38.2 38 69.1 21 38.2 77 46.7 Other placement⸙ 5 9.1 8 14.5 19 34.5 35 21.2 Maltreatment† Family/household violence 19 34.5 12 21.8 10 18.2 41 24.8 Substance misuse* 20 36.4 14 25.5 8 14.5 42 25.5 Inadequate supervision 11 20.0 16 29.1 8 14.5 35 21.2 Physical abuse/injury 10 18.2 9 16.4 14 25.5 33 20.0 Absence of care⸹ 5 9.1 8 14.5 10 18.2 23 13.9 Neglect 9 16.4 7 12.7 6 10.9 22 13.3 Sexual abuse* 1 1.8 6 10.9 12 21.8 19 11.5 Environmental hazard 5 9.1 8 14.5 3 5.5 16 9.7 Other maltreatment⸕ 3 5.5 7 12.7 6 10.9 16 9.7

***Chi-square significant at the p < .001 level. *Chi-square significant at the p < .05 level. ⸙Other placement types included group home, STFC/STGH, SIPP, shelter, hospital, medical foster home, independent living, court-ordered supervision, and pre-adoptive home. †Percentages add up to more than 100, since children may experience more than one type of maltreatment. ⸹Absence of care includes abandonment, loss of caregiver due to death or disability, and incarcerated caregiver. ⸕Other maltreatment includes threatened harm, psychological abuse/mental injury, and failure to protect.

Further analysis examined whether sample characteristics varied by age. There were no

differences in the distribution of gender or race/ethnicity among the age groups. The distribution

of placement types differed significantly by age group. Young children (birth to 5 years) were

more frequently placed in licensed foster care compared to children in the middle (ages 6-12)

Page 43: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

42

FINAL EVALUATION REPORT | Contract LHZ68

and oldest group (ages 13-17). Children ages 6 to 12 years were more frequently placed in

relative care compared to both younger children (birth to 5), and older children (ages 13-17).

Finally, the children comprising the oldest age group (13-17 years) were more frequently placed

in ‘other’ types of placements compared to the younger and middle age groups. Group homes

were the most frequent type of ‘other’ placement (25.7% of ‘other’ placements), however,

represented a small number (n=9) of the overall placements for the sample.

The number of maltreatment allegations did not differ significantly by age group.

However, there were some differences by age group in the distribution of maltreatment types.

The distribution of parental substance misuse allegations differed significantly between children

ages 0 to 5, who experienced parental substance misuse most frequently, and children ages 13 to

17. The distribution of sexual abuse allegations also differed significantly between children ages

0 to 5, for whom there was only one sexual abuse allegation, and children ages 13 to 17, for

whom there were twelve allegations.

Child mental health assessments. FSFN and ASK were reviewed for each child in the

sample for evidence of mental health assessments that were completed. Table 8 presents data on

the most frequently completed mental health assessments found in the case files. Ninety percent

(n=149) of the children in the sample received some form of mental health assessment as

evidenced by documentation in FSFN or ASK. There were 16 children for whom no behavioral

health assessments were found in the case files. The absence of an assessment in the file is not

necessarily an indication that an assessment did not occur. For those who had an assessment in

their file, the number of assessments completed per child ranged from one to eight. The mean

number of assessments completed per child was 2.4 (SD = 1.8).

Page 44: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

43

FINAL EVALUATION REPORT | Contract LHZ68

The mental health assessments most frequently utilized included the Comprehensive

Behavioral Health Assessment (CBHA), Biopsychosocial Evaluation, Psychiatric Evaluation,

and a variety of trauma assessments, such as the Child PTSD Symptom Scale or the Trauma

Symptom Checklist for Children (TSCC). Most children (84.8%, n=140) received a CBHA.

Review of these assessments found that they were typically very detailed and comprehensive.

As part of the CBHA, clinicians often administered additional age and symptom appropriate

emotional, behavioral, and developmental assessments, including the Child Behavior Checklist

(CBCL, ages 6-18) and corresponding Youth Self Report (YSR, ages 11-18), Ages and Stages

Questionnaire (ASQ-3, ages 0-5), Beck Depression Inventory, and the Child and Adolescent

Needs and Strengths (CANS).

Biopsychosocial assessments were found for 20% (n = 33) of the sample, and psychiatric

evaluations were found for 17.6% (n = 29) of the children in the sample. Approximately 9% of

the children (n = 15) had a behavioral assessment related to behavior analysis. Psychological

evaluations were less common, completed for only 6.7% (n = 11) of the children. A small

number of children (n < 5) received psychoeducational, suitability, and psychosexual, sexual

abuse, or human trafficking assessments.

Table 8. Most Frequently Completed Mental/Behavioral Health Assessments by Age Group

Behavioral Health Assessment Ages 0-5 (N = 55)

Ages 6-12 (N = 55)

Ages 13-17 (N = 55)

Total (N = 165)

n % n % n % n % Comprehensive Behavioral Health Assessment*** 52 94.5 51 92.7 37 67.3 140 84.8 Biopsychosocial Evaluation 7 12.7 13 23.6 13 23.6 33 20.0 Psychiatric Evaluation** 3 5.5 12 21.8 14 25.5 29 17.6 Trauma Screen/Assessment** 0 0.0 11 20.0 9 16.4 20 12.1 Behavior Analysis Assessment 5 9.1 5 9.1 5 9.1 15 9.1 Beck Depression Inventory 0 0 6 10.9 6 10.9 12 7.3 Psychological Evaluation 1 1.8 4 7.3 6 10.9 11 6.7 Behavioral/Mental Health Status Exam 2 3.6 2 3.6 6 10.9 10 6.1

***Chi-square significant at the p < .001 level. **Chi-square significant at the p < .01 level.

Page 45: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

44

FINAL EVALUATION REPORT | Contract LHZ68

There was no difference by age in the number of assessments a child received, but there

were differences in the types of assessments children received. First, a greater proportion of

younger children (ages 0-5 and 6-12) had a CBHA in their file compared to older children.

There were also differences by age group in the proportion of children who received psychiatric

evaluation and trauma assessment, with these assessments primarily completed on the middle

and oldest age groups. Statistical testing could not be performed for all the different assessments

used due to the small number of children that received many of the assessments.

Child welfare assessments of child needs. In addition to the mental health assessments,

the study team reviewed the Family Functioning Assessments (FFA) that were administered by

child welfare professionals over the duration of a child’s time in care. This included the FFA-

Investigations (FFA-I) completed at the time of intake by child protective investigations, the

FFA-Ongoing (FFA-O) completed by the child welfare case manager at the time of case transfer,

and Progress Updates, to be completed by case managers every 90 days, or more frequently if

needed, throughout the duration of the case. Using the FFA, child welfare workers document the

functioning, needs, and strengths of the family, including the parents, the children, and any other

individuals living in the household. Relevant to the current study, the items related to child

functioning and child needs on the FFAs were reviewed and assessed for their adequacy in

determining children’s mental and behavioral health functioning and needs. Adequacy of the

assessment was evaluated by the review team based on the information provided in the FFA

document concerning the description of functioning and needs and if it was sufficient to

determine the child’s behavioral needs. The team documented the presence and absence of

behavioral health information in the assessments, as well as when inconsistencies were present

within the document.

Page 46: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

45

FINAL EVALUATION REPORT | Contract LHZ68

Eighty percent of the cases reviewed had a FFA-I completed by child protective

investigators and a FFA-O completed by case managers in the file. Slightly fewer cases (73.9%)

had completed Progress Updates in the file. For the purpose of this analysis, it was documented

if a Progress Update was completed every 90 days and to assess adequacy, the most recent

Progress Update completed during the study period was reviewed and documented. A similar

proportion of cases had completed assessments in the case file for each of the three age groups.

These findings are summarized in Table 9. While the FFA addresses the domains of child

functioning and child needs including the child’s emotional, behavioral, and mental health needs,

the FFAs by design were found to focus primarily on safety concerns and were not a reliable

source to determine a child’s behavioral health service needs. Some FFAs were comprehensive

with detailed narrative that reflected the current emotional and behavioral functioning and needs

as outlined in the mental health assessments and other case documents, but this was not typical.

Thus, while most case files contained the required assessments, the assessments completed did

not necessarily provide comprehensive information about the child’s emotional and behavioral

functioning or behavioral health needs and often did not incorporate findings or

recommendations from the CBHA or other mental health assessments.

Table 9. Child Welfare Assessments Completed by Age Group

Family Functioning Assessment Ages 0-5 (N = 55)

Ages 6-12 (N = 55)

Ages 13-17 (N = 55)

Total (N = 165)

n % n % n % n % FFA-I Completed assessment in

FSFN 45 81.8 43 78.2 44 80.0 132 80.0

Assessed child functioning 27 49.1 30 54.5 29 52.7 86 52.1 Assessed child’s needs 17 30.9 9 16.4 9 16.4 35 21.2

FFA-O Completed assessment in FSFN

46 83.6 45 81.8 41 74.5 132 80.0

Assessed child functioning* 22 40.0 35 63.6 31 56.4 88 53.3 Assessed child’s needs 19 34.5 30 54.5 24 43.6 73 44.2 Completed assessment in FSFN

43 78.2 40 72.7 39 70.9 122 73.9

Page 47: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

46

FINAL EVALUATION REPORT | Contract LHZ68

FFA progress update

Assessed child functioning 24 43.6 33 60.0 30 54.5 87 52.7 Assessed child’s needs 24 43.6 30 54.5 27 49.1 81 49.1

*Chi-square significant at the p < .05 level.

Of the completed FFA-Is that were reviewed (n = 132), approximately 65%11 (n = 86)

were determined to adequately address the child’s emotional and behavioral functioning, but just

slightly over a quarter of them (26.5%, n = 35 of 132 assessments) adequately addressed the

child’s behavioral health needs. Slightly more of the completed FFA-Os that were reviewed (n =

88 of 132 assessments) adequately addressed child functioning, while 55% (n = 73 of 132

assessments) were adequate to determine a child’s mental and behavioral health needs. The

Progress Updates overall provided more thorough documentation, with approximately 71% of

the documented assessments (n = 87 of 122 assessments) considered adequate in assessing child

functioning, and 66% (n = 81 of 122 assessments) adequate to determine the child’s behavioral

health needs. This increase in documentation of a child’s functioning and needs could be

expected as the case managers become more familiar with a child and family and have access to

mental health assessments.

For the most part, the quality of completion of child welfare assessments was similar

across the different age groups. However, a smaller proportion of children in the youngest age

group (0-5 years) were determined to have an adequate assessment of their emotional and

behavioral functioning completed by the case manager compared to both the middle age group

(6-12 years) and the oldest group of children (13-17 years). No other differences by age were

observed with regard to the completion or adequacy of child welfare assessments.

11 The percentages reported in the narrative differ from those reported in Table 9 as they are based on the number of complete assessments documented in the files, and therefore exclude those case files that lacked assessments from the total N. Table 9, on the other hand, presents findings for the full sample, inclusive of case files that lacked FFA documentation.

Page 48: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

47

FINAL EVALUATION REPORT | Contract LHZ68

The FFA-O includes a rating of strength and need for each child on a variety of domains,

spanning mental health, physical health, developmental, and relational. The assessment uses a

letter-grade rating scale from ‘A’ (child demonstrates exceptional ability in this area) to ‘D’

(child demonstrates need for intensive support in this area). An A or B rating indicate the child

is doing well in that area and a rating of C or D indicate the child has needs and requires support

in that area. The most relevant items pertaining to children’s behavioral health needs are

included in Table 10. More than half of the children (59.1%) were identified as having

emotional or trauma-related needs (C or D rating) on the FFA-O. Approximately one third of the

children were identified as having needs related to behavior (29.6%) or family relationships

(36.3%). Although the development domain is only completed for children birth to age five,

more than one-third (34.8%) of the children in the younger age group did not have a rating for

development on the FFA-O. A minority of the younger children (23.9%) were considered to

need increased or intensive support for developmental needs.

Table 10. Child Welfare Needs Assessment Ratings by Age Group

FFA-O Child Needs Rating Ages 0 – 5 (N = 46)

Ages 6-12 (N = 45)

Ages 13-17 (N = 41)

Total (N = 132)

n % n % n % n % Emotional/trauma A

B C D NR

13 11 11 9 2

28.3 23.9 23.9 19.6 4.3

2 7

26 7 3

4.4 15.6 57.8 15.6 6.7

4 7

16 9 5

9.8 17.1 39.1 22.0 12.2

19 25 53 25 10

14.4 18.9 40.2 18.9 7.6

Behavior A B C D NR

18 17 3 7 1

39.1 37.0 6.5

15.2 2.2

9 23 6 4 3

20.0 51.1 13.3 8.9 6.7

9 8

15 4 5

22.0 19.5 36.6 9.8

12.2

36 48 24 15 9

27.3 36.4 18.2 11.4 6.8

Development A B C D NR

9 10 8 3

16

19.6 21.7 17.4 6.5

34.8

0 0 0 0

45

0 0 0 0

100

0 0 0 0

41

0 0 0 0

100

9 10 8 3

102

6.8 7.6 6.1 2.3

77.3 Family Relationships A

B C D

16 16 9 4

34.7 34.7 19.6 8.7

8 20 11 3

17.8 44.4 24.4 6.7

4 11 15 6

9.8 26.8 36.6 14.6

28 47 35 13

21.2 35.6 26.5 9.8

Page 49: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

48

FINAL EVALUATION REPORT | Contract LHZ68

NR 1 2.2 3 6.7 5 12.2 9 6.8 Rating scale:

A = child demonstrates exceptional ability in this area B = child demonstrates average ability in this area C = child demonstrates some need for increased support in this area D = child demonstrates need for intensive support in this area NR = not rated

When considering both some need for increased support (C rating) and need for intensive

support (D rating) combined, children in the youngest age group (birth to age 5) were rated by

case managers to have the lowest levels of need for the relevant domains. Conversely, children

in the oldest age group typically had the highest needs ratings, except for emotional/trauma

needs, which was slightly higher among the middle age group. However, when only considering

the need for intensive support, younger children were considered to demonstrate need at a higher

proportion than both groups in the behavior domain and a higher proportion than the middle age

group for the emotional/trauma domain. Ratings differed significantly by age group for

emotional/trauma and family relationships. A significant difference in ratings was not observed

among the age groups for behavioral needs.

Child mental health diagnoses and treatment needs. The mental health related

assessments and information present in FSFN and ASK were reviewed to document mental

health diagnoses assigned to each child as well as service recommendations. Table 11 contains

the profile of mental health diagnoses documented in the case files and service recommendations

included in the children’s mental health assessments.

Table 11. Children’s Mental Health Diagnoses by Age Group

Diagnosis Ages 0-5 (N = 55)

Ages 6-12 (N = 55)

Ages 13-17 (N = 55)

Total (N = 165)

n % n % n % n % Adjustment disorders 33 60.0 30 54.5 24 43.6 87 52.7 Attention deficit hyperactive disorder (ADHD)** 4 7.3 16 29.1 12 21.8 32 19.4 Mood disorders (depression, bipolar, etc.)** 4 7.3 9 16.4 18 32.7 31 18.8

Page 50: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

49

FINAL EVALUATION REPORT | Contract LHZ68

Trauma-related disorders (including PTSD) 5 9.1 12 21.8 12 21.8 29 17.6 Disruptive, impulse control, and conduct disorders 5 9.1 6 10.9 9 16.4 20 12.1 Anxiety disorders 2 3.6 8 14.5 4 7.3 14 8.5 Developmental or learning disabilities 4 7.3 5 9.1 4 7.3 13 7.9 Oppositional defiant disorder** 0 0.0 3 5.5 9 16.4 12 7.3 Substance use disorders** 0 0.0 0 0.0 8 14.5 8 4.8 Autism spectrum disorders 3 5.5 1 1.8 2 3.6 6 3.6 Number of diagnoses (mean, st. dev.)* 1.54 (1.2) 2.1 (1.3) 2.57 (1.3) 2.05 (1.3)

**Chi-square significant at the p < .01 level. *Chi-square significant at the p < .05 level.

More than half (58.7%, n = 97) of the children had more than one mental health

diagnosis, while 12% (n = 20) were found to have no documented diagnosis or no diagnosis was

given. There were 14 children for whom no diagnostic data were found in the case files.

Slightly more than half of the children (52.7%) were given an adjustment disorder diagnosis.

The types of adjustment disorder included depressed mood, anxiety, disturbance of emotions

and/or conduct, a mixed disturbance, or unspecified type of adjustment. Attention Deficit

Hyperactive Disorder comprised the second most common type of diagnosis given (19.4%),

followed by mood disorders (18.8%), trauma-related disorders (17.6%), and disruptive, impulse

control, and conduct disorders (12.1%). Relatively few children (n = 8) were found to have a

substance use diagnosis. Of these, most were for cannabis-related disorders (n = 6). It is

important to note that a diagnosis indicates meeting the criteria for abuse or dependence;

therefore, lack of a diagnosis does not necessarily mean a lack of substance use.

The number of diagnoses children received differed significantly between the 0-5 age

group and the 13-17 age group, F = 12.014, p < .001. Differences in number of diagnoses

between the 6-12 and 13-17 age groups were not statistically significant, but differences between

the other age group pairings were significant. There were also significant differences in the

distribution of certain diagnoses by age group. First, the diagnosis of Attention Deficit

Hyperactive Disorder (ADHD) was less frequently made for children in the 0-5 age group

Page 51: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

50

FINAL EVALUATION REPORT | Contract LHZ68

compared to the 6-12 age group, and the 13-17 age group. Second, mood disorders were

diagnosed more frequently for older children (ages 13-17) compared to children ages 0-5 and

children ages 6-12. Third, the distribution of Oppositional Defiant Disorder (ODD) was most

frequently found among the oldest group of children (ages 13-17). Finally, the distribution of

substance use disorders differed significantly by age group; children who received this diagnosis

were all in the 13-17 age group.

Children’s mental health treatment needs were also determined based on

recommendations in mental health assessments, child welfare assessments, legal documents,

service referrals, clinical summaries, and other documentation found in FSFN and ASK.

Sometimes these needs were directly related to a formal diagnosis, but they were also related to

child emotional and behavioral symptoms and experiences not necessarily connected to or

meeting criteria for a diagnosis. When applicable, mental health needs were correlated with a

recommended and/or referred service as found in the FSFN or ASK documentation, however,

documentation of mental health service receipt or referral were sometimes found in the case file

without indication of the specific need the service was intended to address. Mental health needs

data were not found in the case files for 12 children.

Thirty-five percent (n=58) of the children in the sample were found to have mental health

needs related to trauma. As noted previously, about 17.6 percent (n=29) of the children in the

sample received a diagnosis of PTSD or other trauma-related disorder; the remaining children

without a trauma diagnosis exhibited symptoms related to trauma and traumatic experiences that

required mental health intervention. Trauma-related needs were fairly evenly dispersed across

the age groups. Most of the children experiencing trauma symptoms were noted to have related

mental health needs including emotional instability, family and peer relationship challenges,

Page 52: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

51

FINAL EVALUATION REPORT | Contract LHZ68

reactive behaviors, depression, and anxiety. Twenty-nine children (17.8%) were found to have

needs related to anxiety, 32 children (19.4%) had needs related to depression or depressive

symptoms, 24 children (14.5%) had needs related to symptoms of ADHD, and 39 (23.6%)

exhibited maladaptive or concerning behaviors. Twenty-four children (14.5%) were identified as

having mental health service needs concerning family or peer relationships, and 17 children

(10.3%) had needs related to aggression or anger.

Fourteen children (8.4%) were identified as having mental health needs related to sexual

abuse, primarily among the 6-12 and 13-17 age groups, although there were actually 19 children

who had sexual abuse maltreatment allegations. Four of the children with identified needs (all

ages 13-17) were identified as having needs specific to human trafficking victimization. Only

four children were identified as having mental health needs related to symptoms of an autism

spectrum disorder and four related to developmental delays. Other, less commonly identified

needs concerned grief or separation, speech and language, substance use, and one child with

gender identity needs.

Mental health and behavioral health service needs. Concerning mental health services,

documentation of recommended or referred services was found for 153 children (92.7%). The

number of distinct service needs identified and recommended per child by behavioral health

assessors ranged from zero to seven. Differences in the number of service needs identified by

age group did not achieve statistical significance. The most commonly recommended service, by

far, was individual therapy or counseling, which was recommended for 71.5% of the children (n

= 118; see Table 12). Of these children, 14.4% (n = 17) were recommended trauma-focused

therapy, and 11% (n = 13) received a recommendation for a specific evidence-based therapeutic

model, such as Trauma-focused Cognitive Behavior Therapy (TF-CBT). Among younger

Page 53: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

52

FINAL EVALUATION REPORT | Contract LHZ68

children, play therapy was commonly recommended (n = 27). Family therapy was

recommended for 52 children (31.5%).

Table 12. Children’s Service Needs Identified by Behavioral Health Providers

Recommended Service Ages 0-5 (N = 55)

Ages 6-12 (N = 55)

Ages 13-17 (N = 55)

Total (N = 165)

n % n % n % n % Individual therapy (psychotherapy, talk therapy)** 25 45.5 48 87.3 45 81.8 118 71.5 Specific evidence-based therapeutic treatments 5 9.1 5 9.1 3 5.5 13 7.9 Trauma-focused therapy 4 7.3 6 10.9 7 12.7 17 10.3 Family therapy 12 21.8 21 38.2 19 34.5 52 31.5 Play therapy** 21 38.2 6 10.9 0 0.0 27 16.4 Evaluation (psychiatric, psychosocial, etc.)* 9 16.4 5 9.1 16 29.1 30 18.2 Behavior analysis 10 18.2 9 16.4 3 5.5 22 13.3 Medication management 4 7.3 8 14.5 7 12.7 19 11.5 Targeted case management 2 3.6 1 1.8 7 12.7 10 6.1 Therapeutic visitation 3 5.5 1 1.8 3 5.5 7 4.2 Substance abuse treatment 0 0.0 0 0.0 3 5.5 3 1.8 Specialized therapeutic foster care or group home 1 1.8 0 0.0 2 3.6 3 1.8 SIPP or residential treatment 0 0.0 1 1.8 1 1.8 2 1.2 Other (group therapy, occupational therapy, etc.) 5 9.1 5 9.1 4 7.3 14 8.5 Number of services (mean, st. dev.) 1.64 (1.5) 1.96 (1.1) 2.20 (1.0) 1.93 (1.2)

**Chi-square significant at the p < .01 level. *Chi-square significant at the p < .05 level.

Thirty children (18.2%) were recommended for additional evaluation and assessment,

including psychiatric and psychological evaluations and behavioral assessments. Behavior

analysis related services were recommended for 22 children (13.3%) including applied behavior

analysis and behavior management. Twelve of the 14 children identified as having sexual abuse

related needs were referred for mental health services specifically to address sexual abuse or

suspected sexual abuse. Furthermore, the four children with human trafficking concerns were

referred for human trafficking specific services. Other, less frequently recommended services

included child-parent psychotherapy, dyadic therapy, therapeutic visitation, grief counseling,

targeted case management, day treatment, residential inpatient treatment, substance abuse

services, art therapy, and occupational and speech therapy.

Page 54: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

53

FINAL EVALUATION REPORT | Contract LHZ68

There were several differences in the distribution of recommended services by age group.

In particular, there were differences in the distribution of individual therapy, play therapy, and

evaluation. Individual therapy was more frequently recommended for children ages 6-12, and

for children ages 13-17, compared to children ages 0-5. In contrast, younger children (ages 0-5)

were more frequently recommended to receive play therapy compared to children ages 6-12, and

children ages 13-17. Finally, additional evaluation services, such as psychiatric, psychological,

or biopsychosocial evaluation, were most commonly recommended for the oldest group of

children (ages 13-17), although differences were only significant compared to the 6-12 age

group.

The case files were also reviewed for evidence of service receipt connected to the specific

behavioral health needs identified. If receipt of the recommended service was documented in the

child’s record, this was noted on the protocol, however, lack of documentation does not mean the

service was not provided, only that there was no evidence to assess whether or not it was

provided. There were 263 mental and behavioral health needs documented for the sample, with

a slightly larger portion of these attributed to the 13-17 age group (34.6%, n = 91) and 6-12 age

group (34.2%, n = 90) compared to the 0-5 age group (31.2%, n = 82). The files contained

evidence of service receipt for approximately 81% of the identified needs (n = 213). A greater

proportion of children in the 13-17 age group had evidence of service receipt in their file (85.7%)

compared to the 6-12 age group (81.1%) and the 0-5 age group (75.6%).

Estimate of overall child welfare population needs. To estimate mental and behavioral

health needs for the overall population of children in licensed care in the Southern Region during

the period under investigation (2016-2018), the percentages of need found through the case

record reviews were applied to the total number of children in licensed care who received at least

Page 55: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

54

FINAL EVALUATION REPORT | Contract LHZ68

one mental health service during this timeframe. A limitation is that this does not address the

possibility that there may have been some children in care with mental health needs who did not

receive services during this period. Administrative data indicate that, of 4,855 children with out-

of-home care episodes during this timeframe, approximately 67% (3,257 children) received at

least one mental health service. We cannot ascertain whether the remaining children had no

mental health needs, or whether their needs were not identified and addressed.

Children in the overall child welfare population that received mental health services in

the Southern Region were not evenly distributed across the age groups. The greatest proportion

of children were ages 6 to 12 (40.2%, n = 1,310), followed by children ages 0 to 5 (32.5%, n =

1,057), and children ages 13 and up (27.3%, n = 890). Table 13 provides diagnostic and service

needs estimates by age group for the total population. Estimated numbers of children with a

given need were rounded to the nearest whole number. Some discrepancies are noted, for

example, between the rate of substance use disorder diagnosis and the rate of substance abuse

treatment recommendations. Thus, service needs may be underestimated through this

methodology, as they are based on the recommendations that were found in case records and do

not account for service needs that might not have been documented.

Table 13. Estimate of Child Mental and Behavioral Health Needs Diagnosis Ages 0-5 (N = 1,057) Ages 6-12 (N = 1,310) Ages 13-17 (N = 890)

%1 n2 %1 n2 %1 n2

Adjustment disorder 60.0 634 54.5 714 43.6 388 ADHD 7.3 77 29.1 381 21.8 194 Mood disorder 7.3 77 16.4 215 32.7 291 Trauma-related disorder 9.1 96 21.8 286 21.8 194 Disruptive, impulse, conduct 9.1 96 10.9 143 16.4 146 Anxiety disorder 3.6 38 14.5 190 7.3 65 Developmental/learning disorder 7.3 77 9.1 119 7.3 65 Oppositional Defiant Disorder 0 0 5.5 72 16.4 146 Substance use disorder 0 0 0 0 14.5 129 Autism spectrum disorder 5.5 58 1.8 24 3.6 32 Service Needs Ages 0-5 (N = 1,057) Ages 6-12 (N = 1,310) Ages 13-17 (N = 890)

Page 56: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

55

FINAL EVALUATION REPORT | Contract LHZ68

%1 n2 %1 n2 %1 n2 Individual therapy 45.5 481 87.3 1,144 81.8 728 Play therapy 38.2 404 10.9 143 0 0 Family therapy 21.8 230 38.2 500 34.5 307 Mental health evaluation 16.4 173 9.1 119 29.1 259 Behavior Analysis 18.2 192 16.4 215 5.5 49 Medication management 7.3 77 14.5 190 12.7 113 Targeted case management 3.6 38 1.8 24 12.7 113 Substance abuse treatment 0 0 0 0 5.5 49 STFC, STGC, or SIPP 1.8 19 1.8 24 5.5 49

1Percentages derived from the case record reviews; refer to Tables 6 and 7. 2Estimated number of children with need; calculated by multiplying the total population size (N) by the proportion expected to be affected (%).

Stakeholder perception of mental and behavioral health needs. Findings from

behavioral health provider interviews, child welfare case manager focus groups, and the case

management survey were reviewed to provide context to the child mental and behavioral health

needs and services identified through the case file reviews. The findings described here speak to

perceived needs only, and not necessarily the actual service capacity of the local system of care.

Service capacity and utilization are examined next in the subsequent sections. Overall, the

perception of unmet behavioral health service needs in the region was high. Considering the

modality of service provision, behavioral health provider respondents emphasized the need to

utilize a family-level perspective, expressing the concern that focus was often placed on treating

the child rather than the family system and family trauma from which a child’s behavioral health

needs often originate. This expressed need for family therapy also stressed the desire for

increased inclusion of and communication with the reunifying parents in the child’s treatment,

when possible. The need for comprehensive mental health assessments at the time of protective

service intake was also emphasized.

Behavioral health providers further noted an absence of evidence-based models being

used in the region to address behavioral health needs, but did not specify the type of

interventions that were lacking, other than a need for greater emphasis on trauma-based

Page 57: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

56

FINAL EVALUATION REPORT | Contract LHZ68

treatments. Residential care for mental health and substance abuse treatment, behavioral health

services for children who also have developmental disabilities, services for children with autism,

and crisis stabilization services to respond to suicidal ideation and high-risk behavior were also

named as needing more resources. The need for residential services were reported to be greatest

in Monroe County, where respondents shared there were no existing residential services, but

Dade County also faced challenges in this area with limited locations to serve such a large

population. Furthermore, they reported a lack of specialized services for children in need of

higher levels of care, such as therapeutic foster care, which often prevented them from keeping

such children in the community. These views were consistent with case manager focus group

findings, in which respondents described non-existent specialized therapeutic foster care and

inpatient services in Monroe County, and a need for more higher-level of care services in Miami-

Dade County, describing availability as limited and inadequate compared to the level of need.

Another need that emerged from the behavioral health provider interviews was use of a

wraparound approach that treated multiple needs impacting long-term well-being and emotional

stability through an array of behavioral and developmental services including speech,

occupational, and physical therapy. Child welfare case manager focus group respondents

expressed a similar need for increased access to occupational therapy, speech therapy and autism

behavior therapy.

In addition, while children might enter into care with particular mental and behavioral

health needs, providers described a need to also provide children with services and support to

cope with the loss and discontinuity of multiple providers during their time in care, potentially

including changes in child welfare case managers, caregivers, teachers, and therapists. Other

recommendations included provision of extracurricular activities to provide emotional well-

Page 58: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

57

FINAL EVALUATION REPORT | Contract LHZ68

being and social support to children, with the intention that they could prevent further mental

health problems from developing.

Another area of concern, particularly among case managers, was with regard to the

effectiveness of available services to meet the behavioral health needs of children in care. As

part of the case management survey, case management professionals rated the effectiveness of

local behavioral health treatment services, from highly effective to largely ineffective, for 16

specific behavioral health needs (See Appendix E for full survey results). Case management

perceptions of the effectiveness of treatment services varied considerably, however, no services

were rated by the majority of case management respondents as highly effective. Very few

respondents (e.g. fewer than 15%) rated the available services as highly effective for any of the

behavioral health needs assessed. Treatments services for anxiety, mood disorders,

attention/hyperactivity, and attachment issues were rated as fairly effective by a majority of

respondents. Even for these conditions, however, a considerable proportion of respondents did

not believe services were particularly effective. Services perceived to be least effective by the

highest percentage of respondents included those for severe/complex trauma, psychosis,

disruptive behavior, conduct problems, victims of sexual abuse, children exhibiting self-harming

behaviors, victims of human trafficking, specialized therapeutic placements, and residential care.

These concerns about the effectiveness of services mirror, to some extent, the concerns

expressed by providers about the lack of evidence-based treatment utilization.

Children’s Behavioral Health Service Array

Findings presented in this section pertain to the identified provider network and array of

behavioral health services available to children in licensed foster care. This includes (1) the

number, array, and availability of community-based services and providers of treatment services

Page 59: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

58

FINAL EVALUATION REPORT | Contract LHZ68

accessible to placement caregivers, (2) the number, array, and availability of higher end (e.g.

specialized therapeutic placements) and inpatient services for children with higher level of care

needs, (3) the number, array, and availability to children in licensed care of service supports that

utilize trauma-informed and evidence-based practices, and (4) the number, array, and availability

to children in licensed care of behavioral health mobile response interventions. Additionally,

barriers and challenges identified by behavioral health providers and case management staff that

may impact service availability or limit access to care are described.

Description of provider network and service array. The children’s behavioral health

provider network for the Southern Region was identified by (1) reviewing Sunshine Health’s

Child Welfare Specialty Plan (CWSP) provider directory, (2) reviewing the Managing Entity’s

champions for child welfare provider network, (3) administration of the behavioral health

provider survey (n = 20 responses), and (4) internet searches to find service information for

providers who did not respond to the survey. Data collection focused on gathering information

on the variety of services available within the community, including the provision of mobile

response interventions, as well as the types of children’s behavioral health needs the available

services are designed to address. Limited information was available for some providers; thus,

this section provides an approximation of the overall service array and capacity.

Outpatient services. A total of 75 provider agencies in Miami-Dade County and five

provider agencies in Monroe County were identified that offer outpatient behavioral health

services to children in licensed foster care. Most (92.5%) of these providers were on the CWSP.

Other common funding sources besides Medicaid that survey respondents reported included the

Managing Entity and DCF. Findings indicate that Miami-Dade County has a fairly wide and

robust array of services, while Monroe County has a more limited array of services. These

Page 60: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

59

FINAL EVALUATION REPORT | Contract LHZ68

findings, shown in Table 14, are limited to the data that could be obtained through the study, and

as a result may under-represent system capacity due to limited availability of data for some

providers. The most widely available services, based on the number of agencies identified as

providing each service, included individual therapy, psychiatric services, family therapy, case

management, mental health assessments (CBHA, bio-psychosocial, psychiatric evaluation, etc.),

and group therapy. There were also 12 agencies in Miami-Dade and two agencies in Monroe

that explicitly reported providing intensive outpatient services. Although there were few

agencies that provide mobile response services, no issues with capacity were reported for either

county; copies of their recent monthly reports (July 2019 – March 2020) indicate that average

response times were under 2 hours for Miami-Dade and under 30 minutes for Monroe.

Table 14. Outpatient Services Provided in the Southern Region Miami-Dade Monroe

Outpatient Services1 # of providers

Estimated capacity2

# of providers

Estimated capacity2

Mental Health Assessments 26 45,022 4 5,574 Individual therapy/counseling 40 3,463 4 279 Family therapy 32 8,320 3 780 Group therapy 23 1,991 0 0 Behavior analyst/ behavior management 13 1,126 1 70 Case management 25 2,165 1 70 Psychiatry/medication management 33 2,857 3 209 Psychosocial rehabilitation 13 1,126 0 0 Substance abuse counseling 16 1,385 2 139 Crisis intervention/management 4 6,926 1 1,394 Intensive outpatient services/ TBOS 12 1,039 2 139 Mobile response services 2 3,463 1 1,394

1There were 17 agencies for whom no information on services could be obtained. It is also possible that information obtained through provider websites about the services they offer was incomplete; the numbers in the table are based on the available data. 2Estimated number of children that can be served per year. See below for explanation of how estimates were calculated.

Determining the actual capacity of these services was more challenging, as most provider

websites did not offer extensive information on staffing, caseloads, or the number of clients

served, and the number of survey responses providing this information was limited (n = 23; see

Page 61: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

60

FINAL EVALUATION REPORT | Contract LHZ68

Appendix D for full survey results). Of the limited data that could be gathered, it was apparent

that agencies vary considerably in size, from small agencies with 5 or fewer front-line staff to

large agencies with 25 or more front-line staff. Average caseloads also varied somewhat,

generally ranging from 10 to 35 children. Similarly, duration of services could vary greatly,

depending on the child’s need, with providers reporting average durations ranging from three to

twelve months for most therapeutic services. The primary exceptions were mental health

assessments, crisis intervention, and mobile response services, all of which are typically short-

term interventions (24-72 hours).

To provide a basic estimate of the overall service capacity, we applied a formula of an

average caseload of 20 children, average of 10 staff per agency able to provide a given service,

and average service duration of nine months for therapeutic services. For mental health

assessments, crisis intervention, and mobile response services, the formula used was an average

of 10 children per staff per week and an average of 10 staff per agency. Next, since most

agencies identified do not exclusively serve children, but also serve adults, it was presumed that

a considerable portion of their capacity would be consumed by adult clients. The adult

population for Miami-Dade County is 2,156,795 compared to approximately 604,786 children.

National estimates of serious mental illness rates in adults is 4.5% (NIMH, 2019), and rates of

serious emotional disturbance in children range from 4.3% to 11% (Ringeisen, et al., 2017; we

assumed an average rate of 8%). These calculations yielded estimates of 97,055 adults and

48,383 children for Miami-Dade County with behavioral health needs, which indicate that

children would be expected to comprise roughly one-third (33.3%) of a provider’s clients. The

same calculations conducted for Monroe County, which has a smaller child population, indicate

that children would be expected to comprise approximately 26.8% of a provider’s clients. These

Page 62: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

61

FINAL EVALUATION REPORT | Contract LHZ68

percentages were therefore applied to the total estimated service capacity12 to provide an

estimate specific to capacity to serve children. An important caveat is that these estimates do not

account for how many non-child welfare clients agencies may serve, which would also likely

consume a considerable portion of a provider’s capacity, but only provide an overall estimate of

how many total children can be served annually.

Specialized therapeutic placement services. The availability of services for children

requiring a higher level of care was much more limited. Notably, these services were only

available in Miami-Dade County. Four providers were identified who offered specialized

therapeutic foster care (STFC) and one provider was identified who provided therapeutic group

care (STGC). On average, duration of these services was reported to range from nine to twelve

months. While the number of licensed beds reported by the CBC was fairly substantial (see

Table 15), there were a couple caveats. First, the CBC explained that the STFC providers accept

children from all over the state; therefore, the 133 licensed beds were not reserved for children

from Miami-Dade County or even the Southern Region, although the CBC is working to change

this process. Second, the CBC has encountered issues with STFC homes not accepting children

who have particularly severe needs, which has resulted in having a wait list of children for STFC

despite having open beds. To address this challenge, the CBC has been working on developing a

Qualified Residential Treatment Program that will be able to serve children with higher level of

care needs who cannot be placed in STFC.

Table 15. Therapeutic Placement Services Provided in the Southern Region Specialized Therapeutic Placements (Miami-Dade only) # of providers # of beds Specialized Therapeutic Foster Care 4 133 Therapeutic/Residential Group Care 1 6

12 Excluding family therapy, since it is already assumed to be an estimate of the number of families that can be served.

Page 63: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

62

FINAL EVALUATION REPORT | Contract LHZ68

Inpatient services. The array of inpatient services identified included crisis stabilization

units, the Statewide Inpatient Psychiatric Program (SIPP), Baker Act receiving facilities and

acute care psychiatric units, and other residential treatment programs. With the exception of one

children’s crisis stabilization unit and one SIPP, these services were not exclusively for children,

and it was unclear whether children were served in separate units or simply mixed with adult

patients, nor was any specificity provided as to the number of beds available to children versus

adults. Some facilities did not specifically state whether they served children, so it was difficult

to ascertain the actual number of providers. Unless a facility explicitly stated that it served

adults only, it was counted. Notably, inpatient services were only available in Miami-Dade

County. Children who require acute care under the Baker Act are transported from Monroe

County to Miami-Dade County. In FY17/18, 37 children were involuntarily examined under the

Baker Act (it is unknown how many were admitted).

Table 16. Inpatient Services Provided in the Southern Region Inpatient Services (Miami-Dade only) # of providers # of beds Children’s crisis stabilization unit 1 16 Crisis stabilization unit – mixed child and adult1 2 44 Statewide Inpatient Psychiatric Program (SIPP) 1 44 Other inpatient/residential treatment1,2 9 184

1 Number of children’s vs. adult beds not specified. 2Includes facilities that serve both children and adults. Information on number of beds could not be found for 6 facilities.

Trauma-informed and evidence-based practice. Information on the provision of trauma-

informed and evidence-based services was limited and difficult to ascertain beyond what was

reported on the provider survey, however, some provider websites did identify specific treatment

modalities that they employ. For the most part, survey respondents reported having training

requirements in place pertaining to trauma-informed care. A majority of respondents indicated

that all staff at their agency receive trauma-informed care training (60.9%) or most staff receive

Page 64: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

63

FINAL EVALUATION REPORT | Contract LHZ68

training (30.4%). Two agencies (10%) reported that only “some staff” receive trauma-informed

care training. Another six providers were identified that mentioned provision of trauma-based

services on their website. The lack of a specific statement about trauma-informed services does

not necessarily mean a provider does not provide such services, since many provider websites

lacked specificity regarding their services.

Regarding the use of evidence-based practices, a total of 19 distinct treatment modalities

were identified through the survey and provider websites. Those most frequently identified

included Cognitive Behavior Therapy (CBT, n = 17), Trauma-Focused Cognitive Behavior

Therapy (TF-CBT, n = 9), Motivational Interviewing (n = 8), Solutions Focused Behavior

Therapy (SFBT, n = 5), Dialectical Behavior Therapy (DBT, n = 5), Play Therapy (n = 5), and

Child-Parent Psychotherapy (CPP, n = 4). The only explicitly trauma-based treatment model

identified was TF-CBT. (For a full list of treatment modalities identified, refer to Appendix C)

While a wide array of evidence-based practices and treatment modalities was identified, there

were a limited number of providers reporting the provision of these services.

Services for specific children’s behavioral health needs. Information was also gathered

with regard to the availability and provision of services to address specific children’s behavioral

health conditions and needs. Findings suggest that the capacity of the behavioral health system

varies by the particular need in question. Children’s behavioral health needs for which capacity

was highest (e.g. more than 20 providers reported services to address the particular need)

included attention deficit hyperactive disorder, anxiety disorders, depression and mood disorders,

trauma-related disorders, outpatient substance abuse treatment, and (non-specified) behavior

problems. Moderate service capacity (e.g. 10 to 20 providers reported services to address the

particular need) was found for attachment disorders, adjustment disorders, impulse control

Page 65: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

64

FINAL EVALUATION REPORT | Contract LHZ68

issues, oppositional defiant disorder, children exhibiting self-harming behavior or suicidal

ideation, psychosis, autism spectrum disorder, developmental disabilities, and treatment for

victims of sexual abuse. Behavioral health needs for which capacity was most limited (e.g.

fewer than 10 providers reported services to address the particular need) included services for

serious conduct disorders, eating disorders, personality disorders, gender or sexual identity

issues, and treatment for victims of human trafficking.

Stakeholder perceptions of service availability and accessibility. Although findings

indicate that an extensive provider network exists for children’s behavioral health services in the

Southern Region, there are a number of factors that may impact how the service array is

experienced by those in the foster care system. Key stakeholders, particularly behavioral health

providers and case management staff, were asked to share their perspectives regarding the

availability and accessibility of services for children in licensed foster care. The findings point

to a number of gaps and challenges in service provision.

Availability and array of services. Respondents described variability in the availability

of children’s behavioral health services, depending on the particular service or behavioral health

need. Common themes emerged across behavioral health providers and child welfare case

managers. Access to mental health evaluations and assessments was reported to be somewhat

limited, or associated with considerable wait times of up to 30 days, according to both providers

and case managers. Outpatient services, such as individual counseling or therapy, were generally

reported to be readily available, but options for children requiring higher levels of care were

more limited. Access to residential care for mental health and substance abuse, behavioral health

services for children who also have developmental disabilities, services for children with autism,

and crisis stabilization (and further, services to respond to suicidal ideation and high-risk

Page 66: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

65

FINAL EVALUATION REPORT | Contract LHZ68

behavior such as cutting) were identified as needing more resources. Services for non-English-

speaking clients were also mentioned as being inadequate, particularly in reference to Creole and

in some cases Spanish or indigenous dialects.

Providers in Monroe County, in particular, reported having limited service options and

indicated that they did not feel there were adequate services in place for youth with behavioral

health needs and developmental disabilities. They reported that many of their services were

outsourced to neighboring counties, and that lack of inpatient or specialized services for children

with higher levels of need, such as therapeutic foster care, was particularly challenging. The

absence of a Baker Act receiving facility in the area was another noted issue.

While the need for residential services was reported to be greatest in Monroe County,

Miami-Dade also faced challenges in this area with limited locations to serve such a large

population. Limited availability, or altogether lack of services, made it difficult, and sometimes

impossible, to keep children with higher levels of need in the local community. When youth

need to be sent out of town for treatment due to a paucity of localized services, providers

expressed that it disrupts the relationship between the case manager and therapist attached to the

youth’s care, further complicating coordination of services. In addition, some agencies

expressed that their facilities were not equipped to keep up with the demand of children in need

of residential services.

Case managers reiterated what was shared by providers regarding the lack of specialized

therapeutic foster care and inpatient services in Monroe County, and limited availability in

Miami-Dade County, noting that their job often entailed finding creative solutions to combat

structural barriers to care. Case managers also expressed frustration with a limited variety of

services, describing what they perceived to be an over-reliance on traditional talk

Page 67: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

66

FINAL EVALUATION REPORT | Contract LHZ68

therapy/counseling and psychiatry, of which service availability was more plentiful. These

sentiments were echoed by some behavioral health providers, who expressed that many children

were in need of, or would benefit from, additional services in combination with individual

therapy, such as mentoring, occupational therapy, and extracurricular activities, as well as greater

incorporation of a wraparound services approach.

Responses from the case management survey, furthermore, indicated that most

respondents perceived the availability of children’s behavioral health services was inadequate

compared to the need13, and that services were often difficult to access14. This finding was

consistent across 16 behavioral health needs that respondents were asked about, although it was

more pronounced for some needs than for others. (For full survey results, see Appendix E). The

greatest gaps reported in terms of availability and accessibility were for services to address

severe conduct problems, specialized therapeutic placements (e.g. STFC or STGC), residential

care, services for disruptive behaviors, services for children experiencing psychosis, services for

children who have experienced human trafficking, and services for children exposed to severe or

complex trauma. For each of these needs, a significant majority of respondents reported that

services were largely unavailable and difficult to access. Case managers were unanimous in

their beliefs that significant gaps in behavioral health services centered upon the lack of available

behavioral health services, particularly for children with severe mental health diagnoses, and lack

of therapeutic homes.

Wait lists. Beyond the actual array of services within the existing provider network, a

number of barriers were identified that limited the availability and accessibility of services. Wait

13 Availability was defined as the extent to which services are offered and readily available (e.g. without a waitlist) in the community 14 Accessibility was defined as the extent to which children in foster care can actually access the services, taking into account factors such as cost, insurance coverage, provider hours and location.

Page 68: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

67

FINAL EVALUATION REPORT | Contract LHZ68

lists for services were reported to be a common challenge. Long wait times were noted as a

challenge by a number of respondents on the case management survey and were also reported

during the case manager focus groups. Responses on the provider survey also confirmed that

some services incurred wait lists, which could be up to four weeks.

When asked directly about wait lists during interviews, behavioral health provider

responses were mixed. However, the reason for the bulk of the no-wait list responses may be

semantics or procedural reasons rather than service needs being met. A minority of respondents

said they did not have a waiting list and reported very short timeframes, for example, “within

two weeks,” that assessment and services started. Generally, interviewees did list wait times for

services such as specialized therapeutic foster homes, specialized medical services, neuro-

psychological testing, residential substance abuse, adolescent residential facilities that were not

in high crime neighborhoods, educational services for academic needs and, in Key West,

children’s outpatient services. A range of one to three months to receive certain services was

given if wait lists were reported.

A number of providers, furthermore, described an articulated strategy to provide some

type of services to a child when high end or specialized services were clinically indicated but

currently full. A provider explained:

We don’t really have any wait list, so what we’ve been doing to manage is we will provide some level of care while people are waiting for that higher level of care. So for example, the Community Action Team is a really intensive program that was created by the State of Florida in order to keep kids out of higher levels of care from going to residential, but we can only have 35 youth in that program at a time, so if there’s somebody who we feel meets the criteria for that program, but that program is full, we will still provide Therapeutic Behavioral On-Site Services, or even crisis counseling. We can always provide something, so there really isn’t the wait list, per se, but that also doesn’t necessarily mean that-that youth couldn’t benefit from having something more intensive.

Page 69: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

68

FINAL EVALUATION REPORT | Contract LHZ68

Another respondent reiterated that high-end services were not always available when needed and

that children who fall into this category of service need may not be getting services that are

clinically appropriate. As this interviewee stated, “They will just kind of get something else.

They would be referred to a community mental health outpatient service that might be able to

intake them quickly, but then, that’s not really going to address the issue.” Another response to

the waiting list question indicated that agencies may be refusing referrals if they cannot serve

children immediately. So, in other words, they do not have a waiting list for services because

agency policy does not allow them to keep one despite population need for services.

Transportation. Additional barriers to accessing care identified by respondents included

transportation and the ability or willingness of foster parents to take children to appointments.

Provider and case management respondents from Miami-Dade noted that the county is quite

large geographically combined with heavy traffic, and as a result, accessing certain services may

require a great deal of travel and time. This can be a considerable burden on foster parents,

especially if they have several children in their care. At the same time, case managers expressed

frustration that many foster parents simply seemed unwilling to take children to appointments,

and expected case managers to take on this responsibility.

Several providers emphasized providing services in the community, for example, going

to children’s schools or homes, rather than conducting appointments in the office. One provider

noted that they are co-located within the schools in their catchment area. Another provider

reported having mobile crisis response services. A number of providers also reported the

provision of in-home individual and/or family therapy on the provider survey or on their

agency’s website (n = 11). To the extent possible, case managers reported that they tried to

identify providers who were close to the child’s residence, or utilize in-home service providers as

Page 70: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

69

FINAL EVALUATION REPORT | Contract LHZ68

much as possible. Additionally, some providers reported offering flexible services hours, such as

evenings or weekends, in order to work around foster parents’ schedules. Providers did not

speak to the extent to which school or home-based services were adequately available throughout

the region, but case managers indicated that there was a need for more of these services. Thus,

increased availability of in-home services and increased implementation of behavioral health

interventions within the school system were offered as recommendations for improving access to

services. One provider explained, “Our program may be in one school, but we’re not in all of the

schools and the counselors tend to have a big caseload.” Another suggested solution was to

expand the use of telehealth technologies to provide services virtually.

Medicaid restrictions and eligibility. Among case managers, the bureaucratic processes

surrounding Medicaid-funded services was a major point of contention. Case managers

criticized that Medicaid requirements and restrictions often blocked or limited access to

behavioral health services for children. One way in which this occurred was with limitations on

the frequency or amount of services that Medicaid would approve. The following excerpt

provides an example of the challenges experienced by case managers:

You know, Medicaid only gives you maybe an hour a month or something like that. It’s like, it’s awful. At max, you’re looking at maybe two to three hours a month for speech therapy on Medicaid’s approval. So, it’s just certain things, you know, you’re fighting. Like she was saying earlier, you’re fighting about whether or not are they doing it because the child really needs it, or is this a money issue? And the things that they really need, Medicaid isn’t covering.

Respondents expressed the need for access to a variety of services such as occupational therapy,

speech therapy, and behavior therapy, however, the funding needed for certain services was

limited and difficult to get approved.

Frustrations regarding Medicaid also included the fact that children typically needed to

have a mental health diagnosis in order to receive services. Case managers frequently had

Page 71: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

70

FINAL EVALUATION REPORT | Contract LHZ68

children on their caseload who exhibited behavioral issues, but lacked a diagnosis, thereby

precluding them from accessing services that could prevent the escalation of their condition.

While other funding sources for services exist, such funding was limited and respondents

expressed that they received considerable resistance from the case management agencies and the

CBC whenever they requested approval to pay for services that Medicaid did not cover.

Eligibility criteria reported by behavioral health providers varied somewhat by service type, but

most commonly, respondents reported that services required a mental health diagnosis, an

identified behavioral health concern, or a court order or referral, and were paid for through a

variety of funding sources, including Medicaid, DCF, and the managing entity. They could not

speak, however, to the process case managers had to go through to get services approved if they

were not Medicaid eligible.

Provider funding and resources. Another pressing issue raised by providers was being

understaffed, and a lack of adequate funding and resources to meet their staffing needs.

Respondents stressed that providers did their best within current resourcing to meet children’s

needs, but both foster parent and staff recruitment were significant issues. This was especially

true for Monroe County, where it was reported they struggled with staff shortages including a

shortage of licensed mental health clinicians, a limited number of service providers, and an

inability to provide compensation commensurate with the local cost of living. Furthermore,

agencies were still dealing with the impact of Hurricane Irma, which had resulted in substantial

housing loss and the relocation of considerable numbers of staff. As one respondent

summarized: “The number one thing is people. We need people. We need the therapists. We

need the case workers. We need the support coordinators. We need people.” It was reported

that it was difficult to attract and retain a skilled workforce in Monroe County because they were

Page 72: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

71

FINAL EVALUATION REPORT | Contract LHZ68

in the midst of a housing crisis, and lacked affordable housing options for the professionals they

desperately needed. They described a severe shortage of workers to manage the Key Largo,

Marathon, and especially Key West areas.

Challenges with staff shortages, and closely related, high turnover rates emerged as an

issue for Miami-Dade County as well. One of the driving factors reported by respondents was

inadequate compensation. It was noted that Medicaid reimbursement rates were extremely low,

and had not changed in many years, despite inflation and increasing costs of living. Providers

further observed that low Medicaid rates had the effect of suppressing private insurance

reimbursement rates, with private insurance companies increasingly “following suit.” In

addition, respondents noted that working with the foster care population was particularly

challenging due to the high level of trauma plus the requirements placed on providers by the

child welfare system. The end result was that providers were tasked with very challenging and

burdensome work for marginal pay, thus fueling staff burnout and high turnover. There was also

recognition that the same issues (high demand job coupled with poor compensation) exist for

case managers and must be addressed throughout the system.

The implications of staff shortages and frequent turnover, as described by providers,

were: (1) children lack consistency and must continually start over each time they get a new

therapist or case manager, which could result in a loss of progress that had been made, and (2)

overburdened staff may not get to know the children on their caseload particularly well, and

therefore cannot adequately assess or address the needs of those children. Thus, respondents

expressed a strong need to provide greater supports, including better compensation, to frontline

workers in order to retain a skilled workforce.

Page 73: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

72

FINAL EVALUATION REPORT | Contract LHZ68

Effectiveness. Additionally, case managers indicated concern regarding the effectiveness

of many children’s behavioral health services. Very few survey respondents (e.g. less than 15%)

rated the available services as highly effective for any of the behavioral health needs assessed.

Treatments for anxiety, mood, attachment, and attention deficit and hyperactivity disorders were

considered to be at least fairly effective by a majority of respondents. Even for these conditions,

however, a considerable proportion of respondents did not believe services were particularly

effective. Services perceived to be least effective included those for severe/complex trauma,

psychosis, disruptive behavior, conduct problems, victims of sexual abuse, children exhibiting

self-harming behaviors, victims of human trafficking, specialized therapeutic placements, and

residential care.

These findings should be interpreted with caution, since case managers do not necessarily

have the tools or knowledge to accurately assess the effectiveness of available treatment

interventions. In fact, during focus groups, case managers indicated a lack of knowledge or

awareness as to the availability of evidence-based treatment interventions, and generally did not

seem to have access to information about the effectiveness of particular service options. Their

perceptions of services tended to be based more on positive experiences with a given provider.

At the same time, their perceptions of service effectiveness likely impact referral decisions, and

therefore are extremely important.

Related to these findings, behavioral health providers expressed concern that case

managers lack a working knowledge of children’s mental health issues and the evidence base for

various treatment services, noting that this may impact whether and how they follow up on

assessment recommendations. As one provider observed,

It’s very difficult to make appropriate referrals if you’re not – if you don’t know what the child needs or if you don’t know what the services are… What specific evaluations are

Page 74: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

73

FINAL EVALUATION REPORT | Contract LHZ68

for, what specific therapies are for. Being trained in evidence-based therapy, being able to ask for evidence-based treatment, knowing how to determine if a child is making progress in the treatment.

This was reiterated by case managers during the focus groups, who expressed that, for the most

part, CBHAs did not provide recommendations for specific types of therapy or treatment models,

such as particular evidence-based practices. Findings from the case file reviews further

corroborated what was reported by providers and case managers; a minority of the cases

reviewed included recommendations in the CBHA for specific services or treatment modalities,

while the majority contained generic service recommendations such as ‘individual therapy’ or

‘family therapy.’ Providers also suggested that lack of awareness with regard to the services that

are available in the community may be a barrier. Case managers and foster parents may not be

aware of the full array of different service options available in the local community, which could

result in underutilization of some services that may be beneficial to children in licensed care.

Furthermore, the extent to which evidence-based treatments are available within the

community was another noted challenge. Behavioral health providers recommended that greater

emphasis be placed on training and certification in evidence-based and trauma-informed

practices. One provider voiced, “There’s a number of evidence-based models that aren’t actually

being used in Miami,” indicating that for families in foster care, access to evidence-based

practices may be limited. While some providers reported that staff at their agencies specialize in

particular evidence-based models and there are expectations around certification and use of those

models, they were less certain about how widespread such practices were throughout the service

system. Information gathered through the provider survey and review of provider websites

identified a number of evidence-based treatment modalities in use, as described above, but these

were reported by a relatively small number of providers compared to the overall provider

Page 75: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

74

FINAL EVALUATION REPORT | Contract LHZ68

network. Identification of specific trauma-based treatment modalities was especially limited.

Respondents recommended that all providers working with the child welfare population should

be trained in specific evidence-based trauma interventions.

Service Utilization Patterns for Children in Licensed Care

This final section examines behavioral health service receipt among the full sample of

children who received at least one behavioral health service while in out-of-home care during

calendar years 2016, 2017, and 2018. The analysis includes numbers of service encounters,

types of services, and service expenditures. Comparisons between Miami-Dade and Monroe

Counties were made when possible and appropriate to do so.

Child Characteristics. Table 17 contains the characteristics of the final sample of

children served in out-of-home care who received behavioral health services. The average age

was nine years old and there were slightly more females than males. The majority of children

were Black and came from single parent homes. Absence of care, neglect, and parental

substance abuse were the most common forms of maltreatment. Over 95% of the children live in

Miami-Dade County. Sixty-eight percent (3,125/4,604) of children receiving child welfare out-

of-home services in Miami-Dade received behavioral health services compared to 52.6%

(132/251) of children in Monroe County.

Table 17. Final Sample Characteristics Number of children % of children/Mean

Age 3,257 9.02

Child gender Female 1,668 51.2 Male 1,589 48.8

Child race Black 1,777 54.6 White 1,352 41.5

Page 76: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

75

FINAL EVALUATION REPORT | Contract LHZ68

Other 136 3.9

Family Structure Married Couple 349 10.7 Single Female 1,739 53.4 Single Male 169 5.2 Unmarried Couple 706 21.7 Unable to determine 294 9.0

Type of Maltreatment Sexual abuse 158 4.9 Physical abuse 456 14.0 Neglect 1,168 35.9 Absence of care 1,379 42.3 Domestic violence 467 14.3 Substance abuse problems 912 28.0

County Miami-Dade 3,125 96.0 Monroe 132 4.0

Diagnoses. The primary and secondary mental health diagnoses on each encounter were

used to establish the most frequent diagnoses received by each child15. The most frequent

mental health diagnosis was determined to be the child’s primary diagnosis, while the second

most frequent mental health diagnosis was determined to be the child’s secondary diagnosis. In

addition, it was determined whether the child had received a substance abuse diagnosis on any

encounter. Table 18 contains the profile of mental health diagnoses. Over 62% of the children

had a primary diagnosis of reaction to stress and/or adjustment disorder. Other primary

diagnoses included ADHD (13.2%), mood disorders (9.8%), and conduct disorders (9.4%). Fifty

percent of children had multiple mental health diagnoses, while 50% only had one mental health

diagnosis. Twelve percent of children had a reaction to stress and/or adjustment disorder as the

secondary diagnosis while 12.4% had ADHD as a secondary diagnosis. In other words, 12.4%

15 A diagnosis on a claim or encounter may be a confirmed diagnosis or a rule-out diagnosis (i.e., a suspected diagnosis to be confirmed or rejected based on assessment).

Page 77: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

76

FINAL EVALUATION REPORT | Contract LHZ68

of the children had reaction to stress and/or adjustment disorder as the second most frequent

diagnosis and another mental health condition as the most frequent diagnosis.

Table 18. Diagnostic profile for children in sample ICD-10 Diagnosis Codes Description

Primary diagnosis

Secondary diagnosis

% of children % of children F30-F39 Mood disorders 9.8% 9.2% F40-F41 Anxiety disorders 2.5% 3.2% F43 Reaction to severe stress, and adjustment disorders 62.2% 12.1% F90 ADHD 13.2% 12.4% F91 Conduct disorders 9.4% 7.0%

F93-F98 Other behavioral and emotional disorders with onset usually occurring in childhood and adolescence 2.3% 3.2%

F20-F29, F42, F48, F50-F59 Other mental health disorders 0.7% 2.2% Note. Not included in the percentages are 75 children that did not have a primary mental health diagnosis in the data.

Only 206 children had an encounter where the primary or secondary diagnosis was for a

substance abuse condition. Of the 206, 159 (77.2%) were for cannabis-related disorders (ICD-10

F12). The remaining 47 children had a substance abuse diagnosis that included alcohol, opioids,

cocaine, and nicotine but each diagnostic category had less than 10 children. Of course, it is

important to note that a diagnosis indicates meeting the criteria for abuse or dependence. The

lack of a diagnosis does not mean a lack of substance use. In addition, the low prevalence rate

likely reflects the young age of children in the sample.

Child Characteristics and Diagnoses by County. Table 19 contains child characteristics

for each county. The children in Miami-Dade County are more likely to be Black, while children

in Monroe County are more likely to be White (p<.001)16. Family structure also differs with a

16 Chi square statistics were computed to determine whether differences between Monroe and Miami-Dade Counties were statistically significant. In general, p values less than .05 are considered to be sufficient to conclude a statistically significant difference exists.

Page 78: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

77

FINAL EVALUATION REPORT | Contract LHZ68

higher proportion of households headed by single females in Miami-Dade (p<.001). Rates of

domestic violence were higher in Miami-Dade County (p=002), as were rates of absence of care

(p=.033). Rates of parental substance abuse were higher in Monroe County (p=.029).17

Table 19. Final Sample Characteristics by County Miami-Dade Monroe

n %/Mean n %/Mean

Age 3,125 9.0 132 9.7

Child gender Female 1,601 51.2 67 50.8 Male 1,524 48.8 65 49.2

Child race Black 1,752 56.1 25 18.9 White 1,254 40.1 98 74.2 Other 119 3.8 <10 6.9

Family Structure Married Couple 330 10.6 19 14.4 Single Female 1,685 53.3 54 40.9 Single Male 157 5.0 12 9.1 Unmarried Couple 681 21.8 25 19.0 Unable to determine 272 8.7 22 16.7

Type of Maltreatment

Sexual abuse 156 5.0 <10 -- Physical abuse 445 14.2 11 8.3 Neglect 1,121 35.9 47 35.6 Absence of care 1,335 42.7 44 33.3 Domestic violence 461 14.8 <10 -- Substance abuse problems 864 27.7 48 36.4

Table 20 contains the diagnostic profile for Miami-Dade and Monroe counties. The

profiles included more categories for Miami-Dade County due to the much larger sample size.

17 The rate of parental substance abuse denotes the reason for child welfare service was reported as parental substance abuse. This will be an underestimate of the number of parents with substance abuse as parents with substance abuse may enter the child welfare system for other reasons such as neglect.

Page 79: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

78

FINAL EVALUATION REPORT | Contract LHZ68

For Monroe County, the number of children with anxiety disorders, conduct disorders, and other

behavioral and emotional disorders was small and these diagnoses were aggregated into an

‘other’ category. Similar proportions of children were diagnosed with mood disorders, reaction

to stress or adjustment disorder, and attention deficit hyperactivity disorder (ADHD) in Monroe

and Miami-Dade Counties.

Table 20. Diagnostic Profile by County

Miami-Dade Monroe

ICD-10 Diagnosis Codes Description Primary diagnosis

Secondary diagnosis

Primary diagnosis

Secondary diagnosis

% of children

% of children

% of children

% of children

F30-F39 Mood disorders 9.4% 8.9% 9.1% 8.3%

F40-F41 Anxiety disorders 2.4% 3.1% -- --

F43 Reaction to severe stress, and adjustment disorders 59.8% 11.9% 65.9%

-- F90 ADHD 12.6% 11.8% 18.2% 6.1%

F91 Conduct disorders 9.2% 6.8% -- --

F93-F98

Other behavioral and emotional disorders with onset usually occurring in childhood and adolescence

2.3% 3.2% -- --

Other Other mental health disorders 4.2% 2.4% 6.8% 27.2%

Page 80: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

79

FINAL EVALUATION REPORT | Contract LHZ68

Behavioral health services. Results reported in this section include the number of

children receiving different types of behavioral health services, the number of behavioral health

service encounters, total expenditures on behavioral health services as well as expenditures per

user, and differences in service utilization and expenditures by child characteristics. Throughout

the remainder of the analysis, reported behavioral health services and expenditures include all

behavioral health services received while the child was receiving child welfare out-of-home care

in SFY 2016-2018.18

Number of children and service encounters19 by type of behavioral health service. Table

21 contains the number of children receiving different behavioral health services. Throughout

the discussion of services, the much larger sample size for Miami-Dade allowed for greater detail

in reporting of services. All 132 children in Monroe County received assessment services during

out-of-home child welfare services. Eighty-seven percent of children received at least one

outpatient behavioral health service and 72 (54.5%) received at least one medical service that

had a primary behavioral health diagnosis. Despite only 12 (9.0% of the 132 children) children

receiving residential treatment services, residential services accounted for $671,329 in

expenditures representing 53.2% of all expenditures.

In Miami-Dade County, 2,876 children (92.0% of the 3,125 children) received at least

one assessment service, while 2,183 (69.8%) received at least one service in-home or on-site and

2,266 (72.5%) received at least one outpatient service. Similar to Monroe County, 7.7% of

18 In other words, the child is the unit of observation and the time frame for examining services received by a child varies between one month and 36 months. 19 This analysis reports the number of claims/encounters in the data, which represents an approximation of the number of services. For example, a youth with a SIPP stay will typically have one record per day in SAMHIS, and one record per week (or month) in Medicaid data. In addition, some services (particularly residential services) may be partly paid by Medicaid and partly paid through SAMH funding. Thus, there may be records in multiple systems for a given service. .

Page 81: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

80

FINAL EVALUATION REPORT | Contract LHZ68

children in Miami-Dade County received residential treatment services. Despite being a small

proportion of children, residential services accounted for $12,804,558 in expenditures or 35.3%

of all expenditures on behavioral health services.

The Medicaid program funded the majority of services, 87% of total expenditures in

Miami-Dade County and 82% of expenditures in Monroe County. Our Kids paid for 11.4% of

all expenditures in Miami-Dade County and 6.7% of total expenditures in Monroe County.

SAMH funding accounted for the remaining 1.5% of expenditures in Miami-Dade and 10.9% in

Monroe County.

Table 21. Number of Children Receiving Behavioral Health Services and Number of Encounters by Service

Monroe County Number of children Number of encounters Expenditures Assessment 132 579 93,676 Inpatient 12 113 44,874 Medical 72 709 24,496 Outpatient 115 5,107 296,826 Residential 12 1,348 671,329 Targeted Case Management (TCM) 42 788 32,613 Medicaid Pharmacy 48 713 42,129 Other <10 22 55,022 Total 132 9,379 1,260,967 Miami-Dade County Number of children Number of encounters Expenditures Assessment 2,876 12,563 1,740,488 Case Management 711 21,256 1,234,302 Crisis Stabilization 226 844 169,947 Crisis Support/Emergency 30 75 2,143 In-Home and On-Site Services Overlay 2,183 76,658 8,147,403 Inpatient 388 2,747 2,762,273 Intervention 170 2,023 69,247 Medical 1,270 7,448 362,165 Outpatient-Individual 2,266 41,440 3,838,648

Prevention 57 132 29,580

Page 82: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

81

FINAL EVALUATION REPORT | Contract LHZ68

Residential 240 53,182 12,804,558

Respite Services 156 517 1,855,816 Substance Abuse Detoxification 33 208 45,749

Incidental Expenses 49 148 134,427 Outpatient-Group 227 23,165 840,721 MH Comprehensive-Individual 81 1,038 478,050

Medicaid Pharmacy 799 12,057 364,253

Other 896 16,589 836,264

Alternative Therapy 117 2,052 516,289

Total 3,125 274,142 36,232,324 Notes. Residential treatment services includes Residential Treatment Centers, Statewide Psychiatric Inpatient Program (SIPP), Specialized Therapeutic Foster Care (STFC), Specialized Therapeutic Group Home (STGH) services.

Expenditures per user. While total expenditures give an idea of the scope of services

provided to all children, Table 22 contains average expenditures per user of a service and

average expenditures per child. In other words, the first column reports the average only for

children that received that particular service, while the second column reports average

expenditures across all children in samples (132 in Monroe County and 3,125 in Miami-Dade

County). Residential treatment services are by far the most costly, with average expenditures per

user of $55,944 in Monroe County and $53,352 in Miami-Dade County. Average expenditures

for outpatient services were $2,248 per child in out-of-home care in Monroe County, while in-

home and on-site services averaged $2,607 per child and individual outpatient services averaged

$1,228 per child in Miami-Dade County. Overall, average expenditures in Monroe County per

child that received behavioral health services were $9,552. Average expenditures in Miami-

Dade County per child that received behavioral health services were $11,594.

Table 22. Expenditures per user of service and per child

Monroe County (n=132) Expenditures per user of service Expenditures per user of behavioral

health services Assessment 710 710 Inpatient 3,740 340

Page 83: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

82

FINAL EVALUATION REPORT | Contract LHZ68

Medical 340 186 Outpatient 2,581 2,248 Residential 55,944 5,086 Targeted Case Management (TCM) 776 247 Medicaid Pharmacy 877 319 Other -- 416 Total 9,552 9,552 Miami-Dade County (n=3,125) Assessment 605 557 Case Management 1,736 395 Crisis Stabilization 752 54 Crisis Support/Emergency 71 1 In-Home and On-Site Services Overlay 3,732 2,607 Inpatient 7,119 884 Intervention 407 22 Medical 285 116 Outpatient-Individual 1,694 1,228 Prevention 519 9 Residential 53,352 4,097 Respite Services 11,896 594 Substance Abuse Detoxification 1,386 15 Incidental expenses 2,743 43 Outpatient-Group 3,703 269 MH Comprehensive-Individual 5,901 153 Medicaid Pharmacy 456 117 Other 933 267 Alt therapy 4,412 165 Total 11,594 11,594

Behavioral health expenditures by child characteristics. Table 23 contains the average

expenditures by child characteristics. Behavioral health service expenditures were higher for

older children. In Miami-Dade County, expenditures were slightly higher for boys than girls,

and were slightly higher for White than Black children. Expenditures were higher when the

child was a victim of sexual or physical abuse and were lower when there was domestic violence

or substance abuse in the household. Patterns were more challenging to interpret in Monroe

Page 84: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

83

FINAL EVALUATION REPORT | Contract LHZ68

County due to the much smaller sample size, averages can be influenced by outliers. For

example, the much higher expenditures for boys ($12,666 versus $6,532 for girls) likely reflects

a more frequent use of higher cost residential services (e.g., SIPP or STGH). With relatively few

people in each cell, one or two people using higher cost residential services can have a notable

impact on average expenditures.

Table 23. Average Expenditures by Child Characteristics Miami-Dade Monroe

Number of children Average expenditures Number of children Average expenditures Age

0-5 1,025 6,432 32 3,380 6-12 1,247 12,267 63 8,479 13+ 853 16,813 37 16,720 Child gender

Female 1,602 11,047 67 6,532 Male 1,523 12,619 65 12,666 Child race

Black 1,750 10,849 25 4,002 White 1,254 12,234 98 11,528 Other 121 12,448 <10 3,462 Family structure

Married Couple 330 10,143 18 12,238 Single Female 1,680 11,597 54 7,391 Single Male 157 17,166 12 30,212 Unmarried Couple 681 9,813 26 5,253 Unable to determine 277 14,525 22 6,398 Type of maltreatment

Sexual abuse 157 15,889 <10 6,575 Physical abuse 443 15,959 11 30,159 Neglect 1,121 12,875 46 5,498 Absence of care 1,356 11,184 44 14,021 Domestic violence 459 8,493 <10 1,221 Substance abuse problems 855 6,460 47 2,849

Page 85: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

84

FINAL EVALUATION REPORT | Contract LHZ68

Differences in average expenditures between Miami-Dade and Monroe Counties can

result from a combination of price and quantity. The cost of providing a service may differ

between Miami-Dade and Monroe and thus differences in expenditures may encompass a price

differential as well as a quantity difference. Table 24 shows the average expenditures reported

for all services except residential services. In addition, the average number of encounters per

child are reported to compare quantities of services between counties and across child

characteristics.

The number of behavioral health services and average expenditures increase with age. In

Miami-Dade the average increased from 52 encounters per child ages 0 to 5 to 91 for children

ages 13 and above. The increase was less dramatic in Monroe County, from 57 per child ages 0

to 5 to 70 for children ages 13 and above. While the average number of encounters did not

increase as dramatically, average expenditures increased by 87% (6,353/3,380) in Monroe

County when comparing the 0 to 5 age group with the 13 and above age group and 67%

(9,635/5,777) in Miami-Dade County.

Table 24. Average Expenditures by Child Characteristics – Non-Residential Services Miami-Dade Monroe

Number of children

Average number of encounters

Average expend ($)

Number of children

Average number of encounters

Average expend ($)

Age 0-5 1,025 52 5,777 32 57 3,380 6-12 1,247 73 7,447 63 58 3,911 13+ 853 91 9,635 37 70 6,353 Child Gender

Female 1,602 68 6,398 67 45 3,957 Male 1,523 74 8,651 65 77 4,993 Child Race Black 1,750 68 6,881 25 37 3,088 White 1,254 73 8,261 98 69 5,045 Other 121 81 8,487 <10 38 2,002

Page 86: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

85

FINAL EVALUATION REPORT | Contract LHZ68

Family Structure Married

couple 330 63 6,066 18 95 7,130

Single Female

1,680 73 7,825 54 54 3,336

Single Male

157 82 8,595 12 92 8,891

Unmarried couple

681 64 7,080 26 69 4,414

Unable to determine

277 75 7,612 22 24 2,714

Type of Maltreatment Sexual abuse

157 101 10,527 <10 92 6,575

Physical abuse

443 88 10,193 11 93 6,899

Neglect 1,121 77 8,303 46 81 5,056 Absence of

care 1,356 71 7,506 44 58 5,041

Domestic violence

459 60 6,027 <10 16 1,221

Substance abuse

855 51 4,772 47 52 2,849

Behavioral health services and expenditures by diagnosis. Average behavioral health

encounters and expenditures are reported by diagnosis in Table 25. Expenditures while in child

welfare out-of-home care averaged $31,698 for the 295 children with mood disorders in Miami-

Dade County (total expenditures of $9.4 million) and $27,711 for 12 children in Monroe County

(total expenditures of $332,527). Average expenditures for children with ADHD averaged

$23,069 in Miami-Dade County (n=394, total expenditures $9 million) and $13,905 for 24

children in Monroe County (total expenditures of $333,708).

The presence of multiple mental health diagnoses also has implications for service needs

and expenditures. Among children in Miami-Dade County, average expenditures are $19,205

for children with multiple diagnoses compared to $4,560 for children with one diagnosis. The

difference is even larger in Monroe County with average expenditures of $19,925 for children

with multiple diagnoses and $2,144 for children with one diagnosis.

Page 87: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

86

FINAL EVALUATION REPORT | Contract LHZ68

Table 25. Behavioral Health Expenditures by Diagnosis

Miami-Dade County Monroe County

Number of children

Average number of encounters

Average exp ($)

Total expenditure

s

Number of

children

Average number of encounters

Average exp ($)

Total expenditu

res Primary Mental Health Diagnosis

Mood disorders 295 167 31,698 9,350,899 12 125 27,711 332,527

Anxiety disorders 76 70 9,448 718,015 Reaction to severe stress, and adjustment disorders 1,868 61 5,918 11,055,207 87 48 4,589 399,257

ADHD 394 160 23,069 9,089,261 24 117 13,905 333,708

Conduct disorders 289 105 14,137 4,085,452 Other behavioral and emotional disorders with onset usually occurring in childhood and adolescence 72 61 9,043 651,066 Other mental health disorders 131 61 10,018 1,312,423 <10 97 21,720 195,476

Secondary Mental health Diagnosis No 1,622 45 4,560 7,396,515 77 28 2,144 165,120

Yes 1,503 135 19,205 28,865,809 55 131 19,925 1,095,848

Mood disorders 278 158 32,007 8,897,822 11 98 21,887 240,762

Anxiety disorders 96 97 8,648 830,166 Reaction to severe stress and adjustment disorders 371 111 14,553 5,399,219 <10 79 28,033 224,268

ADHD 370 132 16,265 6,018,205 Conduct disorders 213 139 16,772 3,572,450 Other mental health disorders 101 118 15,307 1,546,031 36 152 17,523 630,818

Other 74 233 35,161 2,601,916 Substance Abuse Diagnosis No 2922 81 9,402 27,473,484 126 70 9,588 1,208,098 Yes 203 202 43,295 8,788,840 <10 102 8,812 52,870

Page 88: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

Finally, the presence of a substance abuse diagnosis also has implications for average

expenditures. Among children in Miami-Dade County, average expenditures were $43,295 for

children with a substance abuse diagnosis compared to $9,402 for children without a substance

abuse diagnosis. Interestingly, in Monroe County, expenditures were lower for children with a

substance abuse diagnosis compared to children without a substance abuse diagnosis ($8,812

compared to $9,588), although the number of children with a substance abuse diagnosis was

quite small. The results in both counties are rather unexpected. The high costs in Miami-Dade

County are unexpectedly large because the diagnosis for most youth involved cannabis use. The

results in Monroe are unexpectedly small because regardless of the drug we would expect

substance abuse to increase the services provided to a child.

Behavioral health services and expenditures by year in child welfare. Behavioral health

services were examined for all children receiving out-of-home care in calendar years 2016-2018

in Miami-Dade and Monroe Counties. Some children entered out-of-home care in 2016-2018,

while others entered out-of-home care prior to 2016. Thus, some children were observed in their

first years of out-of-home care while others may have been in the tenth year of out-of-home care.

Average expenditures by year in child welfare service are reported in Table 26. For example, a

child entering out-of-home care on January 1st, 2016 and remaining in out-of-home care

throughout the sample time frame would have data in year 1, year 2, and year 3. Average

expenditures increased the longer a child was in out-of-home care. This reflects the relationship

between the severity of mental health conditions and the duration of out-of-home services. As

children with less severe conditions achieved permanency, the remaining children had higher

severity conditions and thus had high average expenditures.

Page 89: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

88

FINAL EVALUATION REPORT | Contract LHZ68

Table 26. Behavioral Health Expenditures by Year of Child Welfare Miami-Dade County Monroe County Year in child welfare out-of-home care

Number of children

Number of encounters

Average exp ($)

Number of children

Number of encounters

Average exp ($)

1 2,556 40 4,906 111 39 5,316 2 1,637 45 5,535 65 41 4,362 3 836 48 7,174 25 55 8,060 4+ 486 121 17,764 20 52 9,290

Behavioral health services and expenditures by placement in child welfare. Table 27

reports average encounters and expenditures for children based on placement. Once again, due

to the larger sample size, greater detail was reported for Miami-Dade County. Average

expenditures were highest when the initial placement was in a psychiatric hospital or residential

treatment center, and lowest when the youth was placed with a relative.

Table 27. Behavioral Health Expenditures by Placement Type Miami-Dade Monroe

Children Number of encounters

Average expenditures ($) Children

Number of encounters

Average expenditures ($)

Foster Home - Non-Relative 926 106 14,307 42 60 5,236 Residential Treatment Center 26 114 29,060 -- Correctional Placement 30 86 17,653 -- Non-Relative 252 53 5,727 -- Relative 1,035 49 5,209 37 49 2,352 Residential 746 116 14,379 40 103 18,969 Hospitalization Medical 43 65 10,402 -- Hospitalization Mental 56 225 57,336 -- Other 11 348 42,212 13 72 15,080 Note. For Miami-Dade County, other includes adoption placements and licensed care –other due to small sample sizes in each. For Monroe County, other includes adoption, licensed care-other, residential treatment center, correctional, non-relative, and hospitalization for medical or mental health care.

Page 90: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

89

FINAL EVALUATION REPORT | Contract LHZ68

The preceding tables have examined average behavioral health expenditures across child

characteristics, diagnoses, and the time in child welfare out-of-home placements. However, it

remains difficult to draw conclusions based on averages. Thus, the standard approach is to

perform a regression analysis that enables isolation of marginal effects while controlling for

other characteristics.

Regression results. Table 28 contains the regression results that examine the

determinants of behavioral health expenditures. The first set of results examined a full model

while the second set of results examined a parsimonious model that focused only on statistically

significant effects.

The results suggest that relatively few factors are the primary determinants of behavioral

health expenditures. Children ages 6-12 have higher expenditures than children ages 13 and

above. Children in households with parental substance abuse receive fewer services than

children in households without identified parental substance abuse. The longer children receive

out-of-home care, the higher their behavioral health expenditures. Once again, this is unlikely a

causal relationship, and most likely reflects the greater severity of behavioral health problems

among children that do not achieve permanency. Behavioral health diagnoses are an important

determinant of expenditures. Children with mood disorders and ADHD tend to have the highest

expenditures. Children that have multiple mental health diagnoses have significantly higher

expenditures than children with a single mental health diagnosis. Children with substance abuse

disorders have average expenditures over $24,000 higher than children without substance abuse

disorders.

Page 91: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

90

FINAL EVALUATION REPORT | Contract LHZ68

Table 28. Regression Results: Determinants of Behavioral Health Expenditures Full Model Parsimonious Model Coef Std error p value Coef Std error p value Intercept -15551 3518 <.0001 -13658 1747 <.0001 Age (ref: age 13+) 0-5 2658 1611 0.0990 2244 1563 0.1512 6-12 4492 1456 0.0021 4311 1431 0.0026 Family Structure (ref: unmarried couple) Single Female -452 1337 0.7351 Single Male 2939 2575 0.2538 Married Couple -1226 1960 0.5316 Unable to determine 878 2065 0.6705 Gender (ref: male) Female -1093 1069 0.3066 Race (ref: White) Black -2241 1102 0.0422 Other -744 2742 0.7861 Type of Maltreatment Physical abuse 3146 1799 0.0804 DV -489 1536 0.7501 Sexual abuse 4350 2607 0.0954 Caregiver unavailable 831 1376 0.5462 Neglect 1024 1192 0.3905 Parental substance abuse -2688 1431 0.0623 -3485 1181 0.0032 County (ref: Monroe County) Miami-Dade County 2201 2668 0.4094 Year in child welfare Year in child welfare 6780 533 <.0001 6792 527 <.0001 Diagnosis (ref: acute reaction to stress and adjustment disorders F43)

Mood disorders (F30-F39) 12235 2010 <.0001 12011 2000 <.0001 Anxiety disorders (F40-F41) -1957 3456 0.5712 -1797 3447 0.6022 ADHD (F90) 8624 1662 <.0001 8799 1641 <.0001 Conduct disorder (F91) -2574 1948 0.1865 -2820 1930 0.1441 Other behavioral and emotional disorders with onset usually occurring in childhood and adolescence (F93) -1182 3626 0.7443 -1173 3620 0.7457 Other mental health disorder 6103 3099 0.0490 5904 3085 0.0558 Secondary Mental Health and Substance Abuse Diagnoses

Page 92: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

91

FINAL EVALUATION REPORT | Contract LHZ68

Secondary mental health diagnosis 7848 1145 <.0001 8049 1141 <.0001 Substance abuse diagnosis 24508 2368 <.0001 24682 2361 <.0001 Placement (ref: relative)

Foster home – non-relative 2587 1364 0.0581 2462 1346 0.0674 Residential treatment center 10899 6061 0.0722 11201 6035 0.0636 Correctional placement -3448 5568 0.5358 -3340 5549 0.5472 Non-relative -574 2046 0.7790 -785 2039 0.7001 Residential 2460 1475 0.0957 2245 1452 0.1223 Hospitalization – Medical 5727 4659 0.2191 5531 4644 0.2337 Hospitalization - Mental 34874 4067 <.0001 34481 4046 <.0001 Other 31179 10458 0.0029 30995 10428 0.0030 R squared 0.2143 0.2107 Number of children 3257 3257

Medicaid plan enrollment and service utilization. The Medicaid Statewide Medicaid

Managed Care (SMMC) program includes standard Medicaid Medical Assistance (MMA) plans

as well as specialty plans for children in child welfare, children’s medical services (CMS),

Medicaid recipients with serious mental illness, and HIV/AIDS. The specialty plan for children

in the child welfare system (CWSP) is currently managed by Sunshine Health. All children with

an open child welfare case become eligible for Medicaid and the CWSP upon their entry into the

child welfare system. Recipients may select a MMA plan other than the CSWP, however, those

who do not select a plan are automatically enrolled in the Sunshine CWSP. (For a more detailed

description of the CWSP and enrollment information, see

https://ahca.myflorida.com/medicaid/statewide_mc/pdf/mma/Specialty_Plans_110316.pdf).

Many children are enrolled in the Medicaid program prior to entering child

welfare services. Assignment to the Sunshine CWSP is automatic for children/parents

that did not select their MMA plan. However, assignment is not automatic when the

child/parent selected the MMA plan.

Page 93: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

92

FINAL EVALUATION REPORT | Contract LHZ68

This section of the report examines enrollment patterns in the months following

entry into out-of-home care as well as service utilization patterns in those months. The

analysis is limited to the 2,038 children that entered out-of-home care in CY 2016-2018.

Table 28 provides enrollment patterns in the month of removal as well as the following

three months. Most children were enrolled in standard MMA plans in the month that

they entered out-of-home care. Prior to entering out-of-home care, most children would

not have been eligible for a specialty plan and thus would have been enrolled in a

standard MMA plan. At some point in that month, when the child enters out-of-home

care, they become eligible for the specialty plan. However, the process of transitioning to

the Sunshine specialty plan takes time. The median length of time between entering out-

of-home care and the start of enrollment in the specialty plan was 45 days.

Approximately 24% of children were enrolled in the specialty plan in the month after

entering out-of-home care. This percentage increased to 66% in the second month and

74% in the third month.

Table 29 also looks at utilization patterns during the first few months. The table

includes all expenditures regardless of the funding source. In other words, service

utilization includes services paid by Our Kids, DCF Substance Abuse and Mental Health,

and Medicaid (including Medicaid fee-for-service, and all MMA plans including the

specialty plan). The percentage of children receiving any behavioral service does not

differ much between children in the specialty plan and children in standard MMA plans.

The highest percentages are in the month after entering out-of-home care when many

children would be receiving their Comprehensive Behavioral Health Assessment

(CBHA). However, differences between the specialty plan and standard MMA plans are

Page 94: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

93

FINAL EVALUATION REPORT | Contract LHZ68

observed for the number of services provided and service expenditures. Among children

receiving any behavioral health services in that month, children in the Sunshine Specialty

plan tended to receive more services than children enrolled in standard MMA plans. In

addition, expenditures were higher for children in the specialty plan.

Table 29. Service Penetration and Utilization by Month and Medicaid Plan Month of removal Month after removal 2 months after 3 months after

Sunshine CW Plan

Other MMA Plan

Sunshine CW Plan

Other MMA Plan

Sunshine CW Plan

Other MMA Plan

Sunshine CW Plan

Other MMA Plan

Children 160 1,875 488 1,535 1,355 674 1,480 532

Received Any BH service

# that received any BH service 77 596 381 1,231 851 405 908 315

% that received any BH service 48% 32% 78% 79% 63% 61% 61% 59%

Number of services

Mean among users 4.66 2.37 5.17 2.99 6.02 4.46 6.17 4.70 Median among users 3 1 3 2 4 3 4 3

Expenditures

Mean among users 592 495 988 671 698 523 727 624 Median among users 233 233 727 630 317 147 293 159

Page 95: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

94

FINAL EVALUATION REPORT | Contract LHZ68

Differences in service use and expenditures can be driven by a few high utilizers of

expensive residential services. Table 30 reexamines the utilization of services, limiting services

to those considered to be non-residential children’s services (see

https://www.myflfamilies.com/service-programs/samh/samhis/155-2-v10/c11v10.pdf for a list

of cost centers defined as non-residential children’s services).20 A very similar pattern is

observed, with small differences in the proportion of children receiving services, and more

substantive differences in the number of expenditures and average expenditures among children

receiving services.

Table 30. Non-residential Service Penetration and Utilization by Month and Medicaid Plan Month of removal Month after removal 2 months after 3 months after

Sunshine CW Plan

Other MMA Plan

Sunshine CW Plan

Other MMA Plan

Sunshine CW Plan

Other MMA Plan

Sunshine CW Plan

Other MMA Plan

Children 160 1875 488 1,535 1,355 674 1,480 532

Community Services

# that received any BH service 73 522 372 1,211 840 386 874 307

% that received any BH service 46% 28% 77% 78% 62% 57% 59% 58%

Number of services

Mean among users 3.75 2.06 4.16 2.61 5.01 4.04 5.05 4.33 Median among users 3 1 3 1 4 3 4 3

Expenditures

Mean among users 457 393 852 595 538 388 483 312 Median among users 226 160 727 630 311 147 293 146

20 Children’s non-residential services include: Assessment, Case Management, Day/Night, In-Home/On-Site, Intensive Case Management, Intervention, Medical Services, Outpatient (Individual & Group), Respite Services, Supported Employment, Supported Housing/Living, Incidental Expenses, Aftercare/Follow-up, Information and Referral, BHOS, Aftercare – Group, Intervention Group.

Page 96: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

95

FINAL EVALUATION REPORT | Contract LHZ68

Table 31 contains the same statistics for residential services. While based on a much

smaller number of children that use services, the pattern of a higher number of services for

children in the specialty plan was also found for residential services. No clear pattern was found

for expenditures, which can easily be driven by one or two outliers.

Table 31. Inpatient/Residential Service Penetration and Utilization by Month and Medicaid Plan

Month of removal Month after removal 2 months after 3 months after

Sunshine CW Plan

Other MMA Plan

Sunshine CW Plan

Other MMA Plan

Sunshine CW Plan

Other MMA Plan

Sunshine CW Plan

Other MMA Plan

Children 160 1,875 488 1,535 1,355 674 1,480 532

Inpatient/Residential/Crisis Services

# that received any BH service 5 37 17 44 39 22 49 16

% that received any BH service 3.13% 1.97% 3.50% 2.80% 2.90% 3.50% 3.30% 3.00%

Number of services

Mean among users 12 3.43 18.23 4.34 14.33 3.13 14.36 2.56 Median among users 6 2 22 2 4 1 5 2

Expenditures

Mean among users 1,076 1,986 3,197 3,226 2,476 388 4,158 5,211 Median among users 815 311 3,667 2,916 910 147 4,074 2,917

Page 97: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

96

FINAL EVALUATION REPORT | Contract LHZ68

Service utilization based on children’s needs. As described previously, records were

reviewed for a sample of 165 children to identify service needs. Children were placed in groups

based on the findings of this review and the service recommendations in the child’s record. Five

groups were identified: children with no service recommendations, children with one

recommended service, children with two recommended services, children with 3 or more

services recommended, and children with a higher level of care need (e.g., residential treatment).

Given that behavioral health services were only examined in CY 2016-2018, we

restricted the sample to the 101 children who entered out-of-home care in CY 2016-2018 for

whom we were able to gather data on service recommendations. The remaining 64 children

either entered out-of-home care prior to January 1, 2016 or did not have clear service

recommendations. Data are presented by level of service recommendations. Sample size

considerations prevent looking at more refined groupings (e.g., a combination of age and service

recommendations).

Table 32 contains the number of children by level of recommended service, the

percentage of children that received any behavioral health service, and average per child

expenditures (represents total expenditures during the out-of-home episode). For each level of

need, all children received at least one behavioral health service. Expenditures increased as the

level of need increased.

Table 32. Percentage of children that received any behavioral health service and average expenditures

Number of children Users of services % Mean $ Median $ No services recommended 12 12 100.0% 1,567 715 1 service recommended 29 29 100.0% 2,929 1,657 2 services recommended 33 33 100.0% 3,180 2,672 3+ services or TBOS 24 24 100.0% 16,969 5,870 High level of need 3 3 100.0% 31,244 11,049

Page 98: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

97

FINAL EVALUATION REPORT | Contract LHZ68

In Table 33, service utilization was examined by level of need. Services are classified as

assessment, non-residential, residential, and other (includes medications, lab services, durable

medical equipment, and transportation services). With the exception of one child with a high

level of need, all children received at least one assessment service. Most children received non-

residential services; although 4 children with one recommended service, 1 child with 2

recommended services, and 1 child with 3+ recommended services did not receive any non-

residential services. Among children without a higher level of need, non-residential services

were received by most children; children with greater needs received more services. Among the

three children with a higher level of need, only one received any residential services. In

addition, while the average expenditures for non-residential services were quite high for children

with a higher level of need, most of these costs were for in-home respite services and not direct

behavioral health treatment.

Table 33. Service utilization by level of service need Assessments Non-residential Residential Other

Number of Children

Cost per child

Number of children

Cost per child

Number of children

Cost per child

Number of children

Cost per child

No services recommended (n=12) 12 600 5 2,200 1 325 3 91 1 service recommended (n=29) 29 667 28 1,978 0 0 11 925 2 services recommended (n=33) 33 629 32 2,614 0 0 10 51 3+ services or TBOS (n=24) 24 780 23 8,076 8 19,294 12 4034 High level of need (n=3) 2 1,607 3 7,251 1 64,797 2 1,982

Evidence on the time until treatment is provided in Table 34. The mean and median

length of time between the date of entry into out-of-home care and the assessment date reported

Page 99: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

98

FINAL EVALUATION REPORT | Contract LHZ68

in the claim/encounter is reported. The median number days suggests that most children

received their assessment within 30 days. However, the mean number of days is larger than the

median, suggesting that some children have much longer waits before receiving services. One

caveat is that we cannot determine whether a provider used a non-assessment procedure code

when submitting the encounter. There is a possibility that some youth with longer wait times

had received a prompt initial assessment, and the data are capturing a follow-up assessment.

Table 34. Number of days until assessment Children Children with assessments Mean days Median days

No services recommended 12 12 112 30 1 service recommended 29 29 25 25 2 services recommended 33 33 47 30 3+ services or TBOS 24 24 60 27 High level of need 3 2 20 20

Another perspective is to examine the length of time between entering out-of-home care

and the data of the first service received by the child. Interestingly, many children received

behavioral health services before the assessment was completed (or at least the date reported on

the encounter). The median number of days ranged from 15 (higher level of need) to 29 (no

recommended services, 2 recommended services).

Table 35. Number of days until first non-assessment service

Children Children with non-assessment

services Mean days Median days No services recommended 12 12 50 29 1 service recommended 29 29 20 23 2 services recommended 33 33 36 29 3+ services or TBOS 24 24 36 26 High level of need 3 2 15 15

Page 100: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

99

FINAL EVALUATION REPORT | Contract LHZ68

Table 35 examined the length of time until the child received their first non-assessment

service. However, evidence-based practices typically require regular therapeutic services. In

Table 36, we report the median number of days between the first ten non-assessment services.

As reported above, the median number of days before the first non-assessment service ranged

from 15-29 days across the levels of need. After the first 2-3 services, the median time between

services stabilized at one week. Thus, the number of days between services are consistent with

many evidence-based therapeutic services. The greater concern might be the number of services

some children received. For example, across the levels of need, the number of children started to

decline after only three services. Eleven of the 29 youth with one recommended service have

less than 10 service encounters. Similarly, 9 of the 33 children with two service

recommendations received less than 10 service encounters. However, firm conclusions cannot

be drawn. Treatment for adjustment disorders without trauma tends to be brief, and thus it is

conceivable that some children will only need limited therapeutic services.

Table 36. Number of days between services 1 service recommended 2 services recommended 3+ services or TBOS High level of need

Service Number of

children Median Number of

children Median Number of

children Median Number of

children Median 2 24 12 31 15 23 8 3 12 3 24 12 31 11 23 7 3 7 4 22 9 30 7 23 7 3 14 5 22 7 29 7 23 8 3 5 6 21 6 28 7 22 7 3 7 7 19 7 27 7 21 7 3 5 8 19 7 26 7 20 7 2 4 9 18 7 26 7 20 7 2 9

10 18 6 24 7 19 7 2 7 Number of children 29 33 24 3

Page 101: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

100

FINAL EVALUATION REPORT | Contract LHZ68

Discussion

Children who enter the foster care system often have complex needs and require

behavioral health services. It is therefore critical that child welfare systems have procedures in

place to ensure timely assessment of children’s behavioral health needs, identification of

appropriate services, cohesive coordination of care across agencies, and ongoing monitoring to

ensure children’s needs are met. Findings from this study indicate that the Department of

Children and Families, Sunshine Health, and Citrus Family Care Network have established

policies around how behavioral health needs should be assessed and how services should be

coordinated for children in licensed foster care, and that a large network of behavioral health

providers has been established to serve this population. There were, however, a number of gaps

identified that present barriers to children in licensed care receiving the services they need.

First, several concerns and discrepancies emerged with regard to assessment processes.

According to policy, all children who enter out-of-home care should be referred for a

Comprehensive Behavioral Health Assessment (CBHA) within seven business days of their

removal, assessments should be scheduled by providers within 72 hours of receipt of the referral,

and children should subsequently be connected to the services recommended in the CBHA

within 30 days of the assessment. Findings suggest that at times there are delays in this process.

Case managers reported that they encounter wait lists for getting assessments, and providers

confirmed that children may wait up to three weeks to receive a CBHA. This results in delays to

service planning and referrals, as case managers are largely dependent on the provider

recommendations.

There were also some concerns with regard to the quality of assessments, and particularly

the recommendations provided. Some case managers questioned how accurate and

Page 102: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

101

FINAL EVALUATION REPORT | Contract LHZ68

comprehensive the CBHAs actually were, since providers completed them fairly quickly and

having limited contact with the child (typically two hours). Providers also acknowledged that

completing a thorough assessment could be challenging if they were unable to speak with the

child’s biological parents or another knowledgeable caregiver. Thus, assessments at times must

be concluded with incomplete information.

Based on the case record reviews completed, CBHAs for the most part appeared to be

very detailed and comprehensive, however, the service recommendations were frequently

generic and rarely included recommendations for specific treatment modalities or evidence-based

treatments specific to the child’s particular needs. This was also reported as a challenge by case

managers, who depended on the CBHA to identify service needs, but found that the

recommendations provided were not specific enough and overwhelmingly recommended the

same basic set of services – individual therapy and psychiatric services. Furthermore,

recommendations for trauma-based therapeutic interventions were rare, despite the fact that

children in out-of-home care likely have incurred one or more traumatic experiences. While

17.6% of the children whose cases were reviewed were diagnosed with a trauma-related

disorder, only 10.3% were recommended for trauma-based treatment, and even fewer had a

recommendation for a specific evidence-based trauma intervention. Another disjuncture was

observed between the number of children diagnosed with a substance use disorder (n = 8) and the

number of children who received a recommendation for substance abuse treatment (n = 3).

Another identified gap, according to providers, was that children’s needs and services

were often approached from a child-focused rather than family-focused perspective. This

approach fails to understand the child’s needs within the context of the family, the ways in which

family dynamics contribute to the child’s needs, and the importance of involving the family in

Page 103: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

102

FINAL EVALUATION REPORT | Contract LHZ68

the child’s treatment. Case review findings found that fewer than one-third of children (31.5%)

were referred for family therapy, compared to 39% who were rated as having needs pertaining to

family relationships on the FFA-O. This may be an opportunity for improvement when service

recommendations are made in CBHAs and other mental health assessments to incorporate more

family therapy and family engagement in the child’s treatment.

Additionally, there were some discrepancies found between case manager and behavioral

health assessments of children’s needs in the case record reviews. Although the CBHAs that

were reviewed tended to be detailed and thorough, these assessments are completed when a child

first enters care, whereas mental health functioning and needs might become more evident or

exacerbated over time. Case managers have greater contact with children over an extended

period of time compared to mental health assessors, and therefore have greater opportunity to

identify needs. With regard to case managers, specifically, concern was expressed that workers

lack adequate knowledge and training on behavioral health assessments and treatment options.

While case managers were not expected to be experts in mental health, respondents expressed

that it was important for them to at least have some working knowledge of children’s mental

health issues and the evidence base for various treatment services, since they are the ones tasked

with following up on assessment recommendations and making service referrals. Enhanced

communication and coordination between child welfare and behavioral health providers would

help to improve consistency in assessments and facilitate identification of need.

Study findings indicate strong agreement overall about the need for greater cohesion,

communication, cooperation, and coordination across agencies and systems. This area of

identified need extended from the initial assessment process through the coordination of care for

children. A need for more frequent communication and information sharing, both between

Page 104: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

103

FINAL EVALUATION REPORT | Contract LHZ68

providers and across various system partners (e.g. case managers, GALs, attorneys, therapists,

and caregivers) was emphasized by providers. Case managers similarly reported that some of

the greatest challenges they faced in coordinating care were a lack of engagement and

cooperation from foster parents, lack of communication from providers, and expectations that

case managers transport children to and from appointments. Providers also emphasized a need

for cross-system training on trauma and children’s behavioral health. A more coordinated

approach to service provision, with various agencies working together as partners for the best

interest of the child, emerged as a clear need. While policies set by DCF, Sunshine Health, and

CFCN discuss coordination of care, a need for clearer guidelines on these processes and how

various agencies should work together was evident.

Respondents also expressed a need for greater inclusion of the family, either biological

and/or foster caregivers, in children’s mental health treatment and care coordination. Case

managers reported the lack of engagement from foster parents, particularly with regard to taking

children to appointments, was a substantial barrier. Furthermore, respondents indicated that

more comprehensive training on children’s mental and behavioral health issues for foster parents

would be beneficial, particularly training on behavior management.

Another significant gap identified through the study was with regard to the

documentation of children’s behavioral health needs and services. There were notable

discrepancies found between the review of DCF policy and the documentation contained in

FSFN. First, while the majority of children whose files were reviewed did have a completed

CBHA on file, a considerable portion of children (15%) did not, despite the requirement that

every child who enters out-of-home care receive a CBHA. For the vast majority of cases,

furthermore, CBHAs were not uploaded to FSFN, but were instead found in the Lead Agency’s

Page 105: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

104

FINAL EVALUATION REPORT | Contract LHZ68

ASK data system. The review also showed that FFAs did not consistently incorporate findings

and recommendations from the CBHA, nor was such information consistently documented in the

mental health section of FSFN. Findings indicate a strong need for consistent documentation

and the ability for tracking and notification of a child’s mental health functioning, needs,

recommended interventions, and status updates as a dynamic, ongoing, real time process

throughout a child’s involvement in child welfare. This would require enhanced coordination

between the CBC Lead Agency, case management agencies, behavioral health providers,

Sunshine Health, and DCF.

Several gaps were identified with regard to the availability and accessibility of behavioral

health services for children in licensed care. These included limited availability of specialized

and higher level of care services, especially in Monroe County, and limited availability of

services for children with serious conduct disorders, eating disorders, personality disorders,

gender or sexual identity issues, and victims of human trafficking. The utilization and

availability of specific evidence-based and trauma-informed interventions also appeared to be

limited, as was the availability of home- and school-based treatment services. Concerns about

the lack of evidence-based treatments, or limited effectiveness of available services, were

expressed by both providers and case managers. Wait lists were another commonly reported

challenge, which created delays in accessing services or in some cases resulted in children

receiving less appropriate services in an effort to provide something while they waited for the

recommended services. Limited funding and resources were also a significant barrier, which

made it difficult for providers to recruit and retain qualified staff when they were unable to

provide adequate compensation. Finally, eligibility criteria established by primary funding

Page 106: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

105

FINAL EVALUATION REPORT | Contract LHZ68

streams such as Medicaid may limit access to early intervention for children who have mild to

moderate behavioral health needs that do not yet warrant a mental health diagnosis.

Some additional potential gaps in services were also identified through the analysis of

service utilization patterns. First, Medicaid encounter/claims data did not show that all children

received assessments within a month of entering out-of-home care. This also corresponds with

the findings from the case record reviews, which also found some children lacked evidence of a

CBHA. While it is possible the findings merely reflect a lack of complete encounter data, the

Department should ensure that assessments are completed for all children entering out-of-home

care. Another identified gap was that some children with identified service needs did not receive

any non-assessment services. For example, four children with one recommended service, one

child with two recommended services, and one child with three or more recommended services

did not receive any treatment services.

The findings also suggest that children with the highest level of need may require greater

monitoring. Of three children identified with a need for a higher level of care, only one received

inpatient/residential treatment services and the majority of their non-residential costs involved

in-home respite services instead of therapeutic services. Finally, while most children with

identified needs received regular, ongoing services, some children with identified needs received

only a few services. It could not be determined whether the provided services were or were not

adequate to address the child’s needs, or what the reason was for termination of services, but the

very short duration of services for some children (e.g. less than one month) does not appear to be

in accordance with generally recognized best practice.

Page 107: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

106

FINAL EVALUATION REPORT | Contract LHZ68

Recommendations

Based on the gaps identified through this study, the following policy and practice

recommendations are offered to improve the assessment of children’s behavioral health needs,

array of children’s behavioral health services, and coordination of care for children in licensed

foster care. While the recommendations made are specific to findings for the Southern Region,

some of the recommended changes, such as those pertaining to FSFN documentation or

suggestions for monitoring treatment progress, would ideally be implemented at a statewide

level. Recommendations are as follows:

• Require an expedited process for enrollment into the Sunshine Child Welfare Specialty Plan

(CWSP) to reduce the length of the transition period. Most children entering out-of-home

care are eligible for the Medicaid program and are enrolled in either the CWSP or a standard

MMA plan. Given the rules on plan enrollment, it can take weeks if not months for a child to

be enrolled in the CWSP. One option is for an enrollment change from a standard plan to the

specialty plan to become effective immediately instead of the following month. Another

option involves making the transfer from a standard MMA plan to the specialty plan

automatic (i.e., become the default), with the option of remaining in the standard MMA

plan. Such steps would reduce the time between entering out-of-home care and enrollment in

the specialty plan.

• Since the current study only examined the policies of the Sunshine CWSP, but found that a

considerable number of children were enrolled in other MMA plans, the Department should

further explore the other plans to assess their approach to the child welfare population and

how these plans compare to the specialty plan. Expenditure data indicate that children

Page 108: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

107

FINAL EVALUATION REPORT | Contract LHZ68

enrolled in the CWSP received a greater number of services compared to children in standard

MMA plans, which could reflect differences in policies, but further study is necessary.

• The Department of Children and Families and the Agency of Health Care Administration

need to work together to develop better monitoring of children in the child welfare system.

Systems are in place to enroll a child in a Medicaid managed care plan once they have an

open case in FSFN. These same systems should be expanded to provide the Department of

Children and Families with monthly updates of encounter data received by AHCA from

managed care plans. FSFN currently does not have information on child service needs.

Variables capturing such needs should be developed and be a mandatory field in FSFN. This

would enable a matching of FSFN data with Medicaid data, and the development of

algorithms to flag children who are not receiving recommended services. This would be a

clear important step in identifying any children who do not receive prompt assessments, who

do not receive services, or whose services are not aligned with recommended needs.

• A strong reinforcement for CBC Lead Agencies and Case Management Organizations to

adhere to contract language requirements for FSFN data entry, including but not limited to

the CBHA and treatment updates.

• A policy change that allows for the CBHA information to be entered in FSFN rather than

uploaded as a PDF. This change will allow the Department, Lead Agencies, and CMOs to

use CBHA data to track outcomes and receipt of recommended services.

• A policy change that requires reassessment of children who receive a mental health diagnosis

to determine if the symptoms have improved, require ongoing treatment, or have manifested

into more serious mental health needs. All subsequent mental health assessments and

recommendations should be uploaded into FSFN.

Page 109: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

108

FINAL EVALUATION REPORT | Contract LHZ68

• The study team could not find that Sunshine Health has clinical guidelines or practice toolkits

for their providers specific to behavioral health needs of children other than for ADHD. As

possible, Sunshine Health should move toward making available practice guidelines for

Child Welfare Specialty Plan behavioral health providers specific to the behavioral health

needs and disorders found in children and specifically adjustment disorder, given its high

prevalence in the population.

• A practice change that requires behavioral health providers to use a multi-disciplinary team

approach, with team meetings at regular intervals to review cases, assess progress, and

identify new or ongoing service needs.

• A policy change to increase training on children’s mental and behavioral health issues for

foster parents, with attention to strategies for behavior management. Move toward a

philosophical shift from seeing foster homes as placements to foster parents as an essential

part of the child’s treatment intervention team.

• Expand and diversify the service array by engaging smaller community organizations, in

addition to the larger agencies. Engaging smaller organizations in the provider network

could help to fill some of the gaps or provide more individualization of services than larger

agencies are able to offer.

• Expand the service array in Monroe County, especially for higher level of care services.

• Expand the availability of services for children with serious conduct disorders, eating

disorders, personality disorders, gender or sexual identity issues, and victims of human

trafficking.

• Expand the availability of specific evidence-based and trauma-informed interventions and

expand case managers’ knowledge of the currently available services.

Page 110: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

109

FINAL EVALUATION REPORT | Contract LHZ68

• Expand eligibility criteria established by primary funding streams such as Medicaid to access

early intervention for children who have mild to moderate behavioral health needs that do not

yet warrant a mental health diagnosis.

• The Department should ensure that assessments are completed for all youth entering out-of-

home care.

• Increase the level of specificity provided in the CBHA and other assessments regarding

recommendations for specific treatment modalities or evidence-based treatments specific to

the child’s particular needs.

• Policy that looks more closely at CBHAs involving children with a substance use disorder,

ensuring that appropriate recommendations to substance abuse treatment are made.

• To enhance the well-being of the family, policies are needed that include requirements for

family therapy.

• To enhance child well-being, policies and contracts should require family involvement in

therapeutic services for the child.

• Enhanced training for child welfare frontline staff to identify behavioral health needs.

Page 111: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

110

FINAL EVALUATION REPORT | Contract LHZ68

References

American Academy of Pediatrics, District II Task Force on Health Care for Children in Foster

Care (2005). Fostering health: Health care for children and adolescents in foster care (2nd

edition). Lake Success, NY: American Academy of Pediatrics.

Barbel, P. (2020). Addressing health needs of children in foster care. Nursing 2020, 50(3), 18-20.

Briggs, E. C., Fairbank, J. A., Greeson, J. K. P., Steinberg, A. M., Amaya-Jackson, L. M.,

Ostrowski, S. A., … & Pynoos, R. S. (2012). Links between child and adolescent trauma

exposure and service use histories in a national clinic-referred sample. Psychological

Trauma: Theory, Research, Practice, and Policy, 5, 101-109.

Center for Mental Health Services (CMHS) & Center for Substance Abuse Treatment (CSAT)

(2013). Diagnoses and health care utilization of children who are in foster care and

covered by Medicaid. U. S. Department of Health and Human Services, Substance Abuse

and Mental Health Services Administration.

Deutsch, S. A., Lynch, A., Zlotnik, S., Matone, M., Kreider, A., & Noonan, K. (2015). Mental

health, behavioral and developmental issues for youth in foster care. Current problems in

pediatric and adolescent health care, 45(10), 292-297.

Geen, R., Sommers, A., & Cohen, M. (2005). Medicaid spending on foster children. The Urban

Institute. Available at:

http://webarchive.urban.org/UploadedPDF/311221_medicaid_spending.pdf

Greeson, J. K. P., Briggs, E. C., Kisiel, C. L., Layne, C. M., Ake, G. S., Ko, S. J. … & Fairbank,

J. A. (2011). Complex trauma and mental health in children and adolescents placed in

foster care: Findings from the National Child Traumatic Stress Network. Child Welfare,

90(6), 91-108.

Page 112: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

111

FINAL EVALUATION REPORT | Contract LHZ68

Harman, J. S., Childs, G. E., Kelleher, K.J. (2000). Mental health care utilization and

expenditures by children in foster care. Archives of Pediatric & Adolescent Medicine,

154(11), 1114-1117.

Inkelas, M. & Halfon, N. (2002). Medicaid and financing of health care for children in foster

care: Findings from a national survey (Policy Statement No. 1). Los Angeles: University

of California, Los Angeles, Center for Healthier Children, Families and Communities.

Jee, S. H., Conn, A., Szilagyi, P. G., Blumkin, A., Baldwin, C. D., & Szilagyi, M. A. (2010).

Identification of social-emotional problems among young children in foster care. Journal

of Child Psychology and Psychiatry, 51(12), 1351-1358.

Johnson, M., Robst, J., Cruz, A., Sowell, C., Vargo, A., Anderson, R., & Carmona, Y. (2019).

Southern Region Gap Analysis Utilization Pattern and Service Usage Report. Tampa, FL:

Department of Child and Family Studies, University of South Florida.

Kerns, S. E. U., Pullman, M. D., Putnam, B., Buher, A., Holland, S., Berliner, L., … & Trupin,

E. W. (2014). Child welfare and mental health: Facilitators of and barriers to connecting

children and youths in out-of-home care with effective mental health treatment. Children

and Youth Services Review, 46, 315-324.

Landsverk, J. (2017). Beyond common sense: Child welfare, child well-being, and the evidence

for policy reform. Routledge.

Lehmann, S., Havik, O. E., Havik, T., & Heiervang, E. R. (2013). Mental disorders in foster

children: a study of prevalence, comorbidity and risk factors. Child and adolescent

psychiatry and mental health, 7(1), 39.

Page 113: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

112

FINAL EVALUATION REPORT | Contract LHZ68

Leslie, L.K., Hurlburt, M.S., Landsverk, J., Rolls, J.A., Wood, P.A., & Kelleher, K.J. (2003).

Comprehensive assessments for children entering foster care: A national perspective.

Pediatrics, 112, 134-142.

Lohr, W. D., Davis, D. W., Rich, C. A., Ryan, L., Jones, V. F., Williams, P. G., ... & Brothers, K.

B. (2019). Addressing the mental healthcare needs of foster children: perspectives of

stakeholders from the child welfare system. Journal of public child welfare, 13(1), 84-

100.

National Institute of Mental Health (NIMH) (2019). Mental Illness. Retrieved from:

www.nimh.nih.gov/health/statistics/mental-illness.shtml#part_154788.

Oswald, S. H., Fegert, J, M., & Goldbeck, L. (2010). Posttraumatic stress symptoms in foster

children following maltreatment and neglect. Verhaltenstherapie, 20(1), 37-44.

Ringeisen, H., Stambaugh, L., Bose, J., Casanueva, C., Hedden, S., Avenevoli, S. … & West, J.

(2017). Measurement of childhood serious emotional disturbance: State of the science

and issues for consideration. Journal of Emotional and Behavioral Disorders, 25(4),

195–210.

Simms, M. D., Dubowitz, H., & Szilagyi, M. A. (2000). Health care needs of children in the

foster care system. Pediatrics, 106(Suppl.), 909-918.

Simms, M. D., Madelyn, F., Battistelli, E. S., & Kaufman, N. D. (2018). Delivering health and

mental health care services to children in family foster care after welfare and health care

reform. In Family Foster Care in the Next Century (pp. 167-184). Routledge.

Sullivan, D. J. & van Zyl, M. A. (2008). The well-being of children in foster care: Exploring

physical and mental health needs. Children and Youth Services Review, 30, 774-786.

Page 114: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

113

FINAL EVALUATION REPORT | Contract LHZ68

Szilagyi, M. A., Rosen, D. S., Rubin, D., & Zlotnik, S. (2015). Health care issues for children

and adolescents in foster care and kinship care. Pediatrics, 136(4), e1142-e1166.

Tarren-Sweeney, M. (2017). Rates of meaningful change in the mental health of children in

long-term out-of-home care: A seven-to nine-year prospective study. Child abuse &

neglect, 72, 1-9.

Turney, K., & Wildeman, C. (2016). Mental and physical health of children in foster

care. Pediatrics, 138(5).

United States Census Bureau (2018). Quick Facts: Miami-Dade County, Florida.

www.census.gov/quickfacts/miamidadecountyflorida.

United States Census Bureau (2018b). American Fact Finder: Monroe County, Florida.

www.census.gov/quickfacts/monroecountyflorida.

Page 115: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

114

FINAL EVALUATION REPORT | Contract LHZ68

Appendix A

Data Collection Protocols

Page 116: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

115

FINAL EVALUATION REPORT | Contract LHZ68

FSFN ID#____________________ Case File Review Protocol Child Welfare Case Management (FSFN) File Review

Date of Case Review _____ / ____ / _____ Reviewer Name: ___________________________

1. Case Management Agency: ___________________________

2. Date case open to out-of-home care: _____/_____/_____

3. Date case open to case management agency: _____/_____/_____

4. Date case closed to case management agency: _____/_____/_____ N/A Child’s case still open to case management agency

4. Gender of Child: Female Male 5. Child DOB: _________

6. Type of Placement: Licensed Foster Home Relative Non-Relative Residential Group Home Specialized Therapeutic Foster Home Specialized Therapeutic Group Home Statewide Inpatient Psychiatric Program (SIPP) Other ___________________________

7. Type(s) of maltreatment identified in child welfare file:

7a. ___________________________ 7c. __________________________ 7e. __________________________ 7b. ___________________________ 7d. ___________________________ 7f. ___________________________

8. Mental Health Diagnosis identified in child welfare file:

8a. ___________________________ 8b. ___________________________ 8c. ___________________________

Source of Diagnosis (if identified) N/A Diagnosis not in file

___________________________ ___________________________ ___________________________

Page 117: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

116

FINAL EVALUATION REPORT | Contract LHZ68

Child Welfare Assessments

9. Family Functioning Assessment – Investigation (FFA-I) Date completed ___ / ____ / ____

Sources of information for FFA-I:

FFA-I includes an assessment of child’s functioning: Yes No FFA-I includes an assessment of child’s needs: Yes No The description of functioning and needs is adequate to determine the child’s behavioral health needs? Yes No Reviewer’s comments:

10. Family Functioning Assessment - Ongoing (FFA-O) Date completed ___ / ____ / ____ N/A Not completed

Sources of information for FFA-O:

FFA-O includes an assessment of child’s functioning: Yes No FFA-O includes an assessment of child’s needs: Yes No The description of functioning and needs is adequate to determine the child’s behavioral health needs? Yes No Reviewer’s comments:

11. Progress Updates were completed every 90 days after approval of FFA-O, or more frequently if needed Yes No

Sources of information for Progress Updates:

Progress Updates include an updated assessment of child’s functioning: Yes No Progress Updates include an updated assessment of child’s needs: Yes No The description of functioning and needs is adequate to determine the child’s behavioral health needs? Yes No Reviewer’s comments:

Page 118: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

117

FINAL EVALUATION REPORT | Contract LHZ68

Family Functioning Assessment: Child Need Indicators

12. In the fields below document the Child Need Indicator ratings (A-D) for each category as identified on the FFA-Investigations, FFA-Ongoing and the most recent FFA Progress Update

Emot

iona

l/ Tr

aum

a

Beha

vior

al

Dev

elop

men

t

Educ

atio

n

Phys

ical

/Hea

lth

/Dis

abilit

y

Fam

ily

Rel

atio

nshi

ps

Peer

/Adu

lt R

elat

ions

hips

Cul

tura

l Ide

ntity

Subs

tanc

e Aw

aren

ess

Life

Ski

lls

Dev

elop

men

t

FFA-Investigations Date completed ___ / ____ / ____

FFA-Ongoing Date completed ___ / ____ / ____

FFA Progress Update Date completed ___ / ____ / ____

13. List the name and date of completion of all other Mental Health Related assessments of the child included in the child welfare file

Name of assessment Completed by Date of assessment:

___ / ____ / ____

___ / ____ / ____

___ / ____ / ____

___ / ____ / ____

___ / ____ / ____

___ / ____ / ____

___ / ____ / ____

Page 119: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

118

FINAL EVALUATION REPORT | Contract LHZ68

___ / ____ / ____

___ / ____ / ____

Case Planning

14. Is there evidence that Case Planning Conferences included planning for the mental health needs and appropriate services for the child? Yes No

Reviewer’s comments: 15. Does the file contain evidence that the Case Planning Conferences resulted in recommendations and referrals for the child to receive appropriate mental health services?

Yes No Reviewer’s comments: 16. Is there evidence that follow up was conducted by case management to ensure that the child was receiving the recommended mental health services?

Yes No Reviewer’s comments:

Page 120: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

119

FINAL EVALUATION REPORT | Contract LHZ68

Stakeholder Interview Protocol The purpose of this interview is to obtain information about the behavioral health services provided to children in licensed foster care in the Southern Region of Florida (Miami-Dade and Monroe Counties). We are collecting this data as part of the Southern Region Behavioral Health Services Capacity and Gap Analysis Study, which is being conducted by the University of South Florida at the request of the Department of Children and Families. You are being asked to take part in this interview because of your leadership role at either a children’s behavioral health care service provider or the managed care organization in the Southern Region. We appreciate the information you will share with us. Any information shared during this interview will only be included in reports such that interviewees are not personally identifiable. Any questions after the interview takes place about this study may be directed to the Principal Investigator, Melissa Johnson, at (813) 974-0397 or [email protected].

1) Please describe your organizational role and involvement in management of service provision, or contracts for services, to meet the behavioral health needs of children in licensed foster care.

2) Please share what procedures your organization has in place to assess the behavioral health needs of children in licensed foster care.

3) Are standardized assessment tools used? Which ones?

4) From your perspective, are these procedures and assessment tools adequate to identify the

behavioral health needs of children in licensed foster care?

5) Do the recommendations in the assessment drive services offered and received? Please talk a little bit about why or why not.

6) From your perspective, what are the unmet service needs of children in the region?

7) What is your opinion of current service capacity compared to the needs of the children in

care?

8) Are there commonly waiting lists for certain services? What are the services? Approximately how long are the corresponding wait lists?

9) What strategies does your organization (or your contracted providers) have in place to

ensure that children in licensed foster care have access to needed behavioral health services?

10) How does your organization interface with (other) service providers to ensure that

children in licensed foster care have access to services?

Page 121: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

120

FINAL EVALUATION REPORT | Contract LHZ68

11) What is your opinion of current service accessibility and how does that impact the needs of children in care?

12) What is your perspective about the current level of care coordination in the Region?

13) What recommendations do you have for improving access to and/or care coordination of

behavioral health services for children in licensed foster care?

14) Is there any other information you would like to share regarding meeting the behavioral health needs of this population in this Region?

Thank you for your time!

Page 122: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

121

FINAL EVALUATION REPORT | Contract LHZ68

Case Manager Focus Group Protocol The purpose of this focus group is to obtain information about the behavioral health services provided to children in licensed foster care in the Southern Region of Florida (Miami-Dade and Monroe Counties). We are collecting this data as part of the Southern Region Behavioral Health Services Capacity and Gap Analysis Study, which is being conducted by the University of South Florida at the request of the Department of Children and Families. You are being asked to take part in this focus group because of your role in case management in the Southern Region child welfare system. We appreciate the information you will share with us. Any information shared during this interview will only be included in reports such that participants are not personally identifiable. Any questions after the focus group takes place about this study may be directed to the Principal Investigator, Melissa Johnson, at (813) 974-0397 or [email protected].

1) Please describe your role with regard to assessing children’s behavioral health needs and coordinating behavioral health care for children in licensed foster care.

2) How do you assess the behavioral health needs of children on your caseload? Please describe the assessment process, including policies and procedures pertaining to assessment, sources of information, and any specific assessment tools that are used. How is the assessment used to inform service recommendations?

3) In your experience, how effective are these assessment processes in identifying children’s behavioral health needs? What are the challenges or limitations to assessing children’s behavioral health needs?

4) After assessment, what is the process for connecting children to appropriate services based on their identified needs? Please describe your role in this process and any specific policies or procedures.

5) What are the procedures and your role with regard to the ongoing coordination of care for children with behavioral health needs? (E.g. scheduling appointments, facilitating access to services, ensuring appointments are kept and following up when appointments are not kept, addressing barriers to care that arise.)

6) What are the procedures, and your role, in assessing changes in children’s behavioral

health needs over time? (E.g. follow up with providers, determining whether needs have been sufficiently met by services, identifying new needs that emerge over time and/or need for a change in services.)

Page 123: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

122

FINAL EVALUATION REPORT | Contract LHZ68

7) How would you describe the availability and accessibility of behavioral health services for children in licensed foster care? (E.g. Are the current array and of services and capacity of providers adequate to meet the needs of children in care? Are there services that often have long waitlists?)

8) What are the unmet behavioral health service needs of children in licensed foster care?

9) What strategies does your agency have in place to ensure that children in licensed foster care have access to needed behavioral health services?

10) What recommendations do you have for improving the availability and accessibility of behavioral health services, or coordination of care, for children in licensed foster care?

Thank you for your time!

Page 124: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

123

FINAL EVALUATION REPORT | Contract LHZ68

Provider Survey

The purpose of this survey is to obtain information about the behavioral health services provided by your agency to children in licensed foster care in the Southern Region of Florida (Miami-Dade and Monroe Counties). We are collecting this data as part of the Southern Region Behavioral Health Services Capacity and Gap Analysis Study, which is being conducted by the University of South Florida at the request of the Department of Children and Families. Please consult with the appropriate staff at your agency to complete the survey; only one survey response per agency is needed. Any questions may be directed to the Principal Investigator, Melissa Johnson, at (813) 974-0397 or [email protected].

You will be asked about a number of children’s behavioral health services. For each service, you will indicate whether your agency provides the service. For those services that your agency provides, you will be asked for additional information about service provision and capacity.

1. What is the name of your agency? _______________________

2. For which county(ies) does your agency provide behavioral health services?

Miami-Dade Monroe

3. Do staff at your agency receive training on trauma-informed care? All staff receive trauma-informed training Most staff receive trauma-informed training Some staff receive trauma-informed training No staff receive trauma-informed training

Assessment Services

4. Does your agency provide [name of assessment 1]?

Yes No – Skip to next assessment

4.a. How many staff are certified to provide [Assessment 1]? __________

4.b. How many children per week can each certified staff assess? _________

Page 125: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

124

FINAL EVALUATION REPORT | Contract LHZ68

4.c. What is the typical wait time for a child to receive an assessment after they are referred? ______________

[Repeat questions for next Assessment]

Behavioral Health Services

5. Is an individualized treatment plan developed for every child that your agency serves? Yes No

5.a. Is the treatment plan developed jointly with the child and his/her caregiver(s)?

Yes No

5.b. Please provide any additional relevant information regarding client involvement in the treatment planning process: ______________________________________

5.c. Is the child’s case manager included in developing the treatment plan?

Yes No

5.d. Is the treatment plan reviewed and updated at a minimum every six months?

Yes, always

Usually/most of the time

No, never, rarely

5.e. What role does the provider play in coordinating services with the child welfare agency? _____________________________________________________

6. Does your agency provide [Service 1]?

Yes No – Skip to next service

6.a. What are the eligibility criteria for this service? ____________________

Page 126: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

125

FINAL EVALUATION REPORT | Contract LHZ68

6.b. Which of the following behavioral health needs is this service used to address? Please mark all that apply.

Anxiety disorders

Mood disorders (depression, bipolar, etc.)

Trauma exposure/coping

Attachment disorders

Autism Spectrum disorders

Intellectual or learning disabilities

Psychosis

Attention deficit/hyperactivity/impulsivity

Self-harming behavior

Disruptive behavior/acting out

Severe conduct disorders/ anti-social behavior

Substance abuse/misuse

Victims of sexual abuse

Victims of human trafficking/ commercial sexual exploitation

Other: ______________________

6.c. How many staff at your agency are trained/certified to provide this service? ______

6.d. How many children can each trained staff carry on their caseload at a time? ______

6.e. What is the typical duration of this service? _______________

6.f. What is the treatment modality used for this service? ___________

6.g. How is this service provided?

Outpatient – In the provider’s office

Outpatient – at the client’s home/school/other community location

Page 127: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

126

FINAL EVALUATION REPORT | Contract LHZ68

Intensive outpatient – in the provider’s office

Intensive outpatient – at the client’s home/school/other location

Partial hospitalization

Inpatient

Other: ____________________

6.h. Is the service provision trauma-informed?

Yes No

6.i. How many hours per week of this service does a child typically receive?

Less than 1

1 hour

2 to 3 hours

4 to 5 hours

More than 5 hours

6.j. How many children in licensed foster care received this service from your agency during the past year? ___________

6.k. What is the typical wait time for a child to initiate this service after they are referred to your agency?

Less than 1 week

1 to 2 weeks

3 to 4 weeks

Greater than 1 month

6.l. Does your agency ever have a wait list of 6 weeks or more for this service?

Yes No

6.m. What is the funding source for this service? _______________

Page 128: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

127

FINAL EVALUATION REPORT | Contract LHZ68

[Repeat questions for next Service]

Thank you for your participation!

List of assessments and services included on survey:

Comprehensive Behavioral Health Assessment (CBHA) Psychiatric Evaluation Bio-psychosocial Evaluation Behavior Analysis Individual Therapy Family Therapy Group Therapy Behavior Management Therapeutic Support Services Medication Management Behavioral Health Day Services Targeted Case Management Crisis Stabilization Statewide Inpatient Psychiatric Program (SIPP) Specialized Therapeutic Foster Care (STFC) Specialized Therapeutic Group Home (STGH)

Page 129: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

128

FINAL EVALUATION REPORT | Contract LHZ68

Case Manager Survey

The purpose of this survey is to obtain information about the availability and accessibility of behavioral health services for children in licensed foster care in the Southern Region of Florida (Miami-Dade and Monroe Counties). We are collecting this data as part of the Southern Region Behavioral Health Services Capacity and Gap Analysis Study, which is being conducted by the University of South Florida at the request of the Department of Children and Families. Your participation in this study is voluntary; if you do not wish to participate, you do not need to complete the survey. Your responses will be kept anonymous, and we will not ask you to provide your name or any personally identifiable information. If you have questions, you may contact the Principal Investigator, Melissa Johnson, at (813) 974-0397 or [email protected].

Background Information

1. What case management agency do you work for? _________________

2. Which county do you work in?

Miami-Dade Monroe

3. What is your position?

Case Manager Supervisor Program Manager/Director Other: __________________

4. How long have you worked in your current position? ______ years _____ months

5. What is your role in the coordination of care for children in licensed foster care?

Page 130: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

129

FINAL EVALUATION REPORT | Contract LHZ68

Behavioral Health Services Capacity

Next you will be asked about a variety of behavioral health issues or needs that children in licensed foster care may have. For each identified need, you will be asked about the availability, accessibility, effectiveness, and capacity of behavioral health services to address the need. Availability refers to the extent to which services are offered and readily available (e.g. without a waitlist) in the community. Accessibility refers to the extent to which children in foster care can actually access the services, taking into account factors such as cost, insurance coverage, provider hours and location. Effectiveness refers to how well the services meet the needs of children and result in improved functioning and well-being. Capacity refers to the extent to which services are adequately available and accessible to address the level of need in the community. Please answer the questions to the best of your ability based on your knowledge and experience.

6. Answer the following questions about behavioral health services in your county to address the needs of children with anxiety issues or disorders.

a. How would you characterize the availability of behavioral health services to address the needs of children with anxiety issues or disorders?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with anxiety issues or disorders?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with anxiety issues or disorders?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with anxiety issues or disorders?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need

Page 131: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

130

FINAL EVALUATION REPORT | Contract LHZ68

Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

7. Answer the following questions about behavioral health services in your county to address the needs of children with mood disorders, such as depression or bipolar disorder.

a. How would you characterize the availability of behavioral health services to address the needs of children with mood disorders, such as depression or bipolar disorder?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with mood disorders, such as depression or bipolar disorder?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with mood disorders, such as depression or bipolar disorder?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with mood disorders, such as depression or bipolar disorder?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

8. Answer the following questions about behavioral health services in your county to address the needs of children with attention or hyperactivity issues (e.g. ADD, ADHD).

a. How would you characterize the availability of behavioral health services to address the needs of children with attention or hyperactivity issues?

Page 132: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

131

FINAL EVALUATION REPORT | Contract LHZ68

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with attention or hyperactivity issues?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with attention or hyperactivity issues?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with attention or hyperactivity issues?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

9. Answer the following questions about behavioral health services in your county to address the needs of children with Autism Spectrum disorders.

a. How would you characterize the availability of behavioral health services to address the needs of children with Autism Spectrum disorders?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with Autism Spectrum disorders?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

Page 133: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

132

FINAL EVALUATION REPORT | Contract LHZ68

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with Autism Spectrum disorders?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with Autism Spectrum disorders?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

10. Answer the following questions about behavioral health services in your county to address the needs of children with intellectual or learning disabilities.

a. How would you characterize the availability of behavioral health services to address the needs of children with intellectual or learning disabilities?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with intellectual or learning disabilities?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with intellectual or learning disabilities?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with intellectual or learning disabilities?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need

Page 134: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

133

FINAL EVALUATION REPORT | Contract LHZ68

Capacity is completely adequate, there are plenty of services to meet the need

11. Answer the following questions about behavioral health services in your county to address the needs of children who have experienced severe and/or complex trauma.

a. How would you characterize the availability of behavioral health services to address the needs of children who have experienced severe and/or complex trauma?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children who have experienced severe and/or complex trauma?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children who have experienced severe and/or complex trauma?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children who have experienced severe and/or complex trauma?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

12. Answer the following questions about behavioral health services in your county to address the needs of children with psychosis.

a. How would you characterize the availability of behavioral health services to address the needs of children with psychosis?

Page 135: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

134

FINAL EVALUATION REPORT | Contract LHZ68

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with psychosis?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with psychosis?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with psychosis?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

13. Answer the following questions about behavioral health services in your county to address the needs of children with disruptive behavior issues (e.g. acting out).

a. How would you characterize the availability of behavioral health services to address the needs of children with disruptive behavior issues?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with disruptive behavior issues?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

Page 136: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

135

FINAL EVALUATION REPORT | Contract LHZ68

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with disruptive behavior issues?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with disruptive behavior issues?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

14. Answer the following questions about behavioral health services in your county to address the needs of children with severe conduct problems (such as oppositional defiant disorder, anti-social behavior, delinquency problems).

a. How would you characterize the availability of behavioral health services to address the needs of children with severe conduct problems?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with severe conduct problems?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with severe conduct problems?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with severe conduct problems?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need

Page 137: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

136

FINAL EVALUATION REPORT | Contract LHZ68

Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

15. Answer the following questions about behavioral health services in your county to address the needs of children with attachment issues or disorders.

a. How would you characterize the availability of behavioral health services to address the needs of children with attachment issues or disorders?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with attachment issues or disorders?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with attachment issues or disorders?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with attachment issues or disorders?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

16. Answer the following questions about behavioral health services in your county to address the needs of children who have experienced sexual abuse.

a. How would you characterize the availability of behavioral health services to address the needs of children who have experienced sexual abuse?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods

Page 138: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

137

FINAL EVALUATION REPORT | Contract LHZ68

Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children who have experienced sexual abuse?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children who have experienced sexual abuse?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children who have experienced sexual abuse?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

17. Answer the following questions about behavioral health services in your county to address the needs of children with substance abuse issues.

a. How would you characterize the availability of behavioral health services to address the needs of children with substance abuse issues?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children with substance abuse issues

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children with substance abuse issues?

Services are largely ineffective and do not meet the needs of these children

Page 139: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

138

FINAL EVALUATION REPORT | Contract LHZ68

Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children with substance abuse issues?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

18. Answer the following questions about behavioral health services in your county to address the needs of children who exhibit suicidal or self-harming behavior.

a. How would you characterize the availability of behavioral health services to address the needs of children who exhibit suicidal or self-harming behavior?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children who exhibit suicidal or self-harming behavior?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children who exhibit suicidal or self-harming behavior?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children who exhibit suicidal or self-harming behavior?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

Page 140: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

139

FINAL EVALUATION REPORT | Contract LHZ68

19. Answer the following questions about behavioral health services in your county to address the needs of children who have experienced human trafficking (including commercial sexual exploitation, labor trafficking, or domestic servitude).

a. How would you characterize the availability of behavioral health services to address the needs of children who have experienced human trafficking?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of behavioral health services to address the needs of children who have experienced human trafficking?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of behavioral health services to address the needs of children who have experienced human trafficking?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of behavioral health services to address the needs of children who have experienced human trafficking?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

20. Answer the following questions about therapeutic placement options (e.g. therapeutic foster care, specialized therapeutic foster care, therapeutic group care) in your county.

a. How would you characterize the availability of therapeutic placement options for children in need of this level of care?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

Page 141: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

140

FINAL EVALUATION REPORT | Contract LHZ68

b. How would you characterize the accessibility of therapeutic placement options for children in need of this level of care?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of therapeutic placement options for children in need of this level of care?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of therapeutic placement options for children in need of this level of care?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

21. Answer the following questions about residential care (e.g. SIPP, inpatient substance abuse, etc.) in your county.

a. How would you characterize the availability of residential care for children in need of this level of care?

There are no services available at all to address this need Services are somewhat available, but often have long waitlists Services are usually available, seldom have waitlists or short wait periods Services are always immediately available

b. How would you characterize the accessibility of residential care for children in need of this level of care?

Services are largely inaccessible to children in foster care Services can be difficult to access for children in foster care Services are fairly easy to access for children in foster care Services are very easy to access for children in foster care

c. How would you characterize the effectiveness of residential care for children in need of this level of care?

Services are largely ineffective and do not meet the needs of these children Services are slightly effective or somewhat meet the needs of children Services are fairly effective, able to meet the needs of many children

Page 142: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

141

FINAL EVALUATION REPORT | Contract LHZ68

Services are highly effective, able to meet the needs of most children

d. How would you characterize the current capacity of residential care for children in need of this level of care?

Capacity is entirely inadequate, there is a complete lack of services Capacity is largely inadequate, there are not enough services to meet the need Capacity is mostly adequate, there are usually enough services to meet need Capacity is completely adequate, there are plenty of services to meet the need

22. Based on your experience, what are the most significant gaps in behavioral health services for foster care children in your community?

Thank you for your participation!

Page 143: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

142

FINAL EVALUATION REPORT | Contract LHZ68

Appendix B

Mental Health Assessments used by Behavioral Health Providers

Page 144: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

143

FINAL EVALUATION REPORT | Contract LHZ68

Children’s Mental Health Assessments and Screening Instruments

Screening Instrument Brief Description

GAIN-Q The GAIN-Q3 is a brief screener used to identify and address a wide range of problems. It is designed to be used in diverse settings (i.e. child welfare, health clinics, juvenile justice). Domains include: problems and service utilization, substance use, mental health (internalizing and externalizing problems), crime and violence, stress, physical health, school and work, and quality of life. http://gaincc.org/instruments/

GAIN-I

The GAIN-I is a comprehensive bio-psychosocial assessment intended to support clinical diagnosis, placement, treatment planning, performance monitoring, and program planning. It is designed to be used primarily in clinical settings. Domains include: background, substance use, physical health, risk behaviors and disease prevention, mental and emotional health, environment and living situation, legal, and vocational. http://gaincc.org/instruments/

Youth Level of Service/Case Management Inventory (YLS/CMI)

The Youth Level of Service/Case Management Inventory is intended to assess rehabilitation needs. It is used with 12-18-year-old youth who have a juvenile offense. It examines likelihood of re-offending as well as providing an opportunity for users to evaluate positive client attributes so that client strengths may be highlighted and built upon in service delivery. The YLS/CMI provides an estimate of risk of reconviction for individual offenders over twelve months. https://www.cognitivecentre.com/assessment/youth-level-servicecase-management-inventory-ylscmi-2-0-new/

Adverse Childhood Experiences (ACES) Tool

The CDC-Kaiser Permanente Adverse Childhood Experiences (ACE) Study is one of the largest investigations of childhood abuse and neglect and household challenges and later-life health and well-being. The Family Health History and Health Appraisal questionnaires were used to collect information on child abuse and neglect, household challenges, and other socio-behavioral factors in the original CDC-Kaiser ACE Study. https://www.aap.org/en-us/advocacy-and-policy/aap-health-initiatives/resilience/Pages/Clinical-Assessment-Tools.aspx

SBIRT

Screening, Brief Intervention, and Referral to Treatment (SBIRT) is an evidence-based practice used to identify, reduce, and prevent substance abuse. The SBIRT consists of three major components: Screening — assessment of any risky substance use behaviors using standardized screening tools. Brief Intervention — child-serving professional engages client showing risky substance use behaviors in a short conversation, providing feedback and advice Referral to Treatment — child-serving professional provides a referral to brief therapy or additional treatment to clients who screen in need of additional services

Page 145: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

144

FINAL EVALUATION REPORT | Contract LHZ68

https://www.integration.samhsa.gov/clinical-practice/sbirt#why? Youth Outcome Questionnaire (completed by parents) Youth Outcomes Self Repot (completed by youth)

The Youth Outcome Questionnaire is a collection of questions aimed at collecting data regarding the effectiveness of youth therapies. The Y-OQ is a parent report measure of treatment progress for children and adolescents (ages 4 – 17) receiving mental health interventions. The Y-OQ–SR is an adolescent self-report measure appropriate for ages 12 – 18. The Y-OQ measures six subscales: Intrapersonal Distress (ID), Somatic (S), Interpersonal Relationships (IR), Critical Items (CI), Social Problems (SP), and Behavioral Dysfunction (BD). The subscale scores can be used to identify and target particularly problematic areas as a focus of treatment and help with treatment planning. The YOQ was developed by Dr. Michael Lambert and Dr. Gary Burlingame with more information: https://www.oqmeasures.com/

Therapist Outcome Measure (TOM; completed by therapist pre and post) Client Outcome Measure (COM; completed by youth pre and post)

The Therapy Outcome Measure (TOM) is a brief outcome measure that allows professionals to describe the relative abilities and difficulties of a client in the four domains of ‘impairment’, ‘activity’, ‘participation’ and ‘wellbeing’ in order to monitor changes over time. It is used for treatment planning, clinical management, audit and research. It allows for the aggregation of data so that comparisons can be made that may be suitable for internal and external benchmarking. http://www.communitytherapy.org.uk/TOM.html

ADAD ADAD is a 150-item instrument conducted as a structured interview that yields a comprehensive evaluation of clients and provides a 10-point severity rating for each of 9 life problem areas. Composite scores to measure client behavioral change in each life problem area, during and after treatment, can be calculated. The ADAD’s primary purpose is to assess substance abuse and other life problems (e.g., medical, school, employment, social relations, family, psychological, legal, alcohol and drug use), to assist with treatment planning, and to assess changes in life problem areas and severity over time. http://www.emcdda.europa.eu/html.cfm/index3530EN.html

PHQ2 and PHQ9 depression screenings

The Patient Health Questionnaire-2 (PHQ-2) asks about the frequency of depressed mood over the past two weeks. The purpose of the PHQ-2 is to screen for depression in a “first-step” approach. Patients who screen positive should be further evaluated with the PHQ-9 to determine whether they meet criteria for a depressive disorder. https://www.hiv.uw.edu/page/mental-health-screening/phq-2 Patient Health Questionnaire-9 (PHQ-9) The PHQ-9 is a multipurpose instrument for screening, diagnosing, monitoring and measuring the severity of depression. https://www.hiv.uw.edu/page/mental-health-screening/phq-9

Columbia Suicide Rating Scale

The Columbia Protocol, also known as the Columbia-Suicide Severity Rating Scale (C-SSRS), supports suicide risk assessment

Page 146: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

145

FINAL EVALUATION REPORT | Contract LHZ68

through a series of simple, plain-language questions. The answers help users identify whether someone is at risk for suicide, assess the severity and immediacy of that risk, and assess the level of support that the client may need. Question items include whether and when clients have thought about suicide (ideation), what actions they have taken to prepare for suicide, and whether and when they attempted suicide or began a suicide attempt that was interrupted or stopped of their own accord. http://cssrs.columbia.edu/the-columbia-scale-c-ssrs/about-the-scale/

Page 147: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

146

FINAL EVALUATION REPORT | Contract LHZ68

Appendix C

Evidence-Based Practices and Treatment Modalities

Page 148: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

147

FINAL EVALUATION REPORT | Contract LHZ68

List of Evidence-based Treatments reported by providers

Treatment Model # of providers Cognitive Behavior Therapy (CBT) 17 Trauma-Focused Cognitive Behavior Therapy (TF-CBT) 9 Dialectical Behavior Therapy (DBT) 5 Motivational Interviewing 8 Solution Focused Behavior Therapy (SFBT) 5 Play Therapy 5 Child-Parent Psychotherapy (CPP) 4 Emotionally Focused Family Therapy 3 Mindfulness Based Cognitive Therapy (MBCT) 3 Person Centered Therapy 2 Motivational Enhancement Therapy 1 Acceptance and Commitment Therapy (ACT) 1 Internal Family Systems 1 Parent-Child Interaction Therapy (PCIT) 1 Family Functional Therapy 1 Attachment-based Therapy 1 Rational Emotive Behavior Therapy (REBT) 1

Page 149: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

148

FINAL EVALUATION REPORT | Contract LHZ68

Appendix D

Behavioral Health Provider Survey Results

Page 150: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

149

FINAL EVALUATION REPORT | Contract LHZ68

Children’s Behavioral Health Assessment Capacity Assessment County # of agencies # of staff children/week avg. wait time Comprehensive Behavioral Health Assessment

Miami-Dade Monroe

6 1

4* Unknown*

Unknown* Unknown*

1 – 21 days Unknown*

Psychiatric Evaluation Miami-Dade Monroe

10 3

18 8

154* 27

2 – 30 days 7 – 10 days

Bio-psychosocial Evaluation

Miami-Dade Monroe

12 3

126 13

1001* 65

2 – 15 days 1 – 7 days

*Multiple agencies did not know or did not respond to this question; reported numbers are presumed to be an underestimate due to these missing data

Children’s Behavioral Health Treatment Services Capacity

Service Count

y

# of agenci

es # staff

Avg. caseloa

d Avg.

Duration

Avg. hours/we

ek

# served in past year

Avg. wait time

Funding

source(s)

Behavioral Analysis

Miami-Dade

Monroe

2 0

2* -

20 -

6 mo. -

2 – 3 -

71 -

< 1 week -

Medicaid

Individual Therapy

Miami-Dade

Monroe

12 4

116 38

12 – 35 5 – 25

3 – 12 mo.

3 – 12 mo.

1 – 3 1

2081* 40*

< 1 week < 1 week

Medicaid, DCF,

ME, CBC

Family Therapy

Miami-Dade

Monroe

11 3

101 17

5 – 30 5 – 20

6 – 12 mo.

6 – 12 mo.

1 1

1405* 30*

1 – 2 weeks 1 – 2 weeks

Medicaid, ME, DCF

Group Therapy

Miami-Dade

Monroe

6 -

41 -

20* -

4 – 6 mo. -

1 – 2 -

71* -

1 – 4 weeks

-

Medicaid, DCF

Behavior Management

Miami-Dade

Monroe

2 -

Unknown -

Unknown -

Unknown -

Unknown -

Unknown -

Unknown -

Unknown -

Therapeutic Support Services

Miami-Dade

Monroe

5 1

26* Unkno

wn

1 – 30 Unkno

wn

1 wk. – 9 mo.

Unknown

1 – 5 Unknown

70* Unkno

wn

1 – 2 weeks

Unknown

Medicaid, ME, DCF

Medication Management

Miami-Dade

Monroe

10 3

42* 8

25 – 60*

15+*

Unspecified “

< 1 < 1

1285* 100*

1 – 4 weeks <1 – 4 weeks

Medicaid, ME, DCF,

insurance

Targeted Case Management

Miami-Dade

Monroe

4 1

24 4

15 – 30 20

6 – 12 mo.

6 – 12 mo.

2 – 3 1

1080* 100

1 – 4 weeks

< 1 week

Medicaid, ME, DCF

Crisis Stabilization

Miami-Dade

Monroe

1 1

Unknown 30

16 beds Unkno

wn

72 hours 24 hours

5+ < 1

Unknown

Unknown

Immediate

Immediate

Medicaid, DCF

Page 151: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

150

FINAL EVALUATION REPORT | Contract LHZ68

Mobile Response

Miami-Dade

Monroe

1 1

4 15

N/A N/A

1 – 2 hours 1 – 2 hours

- -

Unknown

Unknown

Immediate

Immediate

ME, DCF

SIPP Miami-Dade

Monroe

1 -

Unknown -

44 beds -

Unknown -

Unknown -

Unknown -

Unknown -

Medicaid, DCF

STFC Miami-Dade

Monroe

3 -

20* -

1 – 2 -

9 – 12 mo.

-

24/7 -

30* 1 – 2 weeks

-

Medicaid

*One or more agencies did not know or did not respond to this question; reported numbers are presumed to be an underestimate due to these missing data.

Page 152: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

151

FINAL EVALUATION REPORT | Contract LHZ68

Appendix E

Case Management Survey Results

Page 153: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

152

FINAL EVALUATION REPORT | Contract LHZ68

Case Management Perceptions of Children’s Behavioral Health Services

Behavioral Health Need Availability1 Accessibility2 Effectiveness3 Capacity4

Anxiety Not available 0% Largely inaccessible 0% Largely ineffective 10.5% Entirely inadequate 2.6% Somewhat available 51.4% Difficult to access 44.7% Slightly effective 34.2% Largely inadequate 39.5% Usually available 37.8% Fairly easy to access 42.1% Fairly effective 47.4% Mostly adequate 52.6% Always available 10.8% Very easy to access 13.2% Highly effective 7.9% Completely adequate 5.3%

Mood disorders

Not available 0% Largely inaccessible 0% Largely ineffective 9.1% Entirely inadequate 6.1% Somewhat available 46.9% Difficult to access 45.5% Slightly effective 30.3% Largely inadequate 36.4% Usually available 50.0% Fairly easy to access 45.5% Fairly effective 51.5% Mostly adequate 57.6% Always available 3.1% Very easy to access 9.1% Highly effective 9.1% Completely adequate 6.1%

Attention/ hyperactivity

Not available 4.2% Largely inaccessible 3.6% Largely ineffective 7.1% Entirely inadequate 3.6% Somewhat available 50.0% Difficult to access 46.4% Slightly effective 35.7% Largely inadequate 39.3% Usually available 37.5% Fairly easy to access 42.9% Fairly effective 50.0% Mostly adequate 46.4% Always available 8.3% Very easy to access 7.1% Highly effective 7.1% Completely adequate 10.7%

Autism spectrum

Not available 0% Largely inaccessible 4.2% Largely ineffective 0% Entirely inadequate 8.0% Somewhat available 70.8% Difficult to access 58.3% Slightly effective 52.0% Largely inadequate 44.0% Usually available 29.2% Fairly easy to access 37.5% Fairly effective 44.0% Mostly adequate 48.0% Always available 0% Very easy to access 0% Highly effective 4.0% Completely adequate 0%

Intellectual/ learning disabilities

Not available 8.0% Largely inaccessible 8.0% Largely ineffective 8.0% Entirely inadequate 8.0% Somewhat available 56.0% Difficult to access 48.0% Slightly effective 44.0% Largely inadequate 44.0% Usually available 32.0% Fairly easy to access 40.0% Fairly effective 44.0% Mostly adequate 48.0% Always available 4.0% Very easy to access 4.0% Highly effective 4% Completely adequate 0%

Severe/ complex trauma

Not available 13.6% Largely inaccessible 13.0% Largely ineffective 18.2% Entirely inadequate 13.0% Somewhat available 54.5% Difficult to access 60.9% Slightly effective 50.0% Largely inadequate 47.8% Usually available 31.8% Fairly easy to access 26.1% Fairly effective 31.8% Mostly adequate 39.1% Always available 0% Very easy to access 0% Highly effective 0% Completely adequate 0%

Psychosis Not available 28.6% Largely inaccessible 25.0% Largely ineffective 20.8% Entirely inadequate 20.8% Somewhat available 42.9% Difficult to access 41.7% Slightly effective 45.8% Largely inadequate 37.5% Usually available 28.6% Fairly easy to access 33.3% Fairly effective 33.3% Mostly adequate 41.7% Always available 0% Very easy to access 0% Highly effective 0% Completely adequate 0%

Disruptive behavior

Not available 22.7% Largely inaccessible 13.0% Largely ineffective 17.4% Entirely inadequate 13.0% Somewhat available 50.0% Difficult to access 56.5% Slightly effective 56.5% Largely inadequate 56.5% Usually available 27.3% Fairly easy to access 30.4% Fairly effective 26.1% Mostly adequate 26.1% Always available 0% Very easy to access 0% Highly effective 0% Completely adequate 4.3%

Conduct problems

Not available 21.7% Largely inaccessible 13.0% Largely ineffective 21.7% Entirely inadequate 13.0% Somewhat available 60.9% Difficult to access 69.6% Slightly effective 56.5% Largely inadequate 69.6% Usually available 17.4% Fairly easy to access 17.4% Fairly effective 21.7% Mostly adequate 17.4%

Page 154: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

153

FINAL EVALUATION REPORT | Contract LHZ68

Always available 0% Very easy to access 0% Highly effective 0% Completely adequate 0% Attachment issues

Not available 8.0% Largely inaccessible 8.0% Largely ineffective 12.5% Entirely inadequate 8.0% Somewhat available 36.0% Difficult to access 32.0% Slightly effective 33.3% Largely inadequate 28.0% Usually available 52.0% Fairly easy to access 56.0% Fairly effective 54.2% Mostly adequate 60.0% Always available 4.0% Very easy to access 4.0% Highly effective 0% Completely adequate 4.0%

Sexual abuse Not available 4.3% Largely inaccessible 4.3% Largely ineffective 17.4% Entirely inadequate 4.3% Somewhat available 43.5% Difficult to access 34.8% Slightly effective 43.5% Largely inadequate 47.8% Usually available 47.8% Fairly easy to access 56.5% Fairly effective 34.8% Mostly adequate 43.5% Always available 4.3% Very easy to access 4.3% Highly effective 4.3% Completely adequate 4.3%

Substance abuse

Not available 4.3% Largely inaccessible 4.3% Largely ineffective 13.6% Entirely inadequate 13.0% Somewhat available 52.2% Difficult to access 56.5% Slightly effective 54.5% Largely inadequate 43.5% Usually available 30.4% Fairly easy to access 26.1% Fairly effective 22.7% Mostly adequate 30.4% Always available 13.0% Very easy to access 13.0% Highly effective 9.1% Completely adequate 13.0%

Self-harming behavior

Not available 17.4% Largely inaccessible 17.4% Largely ineffective 26.1% Entirely inadequate 17.4% Somewhat available 39.1% Difficult to access 39.1% Slightly effective 43.5% Largely inadequate 39.1% Usually available 26.1% Fairly easy to access 26.1% Fairly effective 17.4% Mostly adequate 30.4% Always available 17.4% Very easy to access 17.4% Highly effective 13.0% Completely adequate 13.0%

Human trafficking

Not available 8.7% Largely inaccessible 8.7% Largely ineffective 17.4% Entirely inadequate 13.0% Somewhat available 60.9% Difficult to access 52.2% Slightly effective 65.2% Largely inadequate 65.2% Usually available 26.1% Fairly easy to access 30.4% Fairly effective 13.0% Mostly adequate 17.4% Always available 4.3% Very easy to access 8.7% Highly effective 4.3% Completely adequate 4.3%

Therapeutic placements

Not available 17.4% Largely inaccessible 21.7% Largely ineffective 26.1% Entirely inadequate 30.4% Somewhat available 65.2% Difficult to access 60.9% Slightly effective 43.5% Largely inadequate 43.5% Usually available 17.4% Fairly easy to access 17.4% Fairly effective 30.4% Mostly adequate 26.1% Always available 0% Very easy to access 0% Highly effective 0% Completely adequate 0%

Residential care

Not available 13.6% Largely inaccessible 9.1% Largely ineffective 18.2% Entirely inadequate 18.2% Somewhat available 63.6% Difficult to access 59.1% Slightly effective 50.0% Largely inadequate 54.5% Usually available 18.2% Fairly easy to access 22.7% Fairly effective 22.7% Mostly adequate 18.2% Always available 4.5% Very easy to access 9.1% Highly effective 9.1% Completely adequate 9.1%

1Availability refers to the extent to which services are offered and readily available (e.g. without a waitlist) in the community. 2Accessibility refers to the extent to which children in foster care can actually access the services, taking into account factors such as cost, insurance coverage, provider hours and location. 3Effectiveness refers to how well the services meet the needs of children and result in improved functioning and well-being. 4Capacity refers to the extent to which services are adequately available and accessible to address the level of need in the community.

Page 155: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

154

Appendix F

Definitions for Administrative Data Analysis

Page 156: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

155

Cost Center Definitions:

1. Assessment. Assessment services assess, evaluate, and provide assistance to individuals

and families to determine level of care, motivation, and the need for services and supports

to assist individuals and families identify their strengths.

2. Case Management. Case management services consist of activities aimed at identifying

the recipient’s needs, planning services, linking the service system with the person,

coordinating the various system components, monitoring service delivery and evaluating

the effect of the services received.

3. Crisis Stabilization. These acute care services provide, on a twenty-four (24) hours per

day, seven (7) days per week basis, brief, intensive mental health residential treatment

services to meet the needs of individuals who are experiencing an acute crisis and who, in

the absence of a suitable alternative, would require hospitalization.

4. Crisis Support / Emergency. These non-residential care services are generally available

twenty-four (24) hours per day, seven (7) days per week, or some other specific time

period, to intervene in a crisis or provide emergency care. Examples include: mobile

crisis, crisis support, crisis/emergency screening, crisis telephone, and emergency walk-

in.

5. Day Care Services. Day care services provide a structured schedule of activities for four

(4) or more consecutive hours per day for children of persons who are participating in a

mental health or substance abuse day – night service or residential services.

6. Day / Night. Day-night services provide a structured schedule of non-residential services

for four (4) or more consecutive hours per day. Activities for children and adult mental

health programs are designed to assist individuals attain skills and behaviors needed to

Page 157: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

156

FINAL EVALUATION REPORT | Contract LHZ68

function successfully in living, learning, work, and social environments. Generally, a

person receives three (3) or more services a week. Activities for substance abuse

programs emphasize rehabilitation, treatment, and education services, using

multidisciplinary teams to provide integrated programs of academic, therapeutic, and

family services.

7. Drop In / Self Help Centers. These centers are intended to provide a range of

opportunities for persons with severe and persistent mental illness to independently

develop, operate and participate in social, recreational, and networking activities.

8. In-Home And On – Site Services Overlay. Therapeutic services and supports are

rendered in non-provider settings such as nursing homes, alternative living facilities

(ALFs), residences, schools, detention centers, commitment settings, foster homes, and

other community settings.

9. Inpatient. Inpatient services are provided in hospitals, licensed under Chapter 395,

Florida Statutes, as general hospitals and psychiatric specialty hospitals. They are

designed to provide intensive treatment to persons exhibiting violent behaviors, suicidal

behaviors and other severe disturbances due to substance abuse or mental illness.

10. Intensive Case Management. Case management services consist of activities aimed at

assessing recipient needs, planning services, linking the service system to a recipient,

coordinating the various system components, monitoring service delivery and evaluating

the effect of services received. These services are typically offered to persons who are

being discharged from a hospital or crisis stabilization unit, who are in need of more

professional care, and who will have contingency needs to remain in a less restrictive

setting.

Page 158: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

157

FINAL EVALUATION REPORT | Contract LHZ68

11. Intervention. Intervention services focus on reducing risk factors generally associated

with the progression of substance abuse and mental health problems. Intervention is

accomplished through early identification of persons at risk, performing basic individual

assessments, and providing supportive services, which emphasize short-term counseling

and referral. These services are targeted toward individuals and families.

12. Medical Services. Medical services provide primary medical care, therapy and

medication administration to improve the functioning or prevent further deterioration of

persons with mental health or substance abuse problems. Included is psychiatric mental

status assessment.

a. For adults with mental illness, medical services are usually provided on a regular

schedule, with arrangements for non-scheduled visits during times of increased

stress or crisis. This service includes medication administration of psychotropic

drugs including Clozaril and other new medications, and psychiatric services.

13. Methadone Maintenance. Methadone medication maintenance consists of a group of

outpatient services, which utilize methadone and other opioid replacement therapies,

where permitted, in conjunction with assessment, rehabilitation and treatment services.

14. Outpatient-Individual. Outpatient services provide a therapeutic environment that is

designed to improve the functioning or prevent further deterioration of persons with

mental health and/or substance abuse problems. These services are usually provided on a

regularly scheduled basis by appointment, with arrangements made for non-scheduled

visits during times of increased stress or crisis.

15. Outreach. Outreach services are provided through a formal program to both the

community at large and to individuals. Community services include education,

Page 159: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

158

FINAL EVALUATION REPORT | Contract LHZ68

identification and linkage with high risk groups. Outreach services for individuals are

designed to: encourage, educate, and engage prospective clients who show an indication

of substance abuse and mental health problems or needs. Client enrollment is not

included in outreach services.

16. Prevention. Prevention services are those involving strategies that preclude, forestall, or

impede the development of substance abuse and mental health problems, and include

increasing public awareness through information dissemination, education, and

alternative-focused activities. These services may be directed either toward a Level II

prevention target where the client has been identified, or at a Level I prevention target

where the client is not identifiable.

17. Prevention / Intervention Day. This cost center includes school-based day services for

children and adolescents for four (4) or more consecutive hours per day. These services

include school-based mental health services for children who have been identified by the

school as being at risk of developing, mental health problems. Services are

individualized and may be provided in a self-contained classroom, a regular classroom, or

as a component of a full service school.

18. Residential Level I. These licensed facilities provide structured, live-in, non-hospital

setting, services with supervision on a twenty-four (24) hours per day, seven (7) days per

week basis. There is a nurse on duty in these facilities at all times. For adult mental

health, these services include group homes, which are for longer-term residents. These

facilities offer nursing supervision provided by, at a minimum, licensed practical nurses

on a twenty-four (24) hours per day, seven (7) days per week basis. For children with

serious emotional disturbances, Level I services are the most intensive and restrictive

Page 160: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

159

FINAL EVALUATION REPORT | Contract LHZ68

level of residential therapeutic intervention provided in a non-hospital or non-crisis

support setting, including residential treatment centers. Medicaid Residential Treatment

Centers (MRTC) and Residential Treatment Centers (RTC) are reported under this cost

center. On-call medical care must be available for substance abuse programs. For

substance abuse, Level I services provide a range of assessment, treatment, rehabilitation,

and ancillary services in an intensive therapeutic environment, with an emphasis on

treatment, and may include formal school and adult education programs.

19. Residential Level II. These are licensed, structured rehabilitation-oriented group

facilities that have twenty-four (24) hours per day, seven (7) days per week, supervision.

Level II facilities are for persons who have significant deficits in independent living skills

and need extensive support and supervision. For children with serious emotional

disturbances, Level II services are programs specifically designed for the purpose of

providing intensive therapeutic behavioral and treatment interventions. This cost center

includes services provided in Therapeutic Group Homes (TGH), Specialized Therapeutic

Foster Homes (STFH) – Level I, and Therapeutic Foster Homes (TFH) – Level I. For

substance abuse, Level II services provide a range of assessment, treatment,

rehabilitation, and ancillary services in a less intensive therapeutic environment with an

emphasis on rehabilitation, and may include formal school and adult educational

programs.

20. Residential Level III. These are licensed facilities which provide twenty-four (24) hours

per day, seven (7) days per week supervised residential alternatives to persons who have

developed a moderate functional capacity for independent living. For adults with serious

mental illness, this cost center consists of supervised apartments. For children with

Page 161: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

160

FINAL EVALUATION REPORT | Contract LHZ68

serious emotional disturbances, Level III services are services specifically designed to

provide sparse therapeutic behavioral and treatment interventions. This cost center

provides services in Therapeutic Group Homes (TGH), Specialized Therapeutic Foster

Homes (STFH)-Level I, and Therapeutic Foster Homes (TFH) – Level I. For substance

abuse, Level III provides a range of assessment, rehabilitation, treatment and ancillary

services on a long-term, continuing care basis where, depending upon the characteristics

of the clients served, the emphasis is on rehabilitation or treatment.

21. Residential Level IV. This type of facility may have less than twenty-four (24) hours

per day, seven (7) days per week on-premise supervision. This is the least intensive level

of residential care. It is primarily a support service and, as such, treatment services are

not included in this cost center. For adult mental health, Level IV includes satellite

apartments, satellite group homes and therapeutic foster homes. For children with

serious emotional disturbances, Level IV services are the least intensive and restrictive

levels of residential care provided in group or foster homes settings, therapeutic foster

homes, and group care. Note: Regular therapeutic foster care can be provided either

through Residential Level IV “Day of Care: TFH” or by billing in-home/non-provider

setting for a child in a foster home.

22. Respite Services. Respite care services are designed to sustain the family or other

primary caregiver by providing time-limited, temporary relief from the ongoing

responsibility of care giving. Although the respite is for the caregiver, use the SSN of the

client in question.

Page 162: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

161

FINAL EVALUATION REPORT | Contract LHZ68

23. Sheltered Employment. Sheltered employment services are non-competitive

employment services within a work-based facility; it requires federal exemption from the

Minimum Wage Act.

24. Substance Abuse Detoxification. Detoxification programs use medical and clinical

procedures in a residential setting to assist adults, children and adolescents with

substance abuse problems in their efforts to withdraw from the physiological and

psychological effects of substance abuse. Residential detoxification and Addiction

Receiving Facilities (ARFs) provide emergency screening, evaluation, short-term

stabilization, and treatment in a secure environment. The maximum unit cost rate for a

Juvenile Addiction Receiving Facility that is integrated with a Children’s Crisis

Stabilization Unit shall be the maximum unit cost rate for the Crisis Stabilization cost

center rather than for the Substance Abuse Detoxification cost center.

25. Supported Employment. Supported employment services are community-based

employment services in an integrated work setting, which provides regular contact with

non-disabled co-workers or the public. A job coach provides long-term, ongoing support

for as long as it is needed to enable the person served to maintain employment.

26. Supported Housing/Living. Supported housing/living services assist persons with

substance abuse or psychiatric disabilities in the selection of housing of their choice.

These services also provide the necessary services and supports to assure their continued

successful living in the community and transitioning into the community. For children

with mental health problems, supported living is the process of assisting adolescents in

arranging for housing and providing services to assure successful transition to living

independently on their own or with roommates in the community. Services include

Page 163: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

162

FINAL EVALUATION REPORT | Contract LHZ68

training in independent living skills. For substance abuse, services provide for the

placement and monitoring of recipients who: (a) are participating in non-residential

services, (b) have completed or are completing substance abuse treatment, and (c) need

assistance and support in independent or supervised living within a live-in environment.

27. TASC. Treatment Accountability for Safer Communities (TASC) provides for

identification, screening, court liaison, referral and tracking of persons in the criminal

justice system with a history of drug abuse or addiction.

28. Incidental Expenses. This cost center provides for incidental expenses for items, such

as clothing, medical care, educational needs, developmental services, FACT Team

housing subsidies and pharmaceuticals, (if not required by the Request for Proposal –

RFP to be reimbursed through a separate cost reimbursement contract) and other

approved costs. All incidental expenses must be included in the contract or must have

prior written authorization from authorized department staff member.

29. Aftercare/Follow-up. Aftercare services, including but not limited to relapse

prevention, are a vital part of recovery in every treatment level. Aftercare activities

include client participation in daily activity functions, which were adversely affected by

mental illness and/or substance abuse impairments. New directional goals such as

vocational education or re-building relationships are often priorities. Relapse prevention

issues are key in assisting the client’s recognition of triggers and warning signs of

regression. Aftercare services help families and pro-social support systems reinforce a

healthy living environment.

30. Information and Referral. These services maintain information about resources in the

community, link people who need assistance with appropriate service providers, and

Page 164: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

163

FINAL EVALUATION REPORT | Contract LHZ68

provide information about agencies and organizations that offer services. The

information and referral process involves being readily available for contact by the

individual; assisting the individual with determining which resources are needed;

providing referral to appropriate resources; and following up to ensure the individual’s

needs have been met, if the individual agrees to such follow-up activities.

31. Behavioral Health Overlay Services (BHOS). Medicaid funded behavioral health

services provided as an overlay to residential group care.

32. Outpatient Detoxification. Outpatient detoxification services utilize medication and/or

psychosocial counseling regimen to assist recipients in their efforts to withdraw from the

physiological and psychological effects of the abuse of addictive substances.

33. FACT Team. These non-residential care services are available twenty-four (24) hours

per day, seven (7) days per week, and include community-based treatment, rehabilitation

and support services provided by a multidisciplinary team to persons with severe and

persistent mental illness (SPMI) or to SPMI with co-occurring disorders.

34. Outpatient-Group. This cost center provides a therapeutic environment that is designed

to improve the functioning or prevent further deterioration of persons with mental health

and/or substance abuse problems. Outpatient-group services are usually provided on a

regularly scheduled basis by appointment, with arrangements made for non-scheduled

visits during times of increased stress or crisis. The group size limitations applicable to

the Medicaid program shall apply to all outpatient services funded through a state

substance abuse and mental health program contract.

35. Room & Board w/Supervision, Level I. This cost center solely provides for room and

board with supervision on a twenty-four (24) hours per day, seven (7) days per week

Page 165: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

164

FINAL EVALUATION REPORT | Contract LHZ68

basis. It corresponds to Residential Level I. This cost center is not applicable for

provider facilities which meet the definition of an Institute for Mental Disease (IMD) as

defined in the Center for Medicaid Service’s State Medicaid Manual, Section 4, March

1994.

36. Room & Board w/Supervision, Level II. This cost center corresponds to cc [19] above

for Residential Level II; same programs, units and data elements as cc [36] above for

Room and Board with Supervision Level I

37. Room & Board w/Supervision, Level III. This cost center corresponds to cc [20] above

for Residential Level III; same programs, units and data elements as cc [36] above for

Room and Board with Supervision Level I.

38. Short-term Residential Treatment. These individualized, stabilizing acute and

immediately sub acute care services provide short and intermediate duration intensive

mental health residential and habilitative services on a twenty-four (24) hour per day,

seven (7) days per week basis. These services must meet the needs of individuals who

are experiencing an acute or immediately sub acute crisis and who, in the absence of a

suitable alternative, would require hospitalization.

39. Mental Health Clubhouse Services. This cost center provides structured, community-

based services designed to strengthen and/or regain the client’s interpersonal skills,

provide psycho-social therapy toward rehabilitation, develop the environmental supports

necessary to help the client thrive in the community and meet employment and other life

goals and promote recovery from mental illness. Services are typically provided in a

community-based program with trained staff and members working as teams to address

the client’s life goals and to perform the tasks necessary for the operations of the

Page 166: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

165

FINAL EVALUATION REPORT | Contract LHZ68

program. The emphasis is on a holistic approach focusing on the client’s strengths and

abilities while challenging the client to pursue those life goals. This service would

include, but not limited to, clubhouses certified under the International Center for

Clubhouse Development.

40. Project Recovery. Project Recovery is designed to enhance and extend the state’s

capacity to serve individuals with severe emotional issues beyond the scope of crisis

counseling. The project uses multidisciplinary teams located in selected counties to

provide assessments, referrals, service planning, direct services and the purchase of

therapeutic service from other providers to reduce the effects of trauma or other

emotional effects resulting from the storms.

41. Intervention – Group. Intervention services focus on reducing risk factors generally

associated with the progression of substance abuse and mental health problems.

Intervention is accomplished through early identification of persons at risk, performing

basic individual assessments, and providing supportive services that emphasize short-

term counseling and referral. These services are targeted toward individuals and families.

This cost center is used when reporting an individual’s services which are provided in a

group environment. Each individual within the group would have separate service event

record to record group participation.

42. Aftercare – Group. This cost center includes services provided to individuals who have

completed treatment in a licensable service component. Aftercare activities include client

participation in daily activity functions which were adversely affected by mental illness

or substance abuse impairments. New directional goals such as vocational education or

re-building relationships are often priorities. Relapse prevention issues are key in

Page 167: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

166

FINAL EVALUATION REPORT | Contract LHZ68

assisting the client’s recognition of triggers and warning signs of regression. Aftercare

services help families and pro-social support systems reinforce a healthy living

environment. This cost center is used when reporting an individual’s services which are

provided in a group environment. Each individual within the group would have a

separate service event record to record group participation.

43. Comprehensive Community Service Team – Individual. Comprehensive Community

Service Team (CCST) services render assistance in identifying goals and making choices

to promote resiliency and facilitate recovery to adults and children with mental illness.

The services take place in either an outpatient or community based setting. For

individuals with mental health problems, recovery is the personal process of overcoming

the negative impact of psychiatric illness despite its continued presence. CCST services

are intended to restore the individual’s function and participation in the community. The

services are designed to assist and guide individuals in reconnecting with society and

rebuilding skills in identified roles in their environment. The focus is on the individual

strengths and resources as well as their readiness and phase of recovery. A team

approach to services will be used to guide and support the adults and children served with

development of a recovery plan focusing on the areas of individual and family living,

learning, working and socialization activities. Any therapy is brief and oriented toward

skill building.

44. Comprehensive Community Service Team – Group. Comprehensive Community

Service Team (CCST) services render assistance in identifying goals and making choices

to promote resiliency and facilitate recovery to adults and children with mental illness,

the services take place in either an outpatient or community based setting. For

Page 168: Final evaluation report - Florida Department of Children ... Region Gap … · 26/6/2020  · FINAL EVALUATION REPORT | Contract LHZ68 services to meet their needs (Simms, Madelyn,

167

FINAL EVALUATION REPORT | Contract LHZ68

individuals with mental health problems, recovery is the personal process of overcoming

the negative impact of psychiatric illness despite its continued presence. CCST services

are intended to restore the individual’s function and participation in the community. The

services are designed to assist and guide individuals in reconnecting with society and

rebuilding skills in identified roles in their environment. The focus is on the individual

strengths and resources as well as their readiness and phase of recovery. A team

approach of services will be used to guide and support the adults and children served with

development of a recovery plan focusing on the areas of individual and family living,

learning, working and socialization activities. Any therapy is brief and oriented toward

skill building.

45. Substance Abuse Recovery Support Services – Individual. These services are

designed to strengthen and/or regain the person’s skills, and to assist the person in

developing the environmental support necessary to help him or her thrive in the

community and meet life goals which promote recovery and resiliency. The focus is on

person strengths and abilities while providing support for progress toward the person

achieving recovery goals reflected in the person’s screening, assessment, treatment plan,

or discharge summary.

46. Substance Abuse Recovery Support Services – Group. These services are designed to

strengthen and/or regain the person’s skills, and to assist the person in developing the

environmental support necessary to help him or her thrive in the community and meet life

goals which promote recovery and resiliency. The focus is on person strengths and

abilities while providing support for progress toward the person achieving recovery goals

reflected in the person’s screening, assessment, treatment plan, or discharge summary.