Embed Size (px)
Citation preview
US Department of Education - EDCAPS G5-Technical Review Form (New)
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10062017 1024 AM
Technical Review Coversheet
Applicant
Reader 1
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 1
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The proposed project would serve a population of students that all fall significantly below every indicator (p e32-51) These communities have severe deficiencies A project as such would greatly benefit the area by making services more accessible
Weaknesses No weaknesses found
Strengths The applicant provided a vivid picture of the geographical area and conditions in Perry County Kentucky (pp e50-53) The area described included human conditions and the physical conditions of the land The applicant provides data in reference to very low per capita income and hazardous travel These communities face hardships as those in urban areas but less frequently heard of and addressed
Weaknesses No weaknesses found
Strengths The applicant provides adequate information on the communities to be served (pp e32-51) The applicant provides past and current data in order to identify long overdue needs The communities have significant gaps and weaknesses that need to be addressed such as access to services and community resources adequate nutrition and safety (pp e55-58)
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
113017 248 PM Page 2 of 7
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant completely describes services that will create an absolute pipeline from early learning through college and career (p e60) The family and school coordination is very beneficial for the communities because bridging relationships between school and home are imperative in order to produce success in children (pp e313-318) This pipeline of services does not have time and resource gaps
Weaknesses No weaknesses found
Strengths The proposed project has multiple specific methods of evaluation to produce data (p e67-70) For example the percent of students graduating college and career ready the intended outcome is related to performance measures and the applicant will collect extensive quantitative and qualitative data The applicant chose to display the methods of evaluation for acquiring multiple sources of data in a clear and concise format using a table The table is very reader friendly The methods of evaluation are strong and will progress the project
Weaknesses No weaknesses found
Strengths The applicant provides a detailed logic model for the proposed project (p e328) The logic model is aligned with the intended outcomes For example increased appropriate age functioning and access to 21st century learning tools The logic model includes details of the projected projectrsquos success The logic model was a great representation of the projectrsquos framework
Weaknesses No weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The strategies for access and treatment are of quality and feasible (pp e76-77)The applicant will use print and radio to effectively publicize the project I think it is an creative idea to incorporate home visits to introduce the services available as well
Weaknesses The applicant does not provide any statistical information about the underrepresented groups that will be served
Strengths The applicant is very experienced providing interventions to high needs populations (p e77) With the Promise Neighborhoods grant these programs can be successful The applicant should improve achievement of the students
113017 248 PM Page 3 of 7
served based on the complete pipeline of services and methods of evaluation
Weaknesses No weaknesses found
Strengths The applicantrsquos current partnerships are impressive and will greatly assist with the proposed project including one currently with the US Department of Education (p e85) The applicant will have measures in place to hold partners accountable such as formal and informal MOUs contractual and reimbursement agreements and continuous communication (p e85) The applicant included a plan to manage partnerships which is a great step towards greatness as it shows reflection and how the project is enhanced from experiences with partners (p e86)
Weaknesses The applicant does not describe a plan to establish partnerships The applicant describes relationships already in place and how those partnerships will be managed
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant did an excellent job providing a well designed and adequate management plan The plan is adequate to support its educational purposes by providing proper management responsibilities over the project The applicant provides a timeline and milestones for the first 2 years (p e99-100) The costs are responsible and slight increases are included after year 5 for cost of living The responsibilities of key personnel are included and justifiable (p e94-96)
Weaknesses No weaknesses found
Strengths The applicantrsquos plan for data collection is extensive and appropriate for such a large project (p e102) This is a result of their data systems matching and linking data from multiple systems The Data Management and Security Plan is appropriate and aligned with the project They will ensure that they secure appropriate data sharing agreements upon expansion (p e108) The project will use the same data management system as used in the 2011 Promise Neighborhoods with some changes and expansion This will work because they are adding to a system that is already in place and that they are familiar with
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
113017 248 PM Page 4 of 7
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The proposed costs are reasonable for the number of persons to be served None of the costs appear excessive or beyond what is needed for the scope of the project (pp e110-112) For example academic interventionists are necessary for the success of the proposed project (p e447)
Weaknesses No weaknesses found
Strengths The applicantrsquos sustainability plan is realistic for the proposed project (p e113) The applicant is experienced with the use of grant funds and sustainability The proposed project has commitments already in place to sustain the project following the grant period The applicant provides evidence of success for the current Promise Neighborhood The applicant collected input from teachers demonstrating a commitment to the most important stakeholders (p e38)
Weaknesses No weaknesses found
Strengths The applicant details existing assets that will be used (pp e120-124) The applicant provides an ample amount of assets in order to implement each part of the pipeline services For example State of Kentucky Police safety programs and Perry County Health Department for wellness initiatives
Weaknesses
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant was awarded the BCJI grant in 2016 the appropriate documentation was provided (pp e426-432)
Weaknesses No weaknesses found
113017 248 PM Page 5 of 7
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant provided a memorandum of understanding with Owsley County Action Team recipient of the DFC grant (pp e436-438)
Weaknesses No weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
Readers Score
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant provide a signed Certification of Consistency with Promise Zones Goals and Implementation (HUD Form 50153) (p e439) This provides verification of the designated Promise Zone
Weaknesses No weaknesses found
113017 248 PM Page 6 of 7
Readers Score 1
Status Submitted
Last Updated 10062017 1024 AM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10012017 1137 PM
Technical Review Coversheet
Applicant
Reader 2
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10062017 1024 AM
Technical Review Coversheet
Applicant
Reader 1
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 1
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The proposed project would serve a population of students that all fall significantly below every indicator (p e32-51) These communities have severe deficiencies A project as such would greatly benefit the area by making services more accessible
Weaknesses No weaknesses found
Strengths The applicant provided a vivid picture of the geographical area and conditions in Perry County Kentucky (pp e50-53) The area described included human conditions and the physical conditions of the land The applicant provides data in reference to very low per capita income and hazardous travel These communities face hardships as those in urban areas but less frequently heard of and addressed
Weaknesses No weaknesses found
Strengths The applicant provides adequate information on the communities to be served (pp e32-51) The applicant provides past and current data in order to identify long overdue needs The communities have significant gaps and weaknesses that need to be addressed such as access to services and community resources adequate nutrition and safety (pp e55-58)
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
113017 248 PM Page 2 of 7
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant completely describes services that will create an absolute pipeline from early learning through college and career (p e60) The family and school coordination is very beneficial for the communities because bridging relationships between school and home are imperative in order to produce success in children (pp e313-318) This pipeline of services does not have time and resource gaps
Weaknesses No weaknesses found
Strengths The proposed project has multiple specific methods of evaluation to produce data (p e67-70) For example the percent of students graduating college and career ready the intended outcome is related to performance measures and the applicant will collect extensive quantitative and qualitative data The applicant chose to display the methods of evaluation for acquiring multiple sources of data in a clear and concise format using a table The table is very reader friendly The methods of evaluation are strong and will progress the project
Weaknesses No weaknesses found
Strengths The applicant provides a detailed logic model for the proposed project (p e328) The logic model is aligned with the intended outcomes For example increased appropriate age functioning and access to 21st century learning tools The logic model includes details of the projected projectrsquos success The logic model was a great representation of the projectrsquos framework
Weaknesses No weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The strategies for access and treatment are of quality and feasible (pp e76-77)The applicant will use print and radio to effectively publicize the project I think it is an creative idea to incorporate home visits to introduce the services available as well
Weaknesses The applicant does not provide any statistical information about the underrepresented groups that will be served
Strengths The applicant is very experienced providing interventions to high needs populations (p e77) With the Promise Neighborhoods grant these programs can be successful The applicant should improve achievement of the students
113017 248 PM Page 3 of 7
served based on the complete pipeline of services and methods of evaluation
Weaknesses No weaknesses found
Strengths The applicantrsquos current partnerships are impressive and will greatly assist with the proposed project including one currently with the US Department of Education (p e85) The applicant will have measures in place to hold partners accountable such as formal and informal MOUs contractual and reimbursement agreements and continuous communication (p e85) The applicant included a plan to manage partnerships which is a great step towards greatness as it shows reflection and how the project is enhanced from experiences with partners (p e86)
Weaknesses The applicant does not describe a plan to establish partnerships The applicant describes relationships already in place and how those partnerships will be managed
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant did an excellent job providing a well designed and adequate management plan The plan is adequate to support its educational purposes by providing proper management responsibilities over the project The applicant provides a timeline and milestones for the first 2 years (p e99-100) The costs are responsible and slight increases are included after year 5 for cost of living The responsibilities of key personnel are included and justifiable (p e94-96)
Weaknesses No weaknesses found
Strengths The applicantrsquos plan for data collection is extensive and appropriate for such a large project (p e102) This is a result of their data systems matching and linking data from multiple systems The Data Management and Security Plan is appropriate and aligned with the project They will ensure that they secure appropriate data sharing agreements upon expansion (p e108) The project will use the same data management system as used in the 2011 Promise Neighborhoods with some changes and expansion This will work because they are adding to a system that is already in place and that they are familiar with
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
113017 248 PM Page 4 of 7
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The proposed costs are reasonable for the number of persons to be served None of the costs appear excessive or beyond what is needed for the scope of the project (pp e110-112) For example academic interventionists are necessary for the success of the proposed project (p e447)
Weaknesses No weaknesses found
Strengths The applicantrsquos sustainability plan is realistic for the proposed project (p e113) The applicant is experienced with the use of grant funds and sustainability The proposed project has commitments already in place to sustain the project following the grant period The applicant provides evidence of success for the current Promise Neighborhood The applicant collected input from teachers demonstrating a commitment to the most important stakeholders (p e38)
Weaknesses No weaknesses found
Strengths The applicant details existing assets that will be used (pp e120-124) The applicant provides an ample amount of assets in order to implement each part of the pipeline services For example State of Kentucky Police safety programs and Perry County Health Department for wellness initiatives
Weaknesses
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant was awarded the BCJI grant in 2016 the appropriate documentation was provided (pp e426-432)
Weaknesses No weaknesses found
113017 248 PM Page 5 of 7
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant provided a memorandum of understanding with Owsley County Action Team recipient of the DFC grant (pp e436-438)
Weaknesses No weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
Readers Score
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant provide a signed Certification of Consistency with Promise Zones Goals and Implementation (HUD Form 50153) (p e439) This provides verification of the designated Promise Zone
Weaknesses No weaknesses found
113017 248 PM Page 6 of 7
Readers Score 1
Status Submitted
Last Updated 10062017 1024 AM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10012017 1137 PM
Technical Review Coversheet
Applicant
Reader 2
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 1
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The proposed project would serve a population of students that all fall significantly below every indicator (p e32-51) These communities have severe deficiencies A project as such would greatly benefit the area by making services more accessible
Weaknesses No weaknesses found
Strengths The applicant provided a vivid picture of the geographical area and conditions in Perry County Kentucky (pp e50-53) The area described included human conditions and the physical conditions of the land The applicant provides data in reference to very low per capita income and hazardous travel These communities face hardships as those in urban areas but less frequently heard of and addressed
Weaknesses No weaknesses found
Strengths The applicant provides adequate information on the communities to be served (pp e32-51) The applicant provides past and current data in order to identify long overdue needs The communities have significant gaps and weaknesses that need to be addressed such as access to services and community resources adequate nutrition and safety (pp e55-58)
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
113017 248 PM Page 2 of 7
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant completely describes services that will create an absolute pipeline from early learning through college and career (p e60) The family and school coordination is very beneficial for the communities because bridging relationships between school and home are imperative in order to produce success in children (pp e313-318) This pipeline of services does not have time and resource gaps
Weaknesses No weaknesses found
Strengths The proposed project has multiple specific methods of evaluation to produce data (p e67-70) For example the percent of students graduating college and career ready the intended outcome is related to performance measures and the applicant will collect extensive quantitative and qualitative data The applicant chose to display the methods of evaluation for acquiring multiple sources of data in a clear and concise format using a table The table is very reader friendly The methods of evaluation are strong and will progress the project
Weaknesses No weaknesses found
Strengths The applicant provides a detailed logic model for the proposed project (p e328) The logic model is aligned with the intended outcomes For example increased appropriate age functioning and access to 21st century learning tools The logic model includes details of the projected projectrsquos success The logic model was a great representation of the projectrsquos framework
Weaknesses No weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The strategies for access and treatment are of quality and feasible (pp e76-77)The applicant will use print and radio to effectively publicize the project I think it is an creative idea to incorporate home visits to introduce the services available as well
Weaknesses The applicant does not provide any statistical information about the underrepresented groups that will be served
Strengths The applicant is very experienced providing interventions to high needs populations (p e77) With the Promise Neighborhoods grant these programs can be successful The applicant should improve achievement of the students
113017 248 PM Page 3 of 7
served based on the complete pipeline of services and methods of evaluation
Weaknesses No weaknesses found
Strengths The applicantrsquos current partnerships are impressive and will greatly assist with the proposed project including one currently with the US Department of Education (p e85) The applicant will have measures in place to hold partners accountable such as formal and informal MOUs contractual and reimbursement agreements and continuous communication (p e85) The applicant included a plan to manage partnerships which is a great step towards greatness as it shows reflection and how the project is enhanced from experiences with partners (p e86)
Weaknesses The applicant does not describe a plan to establish partnerships The applicant describes relationships already in place and how those partnerships will be managed
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant did an excellent job providing a well designed and adequate management plan The plan is adequate to support its educational purposes by providing proper management responsibilities over the project The applicant provides a timeline and milestones for the first 2 years (p e99-100) The costs are responsible and slight increases are included after year 5 for cost of living The responsibilities of key personnel are included and justifiable (p e94-96)
Weaknesses No weaknesses found
Strengths The applicantrsquos plan for data collection is extensive and appropriate for such a large project (p e102) This is a result of their data systems matching and linking data from multiple systems The Data Management and Security Plan is appropriate and aligned with the project They will ensure that they secure appropriate data sharing agreements upon expansion (p e108) The project will use the same data management system as used in the 2011 Promise Neighborhoods with some changes and expansion This will work because they are adding to a system that is already in place and that they are familiar with
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
113017 248 PM Page 4 of 7
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The proposed costs are reasonable for the number of persons to be served None of the costs appear excessive or beyond what is needed for the scope of the project (pp e110-112) For example academic interventionists are necessary for the success of the proposed project (p e447)
Weaknesses No weaknesses found
Strengths The applicantrsquos sustainability plan is realistic for the proposed project (p e113) The applicant is experienced with the use of grant funds and sustainability The proposed project has commitments already in place to sustain the project following the grant period The applicant provides evidence of success for the current Promise Neighborhood The applicant collected input from teachers demonstrating a commitment to the most important stakeholders (p e38)
Weaknesses No weaknesses found
Strengths The applicant details existing assets that will be used (pp e120-124) The applicant provides an ample amount of assets in order to implement each part of the pipeline services For example State of Kentucky Police safety programs and Perry County Health Department for wellness initiatives
Weaknesses
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant was awarded the BCJI grant in 2016 the appropriate documentation was provided (pp e426-432)
Weaknesses No weaknesses found
113017 248 PM Page 5 of 7
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant provided a memorandum of understanding with Owsley County Action Team recipient of the DFC grant (pp e436-438)
Weaknesses No weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
Readers Score
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant provide a signed Certification of Consistency with Promise Zones Goals and Implementation (HUD Form 50153) (p e439) This provides verification of the designated Promise Zone
Weaknesses No weaknesses found
113017 248 PM Page 6 of 7
Readers Score 1
Status Submitted
Last Updated 10062017 1024 AM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10012017 1137 PM
Technical Review Coversheet
Applicant
Reader 2
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant completely describes services that will create an absolute pipeline from early learning through college and career (p e60) The family and school coordination is very beneficial for the communities because bridging relationships between school and home are imperative in order to produce success in children (pp e313-318) This pipeline of services does not have time and resource gaps
Weaknesses No weaknesses found
Strengths The proposed project has multiple specific methods of evaluation to produce data (p e67-70) For example the percent of students graduating college and career ready the intended outcome is related to performance measures and the applicant will collect extensive quantitative and qualitative data The applicant chose to display the methods of evaluation for acquiring multiple sources of data in a clear and concise format using a table The table is very reader friendly The methods of evaluation are strong and will progress the project
Weaknesses No weaknesses found
Strengths The applicant provides a detailed logic model for the proposed project (p e328) The logic model is aligned with the intended outcomes For example increased appropriate age functioning and access to 21st century learning tools The logic model includes details of the projected projectrsquos success The logic model was a great representation of the projectrsquos framework
Weaknesses No weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The strategies for access and treatment are of quality and feasible (pp e76-77)The applicant will use print and radio to effectively publicize the project I think it is an creative idea to incorporate home visits to introduce the services available as well
Weaknesses The applicant does not provide any statistical information about the underrepresented groups that will be served
Strengths The applicant is very experienced providing interventions to high needs populations (p e77) With the Promise Neighborhoods grant these programs can be successful The applicant should improve achievement of the students
113017 248 PM Page 3 of 7
served based on the complete pipeline of services and methods of evaluation
Weaknesses No weaknesses found
Strengths The applicantrsquos current partnerships are impressive and will greatly assist with the proposed project including one currently with the US Department of Education (p e85) The applicant will have measures in place to hold partners accountable such as formal and informal MOUs contractual and reimbursement agreements and continuous communication (p e85) The applicant included a plan to manage partnerships which is a great step towards greatness as it shows reflection and how the project is enhanced from experiences with partners (p e86)
Weaknesses The applicant does not describe a plan to establish partnerships The applicant describes relationships already in place and how those partnerships will be managed
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant did an excellent job providing a well designed and adequate management plan The plan is adequate to support its educational purposes by providing proper management responsibilities over the project The applicant provides a timeline and milestones for the first 2 years (p e99-100) The costs are responsible and slight increases are included after year 5 for cost of living The responsibilities of key personnel are included and justifiable (p e94-96)
Weaknesses No weaknesses found
Strengths The applicantrsquos plan for data collection is extensive and appropriate for such a large project (p e102) This is a result of their data systems matching and linking data from multiple systems The Data Management and Security Plan is appropriate and aligned with the project They will ensure that they secure appropriate data sharing agreements upon expansion (p e108) The project will use the same data management system as used in the 2011 Promise Neighborhoods with some changes and expansion This will work because they are adding to a system that is already in place and that they are familiar with
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
113017 248 PM Page 4 of 7
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The proposed costs are reasonable for the number of persons to be served None of the costs appear excessive or beyond what is needed for the scope of the project (pp e110-112) For example academic interventionists are necessary for the success of the proposed project (p e447)
Weaknesses No weaknesses found
Strengths The applicantrsquos sustainability plan is realistic for the proposed project (p e113) The applicant is experienced with the use of grant funds and sustainability The proposed project has commitments already in place to sustain the project following the grant period The applicant provides evidence of success for the current Promise Neighborhood The applicant collected input from teachers demonstrating a commitment to the most important stakeholders (p e38)
Weaknesses No weaknesses found
Strengths The applicant details existing assets that will be used (pp e120-124) The applicant provides an ample amount of assets in order to implement each part of the pipeline services For example State of Kentucky Police safety programs and Perry County Health Department for wellness initiatives
Weaknesses
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant was awarded the BCJI grant in 2016 the appropriate documentation was provided (pp e426-432)
Weaknesses No weaknesses found
113017 248 PM Page 5 of 7
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant provided a memorandum of understanding with Owsley County Action Team recipient of the DFC grant (pp e436-438)
Weaknesses No weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
Readers Score
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant provide a signed Certification of Consistency with Promise Zones Goals and Implementation (HUD Form 50153) (p e439) This provides verification of the designated Promise Zone
Weaknesses No weaknesses found
113017 248 PM Page 6 of 7
Readers Score 1
Status Submitted
Last Updated 10062017 1024 AM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10012017 1137 PM
Technical Review Coversheet
Applicant
Reader 2
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
served based on the complete pipeline of services and methods of evaluation
Weaknesses No weaknesses found
Strengths The applicantrsquos current partnerships are impressive and will greatly assist with the proposed project including one currently with the US Department of Education (p e85) The applicant will have measures in place to hold partners accountable such as formal and informal MOUs contractual and reimbursement agreements and continuous communication (p e85) The applicant included a plan to manage partnerships which is a great step towards greatness as it shows reflection and how the project is enhanced from experiences with partners (p e86)
Weaknesses The applicant does not describe a plan to establish partnerships The applicant describes relationships already in place and how those partnerships will be managed
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant did an excellent job providing a well designed and adequate management plan The plan is adequate to support its educational purposes by providing proper management responsibilities over the project The applicant provides a timeline and milestones for the first 2 years (p e99-100) The costs are responsible and slight increases are included after year 5 for cost of living The responsibilities of key personnel are included and justifiable (p e94-96)
Weaknesses No weaknesses found
Strengths The applicantrsquos plan for data collection is extensive and appropriate for such a large project (p e102) This is a result of their data systems matching and linking data from multiple systems The Data Management and Security Plan is appropriate and aligned with the project They will ensure that they secure appropriate data sharing agreements upon expansion (p e108) The project will use the same data management system as used in the 2011 Promise Neighborhoods with some changes and expansion This will work because they are adding to a system that is already in place and that they are familiar with
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
113017 248 PM Page 4 of 7
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The proposed costs are reasonable for the number of persons to be served None of the costs appear excessive or beyond what is needed for the scope of the project (pp e110-112) For example academic interventionists are necessary for the success of the proposed project (p e447)
Weaknesses No weaknesses found
Strengths The applicantrsquos sustainability plan is realistic for the proposed project (p e113) The applicant is experienced with the use of grant funds and sustainability The proposed project has commitments already in place to sustain the project following the grant period The applicant provides evidence of success for the current Promise Neighborhood The applicant collected input from teachers demonstrating a commitment to the most important stakeholders (p e38)
Weaknesses No weaknesses found
Strengths The applicant details existing assets that will be used (pp e120-124) The applicant provides an ample amount of assets in order to implement each part of the pipeline services For example State of Kentucky Police safety programs and Perry County Health Department for wellness initiatives
Weaknesses
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant was awarded the BCJI grant in 2016 the appropriate documentation was provided (pp e426-432)
Weaknesses No weaknesses found
113017 248 PM Page 5 of 7
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant provided a memorandum of understanding with Owsley County Action Team recipient of the DFC grant (pp e436-438)
Weaknesses No weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
Readers Score
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant provide a signed Certification of Consistency with Promise Zones Goals and Implementation (HUD Form 50153) (p e439) This provides verification of the designated Promise Zone
Weaknesses No weaknesses found
113017 248 PM Page 6 of 7
Readers Score 1
Status Submitted
Last Updated 10062017 1024 AM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10012017 1137 PM
Technical Review Coversheet
Applicant
Reader 2
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The proposed costs are reasonable for the number of persons to be served None of the costs appear excessive or beyond what is needed for the scope of the project (pp e110-112) For example academic interventionists are necessary for the success of the proposed project (p e447)
Weaknesses No weaknesses found
Strengths The applicantrsquos sustainability plan is realistic for the proposed project (p e113) The applicant is experienced with the use of grant funds and sustainability The proposed project has commitments already in place to sustain the project following the grant period The applicant provides evidence of success for the current Promise Neighborhood The applicant collected input from teachers demonstrating a commitment to the most important stakeholders (p e38)
Weaknesses No weaknesses found
Strengths The applicant details existing assets that will be used (pp e120-124) The applicant provides an ample amount of assets in order to implement each part of the pipeline services For example State of Kentucky Police safety programs and Perry County Health Department for wellness initiatives
Weaknesses
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant was awarded the BCJI grant in 2016 the appropriate documentation was provided (pp e426-432)
Weaknesses No weaknesses found
113017 248 PM Page 5 of 7
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant provided a memorandum of understanding with Owsley County Action Team recipient of the DFC grant (pp e436-438)
Weaknesses No weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
Readers Score
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant provide a signed Certification of Consistency with Promise Zones Goals and Implementation (HUD Form 50153) (p e439) This provides verification of the designated Promise Zone
Weaknesses No weaknesses found
113017 248 PM Page 6 of 7
Readers Score 1
Status Submitted
Last Updated 10062017 1024 AM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10012017 1137 PM
Technical Review Coversheet
Applicant
Reader 2
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant provided a memorandum of understanding with Owsley County Action Team recipient of the DFC grant (pp e436-438)
Weaknesses No weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
Readers Score
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant provide a signed Certification of Consistency with Promise Zones Goals and Implementation (HUD Form 50153) (p e439) This provides verification of the designated Promise Zone
Weaknesses No weaknesses found
113017 248 PM Page 6 of 7
Readers Score 1
Status Submitted
Last Updated 10062017 1024 AM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10012017 1137 PM
Technical Review Coversheet
Applicant
Reader 2
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Readers Score 1
Status Submitted
Last Updated 10062017 1024 AM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10012017 1137 PM
Technical Review Coversheet
Applicant
Reader 2
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 10012017 1137 PM
Technical Review Coversheet
Applicant
Reader 2
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 18
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
15
98
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 105
113017 248 PM Page 1 of 7
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 2
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant clearly defined the magnitude of the problem to be addressed with an explanation of the effects of substance abuse in the applicants target area The applicant has shown a need for intervention due to the high rates of opioid- caused overdose deaths in 2014 (e376) The applicant states that there is a greater need for more rigors in the schools in the Promise Neighborhood Zones including a lack of math and English proficiency The applicant provides 14 indicators which give an analysis of the necessity and severity of issues in Promise Neighborhoods The applicant states that Attendance rates in 6th 7th 8th and 9th grades within the Promise Neighborhood are lower or on pace with that of Kentucky(e32-39)
Weaknesses no weaknesses noted
Strengths The applicant gave a detailed explanation to the extent to which the geographically defined area has been described The applicant states that there is a lack of involvement with isolated areas in Perry county and there is a high rate of students who are not prepared for instruction The applicant states how the mountainous range area is problematic and has caused issues in terms of internet access and access to needed materials In 2016 97 of the school-age children in the Neighborhood qualified for free and reduced lunch The applicant states that 8495 children and youth as follow 1766 children ages 0ndash4 4346 ages 5ndash17 and 2383 youth ages 18ndash24(e375)
Weaknesses no weaknesses noted
Strengths The applicant gives a clear explanation of the gaps or weaknesses in service infrastructure or opportunities For example the lack of resources have caused for low postsecondary enrollment at 72 and completion rates of 37 which gave yielded 336 certificates of completion (e374) Each of the 14 indicators is provided with a solution addressed through services infrastructure and opportunities that are deficient in the target area
Weaknesses no weaknesses found
Readers Score 15
113017 248 PM Page 2 of 7
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths The applicant has given an excellent plan to create a complete pipeline of services For example the applicant proposes a priority connection which begins at early learning with children family learning and outdoor activities in preparation for Kindergarten through Eighth Grade students The applicant seeks to improve the resources and health situations for the target group For example the applicant seeks to include external businesses in order to help increase parents learning and sustainability to improve transitions over time
Weaknesses no weaknesses found
Strengths The applicant has given a clear explanation for the methods of evaluations using objective performance measures These measures are clearly related to intended outcomes The applicant states that within the first six months of the project each of the 13 Promise Neighborhood schools will develop a local work plan to implement integrated student supports to ensure all students are receiving necessary supports referrals and services (pg 32) The applicant seeks to improve the environment as a whole through healthy eating an improved academic curricula focusing on abuse prevention and improve the social emotional competencies that have been evaluated in their youth For example the applicant will Implement early warning system AndashBndashC One-to-One Academic Case Management system tiered interventions integrated student supports to include embedded tutoring referrals to tutoring academic programs support services and summer reading programs (starting in 3rd grade)
Weaknesses no weaknesses found
Strengths The applicant has given a detailed explanation of the proposed project being supported by strong theory The applicant has provided direction connections between birth to career with short term and long terms goals This 4 year plan supports and uses connectors to show the relevance of the need for early childhood development to support their ultimate versions of improved systems for education as well as a more positive leverage of resources for all learners
Weaknesses no weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of
113017 248 PM Page 3 of 7
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant provides an equal access plan for various groups of learners The applicant gives strategies to improve the language barriers along with various vision hearing and translators to support students that have traditionally been underrepresented based on race color national origin gender age or disability The applicant gives information to support diversity within their program and efforts set aside to make sure that the diversity is sufficient within the program
Weaknesses The applicant does not provide clear detail as to how they will implement these advantages to the target group
Strengths The applicant has provided a clear explanation of the likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards The applicant shows a detailed plan for student achievement and growth with tutoring and extra assistance The applicant has shown closure in achievement gaps from 11 in 2004 to 8 in 2008 The applicant provides data to support their plan for project services through explanations of aspiration rigor expectation accountability and sustainably to foster lasting success (pg 52 53 e80 e81) The applicant seeks increase access to rigorous and engaging in coursework by replicating that National Math and Science Institute Advanced Placement Incentive Program (APOP) (pg 45 e82)
Weaknesses no weaknesses found
Strengths The applicant has clearly demonstrated commitment of key partners including LEA government agencies and nonprofits which are in place in order to support the goals of the program This will establish methods that will ensure long term success For example in June 2017 the program received additional funding form Kentucky Arts Council which enabled extended learning opportunities after a school day for students to increase exposure to the arts
Weaknesses none weaknesses found
Readers Score 18
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths The applicant has provided a sufficient plan of management The applicant will use integrative resources through regional offices trained staff and population awareness Key personnel are in place to ensure the implementation of the plan School superintendents and program directors will work with an advisor board to assure results F or example the advisory board will meet six items through the year and its 25 members will contain 60 of Neighborhood residents The applicant has provided a detailed timeline which will ensure that the responsibilities of each staff member will have coordinated planned activities for each task For example the Project director and Program
113017 248 PM Page 4 of 7
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
managers will work with partners to develop[s sustainability action plans for the target group (pg 73 e400)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear management plan with provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability The applicant states that they have a Data Management and Security plan that includes data description and collections responsibilities various types of data and storage and a data team which is directed by the Principal Investigator This is the expansion of longitudinal data stems and makes data integration a simpler process The applicant also details how their full-time data team will help and ensure security controls are handled for existing and expanding services (pg 81 e405) The applicant also states a clear strategy to collaborate with the national evaluator on design and data collection procedures maintaining up-to-date data handling standards
Weaknesses no weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicantrsquos budget of $3000000 per year with an average of $706 per child per year in total direct costs appears adequate to support planned project services and activities for the participant The proposed allocation of resources in the budget is clearly related to the objectives of the project (pg 27 e468)
Weaknesses no weaknesses found
Strengths The applicant has provided a clear explanation of the extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders critical to the projectrsquos long-term success For example the applicant has provided an adequate breakdown of total direct costs indirect costs as well as contractual obligation pg26 27-e467 468)
Weaknesses no weakness found
Strengths The applicant has provided a clear and concise listing of existing neighborhood assets and programs which are supported by Federal state local and private funds used to implement pipeline services (e22 e38) For example the applicant provides information about Quantum Health Care (private) as well as the Primary Care Center which provides medical services and wellness programs for families and their children from birth to age 5 (pg e120)
113017 248 PM Page 5 of 7
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Weaknesses no weaknesses found
Readers Score 15
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
Strengths The applicant has met the qualifications and proposes to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable The applicant has efforts that ill information Promise neighborhood of gaps in safety (e371)
Weaknesses no weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
General
Strengths The applicant has addressed the Preference priority to and demonstrated that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) The applicant states that they have reviewed data from meetings that were held over the last 18 month including Promise Zone and BCJ(e371) (Weaknesses no weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3
113017 248 PM Page 6 of 7
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
none noted
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strengths The applicant has addressed competitive preference 4 The applicant shows that they are the lead education implementation partner for the Promise Zone Dreama Gentry executive director of Partners for Education serves on the Promise Zone Advisory Board and chairs the Promise Zone Education Working Group(pg 12 e28)
Weaknesses no weaknesses found
Readers Score 1
Status Submitted
Last Updated 10012017 1137 PM
113017 248 PM Page 7 of 7
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Scored
Points Possible Points Possible
Status Submitted
Last Updated 09292017 0102 PM
Technical Review Coversheet
Applicant
Reader 3
Berea College (U215N170006)
Points Possible Points Scored
Questions
Selection Criteria
Need for Project
1 Need 15 15
Quality of Project Design
1 Project Design 30 30
Quality of Project Services
1 Project Services 20 19
Quality of the Management Plan
1 Management Plan 20 20
Adequacy of Resources
1 Adequacy of Resources
Sub Total
15
100
12
96
Priority Questions
Competitive Preference Priority
Competitive Preference Priority
1 Priority
2 Priority
3 Priority
4 Priority
Sub Total
3
3
1
1
8
3
3
0
1
7
Total 108 103
113017 248 PM Page 1 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Technical Review Form
Panel 3 - Panel - 6 84215N
Reader 3
Applicant Berea College (U215N170006)
Questions
Selection Criteria - Need for Project
1 The magnitude or severity of the problems to be addressed by the proposed project as described by indicators of need and other relevant indicators identified in part by the needs assessment and segmentation analysis
The extent to which the geographically defined area has been described
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
Strengths The applicant is commended for the thoroughness of their needs assessment to determine the magnitude or severity of the problems to be addressed by the proposed project They relied on the review of a variety of sources for the assessment It is noted that in addition to Surveys and Focus groups is the use of archival data such as the Annie E Casey Foundation KidsCount and the U S Census Bureaursquos American Community Survey to measure indicators of neighborhood quality health and well-being Other sources included the Kentucky Department of Education reports on attendance graduation rate and educational achievement and progress Collected data were analyzed and segmented by gender race income grade level and place of residence within the county (pages e32 amp 33) The analysis of data found for example that students in the most geographically isolated parts of Perry County have low levels of kindergarten readiness For example only 6 of children in the most isolated school in the Neighborhood entered Kindergarten ready to learn (page e34) Another notable finding revealed an Achievement Gap of 19 - 30 among those students who qualify for free and reduced lunch and those who do not (page e36)
Weaknesses No weaknesses found Strengths The proposal provides a descriptive picture of Perry County the projectrsquos Promise Neighborhood (PN) which is in the heart of Appalachian Kentucky Details of its topographical features such as the fact that mountains and valleys occupy about equal portions of the county with 80 of the landscape forested and hazardous travel conditions during inclement weather combined with an overall isolated setting contribute to the nature of the projectrsquos needs There are two local education agencies and three towns in the PN spread out over 340 square miles serving close to 5000 students in 13 schools grades K-12) (pages e51-e53)
Weaknesses No weaknesses found
The extent to which specific gaps or weaknesses in services infrastructure or opportunities have been identified and will be addressed by the proposed project including the nature and magnitude of those gaps or weaknesses (34 CFR 75210)
Strengths
113017 248 PM Page 2 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
The applicantrsquos needs assessment and segmentation analysis is effective in that it identifies specific indicators to be addressed by the proposed project Material on page e33-e51 presents in detail each indicated need For example only 50 of children enter Kindergarten ready to learn and 25 of youth 16- to 19-year-olds in the community are not in school and not working Relevant data describes the magnitude and severity of those gaps or weaknesses The indicators that will be addressed by the Project are clearly summarized in Figure 14 that outlines indicator gaps or weaknesses in services infrastructure and opportunities addressed by the project and refers to solutions described in other sections of the proposal (pages e55-e60) Of note is the indicator describing the low number of students at or above Proficiency and the low number of passing scores on AP courses especially among non-white students The applicant sees this as a reflection of the lack of rigorous instruction (page e37) Figure 5 Promise Neighborhood Classroom Rigor Findings by Content (page 38-e40) summarizes the indicators that support the assessment of lack of rigor
Weaknesses No weaknesses found
Readers Score 15
Selection Criteria - Quality of Project Design
1 The extent to which the applicant describes a plan to create a complete pipeline of services including early learning through grade 12 college- and career-readiness and family and community supports without time and resource gaps that will prepare all children in the neighborhood to attain an excellent education and successfully transition to college and a career and that will significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible
The extent to which the proposed project is supported by strong theory
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-11 Adequately Developed 12-23 Strongly Developed 24-29 Fully Developed 30
General
Strengths
The applicant is commended for both the extent and quality of its plan to create a complete pipeline of services Examples of pipeline components include the development of childrenrsquos vocabulary and expressive and receptive language and a supplemental curriculum designed to develop informal mathematical knowledge and skills in preschool children pages (e331-e332) The combination of a Logic model (page e328) an outline of the connection of Solutions to Need Indicators (Figure 15 pages e63-e66) and details of Targeted indicators partners description of activitystrategy relevant theory of change program cost by activity Implementation Plan and Segmentation Analysis together provide confidence in its ability to significantly increase the proportion of students in the neighborhood that are served by the complete continuum to reach scale over time
WeaknessesNo weaknesses found
The extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data to the extent possible (34 CFR 75210)
Strengths The proposed evaluation aspects of the project are clearly related to its intended outcomes and are appropriate to the production of quantitative and qualitative data Specific qualitative and quantitative data (such as the percentage of 6 7 8
113017 248 PM Page 3 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
and 9th graders identified with attendance issues) to be produced for each indicator along with performance are listed in detail (Figure 16 pages e67-e70) The proposed evaluator REACH has an extensive history of working with similar programs It is anticipated that the evaluator will employ quasi-experimental and repeated measures designs Data Collection Timeline dimensions and Instruments are outlined (pages e71-e74) Significantly these details and a series of guiding evaluation questions indicate the applicantrsquos attention directed at evaluation
WeaknessesNo weaknesses found
StrengthsThe theories supporting the project are illustrated by a logic model (page e75 amp e328) and are cited and annotated indetailed in Attachment G (pages e329-e346) Most of these citations such as ldquoMadden N A Slavin R E Karweit NDolan L amp Wasik B A (1993) Success for All reg Longitudinal effects of a restructuring program for inner-cityelementary schools American Educational Research Journal 30(1) 123ndash148rdquo meet WWC evidence standards
WeaknessesNo weaknesses found
Readers Score 30
Selection Criteria - Quality of Project Services
1 The quality and sufficiency of strategies for ensuring equal access and treatment for eligible project participants who are members of groups that have traditionally been underrepresented based on race color national origin gender age or disability
The likelihood that the services to be provided by the proposed project will lead to improvement in the achievement of students as measured against rigorous academic standards
The quality of the applicantrsquos plan to establish formal and informal partnerships including the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to create a system for holding partners accountable for performance in accordance with the memorandum of understanding
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
StrengthsThe applicant proposes to communicate with every PN family informing them that their student is eligible for PromiseNeighborhood services Special accommodations will be made for participants with disabilities They state that allhomeless children and youth are informed of the program and their eligibility for services Particular attention will be paidto evaluating the progress of participants with special needs to determine if their needs are being met or if modifications inservice delivery should be made
WeaknessesAlthough assurances are made and general methods mentioned regarding equal access and treatment for eligible projectparticipants little detail is provided as to how the applicant will ensure equal access and treatment for members of groupsthat have traditionally been underrepresented based on race color national origin gender age or disability
StrengthsThe applicant has a proven record of improving student achievement as measured against rigorous academic standardsand has developed relevant standards for a College-Going Culture for the project It is likely that the services to beprovided by the proposed project will lead to improvement in the achievement of students as measured against rigorousacademic standards These standards include program services and activities that are aligned with the standards or
113017 248 PM Page 4 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
conditions (pages e77-e80)
Weaknesses No weaknesses found
Strengths A Memoranda of Understanding (MOU) signed by each partner is attached (pages e212-e225) Each partner has agreed to the alignment of the visions theories of action and theories of change described in its memorandum of understanding and to be held accountable for performance in accordance with the memorandum of understanding In addition to the applicant and the three PN school districts these partners include a community childrenrsquos foundation that empowers children in Southern Appalachia a drug coalition that works to rid communities of illegal drug use and Save the Children an independent international organization creating lasting change in the lives of children in need This combination of partnering organizations has the ability to address many of the projects indicators of need The applicant is recognized for convening a group of key partners who developed the Perry Promise Neighborhood pipeline of services and secured commitments for both direct and in-kind dollars to support the Promise Neighborhood initiative The applicant also established an Advisory Board consisting of representatives of all partnering organizations along with community members parents and youth (page e31)
Weaknesses
No weaknesses found
Readers Score 19
Selection Criteria - Quality of the Management Plan
1 CapacityQuality of the Management Plan The adequacy of the management plan to achieve the objectives of the proposed project on time and within budget including clearly defined responsibilities timelines and milestones for accomplishing project tasks
The adequacy of the management planrsquos provisions on collecting analyzing and using data for decision making learning continuous improvement and accountability including whether the applicant has a plan to build adapt or expand a longitudinal data system that integrates student-level data from multiple sources in order to measure progress while abiding by privacy laws and requirements and ensuring that any systems built adapted or expanded upon includes essential security controls
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-6 Adequately Developed 7-13 Strongly Developed 14-19 Fully Developed 20
General
Strengths Oversight of the project is notable for its well-developed involvement of stakeholders and clear division of responsibilities Relevant entities include a Strategy and Sustainability Team an Advisory Board family and youth councils and a principal investigator (pages e90-e94) The Strategy and Sustainability Team assists in the development of a Promise Neighborhood financial and operating model and plan The Advisory Board includes representation from the key partners and residents The councils ensure the voice of families and students are heard The Principal Investigator (100 FTE) responsibilities include but are not limited to ensuring that all programs strategies and activities are implemented with fidelity Management is led by a 100 FTE Project director whose qualifications and responsibilities and outlines on pages e95-96 Resumes and job descriptions of personnel portray a competent staff with specific responsibilities appropriate to the projectrsquos requirements (Attachment B pages e130-e210) The projectrsquos activities responsibilities and timelines are outlined for year 1 (pages e100-e101) and appear to be adequate to achieve the objectives of the proposed project on time
Weaknesses
113017 248 PM Page 5 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
No weaknesses found
Strengths The proposal presents a comprehensive data system based on previous training and experience It is managed by a full-time data team that includes data analysts designated data managers that work with others to ensure security controls The data team is experienced in data management and have attended numerous training opportunities on data security (page e109) Case Management and Data Systems Include backup procedures for the data It also details timelines for data preservation and destruction and outlines the protocols and data needed to maintain both the case management system for tracking progress toward outcomes for individual students and parents participating in programs and the longitudinal data system to track outcome measures over time The data system becomes more effective because it links data from multiple systems including the Kentucky Department of Education and the National Student Clearinghouse (pages e105-106)
Weaknesses No weaknesses found
Readers Score 20
Selection Criteria - Adequacy of Resources
1 The extent to which the costs are reasonable in relation to the number of persons to be served and to the anticipated results and benefits
The extent to which the applicant demonstrates that it has the resources to operate the project beyond the length of the grant including a multi-year financial and operating model and accompanying plan the demonstrated commitment of any partners evidence of broad support from stakeholders (eg State educational agencies teachersrsquo unions) critical to the projectrsquos long-term success or more than one of these types of evidence
The extent to which the applicant identifies existing neighborhood assets and programs supported by Federal State local and private funds that will be used to implement pipeline services
Suggested Point Ranges Not Addressed 0 Poorly Developed 1-5 Adequately Developed 6-10 Strongly Developed 11-14 Fully Developed 15
General
StrengthsThe number of PN students in grades three through high school is 2552 and those entering Kindergarten is 370 (pagese33-e35) Added to these are students in grades one and two and serviced families costs are reasonable in relation toanticipated results and benefits Examples of these costs are 24 Academic Interventionists placed in each school toprovide academic support for students and 4 Program Managers responsible for the implementation of one or morecritical areas of the continuum (pages e443-e444)
WeaknessesIt is unclear if the FTE for the principal Investigator and Program Associates is reasonable given the scope and nature oftheir outlined responsibilities (page e443)
StrengthsThe applicantrsquos sustainability plan contains elements that make it workable These include an endowment to fundleadership and fundraising and cultivating community partnerships that lead to sustainability Figure 22 (pages e114-e116)illustrates the applicantrsquos previous PN grant sustainability A key suggestion was for partners to develop a plan to guidethe future direction of the Promise Neighborhood The intention to duplicate this strategy is implied or stated in the MOUsby a number of formal and informal program partners For example the Perry County Public Schools a programparticipant states in its MOU that after completion of the plan it will adopt its elements into its area of work (pages e107-
113017 248 PM Page 6 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
e118 e221 and e212-e285)
WeaknessesNo weaknesses found
StrengthsWidespread local support is evidenced by the extensive neighborhood assets and programs supported by Federal Statelocal and private funds that will be used to implement pipeline services eg the Appalachian Regional Medical Centerprovides medical services to families and their children birth to age five (pages e120-e124) The applicant is commendedfor having garnered the support of the leaders of these programs
WeaknessesNo weaknesses found
Readers Score 12
Priority Questions
Competitive Preference Priority - Competitive Preference Priority
1 Competitive Preference Priority 1 0 or 3 Points
Byrne Criminal Justice Innovation (BCJI) Program
To meet this priority an applicant must propose to serve geographic areas that were the subject of a targeted strategy addressing crime in a specific community pursuant to a BCJI grant awarded by the US Department of Justice during FY 2012 or later years To be eligible under this priority the applicant must either (1) Be able to demonstrate that it has received a BCJI grant or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a BCJI grant The memorandum of understanding must indicate a commitment on the part of the applicant and partner to coordinate implementation and align resources to the greatest extent practicable
General
StrengthsThe applicant has verified by means of appropriate documentation (Appendix J pages e422-e436) that it is a recipient ofthe Bureau of Justice Assistance (BJA) Fiscal Year 2015 Byrne Criminal Justice Innovation Program implementationaward to serve the Southeastern Kentucky Promise Zone which includes the targeted Perry County
WeaknessesNo weaknesses found
Readers Score 3
2 Competitive Preference Priority 2 0 or 3 Points
Drug Free Communities (DFC) Support Program
To receive points under this priority the applicant must either (1) Demonstrate that it has received a DFC grant to prevent opioid abuse (as one of its areas of focus) or (2) provide in its application a memorandum of understanding between it and a partner that is a recipient of a DFC grant to address opioid abuse prevention as one of its areas of focus
113017 248 PM Page 7 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
General
Strengths Appendix J (pages e437-e439) includes a memorandum of understanding with the Owsley County Action Team a partner organization verifying its award of a Drug Free Communities (DFC) grant in 2016 Notably a key area of focus of the DFC grant is the reduction of opioid abuse through a community campaign targeted to parents grandparents and caregivers
WeaknessesNo weaknesses found
Readers Score 3
3 FOR EVIDENCE BASED REVIEWERS ONLY
Competitive Preference Priority 3 0 or 1 Points
Evidence-Based Activities Strategies or Interventions
To meet this priority an applicant must propose to carry out evidence based activities strategies or interventions that based on information included in their application are supported by promising evidence
General
We are not to do Priority 3
Readers Score 0
4 Competitive Preference Priority 4 0 or 1 Points
Promise Zones
This priority is for projects that are designed to serve and coordinate with a federally designated Promise Zone To meet this priority an applicant must include a Certification of Consistency with Promise Zone Goals and Implementation (HUD Form 50153) signed by an authorized representative of the lead organization of a Promise Zone designated by the Department of Housing and Urban Development (HUD) or the United States Department of Agriculture An application for Promise Neighborhoods grant funds that is not accompanied by a signed certification (HUD Form 50153) will receive zero points for this priority The certification form is available at portalhudgov hudportaldocuments huddocid=HUD_Form_50153pdf To view the list of designated Promise Zones and lead organizations please go to wwwhudgovpromisezones
General
Strength An attached signed letter and HUD Form 50153 (Appendix J pages e439 amp e440) verify that the project is located in a federally designated rural Promise Zone the Southeastern Kentucky Promise Zone
WeaknessesNo weaknesses found
Readers Score 1
113017 248 PM Page 8 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
Status Submitted
Last Updated 09292017 0102 PM
113017 248 PM Page 9 of 9
