Before we begin, a caution…

PowerPoint Presentation

2015 Self-Study Workshop Session VIIICharacteristics ofGood Self-Study Reports

Tom Tanner ATS Commission Staff1Before we begin, a caution

ATS Commission on Accrediting: 2015 Self-Study Workshop

If youre going to work that hard, do the right carCharacteristics of Good Self-Study ReportsFive things to remember to do the right report:

The 4 purposes of the reportThe 3 qualities of the reportThe 5 features of good/weak reportsThe 4 parts of the reportThe 3 last things to remember


12345Characteristics of Good Self-Study ReportsFive things to remember to do the right report:



1Characteristics of Good Self-Study ReportsThe 4 purposes of the report (www.ats.edu)

ATS Commission on Accrediting: 2015 Self-Study WorkshopTab 5(page 7)

Characteristics of Good Self-Study ReportsThe 4 purposes of the report

Demonstrate ability to analyze institutions own effectivenessDevelop plans for improvementProvide evidence of meeting standardsForm basis for external review

ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 4 purposes of the report

Demonstrate ability to analyze institutions own effectivenessGood long look in the mirrorThe mirror has two faces:Schools own missionATS Commission standards



Develop plans for improvement

Report must not only look around but look ahead

Assessment (self-study) should showATS Commission on Accrediting: 2015 Self-Study Workshop


Provide evidence of meeting standards

Weak report:Our seminary clearly meets this standard.

Good report: Evidence of how our seminary meets this standard may be summarized in these three ways. First,

ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 4 purposes of the report

Form basis for external review

The self-study report is your storybut told to strangers (so dont assume)who are sympathetic, but objectiveso you must present and persuade

ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsFive things to remember to do the right report:



2Characteristics of Good Self-Study ReportsThe 3 qualities of the report*

Provide sufficient descriptionDocument appropriate evaluationIdentify strategic recommendations

* Page 11 of Chapter Two of the HandbookATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 3 qualities of the report

Provide sufficient description

Weak report: We have sufficient faculty, and they are all sufficiently qualified.

Good report:We have seven full-time faculty; six have PhD degrees and one has a DMin (see Faculty Credentials for detailed list).ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 3 qualities of the report

Provide sufficient description

Weak report: Our SLAP efforts have produced significant improvements.

Good report:Our Student Learning Assessment Program (affectionately called SLAP by students) has produced these three improvements in student learning this past year. First,...ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 3 qualities of the report


ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 3 qualities of the report

Document appropriate evaluation

Weak report: Our MDiv program addresses the cultural context requirement (Degree Program Standard A, section A.2.3) fairly well, but could use improvement.

Good report:We evaluate the cultural context component in two ways: (1) a cultural awareness survey (indirect measure) and (2) a cultural engagement project (direct measure). Results are provided in Table A.2 below, followed by a discussion of how those results have been used to improve our MDiv students learning in this critical area.ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 3 qualities of the report

Document appropriate evaluation

Weak report: We try hard not to spend more than we take in.

Good report:The seminary has balanced its budget four of the last five years, as Table 8.6 below demonstrates. The deficit of $74,892 in FY12 represented only a 2.5% overage due to an unexpected need to replace a furnace. We have since established a contingency fund for such emergencies, with a line-item budget of $50,000 per year.ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 3 qualities of the report



Identify strategic recommendations

Weak report: We know more should be done to address our lack of board diversity, and we are working on that.

Good report:Given our global mission and given that one fourth of our students and staff are ethnic minorities, while no one on the board is, our trustees have set a goal of recruiting one new ethnic trustee each year for the next five years until our board more fairly represents our constituency and our mission. Our first African American trustee will begin her term this fall.


Identify strategic recommendations

Weak report: As you will see scattered throughout this report, we have identified dozens and dozens of different areas to improve.

Good report:We have organized each chapter of the report (one per standard) into four parts: (1) a brief description of that area, (2) a critical evaluation of that area, (3) a list of strengths in that area, and (4) a set of two or three strategic recommendations per area to address key concerns identified. All recommendations are summarized and prioritized in the last chapter.




3Characteristics of Good Self-Study ReportsThe 5 features of good [vs. weak] reports

Are organized coherentlyDescribe the self-study processPresent the data crucial to understandingComprehensive as necessary; brief as possibleDemonstrate objectivity and honesty

ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 5 features of good/weak reports

Are organized coherentlyMust be organized by the standards

If joint/coordinated visit, must have detailed cross walk [Joint visits only with NEASC; coordinated, possible with any]

Must also have Introduction and Conclusion Will discuss later under The 4 parts of the report


Describe the self-study process

Introduction describes processProcess engages the communityReflected in report and interviews

Caution: Summarize process in 1-2 pagesIf use peoples names, use titles tooATS Commission on Accrediting: 2015 Self-Study Workshop

Characteristics of Good Self-Study ReportsThe 5 features of good/weak reports

Present the data crucial to understanding

Be clear and concise with dataUse qualitative and quantitative dataUse tables and charts to support narrative

Caution: Put extensive data in Documents Room/links But include summary data in text When using links, make easy to use

ATS Commission on Accrediting: 2015 Self-Study WorkshopClearly label each itemCharacteristics of Good Self-Study ReportsThe 5 features of good/weak reports




Weak report: Our students are very diverse.

Good report:Our 150 students, whose ages range from 24 to 64 (with most in their 30s), are 45% female, and 30% ethnic minorities, with a dozen different denominations represented (see Table 6.3 below for demographic details). This is what one recent graduate said about her experience here regarding diversity: [quote].



Weak report: Most of our MDiv students are placed.

Good report:Over the last five years our MDiv graduates have averaged a 90% placement rate, with a steady increase each year, as the table below shows.



Weak report: We evaluated our student services through a survey last year; see data at this link.

Good report:Faculty and staff reviewed the results of a recent student survey (2014 Student Survey, linked here and also in File 6.2 in Documents Room:) and drew these four conclusions regarding student services


Comprehensive as necessary; brief as possible

Weak reports:Missing standards (e.g., Degree Program Standards)Too few pages: 50 pages wont cover the standardsToo many pages: 175+ pages overwhelm reviewersPrinted incorrectly: Single-sided/double-spaced reports double the length and the weight (remember your traveling readers)


Comprehensive as necessary; brief as possible

Good reports:100-135 pages is ideal range 5-10 page Introduction75ish pages for General Institutional Standards (1-8)15-40 pages for Educational and Degree Program Standards5-10 page ConclusionDont overwhelm text with supplemental informationPut lengthy information in appendices or links


Demonstrate objectivity and honesty

Weak report: Morale on campus is much better.

Good report: Three years ago faculty morale hit a low point when a doctrinal controversy led to the dismissal of a popular professor. The seminary followed its procedures (documented in our personnel files), but it was a very difficult time. Since then, the board and administration have worked hard to rebuild unity, with significant successas noted in the recent faculty survey (see 2015 Faculty Survey, item #8).



Weak report: The seminary has experienced some administrative turnover since the last visit.

Good report: We have had three presidents and four deans in the last decade. These turnovers have occurred for various reasons and with varying results. We will summarize those reasons and results here, but the evaluation committee is also encouraged to ask about this during their on-site interviews to have a more nuanced understanding of this issue.



Weak report: [no mention of recent public controversy]

Good report: Just prior to submitting this self-study report to our trustees for their review, five students filed a complaint against a faculty member alleging sexual harassment. Unfortunately, portions of that complaint have surfaced recently in social media. We have initiated our formal complaint process, and we will inform the evaluation committee of any significant developments that we are permitted legally and ethically to share.

NOTE: Boards are to receive self-study reports (p. 10 of Chapter Two in Handbook)ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsFive things to remember to do the right report:



4Characteristics of Good Self-Study ReportsThe 4 parts of the report*

IntroductionMain NarrativeConclusionAppendices (do not print; on flash drive only)

* Pages 13-14 of Chapter Two of the Handbook [NOTE: These 4 parts were discussed, in part, earlier]

ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsThe 4 parts of the report

IntroductionMain NarrativeConclusionAppendices


Introduction (5-10 pages)Introduce the school (mission/history)Review accreditation history (since last visit)Give overview of the self-study processIdentify any special features of the reportSummarize any major changes (since last visit)Orient readers to any unique school issues


Main Narrative (90-115 pages)

Part 1: General Institutional Standards (75 pp.) Standards 1-8must cover each one

Part 2: Educational and Degree Program Standards (15-40 pp.)

Educational Standardcover only applicable sectionsDegree Programs Standardscover only applicable standards

NOTE: Can cover assessment under ES.6 or under section 1 of each DPS


Main Narrative (90-115 pages)

One suggested structure per chapter (per earlier slide):

brief description of schools resources for that standardcritical evaluation of schools alignment with standardlist of strengths of the school in terms of that standardstrategic recommendations to improve in that standardNOTE: If not meeting standard, must describe plans to do so. * Do not need to cover every subsection in every standard: group things.ATS Commission on Accrediting: 2015 Self-Study WorkshopCharacteristics of Good Self-Study ReportsATS Commission on Accrediting: 2015 Self-Study Workshop

Weak Report: Discuss each of 10 subsections Good Report:

Discuss each of 3 sections Standard 4 Library (as example)Characteristics of Good Self-Study ReportsThe 4 parts of the report

Conclusion (5-10 pages)Summarize overall findings of self-studyOrganize and prioritize strengthsOrganize and prioritize concernsOrganize and prioritize recommendationsConclude with desired action (optional)


Appendices (For any other material, provide link in report)Required appendix materials (bookmarked PDF on USB)

1) Current org chart5) Most recent audit and letter2) Current strategic plan6) Handbooks (board, staff, etc.)3) Current assessment plan7) Academic catalog4) Current budget8) Targeted Issues Checklist

* See list on pages 16-17 of Chapter Three of the Handbook** Also need Word version of TIC for committee to complete

ATS Commission on Accrediting: 2015 Self-Study Workshop***Characteristics of Good Self-Study ReportsThe 4 parts of the report

Items for Documents Room (not in appendix)See list on pages 17-18 of Chapter Three of HandbookDocuments Room may be physical or virtual (if virtual, see guidelines on pages 15-16 of Chapter Three)

These and other items may be linked in reportother items such as Bylaws, Charter, etc.




5Characteristics of Good Self-Study Reports5. The 3 last things to remember

Tell your storyin light of the standardsto improve your students and school


Where will this journey take you?