Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
EllenBaraStolzenberg,Ph.D.AssistantDirector,CIRP
HigherEducationResearchInstituteUniversityofCalifornia,LosAngeles
� Weaccomplishthismissionby:� Workingincooperationwithinstitutionsofhighereducation
� Producinganddisseminatingoriginalresearch
� Providingthetoolsandresourcestoutilizeresearchattheinstitutionallevel
� Trainingresearcherstoadvanceinstitutionalassessmentandscholarshipinhighereducation
� Developingpartnershipswithhighereducationorganizationstopromoteinstitutionalexcellence
HERIMissionStatement“ThemissionoftheHigherEducationResearchInstituteistoinformeducationalpolicyandpromoteinstitutionalimprovementthroughanincreasedunderstandingofhighereducationanditsimpactoncollegestudents.”
TwoDimensionsofHERI
Grant-FundedResearch
• HHMI• HelmsleyTrust• NationalInstitutesofHealth• NationalScienceFoundation
• AnnualStudentSurveys• TriennialFacultySurvey
CIRPStudentSurveys*
CollegeSeniorSurvey
(CSS)
DiverseLearning
Environments(DLE)
YourFirstCollegeYear
(YFCY)
FreshmanSurvey(TFS)
Collegeentry Endof1styear 2ndor3rdyear Senioryear
*FacultySurveyadministeredevery3years
As=nI-E-O
Inputs
Environments
Outputs
Source:AssessmentforExcellence:ThePhilosophyandPracticeofAssessmentandEvaluationinHigherEducation(Astin,1991)
ImportanceofLongitudinalData� Linksurveyscompletedbythesameindividualatdifferentpointsintime
� Onlywaytoeffectivelyassesschange
� Demonstrategrowth
� Studentdevelopment
� Programevaluation
� Collegeimpact
HowCIRPsurveysareusedinlongitudinalassessment?� CIRPdatacanbeusedtoexamineassumptionsaboutthestudentexperienceandhowinstitutionalresourcesrelatetostudentlearning,growth,anddevelopment.
� Institutionscanbenchmarkagainstthemselvesovertimetoexaminetrends,orlongitudinally(usingmultiplesurveys)toassessgrowthanddevelopment.
� InstitutionscancomparetheirperformanceonindividualitemsandrelevantCIRPConstructstopeerinstitutions.
Conceptualiza=onofDiverseLearningEnvironmentsandAssessment� Understandtheexperiencesoftargetpopulationstodiminishinequityandimproveexperiences
� Needtoknowmoreaboutcreatingtheconditionstooptimizeengagementanddesireddiversityoutcomes
� Understandhowtoimproveservicestomeetstudentneeds� Builtonagrowingbodyofresearchwithdiversepopulationsatthecenter
� Reviewed90+previousinstrumentsusedtoassessdiversityandcampusclimate
� Builtonpreviousmodelsoftheenvironment,multiplecontextsofstudentexperience
� Developedasurveythatlinkedclimate(perceptionsandbehaviors)andpractices(whatinstitutionsdo)withstudentoutcomes
DiverseLearningEnvironmentsProject� DLEwasnotjustasurvey.Partoflargermixedmethodsproject� Sitevisits� AdministrationofDLEinstrument� AdvancedresearchmethodsandclimateassessmenttrainingatUCLA
� SimultaneousdevelopmentofMMDLE–Multi-ContextualModelforDiverseLearningEnvironments
� NationalStudentClearinghousedatatostudyretention,combinedwithTFSdata
CampusClimateforDiversity
HistoricalLegacyofInclusion/Exclusion
PsychologicalClimate
(Perceptions)
BehavioralDimension
(InteractionsandPractices)
StructuralDiversity(TheNumbers)
Government/Policy Context Socio-historical Context
(Hurtado, Milem, Clayton-Pedersen, & Allen, 1999)
DLEInstrument
11
� Integratedassessmentofclimate,diversitypractice,andoutcomes
� Inclusiveofdiversesocialidentities� Factors� Longitudinal,orencourageitsuselinkedwithotherstudentdata
� Widelyavailable� Modulestargetingspecifictopics� Newfor2015
Op=onalModules� ClassroomClimate
� TransitiontotheMajor
� IntergroupRelations
� Spirituality(newfor2016)
� ClimateforTransferat2-YearInstitutions
� ClimateforTransferStudentsat4-YearInstitutions
DLEInstrument:Newfor2015� Additionoflimitedsetofquestionsaddressingsexualassault� Students’experienceswith“unwantedsexualcontact”� Follow-upsregardingincapacitation,physicalforce� Disclosurequestions
� Agnosticandatheistoptionsforreligiouspreference
� Additionalrace/ethnicityoptions� Reasonsforconsideringdroppingout
Factors
� Climate� Practices� Outcomes
• Harassment(α=0.917)• Microaggressions(α=0.889)• PositiveCross-RacialInteraction(α=0.882)• SatisfactionwithDiversePerspectivesonCampus(α=0.873)
• InstitutionalCommitmenttoDiversity(α=0.857)
• AcademicValidationintheClassroom(α=0.863)• GeneralInterpersonalValidation(α=0.862)
• CurriculumofInclusion(α=0.854)
• Co-CurricularDiversityActivities(Campus-Facilitated)(α=0.903)
• IntegrationofLearning(α=0.736)• PluralisticOrientation(α=0.787)
• SocialActionEngagement(α=0.799)
• CivicAction(α=0.801)
Administra=on,Data,Reports,&Deliverables
Administra=on� Timing
� Customization� Welcome&Thankyoupages� Invitation&reminders� Logo
� Weboptionsfordisseminatingsurvey
� Additionalquestions� Upto20closed-endedquestions� Upto5open-endedquestions
Data� Accesstopreliminarydataduringadministration
� Finaldatafile
� Confidentialityvs.anonymity
� PersonalIdentifiers
� Mergingdata
Reports&Deliverables� Reports
� InstitutionalProfile� FactorReport� ThemeReport
� Deliverables� PowerPoint� Infographics
� Futureadditionstoreportingpackage� Intergroupcomparisons� Themeinfographicsortargetedhandoutsfordifferentaudiences
Sample:Infographics
2015DLESample� 19,580students
� 26institutions
� 69.4%Female
� 20.8%First-Generation
Race/Ethnicity %NativeAmerican 0.2AsianAmerican 8.4Black/AfricanAmerican 5.7Hawaiian 0.2White,non-Hispanic 48.6Latino/a 20.5Unknown 10.1Twoormore,non-Hispanic 6.2
ClassStanding %Freshman/firstyear 14.4Sophomore/secondyear 23.6Junior/thirdyear 33.7Senior/fourthyear 18.0Fifth-yearsenior+ 10.4
SelectedFindings
71.8
89.682.7
23.3
69.0
28.4
0
10
20
30
40
50
60
70
80
90
100
�Iseemyselfaspartofthecampus
community
Ifasked,Iwouldrecommendthiscollegetoothers
Thiscollegehasalongstandingcommitmentto
diversity
Thiscollegehasalotofracial
tension
Thiscollegeprovidesthefinancial
supportIneedtostayenrolled
Imayhavetochoosebetween
financiallysupportingmyfamilyandgoing
tocollege
%AgreeorStronglyagree
Towhatextenthaveyouexperiencedthefollowingwithstudentsfromaracial/ethnicgroupotherthanyourown?
6.3
12.8
40.3
47.2
0
5
10
15
20
25
30
35
40
45
50
Hadtense,somewhathostile
interactions
Hadguarded,cautiousinteractions
Hadmeaningfulandhonestdiscussionsaboutrace/ethnicrelationsoutsideof
class
Sharedpersonalfeelingsandproblems
%Oftenorveryoften
Haveyoupersonallyexperiencedthefollowingformsofbias/harassment/discrimina:onwhileatthiscollege?
14.1 14.2 14.4 15.117.7
19.9
0
5
10
15
20
25
%Yes
Howmanycourseshaveyoutakenatthiscollegethatincludedmaterials/readingsabout...?
48.956.7
61.369.8
78.7 80.8
0
10
20
30
40
50
60
70
80
90
Disability Sexualorientation
Privilege Gender Socioeconomicclassdifferences
Race/ethnicity
%Oneormore
AssessingthePervasivenessofCollegeSexualAssault
• 11.0%ofwomenreportedunwantedsexualcontactcomparedto4.7%ofmen
• Ratesofunwantedsexualcontactamongfemalesurveyrespondentsforindividualcampuses:3.9%to34.6%
Amongstudentswhoreportedunwantedsexualcontact:� 36.1%reportedtheeventoccurredwhileunabletoprovideconsentduetobeingdrugged,drunk,orotherwiseincapacitated
� 19.0%reportedtheeventinvolvedtheuseorthethreattousephysicalforce
� 57.5%indicatedtheallegedassailanthadanaffiliationwithcampus,and16.7%wereunsure
� 18.6%didn’ttellanyone,11.9%toldacounselorortherapist,5.0%toldacampusadministrator,3.9%toldcampuspolice,2.4%toldlocallawenforcement
� 77.7%toldafriend,15.2%toldaparent/guardian
UsingtheData:3Perspec=ves� Localcampusresearch
� Programreviewandevaluation� Mergewithinstitutionaldata� Institutionaleffectiveness� Campusclimate� Learningoutcomes� Accreditation
� Institutional-levelComparisons� National� Comparisongroups� Institution-selectedpeers
� HERIresearchusingnationaldata� Peer-reviewedjournals� Monographs� Presentations� BriefReports
NextStepsfortheDLE� Releaseof2015Infographic&Brief
� Continuetoanalyze2015data� Questionskips� Surveydropoff� Examinationacrossdemographics
� Newfor2016� Socialidentityquestionaddedtothecore� Addeddistinctionbetweenunwantedsexualcontactandsexualassault� Timing,officialcomplaint,satisfactionwithoutcome
� Spiritualitymodule
ContactInforma=onEllenBaraStolzenberg,PhD
AssistantDirector,CIRPUCLAHigherEducationResearchInstitute
(310)[email protected]