Using the Best Evidence to Find Solutions that Make a Difference

Robert PachecoDirector of Research,

Development and PlanningBarstow College

CSI: Barstow

Last year, we had some fun…

Looking at creating a culture of inquiry…We used the metaphor of solving a crime… using

direct and circumstantial evidence….

Outcomes from a Year Ago…

• Develop a sense of “inquiry” (that asking questions without immediately knowing the answers is good);• Evaluate decisions based on the evidence (reliable and valid) not intuition;• Recognize issues of equity and fairness in outcomes and decisions on your campus.

Factors That Impact Student Success and Improvement in Basic Skills

cccbsi.org

But we have to go deeper… You are faculty researchers now…

Outcomes for Today• Understand the levels of data/evidence and

the conclusions that can be drawn and not drawn at each level; and

• Appreciate the movement from a macro (wide angle) look at hurdles to student learning and a micro (highly focused) look at learning.

Utilization Focus Evaluation, Michael Quinn Patton

Magnification and View of the Problem

From the Surface… Macroscopic

At 20 x

At 40 x

At 1000 x

At >Millions x

Hat tip to Janet Fulks

At 20 XNuclei visible with dye

Some organelles perceptible

Cell walls noticeable

At 40 XGreater detail…

Cell material takes shape

Inner parts of Nuclei visible

At 1000 x

Light as a method to view reaching its limits

Cells may need to be in another medium for clarityOrganelles clear

At >Millions XElectron Microscope

Clarity , but field of scope has been narrowed

DNA visible

Magnification and View of the Problem

From the Surface… Macroscopic

At 20 x

At 40 x

At 1000 x

At >Millions x

Let’s take the Metaphor to our Students

At the Surface

Issues of Equity and Opportunity

Different Skill SetsVaried Educational Experiences

Let’s Look at a Situation at an Institution at 20x Magnification

ARCC DATA

What Information Do you Need to Make Looking at This Level of

Magnification Meaningful?

Definitions of the ARCC Variables

Let’s Look at a Situation at an Institution at 20x Magnification

ARCC DATA

What Conclusions Can You Make at this Level of Magnification?

Which Conclusions are Eluding Us at this Level?

Let’s Look at a Situation at an Institution at 40x Magnification

Look at Your Lab Manual

forClearer Image

of the Slide and Much

More Detailed

Information…

What Conclusions Can You Make at this Level of Magnification?

Which Conclusions are Eluding Us at this Level?

Let’s Look at a Situation at an Institution at 1000x Magnification

Program Outcome

Perform mathematical processes well enough to complete freshman college mathematics requirements.

BSI Math Program Outcomes

2a. Seventy percent of the completers will score 75% or higher on a locally devised test of pre-college math competencies.

2b. Seventy percent of completers will score 75% or higher on each sub score area of the locally devised test.

Means of Assessment & Criteria for Success2a. Sixty-one percent of completers scored 75% or better.

2b. Linear equations- 68%; Inequalities- 74%

Quadratic equations- 58%; Graphing- 62%

Powers & roots- 86%; Proportions- 67%

Results of Assessment

Look at Your Lab Manual forClearer Image of the Slide and Much More Detailed

Information…

What Conclusions Can You Make at this Level of Magnification?

Which Conclusions are Eluding Us at this Level?

Let’s Look at a Situation at an Institution at Millionsx Magnification

Look at Your Lab Manual

forClearer Image of the Slide…

Magnification and View of the Problem

From the Surface… Macroscopic

At 20x

At 40x

At 1000x

At >2000x

Let’s Review!

Let’s Look at Inteventions

We Know You Would Study the Algebra Problem Much More Deeply than What We Just Did, but to Help the Discussion Along…

Suppose You Had 2 Interventions to Pick From to Remedy This Problem: 1) Tutorial/SI or 2) Establishing a Learning Community.

Which Intervention Would you Pick and Why?

Now You Are Ready to Go Talk With Your Researcher

Have Fun….