Concepts, Operationalization, & Measurement Dr. Guerette

Concepts, Concepts, Operationalization, Operationalization,

& Measurement& MeasurementDr. GueretteDr. Guerette

Conceptions & ConceptsConceptions & Concepts

These are the abstract mental These are the abstract mental images (concepts) that will be images (concepts) that will be turned into terms that can then be turned into terms that can then be conceptualized specifically into what conceptualized specifically into what we mean when we use particular we mean when we use particular terms.terms.


ConceptualizationConceptualization The process by which we specify The process by which we specify

precisely what we mean when we use precisely what we mean when we use particular terms.particular terms.

Indicators and dimensionsIndicators and dimensions These are the end product of the These are the end product of the

conceptualization process that provides conceptualization process that provides us with measures of our concept.us with measures of our concept.


Creating conceptual orderCreating conceptual order This is the process that will lead to This is the process that will lead to

measurable definitions for study. The measurable definitions for study. The order realizes that progression of order realizes that progression of measurement from a vague sense of a measurement from a vague sense of a term to a specific measurementterm to a specific measurement

Conceptual OrderConceptual Order

ConceptualizationConceptualization

Conceptual definitionConceptual definition

Operational definitionOperational definition

OperationalizationOperationalization

This brings us one step closer to This brings us one step closer to measurement by developing measurement by developing operational definitions, which operational definitions, which specify what operations should be specify what operations should be performed to measure a concept. performed to measure a concept. This includes:This includes: ScoringScoring Exhaustive & Exclusive measurementExhaustive & Exclusive measurement Levels of measurementLevels of measurement


ScoringScoring This represents another way of thinking This represents another way of thinking

about measurement in that it involves about measurement in that it involves actually making observations and actually making observations and assigning scores or values.assigning scores or values.

Measurement as ScoringMeasurement as ScoringGender Impulsivity Criminal

HistoryAge

1 7 1 26

0 1 1 28

1 8 0 34

0 5 0 21

0 4 1 18

1 9 1 33

1 10 1 27

0 3 0 22

0 6 1 20

1 10 0 30


Exhaustive MeasurementExhaustive Measurement Exhaustive qualities of the attributes of Exhaustive qualities of the attributes of

a variable allow us to classify every a variable allow us to classify every observation.observation.

Mutually Exclusive MeasurementMutually Exclusive Measurement Mutually exclusive attributes help Mutually exclusive attributes help

researchers classify every observation researchers classify every observation in terms of only one attribute. in terms of only one attribute.

Levels of MeasurementLevels of Measurement Nominal measuresNominal measures - Are variables whose - Are variables whose

attributes are exhaustive and mutually exclusive and attributes are exhaustive and mutually exclusive and offer names or labels for characteristics.offer names or labels for characteristics.

Ordinal measuresOrdinal measures - Are variables whose attributes - Are variables whose attributes are exhaustive and mutually exclusive and can be are exhaustive and mutually exclusive and can be logically rank ordered from greater than to less logically rank ordered from greater than to less than.than.

Interval measuresInterval measures - Are those that have the same - Are those that have the same characteristic as nominal and ordinal but the logical characteristic as nominal and ordinal but the logical distance between attributes can be expressed in distance between attributes can be expressed in meaningful standard intervals with zero having no meaningful standard intervals with zero having no meaning.meaning.

Ratio measuresRatio measures – Have the same characteristics as – Have the same characteristics as those above except that zero has meaning.those above except that zero has meaning.

In Class Exercise In Class Exercise Levels of MeasurementLevels of Measurement

Indicate the level of measurement – nominal, ordinal, Indicate the level of measurement – nominal, ordinal, interval, or ratio – that describes each of the interval, or ratio – that describes each of the following variables:following variables: Length of prison sentence (in months)Length of prison sentence (in months) Attitudes toward the war in Iraq (strongly approve, approve, Attitudes toward the war in Iraq (strongly approve, approve,

disapprove, strongly disapprove)disapprove, strongly disapprove) Sex of marine life handlers at Sea WorldSex of marine life handlers at Sea World Type of childhood victimization (physical abuse, sexual Type of childhood victimization (physical abuse, sexual

abuse, neglect)abuse, neglect) Height (in centimeters)Height (in centimeters) Score on a scholastic aptitude testScore on a scholastic aptitude test Place of birthPlace of birth Number of years on a job (0-2 years, 3-9 years, 10 or more Number of years on a job (0-2 years, 3-9 years, 10 or more

years)years) Method of drug administration (snort, smoke, freebase, Method of drug administration (snort, smoke, freebase,

ingest, intravenous, inhalation, ingest)ingest, intravenous, inhalation, ingest) Age at time of entering military service (under 18, over 18)Age at time of entering military service (under 18, over 18)

Criteria for Measurement Criteria for Measurement QualityQuality

Two key standards for measurement Two key standards for measurement qualityquality

Reliability - Refers to consistency. We Reliability - Refers to consistency. We look to be sure the measurement used look to be sure the measurement used will produce similar results over time. will produce similar results over time. This can be achieved through the use of This can be achieved through the use of the the Test-retest method, Test-retest method, Inter-rater reliability, and Inter-rater reliability, and The split-half method.The split-half method.

Criteria for Measurement Criteria for Measurement QualityQuality

Validity - Simply put, means are you testing Validity - Simply put, means are you testing what you say you are testing? While more what you say you are testing? While more difficult to test for than reliability, ways of difficult to test for than reliability, ways of dealing with validity consist of dealing with validity consist of Face validity – common agreementFace validity – common agreement Content validity – adequate coverage of range of Content validity – adequate coverage of range of

meaningsmeanings Criterion-related validity – a comparison w/ an Criterion-related validity – a comparison w/ an

external measureexternal measure Construct validity – based on logical relationshipsConstruct validity – based on logical relationships Multiple measures – comparison to alternative Multiple measures – comparison to alternative

measuresmeasures

Reliable but Not ValidReliable but Not Valid

Valid but Not ReliableValid but Not Reliable

Valid and ReliableValid and Reliable

Composite MeasuresComposite Measures

Combine individual measures to Combine individual measures to produce more valid and reliable produce more valid and reliable indicators.indicators. Typologies – These are produced by the Typologies – These are produced by the

intersection of two or more variables to intersection of two or more variables to create a set of categories or types.create a set of categories or types.

An index – Where there are two distinct An index – Where there are two distinct conceptions that are combined in such a conceptions that are combined in such a way to produce a measure that is more way to produce a measure that is more parsimonious than individual variables.parsimonious than individual variables.

Documents

Concepts, Operationalization, & Measurement Dr. Guerette