18
STAT10010 Introductory Statistics Dr. Patrick Murphy School of Mathematical Sciences Textbook Seeing Through Statistics by Jessica Utts OR STATISTICS by UTTS AND HECKARD DISCOUNT PRICE IN CAMPUS BOOKSHOP Course Website available on Monday WWW.UCD.IE/mathsci Click on “classpages” Then Click on STAT10010 Other Requirements New Cambridge Statistical Tables Calculator with Statistics Mode IMPORTANT MY PART OF THIS COURSE DOES NOT USE BLACKBOARD for NOTES “I couldn’t find the notes on Blackboard” Assessment 60% Final Exam 10% Laboratory 20% In Class Tests 10% Participation in Lectures/Labs/Tutorials

stat10010_1

Embed Size (px)

Citation preview

Page 1: stat10010_1

STAT10010

Introductory Statistics

Dr. Patrick Murphy

School of Mathematical Sciences

TextbookSeeing Through Statistics

by

Jessica Utts

OR

STATISTICS

by

UTTS AND HECKARD

DISCOUNT PRICE IN CAMPUS BOOKSHOP

Course Website available on Monday

WWW.UCD.IE/mathsci

Click on “classpages”

Then Click on STAT10010

Other Requirements

New Cambridge Statistical Tables

Calculator with Statistics Mode

IMPORTANT

MY PART OF THIS COURSE

DOES NOT USE

BLACKBOARD for NOTES

“I couldn’t find the notes on Blackboard”

Assessment

60% Final Exam

10% Laboratory

20% In Class Tests

10% Participation in Lectures/Labs/Tutorials

Page 2: stat10010_1

Participation

Arriving Late

Leaving Early

Talking

Eating

Texting

Not Paying Attention

Sleeping

Whole Class Loses Marks

Individuals May Gain Marks

LECTURES 2 per week

Tutorials 1 per week

Tutorials Start in Week 4

Computer Labs Start in Week 4

What do you know about statistics?

It’s boring…

There are three kinds of lies:

• Lies

• Damned Lies

• and

• Statistics

• - Benjamin Disraeli

Page 3: stat10010_1

Simpsons’ episode:• Homer is questioned about his newly formed

vigilante group

Newscaster: Since your group started up, petty crime is down 20%, but other crimes are up.

Such as heavy sack beating which is up 800%. So you’re actually increasing crime.

Homer: You can make up statistics to prove anything.

43% of people know that.

Misuse of Statistics

INTRO STATS

PART 1

Section A : DATA COLLECTION

1. Introduction and Terminology

2. Seven Critical Components of a Study

3. Questionnaire Design

4. Survey Design

5. Design of Experiments and Observational Studies.

Chapter 1:Terminology

Statistics is the science of data. This involves collecting, analysing and interpreting information.

STATISTICS is the Science of Variability.

Descriptive Statistics uses graphical and numerical techniques to summarise and display the information contained in a dataset.

Inferential Statistics uses sample data to make decisions or predictions about a larger population of data

Chapter 1The Beginning

Sample Survey

Observational Study

Designed Experiment

DATA

Page 4: stat10010_1

More Definitions

Population: The entire collection of individuals or objects about which information is desired.

Sample: A part (subset) of the population selected in some prescribed manner.

Variable: A characteristic or property of an individual unit in the population.

Representative Sample: A selection of data chosen from the target population which exhibits characteristics typical of the population.

Representative samples should give unbiased estimates Chapter 2

CHAPTER 2:7 Critical Components: To believe or not to believe the results of a study.

• The importance of “not always believing what we read in the papers” cannot be overstated.

• This lesson applies not just to newspapers but to academic research papers in journals also.

• In fact it applies everywhere someone presents us with a conclusion based on a study.

• When we are presented with a study we should examine 7 components of the study:

1. The source of the research and of the funding.

2. The researchers who had contact with the participants.

3. The individuals or objects studied and how they were selected.

4. The exact nature of the measurements made or the questions asked.

5. The setting in which the measurements were asked.

6. The extraneous differences in groups being compared.

7. The magnitude of any claimed effects or differences.

1. The source of the research and of the funding.Research costs money, researchers need to be paid, equipment has to be bought, subjects need to be found.

We should always be aware of this fact when we examine the claims made by researchers.

We should look differently on research conducted by• Independent agencies e.g. CSO, Eurostat, ESRI?• Academics (who funds them?)• Companies trying to convince consumers to buy their

product instead of a competitors. • Journalists

2. The researchers who had contact with the participants.When a study is conducted, the responses of an individual

may depend on who asks the questions.

Question: How much money do you earn?

Response to a Revenue Commissioner will probably be different than to a friend or date whom you are trying to impress.

Would you trust a study on the use of illegal drugs which was carried out by Gardai knocking on peoples’ doors.

Page 5: stat10010_1

3. The individuals or objects studied and how they were selected.

• THE INDIVIDUALS STUDIEDCan we apply the results of a study conducted on men to women?Does a study conducted on Americans apply to Irish people?

• HOW THEY WERE SELECTEDMany studies rely on volunteers, is this wise?Is there not a difference between the kind of people who volunteer for a study and those who don’t.Consider what would happen if someone came up to you in the street with a questionnaire.

4. The exact nature of the measurements made or the questions asked.

You should be aware that the wording and the ordering of questions can influence responses.

What is your opinion on the plight of refugees forced by war in Syria to flee their homes and come to Ireland?

How do you feel about all those foreigners coming over here taking our jobs?

5. The setting in which measurements were taken.

When and where was the study conducted.

Studies conducted at certain times of the day may exclude certain elements of the target population. @3.00pm many employed people are at work, so a study conducted on Grafton St. at that time will probably not be representative.

Phone surveys conducted during the day will also probably under-represent the views of workers.

How you would reply to certain questions posed in a police interrogation room would probably differ to how you would answer those same questions in a pub. Capilano Suspension Bridge

Page 6: stat10010_1

6. The extraneous differences in groups being compared-Confounding.

CONFOUNDING FACTORSA study shows that exam scores among marijuana smokers are lower than among non-smokers.A conclusion is drawn that marijuana, impairs exam performance.

We should however consider that the type of person who smokes dope may be the kind of unmotivated slacker who doesn’t do enough study for their exams irrespective of whether they smoked or not.

7. The magnitude of any claimed effects or differences.

Newspapers seldom say how large the effects of a statistical study are. Are the results STATISTICALLY SIGNIFICANT?Is Statistically Significant the same as Meaningfully Significant?UK & IRISH General Elections.

Taking aspirin reduces heart attacks.

We really should be told that the reduction is from 17 per 1000 to 9.4 per 1000.

But we should also be told that this increases strokes and stomach ulcers.

Review: Seven Critical Components of a Study

1. The source of the research and of the funding.

2. The researchers who had contact with the participants.

3. The individuals or objects studied and how they were selected.

4. The exact nature of the measurements made or the questions asked.

5. The setting in which the measurements were asked.

6. The extraneous differences in groups being compared.

7. The magnitude of any claimed effects or differences.

Chapter 3

Chapter 3Questionnaire Design: How to ask a question (plus some statistical terms).

• We saw in the previous chapter that deciding exactly what to measure and what questions to ask is extremely important.

Remember the 4th component

• 4. The exact nature of the measurements made or the questions asked.

• In this chapter we will examine this component in detail.

Page 7: stat10010_1

Section 3.1 Questions

• A study was conducted in the US in 1974 where two researchers showed college students a film of a car accident.

• After viewing the film the students were asked one of two questions.

• Group 1 was asked the question:

“About how fast were the cars going when they contacted each other”– The average of the responses for Group 1 was 31.8

Miles per Hour

• Group 2 was asked the question:

“About how fast were the cars going when they collided with each other”

– The average of the responses for Group 2 was 40.8 Miles per Hour

Both groups had seen exactly the same film. The only difference was the use of the word collided instead of contacted.

• Simply using the word collided increased peoples estimates of the speed of the accident by 9 mph or 28%.

There are many problems associated with asking questions we will examine seven of them

• Deliberate Bias

• Unintentional Bias

• Desire to please

• Asking the uninformed

• Unnecessary complexity

• Ordering of questions

• Confidentiality and anonymity

• Deliberate Bias

Sometimes when a survey is conducted, the questions are worded in a leading manner to illicit a favourable response.

Recall the questions on refugees in Ireland.

• The responses to questions that begin “Do you agree that…..” should be treated with caution. This does not invalidate such questions just be careful to see if there is deliberate bias.

• “Asked whether they felt New Improved Persil was better at cleaning clothes than ordinary Persil, 90% of people said yes.”– Who wouldn’t say yes to such a leading question.

• Deliberate Bias

• “Do you agree with the continued destruction of trees on this campus for the construction of new buildings?”

• “Do you agree that during the construction of new buildings to alleviate the overcrowding on Belfield campus that it is okay to knock down a few trees?”

Page 8: stat10010_1

• Unintentional Bias

Besides the deliberate bias caused by leading questions, sometimes the questions are worded badly unintentionally and are misinterpreted by many respondents.

• “What was the most important date in your life?”

People may respond differently to this question.

• Some may interpret the word date as calendar date and may reply for instance

- “The day I was born”

- “The day I passed my final exams”

• Some may interpret the word date as “dinner and a movie”.

• And some may think …

• that a shrivelled fruit is being referred to.

• Desire to please

Many respondents like to please the questioner.

Recall the sketch from “The Fast Show”

Respondents do not like to admit to certain socially undesirable habits

• Surveys on the prevalence of cigarette smoking based on surveys of individuals disagree with data from cigarette sales.

In Dublin’s fair city…

• Asking the uninformed– Nobody likes appearing ignorant when asked a

question.

• The day that Articles 2 & 3 of our constitution were changed TV3 sent a reporter out to Grafton Street to ask Dubliners: – Do you know what important thing happened today in the

North?”– Most people replied yes.

• But the reporter then asked the people:– “OK, so what happened?”

– Many people got embarrassed and said that they didn’t know after all.

• Unnecessary Complexity

Questions should be kept simple, otherwise people may get confused.

• “Shouldn’t students not be allowed to repeat their exams if they fail at the first attempt.”

• This sentence actually contains a double negative .Is it therefore equivalent to the question:– “Should students be allowed to repeat their exams if

they fail at the first attempt.”

• Ordering of Questions.

If two questions are asked of a respondent but one question causes the respondent to think about something they may not have thought of otherwise then the order of the questions will be important.

• Example– Name the five most popular types of television

programme.– Do you watch hospital dramas on TV such as Grey’s

Anatomy?

Page 9: stat10010_1

• Confidentiality and Anonymity

• Anonymity

Some questions may only be answered if the respondent feels that they are anonymous.

• Confidentiality

If a follow up study is necessary then respondents cannot remain anonymous and so confidentiality of responses must be ensured.

• Questions on sexual behaviour and financial dealings are usually only responded to if either Anonymity or Confidentiality can be ensured.

Section 3.2 Choices

• When asking a question should we present the respondent with a choice of possible answers.

• Should we ask open questions or closed questions?

• Most opinion polls are conducted using closed questions i.e. the respondent is asked to chose between a group of answers. This allows easy compilation of the results of the survey compared to an open question format.

• Closed Questions.

We’ve already mentioned that opinion polls often use the closed question format, in which the respondent is presented with a choice of answers. This form of question can often lead to some very strange results.

• The textbook refers to a study conducted in 1987 in the US to examine the difference between Open Questions and Closed Questions. The study asked the following Question:

• “What do you think is the most important problem facing this country today?”

• Half of the sample were given this as an open question, the top four responses were:– 17% Unemployment– 17% General Economic Problems– 12% Threat of Nuclear War– 10% Foreign Affairs

• The other half of the sample were given this as a closed Question to pick between the following choices:– The Energy Shortage– The Quality of Public Schools– Legalised Abortion– Pollution– If you prefer you may name a different problem as

most important.

• The responses to this closed question were:– 5.6% The Energy Shortage– 32% The Quality of Public Schools– 8.4% Legalised Abortion– 14% Pollution

• So even though the respondents were allowed to choose an alternative to these 4 choices, 60% saw these four as being the most important problems.

• But in the open question format these problems were only listed by 2.4% of respondents.

• Something is wrong here!

• WHAT IS HAPPENING?

• Open Questions.

• We mentioned one problem with the open question format, that it is hard to compile results from possibly thousands of different responses.

• There is another major problem with the open question format, this was highlighted in the same 1987 study referred to earlier.

• A group of respondents were asked to “name one or two of the most important national or world events or changes during the past 50 years”

Page 10: stat10010_1

• Half of this sample were given this as an open question, the top responses were:– 14.1% World War II– 6.9% Space Exploration– 4.6% JFK Assassination– 10.1% Vietnam War– 10.6% Don’t know– 53.7% All Other Responses

• These responses were then given as a closed Question together with another choice “The invention of the computer” - this had been mentioned by only 1.4% of respondents in the Open Question format.

• The responses to this closed question were:– 22.9% World War II– 15.8% Space Exploration– 11.6% JFK Assassination– 14.1% Vietnam War– 29.9% The Invention of the Computer– 0.3% Don’t know– 5.4% All Other Responses

• The problem here was the wording of the question, people concentrated on the word events rather than changes. When it was shown to them they realised that the invention of the computer was indeed one of the most important changes during the past 50 years.

• To summarise:

Perhaps the best way to ask a question is to conduct a small trial Open Question format survey. Then use the responses from this trial survey as the choices in a Closed Question survey together with any other answers that may not immediately spring to mind.

Section 3.3 Defining what’s being measured

• Before we use the results of a survey we should be fully aware of what was actually measured by the survey.

• Unemployment in Ireland.

• Live Register 166,142

• QNHS 86,700

• GROWTH RATES

• Q3 2002

• GDP 6.9%

• GNP -0.3%

Section 3.4 Some Statistical Terms• Measurement/Numerical Data: Data we measure in the

form of numbers.

• Examples:– Percentage you will get on the summer exam for this

course.– Number of lectures that you will skip. – Frequency of radio station you listen to when studying.

• Categorical Data: Data which can be placed in a category, cannot add/subtract this kind of data.

• Examples:– Grade you will receive on the summer exam for this

course.– Name of radio station you listen to.– Brand of shoes you are wearing.

Numerical/Measurement data is further distinguished as to whether it is Discrete or Continuous.

• Discrete variables take only isolated whole number values (integers) on the number line. – Example: Number of Nike runners in this class.

• Continuous variables have values comprising entire intervals of the number line. Decimals and Fractions are allowed.– Example: The duration of this class . remember seconds

are not the smallest unit of time measurement. This class could possibly last 50.123456789 Minutes.

Page 11: stat10010_1

• Validity

A valid measurement is one which actually measures what it claims to measure.– Example: Unemployment figures are validly

measured using the Labour Force Survey not the Live Register

• Reliability

A reliable measurement is one which will give approximately the same result time after time, when taken on the same individual or object.– Example: Most physical measurements are reliable,

for example measuring your weight using a bathroom scales.

– Some measurements may be reliable but not necessarily valid.

• Are exams reliable measuring devices?

• Are exams results valid measurements of intelligence?

• Bias

Sometimes when measurements are made a systematic error is made which underestimates or overestimates the true value. Such a measurement is called a biased measurement.

• Example: Suppose your bathroom scales always overestimated your weight.

• Example: Car Speedometers are deliberately biased to overestimate a car’s real speed.

• Variability– If we try to measure a certain characteristic for

many different objects or people we will most likely not get the same answer each time. The fact that the observations vary is referred to as the variability in the dataset.

– Some datasets are more variable than others:– Example: A dataset consisting of the ages of 100

students in UCD will be less variable than a dataset consisting of the ages 100 randomly chosen Irish people.

Homework

• Design two surveys to look at some of the concepts in this chapter.

• Chose a random sample of 20 people and divide the sample in to two groups of 10.

• 1. Examine bias caused by changing words in one question.

• 2. Examine the effects of using Open Questions vs Closed Questions

• The Topics of the questions are up to you!

Chapter 4

Page 12: stat10010_1

Chapter 4How to get the Data Part 1:Survey Design

• In the first 3 Chapters of this course we spoke at length about what care we should take in conducting a study ourselves or in interpreting the results of someone else’s study.

• What we didn’t mention was how to actually conduct the study, that will be the topic of today’s lecture.

• We saw that studies can take three forms:

• Experiments

• Observational Studies

• Sample Surveys

• We saw earlier that experiments are possibly the best way to conduct studies as the researcher usually has complete control over the elements of the study. And experiments allow a determination of cause and effect.

• Since this is a human sciences/business course and not a Biology or Chemistry course we will restrict ourselves to experiments involving humans.

• No not what you may think, experiments these days rely on volunteer subjects.

Experiments

• The Experimental procedure involves manipulating something called the Explanatory Variable and seeing the effect on something called the Outcome Variable

• Example: In an experiment to test the effect of a new diet.

• The Explanatory Variable would be?

• The Outcome Variable would be?

• The experiment has to be designed to eliminate to any extraneous effects and to determine only the results of the explanatory variable on the outcome variable.

• The way that this is accomplished is that participants are randomly assigned to one of two groups:

• One group receives the treatment the other receives a placebo - ie no treatment at all.

• This random assignment to a treatment group or control group is the way most clinical trials are conducted today.

• This form of study is similar to an experiment except that the treatment occurs naturally and is not imposed on the subjects.

• It is much harder to establish a cause and effect relationship using an observational study than using an experiment because we cannot create control and treatment groups to eliminate confounding effects.

• One attempt to isolate the explanatory variable is to conduct what is called a case control study.

• We will examine this type of study in detail later.

Observational Studies

• We will concentrate for the rest of this chapter on sample surveys.

• First some definitions:– A Unit is a single individual or object to be measured.– A Population is the entire collection of Units about

which we would like information.– A Sample is the collection of Units we actually

measure.– A Sampling Frame is a list of Units from which the

sample is chosen. Ideally the sampling frame includes the whole Population.

Sample Surveys

Page 13: stat10010_1

• In a Sample Survey measurements are taken on a sample chosen from the Population

• In a Census the entire Population is surveyed.• Resources are needed to conduct a Census

• CSO Spends about €80 million to conduct the 5 year Census of Population

• Sometimes the measuring process destroys the thing being measured, e.g. if we were to test the

strength of a weld or in testing an individuals blood - who among us would be willing to donate all of our blood in a test?

• Because of the work involved in a Census it is much faster to conduct a survey, sometimes it is important to have results fast.

Why is Sampling used?

• There are accuracy advantages to be had in conducting a sample survey:– It is easier to get complete coverage of a sample

than of a population. – Easier to train a small number of interviewers for a

sample survey than to train a large number for a census.

• OK but a sample is still a sample and is bound to be inaccurate by its very nature, isn’t it???

• British General Election

Accuracy in Surveys

• We mentioned before that if a sample was chosen to be representative of the target population then it could be very accurate.How accurate?

• For surveys conducted to measure a sample proportion as an estimate for a population proportion we can define a Margin of Error.

• The sample proportion will differ from the population proportion by more than the margin of error less than 5% of the time.

• The Margin of Error for a sample of size n is 1/√n

Accuracy in Sampling

• For Example with a sample of 1600 the margin of error is 1/40 or 2.5%

• So a survey conducted using a sample of size 1600 will be accurate to within 2.5% more than 95% of the time.

Accuracy in Sampling

• We saw already that in order for the sampling procedure to work properly the sample must be representative of the target population

• There are several ways to get a representative sample:

• Simple Random Sampling

• Stratified Random Sampling

• Cluster Sampling

• Quota Sampling

• Systematic Sampling

• Random Digit Dialing

• Multi Stage Sampling

How to choose a Sample

Page 14: stat10010_1

• The simplest form of sampling procedure.

• Each group of individuals has the same chance of getting chosen.

• Therefore each individual has the same chance of being chosen.

• Use Random Number Tables or a random number generator.

• Or put names in a hat or roll a die.

Simple Random Sampling

• Polling companies don’t have a list of all adults and select from that list randomly.

• Instead they use other methods like Stratified Random Sampling

• We first divide the population into different strata, then sample randomly within those strata.

• Example: To conduct an opinion poll we might divide the population into different age groups or sexes or by County of residence.

Stratified Random Sampling

• Advantages of this method are:

• We can get individual estimates for each strata

• We can use different interviewers for each strata and train them appropriately

• If strata are different geographic regions it may be cheaper to sample them separately.

Stratified Random Sampling

• Divide the Population into similar groups or clusters. Then choose a random sample of clusters.

• The analysis of this type of survey is more complicated than for simple random sampling.

• NOTE: This is not the same as Stratified Sampling, in Cluster Sampling the Clusters are chosen so that the resemble each other as much as possible.

Cluster Sampling

• This is where a plan is used to chose the participants in the study.

• For Example: We might decide to survey every 3rd person we meet. Or to choose every 5th House to be surveyed.

• Sometimes this procedure can be very biased.

• What happens if every 5th house is an end house?

Systematic Sampling

Quota Sampling

• We know the demographic characteristics of the population of interest and we ensure that our sample contains the same distribution of demographic traits as the population.

• Over-sampling will be required as we will be forced to exclude respondents once each quota has been achieved.

• Used very much in the US

• Phone numbers in certain area codes are dialled randomly by computer, then when someone answers an interviewer asks questions

Random Digit Dialling

Multi- Stage Sampling

Used for large surveys

Involves using a combination of the methods described above.

Page 15: stat10010_1

• Here are 5 ways to make a mess of the sampling procedure:

• Use the wrong sampling frame

• Fail to reach the individuals selected

• Get no response

• Get a sample of volunteers

• Use a convenient or haphazard sample

• The last 2 of these are disastrous

What can go wrong in Sampling• 1936 US election

• Literary Digest had been extremely successful in predictions

• 1936 predicted 3-2 victory for Rep Landon over Dem. FDR

• George Gallup American Institute of Public Opinion predicted FDR correctly and also predicted what Literary Digest would predict.

• Literary Digest 10 million

• Gallup 50,000

• LD- Magazine Subscribers, Phone Directories, Car Owners - Wealthy

• Most serious though: 23% Volunteer response.

What went wrong in Sampling

Chapter 5

• The Experimental procedure involves manipulating something called the Explanatory Variable and seeing the effect on something called the Outcome Variable or the Response Variable.

• Many times it is hard to establish a clear causal connection between one variable and another, it may be that a third variable is causing both.

• There is an established correlation between the number of fillings in children’s teeth and their vocabulary.

Chapter 5Design of Experiments and Observational Studies

• Does this mean that eating Mars bars increases your vocabulary??

• There may be a third variable causing both of the variables we are studying.

• Ideally we want to create changes in the explanatory variable and then examine the effects on the response variable. This we can only really do in an Experiment.

• In an Observational Study we cannot create changes in the explanatory variable. Instead we observe differences in the explanatory variable and try to see if these are related to changes in the response variable.

• So in an Experiment we have an element of control that we do not have in an Observational Study.

• Why don’t we just do Experiments then?

• Well it may be unethical to perform certain experiments. – Eg To measure the effect of smoking during pregnancy on a

child, it would be unethical to make a random selection of mothers smoke. We could however observe the effects on the children of mothers who already are smoking during pregnancy.

• It may be that we cannot randomly assign some explanatory variables-like baldness, or handedness.

Page 16: stat10010_1

Some Definitions

• A Treatment is one or more explanatory variables assigned by the experimenter.

• A Confounding Variable is one whose effect on the response variable cannot be separated from the effect of the explanatory variable.

• An Interaction occurs when the effect of one explanatory variable depends on what’s happening with another explanatory variable.

• An Experimental Unit is the smallest object to which we can assign different treatments in an experiment.

Some More Definitions

• An Observational Unit is the smallest object which we can observe in an observational study.

• When the Units are people they are called Participants or Subjects.

• Usually these participants are Volunteers.

How to design an Experiment

• Randomisation is the most important element of any experiment. We will discuss different types of randomisation in a little while.

• A Control Group which is treated identically in all respects to the group receiving the treatment except that the members of the control group do not receive the treatment.

• Placebos: There is a proven phenomenon called the placebo effect. Patients receiving Placebo tablets which have no active drug ingredient (eg a sugar tablet) may experience a certain beneficial effect.

• The way to eliminate this Placebo Effect from the experiment is to give Placebo tablets to the control group when administering a tablet to the treatment group.

• Blinding: It is not just in receiving tablets that the “power of suggestion” plays an important role. It is usually best therefore if the subject does not know whether they are receiving the treatment or not. This practice is called Blinding.

• Sometimes it is also best if the experimenter does not know which subject is receiving the treatment and which is not. This will remove any potential bias in the way the experimenter reports his findings.

• Experiments in which both the subject and the experimenter do not know who receives the treatment are called Double Blind.

• Experiments in which either the subject or the experimenter (but not both) do not know who receives the treatment are called Single Blind.

Experimental design

• The design of an experiment is very important. Experiments are designed with the purpose of isolating the effect of the treatment on the response variable and removing any confounding effects.

• One way that we have seen already of removing the effect of any confounding variables is to randomly assign subjects to the treatment or control group. This way any possible bias in the population should be evenly spread among the treatment and control groups.

Page 17: stat10010_1

• Sometimes instead of relying on randomisation to make the groups as even as possible we actually force the groups to be similar.

• Matched Pair designs: These are experimental designs in which either the same individual or two matched individuals are assigned to receive the treatment and the control. In the case where an individual receives both the treatment and the control, the order in which this happens should be random. And the experiment should be conducted as a Double Blind experiment.

• Block Designs: This is an extension of the Matched Pair design to the case of three or more treatments (one may be the control).

• If there are 4 treatments and a control then there will be 5 blocks each one designed to be as similar as possible. 4 of the blocks will each receive one of the treatments and one block will be a control.

Problems with Experiments

• Confounding variables -– These are variables connected to the explanatory variable

which may be the actual cause of the effect on the response variable.

– Cured by Randomisation– Storks

• Interacting variables– A second variable which interacts with the explanatory

variable.– Smoking/Alcohol/Exercise

• Placebo effect

• Hawthorne effect– Participants in an experiment respond differently just

because they are in an experiment.

Problems with Experiments

• Experimenter effect– The experimenter can influence the results of the

experiment. – They may record data incorrectly.– Or inadvertently let the subjects know the desired outcome.– RATS

• Ecological validity and generalisability– Results obtained in a closed experimental setting may not

be applicable in the real world

Observational Studies

• Observational studies are not as good as Experiments at establishing causal connections.

• However since no special setting is required they usually do not suffer from the problem of Ecological Validity.

• In addition the Hawthorne and Experimenter effects are not a problem.

Observational Studies

• Observational studies are classified as either Retrospective or Prospective Studies

• In Retrospective studies the participants are asked to recall certain past events.

• In Prospective studies the participants are followed by the researcher into the future and events are recorded.

• One particular type of observational study has become very popular

• - The Case Control Study

Page 18: stat10010_1

Case Control Studies

• To try and examine the possibility of a relationship between an explanatory variable and a response variable the researcher selects a group of participants called CASES in which the response variable is already present.

• For example in a study to determine if there is a relationship between baldness and heart attacks, a group of patients in hospital for heart attacks are chosen as the Cases.

• A group who have not had heart attacks are chosen as the Controls.

Case Control Studies

• The Control Group should be chosen to be as similar in all respects as the case group except for the response variable. Why?

• A Case Control study is much more efficient than some other forms of study. Consider first choosing two groups according to whether the explanatory variable was present or not then waiting until the response variable revealed itself. This may take a long time.

• Good at removing confounding variables if controls are chosen appropriately.

Problems with Observational Studies

• Confounding Variables

• Cases and Controls not representative of the population

• Recollections of the Past may not be accurate.