McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved.

Educational Research: Fundamentals for the Consumer

Woolfolk / PerryChild and Adolescent Development © 2012 Pearson Education, Inc. All rights reserved.

Sixth Edition

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved.

Discussions and Conclusions

Chapter 13

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 3

Discussion Topics

Purpose and nature of the discussion Interpretation of the Results Conclusions

• Limitations• Recommendations and Implications

Criteria for evaluating discussion and conclusions sections of a report

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 4

Purpose and Nature

The purpose of the discussion section is to present an interpretation of the results, the conclusions, and recommendations for further study• An evaluation of the methodology and results to

help readers understand what the results mean and how they can be used

• Integrates the research problem, review of the literature, and results

• Speculates about the implications of the results through a synthesis of the study reflecting the professional judgment of the researcher

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 5

Interpretation of the Results

An analysis of the results focusing on factors that might help explain them

Interpretations related to the problem and/or hypothesis• Restatement of the research question• Interpretation of how well the data answers the

question• Importance of the reader’s critical analysis of these

interpretations Interpretations based on theory

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 6

Interpretation of the Results

Interpretations related to methodology• Selection of participants• Measurement of variables for quantitative

and mixed-method studies• Experimental interventions for quantitative

and mixed-method studies

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 7

Interpretation of the Results

Interpretations based on analyzing data• Quantitative

Errors in reporting statistical results Violation of assumptions of the statistical procedures Use of appropriate statistical procedures, particularly

in multivariate studies Statistical and practical significance

• Qualitative Development of data coding scheme Use of constant comparison Approach to document review

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 8

Interpretation of the Results

Interpretations related to previous research• Most common feature of discussion sections• Places results explicitly in the context of other

research and whether or not it’s consistent• Enhances the contribution of the new

research to a recognized body of literature

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 9

Conclusions

Summary statements of the results as they pertain to the research problem• Can be found in various locations in the

discussion section• Should include indications of why the

conclusions are supported

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 10

Conclusions

Limitations• Seven factors or variables that need to be

considered in using the conclusions• Participant characteristics

Population validity - generalizability to other individuals

– Comparison of the sample, sampling frame, and target population

– Comparisons across subjects within the sample• Contextual characteristics

Ecological validity - generalization to other settings, times, treatments, or measures

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 11

Conclusions

• Seven factors (continued) Methodology

– Non-experimental designs drawing causal conclusions

– Experimental studies drawing causal conclusions when internal validity is weak

When the research is conducted Interventions

– Explication of the intervention– Hawthorne Effect - the effects of individual’s

realizing they are participating in a study

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 12

Conclusions

• Seven factors (continued) Measures

– Validity– Reliability

Concerns related to overly strict analysis of limitations

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 13

Conclusions

Recommendations and implications• Statements suggesting future action as a

result of the study Focus on methodological issues Focus on practice

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 14

Evaluation Criteria The results should be adequately

interpreted The conclusions should answer the

research questions The conclusions should be limited by

participant characteristics and selection The conclusions should be limited by the

nature of the interventions, and measures

McMillanEducational Research: Fundamentals for the Consumer, 6e© 2012 Pearson Education, Inc. All rights reserved. 15

Evaluation Criteria

Statistical and practical significance are discussed separately

Failure to show statistical significance does not mean there is not relationship or difference

Limitations should be reasonable Recommendations and implications

should be specific